WO2024001560A1 - 增强现实绘画教学方法、系统、显示终端及存储介质 - Google Patents

增强现实绘画教学方法、系统、显示终端及存储介质 Download PDF

Info

Publication number
WO2024001560A1
WO2024001560A1 PCT/CN2023/093896 CN2023093896W WO2024001560A1 WO 2024001560 A1 WO2024001560 A1 WO 2024001560A1 CN 2023093896 W CN2023093896 W CN 2023093896W WO 2024001560 A1 WO2024001560 A1 WO 2024001560A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
painting
teaching
image
course
Prior art date
Application number
PCT/CN2023/093896
Other languages
English (en)
French (fr)
Inventor
季娟
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2024001560A1 publication Critical patent/WO2024001560A1/zh

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B11/00—Teaching hand-writing, shorthand, drawing, or painting
    • G09B11/10—Teaching painting

Definitions

  • Embodiments of the present application relate to the field of augmented reality technology, and in particular to an augmented reality AR painting teaching method, system, display terminal and computer-readable storage medium.
  • Augmented reality is a technology that cleverly integrates virtual information with the real world. After simulating computer-generated text, images, three-dimensional models, music, videos and other virtual information, it is applied to the real world. All kinds of information complement each other to achieve "enhancement" of the real world.
  • Embodiments of the present application provide an augmented reality AR painting teaching method, system, display terminal and computer-readable storage medium.
  • embodiments of the present application provide an augmented reality AR painting teaching method, which includes: obtaining entity information of a target object; stereoscopically restoring the entity information to obtain stereoscopic image information corresponding to the target object; and according to the stereoscopic image information to obtain the painting course information corresponding to the target object; wherein the painting course information is used for painting teaching; and the painting course information is displayed.
  • embodiments of the present application provide an augmented reality AR painting teaching system, including: an entity information acquisition module configured to acquire entity information of a target object; a stereoscopic image information generation module configured to generate the entity information Stereoscopic restoration is used to obtain the stereoscopic image information corresponding to the target object; the painting course information generation module is configured to obtain the painting course information corresponding to the target object according to the three-dimensional image information; wherein the painting course information is used for painting teaching ; A display module configured to display the painting course information.
  • embodiments of the present application provide an augmented reality AR painting teaching device, including: at least one processor; at least one memory configured to store at least one program; when at least one of the programs is processed by at least one of the processors When executed, the augmented reality AR painting teaching method described in the first aspect is implemented.
  • embodiments of the present application provide a display terminal, including: a memory, a processor, and a display terminal stored in the memory. and a computer program that can be run on a processor; when the processor executes the computer program, the augmented reality AR painting teaching method described in the first aspect is implemented.
  • embodiments of the present application provide a computer-readable storage medium, including: the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to execute the augmented reality described in the first aspect. AR painting teaching method.
  • Figure 1 is a schematic diagram of an application scenario of a painting teaching method provided by an embodiment of the present application
  • Figure 2 is a schematic diagram of the application scenario system architecture of the augmented reality AR painting teaching method provided by an embodiment of the present application;
  • Figure 3 is a flow chart of an augmented reality AR painting teaching method provided by an embodiment of the present application.
  • Figure 4 is a flow chart of identity verification provided by an embodiment of the present application.
  • Figure 5 is a flow chart of an augmented reality AR painting teaching method provided by an embodiment of the present application.
  • Figure 6 is a flow chart of the entity information acquisition process provided by an embodiment of the present application.
  • Figure 7 is a flow chart of the teaching mode selection process provided by an embodiment of the present application.
  • Figure 8 is a schematic diagram of the augmented reality AR painting teaching content provided by an embodiment of the present application.
  • Figure 9a is a flow chart of augmented reality AR painting teaching scoring provided by an embodiment of the present application.
  • Figure 9b is a flow chart of another augmented reality AR painting teaching scoring provided by an embodiment of the present application.
  • Figure 10 is a schematic diagram of augmented reality AR painting teaching scoring provided by an embodiment of the present application.
  • Figure 11a is a schematic diagram of the structure of an augmented reality AR painting teaching system provided by an embodiment of the present application.
  • Figure 11b is a schematic diagram of the structure of another augmented reality AR painting teaching system provided by an embodiment of the present application.
  • Figure 12 is a schematic structural diagram of an augmented reality AR painting teaching device provided by an embodiment of the present application.
  • Figure 13 is an overall schematic diagram of an augmented reality AR painting teaching method provided by an embodiment of the present application.
  • words such as setting, installation, and connection should be understood in a broad sense. Those skilled in the art can reasonably determine the meaning of the above words in the embodiments of this application based on the specific content of the technical solution. specific meaning.
  • words such as “further”, “exemplarily” or “optionally” are used as examples, illustrations or illustrations, and should not be interpreted as being more preferable or better than other embodiments or designs.
  • the use of the words “further,” “exemplarily,” or “optionally” is intended to present the relevant concepts in a concrete manner.
  • the embodiments of this application can be applied to various AR display-related devices, such as: mobile phones, tablets, computers, Laptops, wearable devices, vehicle-mounted devices, LCD displays, cathode ray tube displays, holographic imaging displays or projections and other terminal devices; it can also be applied to various devices configured to process AR images and AR video data, such as: Mobile phones, tablets, computers, laptops, wearable devices, vehicle-mounted devices and other server equipment.
  • AR display-related devices such as: mobile phones, tablets, computers, Laptops, wearable devices, vehicle-mounted devices, LCD displays, cathode ray tube displays, holographic imaging displays or projections and other terminal devices
  • LCD displays cathode ray tube displays
  • holographic imaging displays or projections and other terminal devices such as: Mobile phones, tablets, computers, laptops, wearable devices, vehicle-mounted devices and other server equipment.
  • the embodiments of this application are not limiting.
  • Augmented reality technology is a relatively new technical content that promotes the integration of real world information and virtual world information content. It integrates physical information that is originally difficult to experience in the spatial scope of the real world on the basis of computers and other science and technology. , implement simulation processing, and superimpose virtual information content to be effectively applied in the real world, and in the process can be perceived by human senses, thereby achieving a sensory experience that transcends reality. After the overlap between the real environment and virtual objects, they can coexist in the same picture and space.
  • FIG 1 is a schematic diagram of the application scenario of the painting teaching method provided by related technologies. As shown in Figure 1, painting teaching usually involves teachers showing and explaining teaching models to convey relevant teaching knowledge to students.
  • embodiments of the present application provide, for example, an augmented reality AR painting teaching method, system, display terminal and computer-readable storage medium, which obtains stereoscopic image information corresponding to the target object by stereoscopically restoring the acquired entity information of the target object. , to obtain the painting course information corresponding to the target object based on the three-dimensional image information and display it to realize the three-dimensional presentation of the teaching model and improve the painting teaching effect.
  • FIG 2 is a schematic diagram of the application scenario system architecture of the augmented reality AR painting teaching method provided by an embodiment of the present application.
  • the system architecture includes an image information scanning and collection device 110, a server 120 and a terminal 130.
  • the image information scanning and collecting device 110 (such as AR scanning equipment) performs image scanning and information collecting on the target object.
  • the target object is a model or mannequin required for teaching.
  • the image information scanning and collecting device 110 completes image scanning and information on the required target object.
  • the entity information corresponding to the target object collected by scanning is sent to the server 120.
  • the server 120 receives and processes the entity information, restores the entity information three-dimensionally, and generates painting course information corresponding to the target object based on the obtained three-dimensional image information. , used for painting teaching.
  • the terminal 130 (such as AR glasses, AR display tablet, etc.) displays the painting course information to complete the painting teaching.
  • Figure 3 is a flow chart of an augmented reality AR painting teaching method provided by an embodiment of the present application.
  • the augmented reality AR painting teaching method may include but is not limited to step S1000, step S2000, step S3000 and step S4000.
  • Step S1000 Obtain the entity information of the target object.
  • the static image information of the target object is obtained, the static image information is stored in a database, and is used as entity information after information processing.
  • the dynamic image information of the target object is obtained, the dynamic image information is stored in a database, and is used as entity information after information processing.
  • Step S2000 Perform stereoscopic restoration of the entity information to obtain stereoscopic image information corresponding to the target object.
  • 3D stereoscopic processing is performed to obtain a stereoscopic image corresponding to the target object as the stereoscopic image information.
  • the entity information is restored to a 3D stereoscopic image as the stereoscopic image information.
  • Step S3000 Obtain the painting course information corresponding to the target object based on the three-dimensional image information; wherein the painting course information is used for painting teaching.
  • the painting course information corresponding to the target object is directly obtained from the three-dimensional image information, and the painting course information is used for subsequent painting teaching.
  • the three-dimensional image information is added with teaching content information.
  • the teaching content information includes teaching guide information.
  • the teaching guide information includes teaching voice explanations, text teaching logos, demonstration animations, etc., to obtain the painting course information corresponding to the target object. Use For subsequent painting teaching.
  • Step S4000 Display the painting course information.
  • the painting course information is displayed on the terminal.
  • the terminal used for the online teaching mode is AR glasses, AR helmets and other terminals that can be used for remote communication and AR screen display. .
  • the painting course information is displayed on the terminal.
  • the terminal used for the offline teaching mode is a terminal that can display AR images, such as a display screen or a tablet that can support AR display. and other display devices.
  • Figure 4 is a flow chart of identity verification provided by an embodiment of the present application.
  • the identity verification steps include but are not limited to step S5100, step S6100, and step S6200.
  • Step S5100 Obtain identity information, verify the identity information, and obtain the identity verification result.
  • the acquired identity information includes name, identity, etc.
  • the acquired identity information is matched with the original identity information recorded in the database to implement the identity information verification process and obtain the identity verification result.
  • Step S6100 If the identity verification result is the first identity verification result, enter the first mode.
  • Step S6200 If the identity verification result is the second identity verification result, enter the second mode.
  • the identity verification result is obtained. If the identity verification result is the teacher's identity, that is, the first identity verification result is the teacher, then the teacher mode is entered, that is, the first mode is the teacher mode.
  • the teacher mode can provide teachers with teacher-side functions, which include a light source simulation function. Teachers can use this function to adjust the light and shadow of the teaching model in the painting teaching course content, and show students the shadow state of the teaching model under different lighting conditions; Painting teaching course content control function, teachers can also use this function to play, pause or double-speed playback of the painting teaching course content.
  • the identity verification result is obtained. If the identity verification result is the teacher's identity, that is, the first identity verification result is the teacher, then the teacher mode is entered, that is, the first mode is the teacher mode.
  • Teacher mode can provide teachers with teacher-side functions. Teacher-side functions include muting the sound function and turning on the microphone. In order to better realize the interaction of painting teaching, teachers can use this function to communicate with students or ask students to answer relevant questions. When you do not need to communicate with students in real time, you can use the mute function to ensure that No interruptions in class.
  • the identity verification result is obtained. If the identity verification result is the student identity, that is, the second identity verification result is the student, then the student mode is entered, that is, the second mode is the student mode.
  • the student mode can provide students with a list of self-study course content information. Students can select the courses they need in the list, play and watch related painting course content independently, and conduct independent learning; the light source simulation function allows students to use this function to analyze the painting teaching course content. Adjust the light and shadow of the teaching model in the teaching model to watch the shadow state of the teaching model under different lighting conditions; the painting teaching course content control function, students can use this function to play, pause or double-speed playback of the painting teaching course content.
  • the identity verification result is obtained. If the identity verification result is the student identity, that is, the second identity verification result is the student, then the student mode is entered, that is, the second mode is the student mode.
  • the student mode can provide students with a hand-raising function. When students have doubts about the course content that the teacher is telling or have communication ideas about the questions raised by the teacher, they can use the raising-hand function to prompt the teacher to communicate; students can use the note-taking function
  • the note recording function records important information in the painting course content as review notes after the course; the screen recording function allows students to use this function to record the screen and save the course information narrated by the teacher through screen recording. As review notes after the course; course playback function, students can use this function to study previous courses again.
  • Figure 5 is a flow chart of an AR painting teaching method provided by an embodiment of the present application. In the embodiment corresponding to Figure 5, it includes but is not limited to step S1000, step S2000, step S3000, step S4000, step S5000, and step S6000.
  • Step S1000 Obtain the entity information of the target object.
  • the static image information of the target object is obtained, the static image information is stored in a database, and is used as entity information after information processing.
  • the dynamic image information of the target object is obtained, the dynamic image information is stored in a database, and is used as entity information after information processing.
  • Step S2000 Perform stereoscopic restoration of the entity information to obtain stereoscopic image information corresponding to the target object.
  • 3D stereoscopic processing is performed to obtain a stereoscopic image corresponding to the target object as the stereoscopic image information.
  • the entity information is restored to a 3D stereoscopic image as the stereoscopic image information.
  • Step S3000 Obtain the painting course information corresponding to the target object based on the three-dimensional image information; wherein the painting course information is used for painting teaching.
  • the painting course information corresponding to the target object is directly obtained from the three-dimensional image information, and the painting course information is used for subsequent painting teaching.
  • the three-dimensional image information is added with teaching content information.
  • the teaching content information includes teaching guide information.
  • the teaching guide information includes teaching voice explanations, text teaching logos, demonstration animations, etc., to obtain the painting course information corresponding to the target object. Use For subsequent painting teaching.
  • Step S4000 Display the painting course information.
  • the painting course information is displayed on the terminal.
  • the terminal used for the online teaching mode is AR glasses, AR helmets and other terminals that can be used for remote communication and AR screen display. .
  • the painting course information is displayed on the terminal.
  • the terminal used for the offline teaching mode is a terminal that can display AR images, such as a display screen or a tablet that can support AR display. Wait for display display equipment.
  • Step S5000 Obtain the operation information, update the painting course information according to the operation information, and generate and update the painting course information.
  • the operation information is light source operation information, which is used to adjust the light source position, light source illumination range, light source intensity, etc. in the painting course information, and change the distribution of bright and shadow surfaces, light and dark of the teaching model in the painting course information.
  • the position of the junction line shows students the light and dark status and details of the same teaching model under different light conditions from multiple angles.
  • the operation information is playback operation information, which is used to adjust the angle, size, etc. of the teaching model in the painting course information, so as to display the details of the teaching model from multiple angles to the students.
  • the operation information is playback operation information, which is used to adjust the movement speed of the dynamic teaching model in the painting course information, such as 0.5 times speed or 2 times speed, etc., by controlling the movement speed, it can show the students the morphological changes and changes of the moving objects. Line variation details.
  • Step S6000 Update the painting course information for display.
  • the painting course information is displayed on the terminal.
  • the terminal used for the online teaching mode is AR glasses, AR helmets and other terminals that can be used for remote communication and AR screen display. .
  • the painting course information is displayed on the terminal.
  • the terminal used for the offline teaching mode is a terminal that can display AR images, such as a display screen or a tablet that can support AR display. and other electronic displays.
  • Figure 6 is a flow chart of the entity information acquisition process provided by an embodiment of the present application.
  • the steps of obtaining entity information include but are not limited to step S1100, step S1200, and step S1300.
  • Step S1100 Scan and collect at least one of static image information or dynamic information of the target object.
  • the target object is a static object, and its static image information is image scanned and information collected.
  • the target object is a moving object, and its dynamic information in the moving state is image scanned and information collected. It can be understood that when the target object is dynamic, the collected information data is in addition to the image information. It also includes time information, and different times correspond to different images.
  • Step S1200 Store the image information in the database.
  • Step S1300 Use the image information stored in the database as entity information.
  • the image information stored in the database is 3D processed and used as entity information.
  • the image information stored in the database is restored to generate three-dimensional entity information.
  • Figure 7 is a flow chart of a teaching mode selection process provided by an embodiment of the present application.
  • the teaching mode selection process includes but is not limited to step S4100, step S4210, and step S4220.
  • Step S4100 Obtain teaching mode information and judge the teaching mode information to obtain teaching mode results.
  • Step S4210 If the teaching mode result is offline teaching mode, display it on the first terminal.
  • Step S4220 If the teaching mode result is the online teaching mode, display it on the second terminal.
  • the teaching mode includes an online painting teaching mode.
  • the teacher or the student selects the online painting teaching mode on the terminal, generates the online teaching mode information, obtains the online teaching mode results, and transmits the online teaching terminal, which is the second Display on the terminal;
  • the online teaching terminal is an AR display terminal device configured for online painting teaching, such as AR glasses, AR helmets, etc.; when conducting online painting teaching through online teaching terminals, teachers and students can use their respective AR display terminals and pair and connect them for painting teaching or learning.
  • teachers and students can use their respective AR display terminals to teach or learn painting. terminal for real-time conversations.
  • the teaching mode includes an offline painting teaching mode.
  • the teacher or the student selects the offline painting teaching mode on the terminal, generates offline teaching mode information, obtains the offline teaching mode results, and transmits the results to the offline teaching terminal.
  • Display on a terminal the offline teaching terminal is an AR display terminal device configured for offline painting teaching, such as an AR three-dimensional display, etc.; when conducting offline painting teaching through the offline teaching terminal, teachers and students can conduct face-to-face teaching For teaching and learning, teachers can use AR display terminal devices to show students the content of the painting teaching course, and deepen students' understanding of the content of the painting teaching course through explanations.
  • Figure 8 is a schematic diagram of the augmented reality AR painting teaching content provided by an embodiment of the present application.
  • the teaching content uses an image information scanning and collection device to shoot and scan the target object and collect data corresponding to the target object image.
  • the target object can be a static model or a dynamic model.
  • the model and image information scanning and acquisition device completes image scanning and data collection of the target object, it uploads the relevant information to the AR painting teaching system to generate teaching course content corresponding to the painting course information.
  • the user can also adjust the teaching course content through the display terminal.
  • the playback speed of the dynamic content in the teaching course content can be controlled, such as 0.5x speed or 2x speed adjustment, to suit the user. experience; in addition, the teaching system also provides a light source simulation function. Users can adjust the position, illumination range, intensity and other parameters of the light source to achieve different effects of the model under different lighting conditions in the teaching course content.
  • Scenario 1 corresponds to augmented reality AR offline painting teaching.
  • the teacher logs in to the teaching system after authenticating on the AR display terminal; the teacher chooses this teaching course, such as the life drawing course, and uses the AR display terminal to display the teaching content model; the AR display terminal will teach The course content is presented to the naked eye; teachers can adjust the three-dimensional teaching images displayed in the teaching course content through touch screen control on the AR display terminal, such as switching to different viewing angles, zooming in on details or reducing the image, changing the perspective, etc.
  • the teacher can control the movement speed of the dynamic model to allow students to more clearly observe the changes in the shape and lines of the dynamic model in motion; in addition, the teacher can also enable the simulated light source function to adjust the light source Position, illumination range, intensity, etc., to show the different light and dark surfaces and shadow effects formed by the teaching model under different lighting.
  • Scenario 2 corresponds to the autonomous learning scenario in augmented reality AR online painting teaching. Students log in to the learning system after identity verification through the AR display terminal and conduct independent learning; students independently choose this learning course and use the AR display terminal to play the learning course video; in addition to presenting the learning course content to the naked eye, the AR display terminal also On the basis of displaying three-dimensional images, text terminology markers and corresponding voice course explanations are added; the AR painting teaching system can provide a free operation experience function. Students can adjust the observation perspective of the teaching model through the AR painting teaching system, or enable simulated light sources. Function, adjust the position, illumination range, intensity, etc. of the light source to feel the different light and dark surfaces, shadow effects and detail changes formed by the teaching model under different lighting.
  • Scenario three corresponds to the remote teaching scenario in augmented reality AR online painting teaching. Students log in to the learning system after identity verification through AR glasses and connect with teachers; teachers remotely display course content and conduct voice communication and interactive teaching with students.
  • Figure 9a is a flow chart of painting teaching scoring provided by an embodiment of the present application.
  • the painting teaching scoring steps include but are not limited to step S7000 and step S8000.
  • Step S7000 Obtain the perspective image under the preset perspective.
  • students use the teaching model in the painting teaching course content as a copy object to perform painting homework or painting exercises.
  • the preset perspective in the step is the observation angle image of the teaching model when the student is performing painting homework or painting exercises.
  • the copy objects used by the students come from external materials.
  • the students take pictures of the external materials from the perspective of doing painting homework or painting exercises, obtain the external material pictures, and store the external material pictures in the database to form Perspective image at the preset perspective.
  • Step S8000 Generate an original painting image according to the perspective image; where the original painting image is used for painting teaching scoring.
  • the original painting image is generated based on the perspective image and stored in the database for painting teaching scoring.
  • the perspective image is a three-dimensional image and the original painting image is a two-dimensional image.
  • Figure 9b shows an embodiment of one of the ways to apply the original painting image to the painting teaching scoring.
  • Figure 9b is a flow chart of another painting teaching scoring provided by an embodiment of the present application.
  • the painting teaching scoring steps include but are not limited to step S7000, step S8000, step S8100, step S8200, and step S8300.
  • Step S7000 Obtain the perspective image under the preset perspective.
  • students use the teaching model in the painting teaching course content as a copy object to perform painting homework or painting exercises.
  • the preset perspective in the step is the observation angle image of the teaching model when the student is performing painting homework or painting exercises.
  • the copy objects used by the students come from external materials.
  • the students take pictures of the external materials from the perspective of doing painting homework or painting exercises, obtain the external material pictures, and store the external material pictures in the database to form Perspective image at the preset perspective.
  • Step S8000 Generate an original painting image according to the perspective image; where the original painting image is used for painting teaching scoring.
  • the original painting image is generated based on the perspective image and stored in the database for painting teaching scoring.
  • the perspective image is a three-dimensional image and the original painting image is a two-dimensional image.
  • Step S8100 Obtain the image to be scored.
  • the image to be scored is a flat two-dimensional image in which the student took a photo of his or her painting assignment or painting practice and uploaded it to the database.
  • Step S8200 Compare the image to be scored with the original painting image to generate similarity information.
  • deep feature extraction and feature vector similarity calculation methods are used to compare the original painting image and the image to be scored to obtain image similarity information.
  • the system treats the original painting image and the image to be scored as two wholes, performs overall comparison, and obtains overall picture similarity information.
  • the system divides the original painting image into key scoring areas. After acquiring the image to be scored, the system divides the image to be scored into corresponding scoring areas based on the key scoring areas of the original painting image. When comparing the scoring images, only the image similarity of the scoring key areas is compared, and the image similarity information of each scoring key area is obtained respectively.
  • Step S8300 Score painting teaching based on picture similarity information.
  • the information is visualized and scored based on the similarity information between the original painting image and the image to be scored.
  • the system performs visual processing on image similarity information, and initially obtains the score of the image to be scored based on the similarity percentage value between the original painting image and the image to be scored.
  • the system performs visual processing on the image similarity information, compares the original painting image and the key scoring areas divided into the image to be scored, and obtains the similarity percentage value of the image in the key scoring area, and initially obtains each image of the image to be scored. Scores for key scoring areas.
  • the system performs visual processing on the image similarity information, compares the original painting image and the key scoring areas divided into the image to be scored, and obtains the similarity percentage value of the image in the key scoring area, and initially obtains each image of the image to be scored. The scores of the key scoring areas are averaged to obtain the final score.
  • the system performs visual processing on the picture similarity information, and initially obtains the score of the image to be scored based on the similarity percentage value between the original painting image and the image to be scored. After the image to be scored is manually corrected by the teacher, combined with The preliminary score is used to obtain the final score of the work.
  • Figure 10 is a schematic diagram of painting teaching scoring provided by an embodiment of the present application. As shown in the embodiment shown in Figure 10, after completing the painting teaching course, students begin to practice painting exercises. After completing the painting exercises, students take photos of their paintings and upload them to the painting teaching system. After completing the works, When grading, the system obtains the image to be graded uploaded by the student and compares the similarity with the original painting image to obtain the similarity information.
  • Figure 11a is a schematic diagram of the structure of a painting teaching system provided by an embodiment of the present application.
  • the painting teaching system includes an entity information acquisition module, a three-dimensional image information generation module, a painting course information generation module, and a display module.
  • the entity information acquisition module is configured to obtain entity information of the target object.
  • the entity information acquisition module directly obtains preset entity information from the system.
  • the entity information acquisition module acquires entity information generated after image scanning and data collection of the target object by an image information collection device.
  • the stereoscopic image information generation module is configured to stereoscopically restore the entity information to obtain stereoscopic image information corresponding to the target object.
  • the painting course information generation module is configured to obtain the painting course information corresponding to the target object based on the stereoscopic image information, Among them, the painting course information is used for painting teaching.
  • the display module is configured to display the painting course information. Depending on the identity verification results and teaching mode selection, the display module displays the painting course information on different display terminals.
  • Figure 11b is a schematic diagram of the structure of a painting teaching system provided by another embodiment of the present application.
  • the painting teaching system may also include at least one of an identity information verification module, an operating information processing module, a scoring module or an information collection module.
  • the identity information verification module is configured to obtain identity information and verify the identity information, obtain the identity verification result, and enter the painting teaching mode corresponding to the identity verification result according to the identity verification result.
  • the operation information processing module is configured to obtain and update the painting course information, and generate and update the painting course information.
  • the scoring module is configured to obtain a perspective image at a preset perspective, and generate an original painting image based on the perspective image, where the original painting image is used for painting teaching scoring.
  • the information collection module is configured to scan and collect image information of the target object and generate entity information.
  • Figure 12 is a schematic structural diagram of an augmented reality AR painting teaching device provided by an embodiment of the present application.
  • the augmented reality AR painting teaching device may include a memory 1100, a processor 1200, an input device 1300, and an output device 1400.
  • Input device 1300 may be configured to receive input numeric or character information and generate event signal input related to user settings and functional controls of the device.
  • the output device 1400 may include a display device such as an AR display screen.
  • An embodiment of the present application also provides a display terminal, including: a memory, a processor, and a computer program stored in the memory and executable on the processor.
  • the processor executes the augmented reality AR painting teaching method described above.
  • An embodiment of the present application also provides a computer-readable storage medium that stores computer-executable instructions.
  • the computer-executable instructions are used to execute the augmented reality AR painting teaching method provided by any embodiment of the present application.
  • Figure 13 is a schematic diagram of an augmented reality AR painting teaching method provided by an embodiment of the present application.
  • the target object scans and collects the corresponding image information through the image information scanning and collection device, and the image information is stored in the painting teaching system.
  • the painting teaching system uses an AR display terminal, a small program or an APP, AR glasses show students the painting teaching course information stored in the painting teaching system; at the same time, teachers can use AR display terminals or AR glasses for offline or online teaching.
  • stereoscopic image information corresponding to the target object is obtained by stereoscopically restoring the obtained entity information of the target object, so as to obtain the stereoscopic image information according to the stereoscopic
  • the image information obtains the painting course information corresponding to the target object and displays it to achieve a three-dimensional presentation of the teaching model and improve the effect of painting teaching.
  • the divisions between functional modules/units mentioned in the above description do not necessarily correspond to physical groups Partitioning of components; for example, a physical component can have multiple functions, or a function or step can be performed cooperatively by several physical components.
  • Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit .
  • a processor such as a central processing unit, a digital signal processor, or a microprocessor
  • Such software may be distributed on computer-readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media).
  • computer storage media includes volatile and nonvolatile media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. removable, removable and non-removable media.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disk (DVD) or other optical disk storage, magnetic cassettes, tapes, disk storage or other magnetic storage devices, or may Any other medium used to store the desired information and that can be accessed by a computer.
  • communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .
  • a component may be, but is not limited to, a process, processor, object, executable file, thread of execution, program or computer running on a processor.
  • applications running on the computing device and the computing device may be components.
  • One or more components can reside in a process or thread of execution, and the component can be localized on one computer or distributed between 2 or more computers. Additionally, these components can execute from various computer-readable media having various data structures stored thereon.
  • a component may, for example, be based on a signal having one or more data packets (eg, data from two components interacting with another component, such as a local system, a distributed system, or a network, such as the Internet, which interacts with other systems via signals) Communicate through local or remote processes.
  • data packets eg, data from two components interacting with another component, such as a local system, a distributed system, or a network, such as the Internet, which interacts with other systems via signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

本申请实施例提供了一种增强现实AR绘画教学方法、系统、显示终端及计算机可读存储介质，方法包括：获取目标对象的实体信息(S1000)；将所述实体信息进行立体还原，得到目标对象对应的立体图像信息(S2000)；根据所述立体图像信息，得到所述目标对象对应的绘画课程信息；其中，所述绘画课程信息用于绘画教学(S3000)；将所述绘画课程信息进行显示(S4000)。

Description

增强现实绘画教学方法、系统、显示终端及存储介质
相关申请的交叉引用
本申请基于申请号为202210736623.X、申请日为2022年6月27日的中国专利申请提出，并要求该中国专利申请的优先权，该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本申请实施例涉及增强现实技术领域，尤其涉及一种增强现实AR绘画教学方法、系统、显示终端及计算机可读存储介质。
背景技术
增强现实(augmented reality，AR)是一种将虚拟信息与真实世界巧妙融合的技术，将计算机生成的文字、图像、三维模型、音乐、视频等虚拟信息模拟仿真后，应用到真实世界中，两种信息互为补充，从而实现对真实世界的“增强”。
以教学领域为例，相关技术中，在进行绘画教学时，采用线下实物写生的方式进行，线下教学需要模特，外出写生需要符合条件的场地，成本开销大，而在线下活动条件受限的情况下，线下教学开展就更为困难。因此，如何在降低成本开销的同时扩大绘画教学的应用场景，是当下亟待讨论和解决的问题。
发明内容
本申请实施例提供一种增强现实AR绘画教学方法、系统、显示终端及计算机可读存储介质。
第一方面，本申请实施例提供一种增强现实AR绘画教学方法，包括：获取目标对象的实体信息；将所述实体信息进行立体还原，得到目标对象对应的立体图像信息；根据所述立体图像信息，得到所述目标对象对应的绘画课程信息；其中，所述绘画课程信息用于绘画教学；将所述绘画课程信息进行显示。
第二方面，本申请实施例提供一种增强现实AR绘画教学系统，包括：实体信息获取模块，被配置为获取目标对象的实体信息；立体图像信息生成模块，被配置为将所述实体信息进行立体还原，得到目标对象对应的立体图像信息；绘画课程信息生成模块，被配置为根据所述立体图像信息，得到所述目标对象对应的绘画课程信息；其中，所述绘画课程信息用于绘画教学；显示模块，被配置为将所述绘画课程信息进行显示。
第三方面，本申请实施例提供一种增强现实AR绘画教学装置，包括：至少一个处理器；至少一个存储器，被配置为存储至少一个程序；当至少一个所述程序被至少一个所述处理器执行时实现第一方面所述的增强现实AR绘画教学方法。
第四方面，本申请实施例提供一种显示终端，包括：存储器、处理器及存储在存储器上 并可在处理器上运行的计算机程序；所述处理器执行所述计算机程序时实现第一方面所述的增强现实AR绘画教学方法。
第五方面，本申请实施例提供一种计算机可读存储介质，包括，所述计算机可读存储介质存储有计算机可执行指令，所述计算机可执行指令用于执行第一方面所述的增强现实AR绘画教学方法。
附图说明
图1是本申请一实施例提供的绘画教学方法的应用场景示意图；
图2是本申请一实施例提供的增强现实AR绘画教学方法的应用场景系统架构示意图；
图3是本申请一实施例提供的增强现实AR绘画教学方法的流程图；
图4是本申请一实施例提供的身份验证的流程图；
图5是本申请一实施例提供的增强现实AR绘画教学方法的流程图；
图6是本申请一实施例提供的实体信息的获取过程的流程图；
图7是本申请一实施例提供的教学模式选择过程的流程图；
图8是本申请一实施例提供的增强现实AR绘画教学内容示意图；
图9a是本申请一实施例提供的增强现实AR绘画教学评分的流程图；
图9b是本申请一实施例提供的另一增强现实AR绘画教学评分的流程图；
图10是本申请一实施例提供的增强现实AR绘画教学评分的示意图；
图11a是本申请一实施例提供的增强现实AR绘画教学系统结构的示意图；
图11b是本申请一实施例提供的另一增强现实AR绘画教学系统结构的示意图；
图12是本申请一实施例提供的增强现实AR绘画教学装置结构示意图；
图13是本申请一实施例提供的增强现实AR绘画教学方法整体示意图。
具体实施方式
为了使本申请的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本申请进行详细说明。应当理解，此处所描述的具体实施例仅用以解释本申请，并不用于限定本申请。
需要说明的是，虽然在装置示意图中进行了功能模块划分，在流程图中示出了逻辑顺序，但是在某些情况下，可以以不同于装置中的模块划分，或流程图中的顺序执行所示出或描述的步骤。说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。
本申请实施例的描述中，除非另有明确的限定，设置、安装、连接等词语应做广义理解，所属技术领域技术人员可以结合技术方案的具体内容合理确定上述词语在本申请实施例中的具体含义。本申请实施例中，“进一步地”、“示例性地”或者“可选地”等词用于表示作为例子、例证或说明，不应被解释为比其它实施例或设计方案更优选或更具有优势。使用“进一步地”、“示例性地”或者“可选地”等词旨在以具体方式呈现相关概念。
本申请实施例可以应用于各种与AR显示相关的设备，例如：手机、平板电脑、计算机、 笔记本电脑、可穿戴设备、车载设备、液晶显示器、阴极射线管显示器、全息成像显示器或投影等其它终端设备等；还可以应用于各种被配置为处理AR图像以及AR视频数据的设备，例如：手机、平板电脑、计算机、笔记本电脑、可穿戴设备、车载设备等其它服务器设备等。本申请实施例并不限定。
增强现实技术是促使真实世界信息和虚拟世界信息内容之间综合在一起的较新的技术内容，其将原本在现实世界的空间范围中比较难以进行体验的实体信息在电脑等科学技术的基础上，实施模拟仿真处理，叠加将虚拟信息内容在真实世界中加以有效应用，并且在这一过程中能够被人类感官所感知，从而实现超越现实的感官体验。真实环境和虚拟物体之间重叠之后，能够在同一个画面以及空间中同时存在。
图1是相关技术提供的绘画教学方法的应用场景示意图。如图1所示，绘画教学通常是教师通过对教学模型进行展示和讲解，以实现向学生传达相关教学知识。
在绘画教学的相关方式中，教师和学生主要采取线上或线下两种方式进行绘画教学和绘画学习。学生在线下通过对教学模型进行观察，分析教学模型与光线的关系并进行绘画练习，或通过观察户外自然景观进行写生，线下教学需要教学模型或教学模特，户外写生需要符合条件的场地，上述教学方式均需要较高的成本和要求较高的环境，另外由于线下条件不足，例如恶劣天气，而导致无法进行户外写生的情况时有发生，对教学效果产生影响；线上方式则主要采用平面展示的方式进行授课和学习，相较于立体图像而言，平面图像无法很好地展示教学模型的光影结构或动态变化，无法达到很好的教学效果。
基于此，本申请实施例提供例如一种增强现实AR绘画教学方法、系统、显示终端及计算机可读存储介质，通过将获取到的目标对象的实体信息进行立体还原得到目标对象对应的立体图像信息，以根据立体图像信息得到目标对象对应的绘画课程信息并将其进行显示，实现对教学模型的立体呈现，提高绘画教学效果。
下面将结合附图，对本申请实施例进行阐述。
图2是本申请一实施例提供的增强现实AR绘画教学方法的应用场景系统架构示意图。如图2所示，该系统架构包括图像信息扫描采集装置110，服务器120以及终端130。
图像信息扫描采集装置110(例如AR扫描设备)对目标对象进行图像扫描及信息采集，目标对象为教学所需的模型或模特，图像信息扫描采集装置110完成对所需目标对象的图像扫描和信息采集后，将扫描采集到的目标对象对应的实体信息发送到服务器120，服务器120接收并处理实体信息，将实体信息进行立体还原，同时根据得到的立体图像信息，生成目标对象对应的绘画课程信息，用于绘画教学。终端130(例如AR眼镜、AR显示平板等)将绘画课程信息进行显示，完成绘画教学。
图3是本申请一实施例提供的增强现实AR绘画教学方法的流程图。在图3所示的实施例中，该增强现实AR绘画教学方法可以包括但不限于步骤S1000、步骤S2000、步骤S3000及步骤S4000。
步骤S1000：获取目标对象的实体信息。
在一实施例中，获取目标对象的静态图像信息，将静态图像信息存储于数据库中，经过信息处理后作为实体信息。
在一实施例中，获取目标对象的动态图像信息，将动态图像信息存储于数据库中，经过信息处理后作为实体信息。
步骤S2000：将实体信息进行立体还原，得到目标对象对应的立体图像信息。
在一实施例中，获取实体信息后进行3D立体化处理，得到目标对象对应的立体图像，作为立体图像信息。
在一实施例中，获取实体信息后将实体信息还原为3D立体图像，作为立体图像信息。
步骤S3000：根据立体图像信息，得到目标对象对应的绘画课程信息；其中，绘画课程信息用于绘画教学。
在一实施例中，由立体图像信息直接得到目标对象对应的绘画课程信息，绘画课程信息用于后续绘画教学。
在一实施例中，立体图像信息在经过加入教学内容信息，教学内容信息包括教学指引信息，教学指引信息包括教学语音讲解、文字教学标识、演示动画等，得到目标对象对应的绘画课程信息，用于后续绘画教学。
步骤S4000：将绘画课程信息进行显示。
在一实施例中，当用户采用线上教学模式时，绘画课程信息在终端进行显示,用于线上教学模式的终端为AR眼镜、AR头盔等可以用于远程沟通和进行AR画面显示的终端。
在一实施例中，当用户采用线下教学模式时，绘画课程信息在终端进行显示，用于线下教学模式的终端为可以进行AR画面显示的终端，例如可以支持AR显示的显示屏、平板等显示设备。
图4是本申请一实施例提供的身份验证的流程图。在图4对应的实施例中，身份验证步骤包括但不限于步骤S5100、步骤S6100、步骤S6200。
步骤S5100：获取身份信息，并对身份信息进行验证，得到身份验证结果。
在一实施例中，获取的身份信息包括姓名、身份等，将获取的身份信息与数据库中收录的原始身份信息进行匹配，实现身份信息的验证过程，得到身份验证结果。
步骤S6100：如果身份验证结果为第一身份验证结果，进入第一模式。
步骤S6200：如果身份验证结果为第二身份验证结果，进入第二模式。
在一实施例中，通过身份验证后，得到身份验证结果，如果身份验证结果为教师身份，即第一身份验证结果为教师，则进入教师模式，即第一模式为教师模式。教师模式可以为教师提供教师端功能，教师端功能包括光源模拟功能，教师可以使用该功能对绘画教学课程内容中的教学模型进行光影调节，为学生展示在不同光照条件下教学模型的阴影状态；绘画教学课程内容控制功能，教师还可以利用该功能对绘画教学课程内容进行播放、暂停或倍速播放等。
在一实施例中，通过身份验证后，得到身份验证结果，如果身份验证结果为教师身份，即第一身份验证结果为教师，则进入教师模式，即第一模式为教师模式。教师模式可以为教师提供教师端功能，教师端功能包括禁音功能和开启麦克风功能，为更好地实现绘画教学的交互，教师可以利用该功能实现在需要与学生沟通或询问学生回答相关问题的时候开启学生端麦克风进行实时对话沟通，当不需要与学生进行实时沟通时，则可以使用禁音功能，保证 课堂不受干扰。
在一实施例中，通过身份验证后，得到身份验证结果，如果身份验证结果为学生身份，即第二身份验证结果为学生，则进入学生模式，即第二模式为学生模式。学生模式可以为学生提供自学课程内容信息列表，学生可以在列表中进行选择自己需要的课程，自主播放观看相关绘画课程内容，进行自主学习；光源模拟功能，学生可以使用该功能对绘画教学课程内容中的教学模型进行光影调节，观看在不同光照条件下教学模型的阴影状态；绘画教学课程内容控制功能，学生可以利用该功能对绘画教学课程内容进行播放、暂停或倍速播放等。
在一实施例中，通过身份验证后，得到身份验证结果，如果身份验证结果为学生身份，即第二身份验证结果为学生，则进入学生模式，即第二模式为学生模式。学生模式可以为学生提供举手功能，当学生对教师正在讲述的课程内容有疑惑或者对于教师提出的问题有沟通想法时，可以使用举手功能，提示教师需要沟通；笔记记录功能，学生可以利用笔记记录功能对绘画课程内容中重要的信息进行记录，作为课程结束后的复习笔记；录屏功能，学生可以使用该功能进行录屏，将教师所讲述的课程信息通过屏幕录制的方式保存下来，作为课程结束后的复习笔记；课程回放功能，学生可以使用该功能对往期课程进行再次学习。
图5是本申请一实施例提供的AR绘画教学方法的流程图。在图5对应的实施例中，包括但不限于步骤S1000、步骤S2000、步骤S3000、步骤S4000、步骤S5000、步骤S6000。
步骤S1000：获取目标对象的实体信息。
在一实施例中，获取目标对象的静态图像信息，将静态图像信息存储于数据库中，经过信息处理后作为实体信息。
在一实施例中，获取目标对象的动态图像信息，将动态图像信息存储于数据库中，经过信息处理后作为实体信息。
步骤S2000：将实体信息进行立体还原，得到目标对象对应的立体图像信息。
在一实施例中，获取实体信息后进行3D立体化处理，得到目标对象对应的立体图像，作为立体图像信息。
在一实施例中，获取实体信息后将实体信息还原为3D立体图像，作为立体图像信息。
步骤S3000：根据立体图像信息，得到目标对象对应的绘画课程信息；其中，绘画课程信息用于绘画教学。
在一实施例中，由立体图像信息直接得到目标对象对应的绘画课程信息，绘画课程信息用于后续绘画教学。
在一实施例中，立体图像信息在经过加入教学内容信息，教学内容信息包括教学指引信息，教学指引信息包括教学语音讲解、文字教学标识、演示动画等，得到目标对象对应的绘画课程信息，用于后续绘画教学。
步骤S4000：将绘画课程信息进行显示。
在一实施例中，当用户采用线上教学模式时，绘画课程信息在终端进行显示,用于线上教学模式的终端为AR眼镜、AR头盔等可以用于远程沟通和进行AR画面显示的终端。
在一实施例中，当用户采用线下教学模式时，绘画课程信息在终端进行显示，用于线下教学模式的终端为可以进行AR画面显示的终端，例如可以支持AR显示的显示屏、平板等显 示设备。
步骤S5000：获取操作信息，根据操作信息，对绘画课程信息进行更新，生成更新绘画课程信息。
在一实施例中，操作信息为光源操作信息，用于调节绘画课程信息中的光源位置、光源照射范围、光源强弱等，改变绘画课程信息中教学模型的亮面、阴影面的分布、明暗交界线的位置，为学生多角度展现同一教学模型在不同光线条件下的明暗状态和细节情况。
在一实施例中，操作信息为播放操作信息，用于调节绘画课程信息中教学模型的角度、大小等，为学生多角度展现教学模型的细节。
在一实施例中，操作信息为播放操作信息，用于调节绘画课程信息中动态教学模型的运动速度，比如0.5倍速或2倍速等，通过控制运动速度，为学生展示运动中物体的形态变化及线条变化细节。
步骤S6000：将更新绘画课程信息进行显示。
将更新后的绘画课程信息通过显示终端进行显示。
在一实施例中，当用户采用线上教学模式时，绘画课程信息在终端进行显示,用于线上教学模式的终端为AR眼镜、AR头盔等可以用于远程沟通和进行AR画面显示的终端。
在一实施例中，当用户采用线下教学模式时，绘画课程信息在终端进行显示，用于线下教学模式的终端为可以进行AR画面显示的终端，例如可以支持AR显示的显示屏、平板等电子显示器。
图6是本申请一实施例提供的实体信息的获取过程的流程图。在图6对应的实施例中，获取实体信息的步骤包括但不限于步骤S1100、步骤S1200、步骤S1300。
步骤S1100：扫描采集目标对象的静态图像信息或动态信息中的至少之一。
在一实施例中，目标对象为静态物体，将其静态图像信息进行图像扫描和信息采集。
在一实施例中，目标对象为运动中的物体，将其在运动状态的动态信息进行图像扫描和信息采集；可以理解的是，当目标对象为动态时，所采集的信息数据除了图像信息外还包括时间信息，不同的时间对应的图像不同。
步骤S1200：将图像信息存储于数据库。
步骤S1300：将存储于数据库的图像信息作为实体信息。
在一实施例中，将存储于数据库中的图像信息进行3D立体化处理后作为实体信息。
在一实施例中，将存储与数据库中的图像信息进行还原，生成立体实体信息。
图7是本申请一实施例提供的教学模式选择过程的流程图。在图7对应的实施例中，教学模式选择过程包括但不限于步骤S4100、步骤S4210、步骤S4220。
步骤S4100：获取教学模式信息并对教学模式信息进行判断，得到教学模式结果。
步骤S4210：如果教学模式结果为线下教学模式，在第一终端进行显示。
步骤S4220：如果教学模式结果为线上教学模式，在第二终端进行显示。
在一实施例中，教学模式包括线上绘画教学模式，教师或学生在终端进行线上绘画教学模式选择，生成线上教学模式信息，得到线上教学模式结果，并在线上教学终端即第二终端上进行显示；线上教学终端为被配置为线上绘画教学使用的AR显示终端设备，如AR眼镜、 AR头盔等；通过线上教学终端进行线上绘画教学时，教师和学生可以使用各自的AR显示终端，配对连接后进行绘画教学或绘画学习，在线上绘画教学模式下，教师和学生可以通过各自的终端进行实时对话。
在一实施例中，教学模式包括线下绘画教学模式，教师或学生在终端上进行线下绘画教学模式选择，生成线下教学模式信息，得到线下教学模式结果，并在线下教学终端即第一终端上进行显示；线下教学终端为被配置为线下绘画教学使用的AR显示终端设备，如AR立体显示屏等；通过线下教学终端进行线下绘画教学时，教师和学生可以面对面进行授课和学习，教师可以使用AR显示终端设备向学生展示绘画教学课程内容，并通过讲解加深学生对于该绘画教学课程内容的理解。
图8是本申请一实施例提供的增强现实AR绘画教学内容示意图。如图8所示，在进行增强现实AR绘画教学时，教学内容通过图像信息扫描采集装置对目标对象进行拍摄和扫描并采集目标对象图像对应的数据，该目标对象可以是静态模型也可以是动态模型，图像信息扫描采集装置完成对目标对象的图像扫描和数据采集后，将相关信息上传至AR绘画教学系统中，生成绘画课程信息对应的教学课程内容。
教学课程内容在进行播放时，用户还可以通过显示终端对教学课程内容进行调整，例如，对于教学课程内容中的动态内容可以进行播放速度的控制，比如0.5倍速或者2倍速的调节，以配合用户体验；另外，教学系统还提供光源模拟功能，用户可以自行调节光源的位置、照射范围、强弱等参数来达到教学课程内容中模型在不同光照条件下形成的不同效果画面。
下面将通过三个应用场景详细说明本申请实施例提供的AR绘画教学方法的应用过程。
场景一：
场景一对应于增强现实AR线下绘画教学。教师在进行线下绘画教学时，在AR显示终端上进行身份验证后登录教学系统；教师选择本次教学课程，比如人体素描课程，采用AR显示终端进行教学内容模型的展示；AR显示终端将教学课程内容裸眼呈现；教师可以通过在AR显示终端上进行触屏控制，对教学课程内容中显示的教学立体图像进行调整，如切换不同的观察角度，细节放大或者图像缩小、改变视角等操作。如果是教学课程内容中涉及到动态模型，教师通过控制动态模型的运动速度，让学生更为清晰地的观察动态模型运动中形态线条的变化；此外，教师还可以启用模拟光源功能，调节光源的位置、照射范围、强弱等，以展示教学模型在不同光照下形成不同的明暗面以及阴影效果。
场景二：
场景二对应于增强现实AR线上绘画教学中的自主学习场景。学生通过AR显示终端进行身份验证后登录学习系统，进行自主学习；学生自主选择本次学习课程，采用AR显示终端进行学习课程视频的播放；AR显示终端除将学习课程内容裸眼呈现外，还在对立体图像进行展示的基础上加上文字术语标记及对应的语音课程讲解；AR绘画教学系统可以提供自由操作体验功能，学生可以通过AR绘画教学系统自行调整教学模型的观察视角，或者启用模拟光源功能，调节光源的位置、照射范围、强弱等，以感受教学模型在不同光照下形成不同的明暗面及阴影效果及细节变化。
场景三：
场景三对应于增强现实AR线上绘画教学中的远程教学场景。学生通过AR眼镜进行身份验证后登录学习系统，与教师进行连线；教师远程进行课程内容展示并和学生进行语音交流及互动教学。
图9a是本申请一实施例提供的绘画教学评分的流程图。在图9a的实施例中，绘画教学评分步骤包括但不限于步骤S7000、步骤S8000。
步骤S7000：获取预设视角下的视角图像。
在一实施例中，学生使用绘画教学课程内容中的教学模型作为临摹对象，进行绘画作业或绘画练习，步骤中的预设视角为学生在进行绘画作业或绘画练习时教学模型的观察角度图像，有特定的光源位置、光线强度和形状大小。
在一实施例中，学生使用的临摹对象来自于外部素材，此时学生从进行绘画作业或绘画练习时的角度对外部素材进行拍照，获取外部素材图片并将外部素材图片存储于数据库中，形成预设视角下的视角图像。
步骤S8000：根据视角图像生成原始绘画图像；其中原始绘画图像用于绘画教学评分。
获取预设视角下的视角图像后，根据视角图像生成原始绘画图像，并存储在数据库中用于绘画教学评分，其中，视角图像为三维图像，原始绘画图像为二维图像。
可以理解的是，将原始绘画图像应用于绘画教学评分的方式有多种，图9b显示的为将原始绘画图像应用于绘画教学评分方式之一的实施例。
图9b是本申请一实施例提供的另一绘画教学评分的流程图。在图9b的实施例中，绘画教学评分步骤包括但不限于步骤S7000、步骤S8000、步骤S8100、步骤S8200、步骤S8300。
步骤S7000：获取预设视角下的视角图像。
在一实施例中，学生使用绘画教学课程内容中的教学模型作为临摹对象，进行绘画作业或绘画练习，步骤中的预设视角为学生在进行绘画作业或绘画练习时教学模型的观察角度图像，有特定的光源位置、光线强度和形状大小。
在一实施例中，学生使用的临摹对象来自于外部素材，此时学生从进行绘画作业或绘画练习时的角度对外部素材进行拍照，获取外部素材图片并将外部素材图片存储于数据库中，形成预设视角下的视角图像。
步骤S8000：根据视角图像生成原始绘画图像；其中原始绘画图像用于绘画教学评分。
获取预设视角下的视角图像后，根据视角图像生成原始绘画图像，并存储在数据库中用于绘画教学评分，其中，视角图像为三维图像，原始绘画图像为二维图像。
步骤S8100：获取待评分图像。
学生在完成绘画作业或绘画练习后，将作品拍照上传系统，生成待评分图像。
在一实施例中，待评分图像为学生将自己的绘画作业或绘画练习进行拍照后上传至数据库中的平面二维图像。
步骤S8200：将待评分图像与原始绘画图像进行对比，生成相似度信息。
获取原始绘画图像和待评分图像后，将两者进行对比，生成相似度信息。
在一实施例中，使用深度特征提取及特征向量相似度计算方式将原始绘画图像和待评分图像进行对比，得到图片相似度信息。
在一实施例中，系统将原始绘画图像和待评分图像分别作为两个整体，进行整体对比，得到整体图片相似度信息。
在一实施例中，系统将原始绘画图像分割成评分重点区域，在获取待评分图像后，根据原始绘画图像的评分重点区域对待评分图像进行相对应的评分区域划分，在进行原始绘画图像和待评分图像对比时，仅对比评分重点区域图像相似度，分别得到各评分重点区域的图片相似度信息。
步骤S8300：根据图片相似度信息进行绘画教学评分。
得到图片相似度信息后，将信息进行可视化处理，根据原始绘画图像和待评分图像的相似程度信息进行评分。
在一实施例中，系统将图片相似度信息进行可视化处理，根据原始绘画图像和待评分图像的相似程度百分比数值，初步得到待评分图像的分值。
在一实施例中，系统将图片相似度信息进行可视化处理，将原始绘画图像和待评分图像划分出的重点评分区域进行对比后得到的评分重点区域图像相似程度百分比数值，初步得到待评分图像各评分重点区域的分值。
在一实施例中，系统将图片相似度信息进行可视化处理，将原始绘画图像和待评分图像划分出的重点评分区域进行对比后得到的评分重点区域图像相似程度百分比数值，初步得到待评分图像各评分重点区域的分值，经过分值平均化处理后得到最终分值。
可以理解的是，在进行分值平均化处理方式中，可以有多种选择模式，如去掉最高分和最低分后对剩余区域分值进行平均化处理，得到最终分值；或选取各评分重点区域的分值中位数作为最终得分等。
在一实施例中，系统将图片相似度信息进行可视化处理，根据原始绘画图像和待评分图像的相似程度百分比数值，初步得到待评分图像的分值，待评分图像经过教师的人工批改后，结合初步得到的分值，得到最终的作品分值。
图10是本申请一实施例提供的绘画教学评分的示意图。如图10所示的实施例中，在绘画教学课程学习完成后，学生开始进行绘画作业练习，学生完成绘画作业练习后，将自己的绘画作品进行拍照并上传提交至绘画教学系统，在进行作品评分时，系统获取学生上传的待评分图像和原始绘画图像进行相似度对比，得到相似度信息。
图11a是本申请一实施例提供的绘画教学系统结构的示意图。如图11a所示的实施例中，绘画教学系统包括实体信息获取模块、立体图像信息生成模块、绘画课程信息生成模块、显示模块。
实体信息获取模块被配置为获取目标对象的实体信息。
在一实施例中，实体信息获取模块从系统中直接获取预先设定好的实体信息。
在一实施例中，实体信息获取模块获取通过图像信息采集设备对目标对象进行图像扫描和数据采集后生成的实体信息。
立体图像信息生成模块被配置为将实体信息进行立体还原，得到目标对象对应的立体图像信息。
绘画课程信息生成模块，被配置为根据立体图像信息得到目标对象对应的绘画课程信息， 其中，绘画课程信息用于绘画教学。
显示模块被配置为将绘画课程信息进行显示，根据身份验证结果和教学模式选择的不同，显示模块将绘画课程信息在不同显示终端进行显示。
图11b是本申请另一实施例提供的绘画教学系统结构的示意图。如图11b所示的另一实施例中，绘画教学系统还可以包括身份信息验证模块、操作信息处理模块、评分模块或信息采集模块中的至少一种。
身份信息验证模块被配置为获取身份信息并对身份信息进行验证，得到身份验证结果，并根据身份验证结果进入与身份验证结果对应的绘画教学模式。
操作信息处理模块被配置为获取并更新绘画课程信息，生成更新绘画课程信息。
评分模块被配置为获取预设视角下的视角图像，根据视角图像生成原始绘画图像，其中，原始绘画图像用于绘画教学评分。
信息采集模块被配置为扫描采集目标对象的图像信息并生成实体信息。
图12是本申请一实施例提供的增强现实AR绘画教学装置结构示意图。如图12所示，在一实施例中，增强现实AR绘画教学装置可以包括存储器1100、处理器1200、输入装置1300、输出装置1400。
输入装置1300可被配置为接收输入的数字或字符信息，以及产生与设备的用户设置以及功能控制有关的案件信号输入。输出装置1400可包括AR显示屏等显示设备。
本申请一实施例还提供了一种显示终端，包括：存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，处理器执行前文所述的增强现实AR绘画教学方法。
本申请一实施例还提供了一种计算机可读存储介质，存储有计算机可执行指令，该计算机可执行指令用于执行如本申请任一实施例提供的增强现实AR绘画教学方法。
图13是本申请一实施例提供的增强现实AR绘画教学方法示意图。如图13所示，在一实施例中，目标对象经过图像信息扫描采集装置扫描采集对应的图像信息，将图像信息存储于绘画教学系统中，绘画教学系统通过AR显示终端、小程序或APP、AR眼镜向学生展示绘画教学系统中存储的绘画教学课程信息；同时教师可以使用AR显示终端或AR眼镜进行线下或线上教学。
根据本申请实施例提供的增强现实AR绘画教学方法、系统、显示终端及计算机可读存储介质，通过将获取到的目标对象的实体信息进行立体还原得到目标对象对应的立体图像信息，以根据立体图像信息得到目标对象对应的绘画课程信息并将其进行显示，实现对教学模型的立体呈现，提高绘画教学效果。
本申请实施例描述的系统架构以及应用场景是为了更加清楚的说明本申请实施例的技术方案，并不构成对于本申请实施例提供的技术方案的限定，本领域技术人员可知，随着系统架构的演变和新应用场景的出现，本申请实施例提供的技术方案对于类似的技术问题，同样适用。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、系统、设备中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。
在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组 件的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些物理组件或所有物理组件可以被实施为由处理器，如中央处理器、数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。
在本说明书中使用的术语“部件”、“模块”、“系统”等用于表示计算机相关的实体、硬件、固件、硬件和软件的组合、软件、或执行中的软件。例如，部件可以是但不限于，在处理器上运行的进程、处理器、对象、可执行文件、执行线程、程序或计算机。通过图示，在计算设备上运行的应用和计算设备都可以是部件。一个或多个部件可驻留在进程或执行线程中，部件可位于一个计算机上或分布在2个或更多个计算机之间。此外，这些部件可从在上面存储有各种数据结构的各种计算机可读介质执行。部件可例如根据具有一个或多个数据分组(例如来自于自与本地系统、分布式系统或网络间的另一部件交互的二个部件的数据，例如通过信号与其它系统交互的互联网)的信号通过本地或远程进程来通信。
以上参照附图说明了本申请的一些实施例，并非因此局限本申请的权利范围。本领域技术人员不脱离本申请的范围和实质内所作的任何修改、等同替换和改进，均应在本申请的权利范围之内。

Claims (17)

  1. 一种增强现实AR绘画教学方法，包括：
    获取目标对象的实体信息；
    将所述实体信息进行立体还原，得到目标对象对应的立体图像信息；
    根据所述立体图像信息，得到所述目标对象对应的绘画课程信息；其中，所述绘画课程信息用于绘画教学；
    将所述绘画课程信息进行显示。
  2. 根据权利要求1所述的方法，还包括：
    获取身份信息，并对身份信息进行验证，得到身份验证结果；
    如果身份验证结果为第一身份验证结果，进入第一模式；
    如果身份验证结果为第二身份验证结果，进入第二模式。
  3. 根据权利要求1所述的方法，还包括：
    获取操作信息，根据所述操作信息，对所述绘画课程信息进行更新，生成更新绘画课程信息；
    将所述更新绘画课程信息进行显示。
  4. 根据权利要求3所述的方法，其中，所述操作信息至少包括以下之一：
    光源操作信息，用于调节光源位置，或光源照射范围，或光源强弱中的至少之一；或
    播放操作信息，用于调节所述立体图像信息的播放角度，或播放大小，或播放速度中的至少之一。
  5. 根据权利要求1所述的方法，还包括：
    扫描采集所述目标对象的静态图像信息或动态图像信息中的至少之一；
    将所述图像信息存储于数据库；
    将存储于所述数据库的所述图像信息作为所述实体信息。
  6. 根据权利要求1所述的方法，还包括：获取教学模式信息并对所述教学模式信息进行判断，得到教学模式结果；
    所述将所述绘画课程信息进行显示，包括：
    如果所述教学模式结果为线下教学模式，在第一终端进行显示；
    如果所述教学模式结果为线上教学模式，在第二终端进行显示。
  7. 根据权利要求1所述的方法，还包括：
    获取预设视角下的视角图像；
    根据所述视角图像生成原始绘画图像；其中，所述原始绘画图像用于绘画教学评分。
  8. 根据权利要求7所述的方法，还包括：
    获取待评分图像；
    将所述待评分图像与所述原始绘画图像进行对比，生成相似度信息；
    根据所述相似度信息进行绘画教学评分。
  9. 根据权利要求1所述的方法，其中，所述绘画课程信息包括教学指引信息，所述教学指引信息至少包括以下之一：
    文字标识信息，或语音讲解信息，或动画演示信息。
  10. 一种增强现实AR绘画教学系统，包括：
    实体信息获取模块，被配置为获取目标对象的实体信息；
    立体图像信息生成模块，被配置为将所述实体信息进行立体还原，得到目标对象对应的立体图像信息；
    绘画课程信息生成模块，被配置为根据所述立体图像信息，得到所述目标对象对应的绘画课程信息；其中，所述绘画课程信息用于绘画教学；
    显示模块，被配置为将所述绘画课程信息进行显示。
  11. 根据权利要求10所述的系统，还包括：
    身份信息验证模块，被配置为获取身份信息，并对身份信息进行验证，得到身份验证结果，并根据所述身份验证结果，进入与身份验证结果对应的模式。
  12. 根据权利要求10所述的系统，还包括：
    操作信息处理模块，被配置为获取并更新所述绘画课程信息，生成更新绘画课程信息。
  13. 根据权利要求10所述的系统，还包括：
    评分模块，被配置为获取预设视角下的视角图像，根据所述视角图像生成原始绘画图像；其中，所述原始绘画图像用于绘画教学评分。
  14. 根据权利要求10所述的系统，还包括：
    信息采集模块，被配置为扫描采集所述目标对象的图像信息并生成所述实体信息。
  15. 一种增强现实AR绘画教学装置，包括：
    至少一个处理器；
    至少一个存储器，被配置为存储至少一个程序；
    当至少一个所述程序被至少一个所述处理器执行时实现如权利要求1至9任意一项所述的增强现实AR绘画教学方法。
  16. 一种显示终端，包括：存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序；所述处理器执行所述计算机程序时实现如权利要求1至9中任一项所述的增强现实AR绘画教学方法。
  17. 一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令用于执行如权利要求1至9任一项所述的增强现实AR绘画教学方法。
PCT/CN2023/093896 2022-06-27 2023-05-12 增强现实绘画教学方法、系统、显示终端及存储介质 WO2024001560A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210736623.XA CN117351814A (zh) 2022-06-27 2022-06-27 增强现实绘画教学方法、系统、显示终端及存储介质
CN202210736623.X 2022-06-27

Publications (1)

Publication Number Publication Date
WO2024001560A1 true WO2024001560A1 (zh) 2024-01-04

Family

ID=89359923

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/093896 WO2024001560A1 (zh) 2022-06-27 2023-05-12 增强现实绘画教学方法、系统、显示终端及存储介质

Country Status (2)

Country Link
CN (1) CN117351814A (zh)
WO (1) WO2024001560A1 (zh)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105528923A (zh) * 2016-02-03 2016-04-27 张燕丽 美术教学系统
CN106534800A (zh) * 2016-12-12 2017-03-22 大连文森特软件科技有限公司 基于ar增强现实技术和无线通信技术的绘画辅助系统
CN109509130A (zh) * 2019-01-14 2019-03-22 重庆三峡学院 一种基于增强现实的教学系统
CN109978974A (zh) * 2019-03-05 2019-07-05 广州千之绘网络科技有限公司 基于移动终端的以3维素材为参考的绘画方法
CN111564068A (zh) * 2020-06-08 2020-08-21 上海意存文化传播有限公司 一种智能化线上美术教学系统
CN111640190A (zh) * 2020-06-02 2020-09-08 浙江商汤科技开发有限公司 Ar效果的呈现方法、装置、电子设备及存储介质
CN113763778A (zh) * 2020-06-02 2021-12-07 重庆艾艺荷马教育科技股份有限公司 一种基于ar设备的可视化美术交互教学方法

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105528923A (zh) * 2016-02-03 2016-04-27 张燕丽 美术教学系统
CN106534800A (zh) * 2016-12-12 2017-03-22 大连文森特软件科技有限公司 基于ar增强现实技术和无线通信技术的绘画辅助系统
CN109509130A (zh) * 2019-01-14 2019-03-22 重庆三峡学院 一种基于增强现实的教学系统
CN109978974A (zh) * 2019-03-05 2019-07-05 广州千之绘网络科技有限公司 基于移动终端的以3维素材为参考的绘画方法
CN111640190A (zh) * 2020-06-02 2020-09-08 浙江商汤科技开发有限公司 Ar效果的呈现方法、装置、电子设备及存储介质
CN113763778A (zh) * 2020-06-02 2021-12-07 重庆艾艺荷马教育科技股份有限公司 一种基于ar设备的可视化美术交互教学方法
CN111564068A (zh) * 2020-06-08 2020-08-21 上海意存文化传播有限公司 一种智能化线上美术教学系统

Also Published As

Publication number Publication date
CN117351814A (zh) 2024-01-05

Similar Documents

Publication Publication Date Title
US20210343171A1 (en) Systems and methods for monitoring learner engagement during a learning event
US9077846B2 (en) Integrated interactive space
US20120322037A1 (en) Anomaly Detection Educational Process
WO2019019403A1 (zh) 一种用于k12阶段的互动情景教学系统
JP6683864B1 (ja) コンテンツ制御システム、コンテンツ制御方法、およびコンテンツ制御プログラム
Camba et al. From reality to augmented reality: Rapid strategies for developing marker-based AR content using image capturing and authoring tools
CN111325853B (zh) 一种基于增强现实眼镜的远程辅导系统及方法
KR101757420B1 (ko) 투명 디스플레이를 이용한 상호작용 기반의 원격 화상 통신 및 강의 시스템
Kim et al. Virtual reality as a standard in the construction management curriculum
WO2024001560A1 (zh) 增强现实绘画教学方法、系统、显示终端及存储介质
Wibawa et al. MobiAugmented reality: Studio lighting photography simulator ver. 1.0
Tomsic Amon E-Studio: The use of information and communication technologies in the development of drawing competences in different educational environments
JP7465736B2 (ja) コンテンツ制御システム、コンテンツ制御方法、およびコンテンツ制御プログラム
Mujumdar Augmented Reality
Jin A Constructivism-based 3D Scene Display Teaching System for Wushu Teaching.
Zhou et al. Design research and practice of augmented reality textbook
Martono et al. Design of learning media for fish classification with augmented reality technology
Georgieva et al. Application of information technologies and interactive tools for improving educational quality
Lartigue et al. Leveraging oculus rift for an immersive distance-learning experience: a high definition, panoramic lecture recording/playback system using commercial virtual reality tools
US20220343783A1 (en) Content control system, content control method, and content control program
Eiris et al. Applying 360-degree virtual reality for construction safety training
Tsvetkova et al. A complex workflow for development of interactive and impressive educational content using capabilities of animated augmented reality trends
Garcia-Ruiz et al. A user study of virtual reality for visualizing digitized Canadian cultural objects
CN116149470A (zh) 一种xr虚拟仿真与职业教育深度融合的实训方法及装置
CN108091186B (zh) 一种教学方法及教学系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23829746

Country of ref document: EP

Kind code of ref document: A1