WO2020114333A1 - Video-based ar education method, smart television, storage medium, and device - Google Patents

Video-based ar education method, smart television, storage medium, and device Download PDF

Info

Publication number
WO2020114333A1
WO2020114333A1 PCT/CN2019/122208 CN2019122208W WO2020114333A1 WO 2020114333 A1 WO2020114333 A1 WO 2020114333A1 CN 2019122208 W CN2019122208 W CN 2019122208W WO 2020114333 A1 WO2020114333 A1 WO 2020114333A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
learning
education
target
target video
Prior art date
Application number
PCT/CN2019/122208
Other languages
French (fr)
Chinese (zh)
Inventor
徐永泽
赖长明
Original Assignee
深圳Tcl新技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳Tcl新技术有限公司 filed Critical 深圳Tcl新技术有限公司
Publication of WO2020114333A1 publication Critical patent/WO2020114333A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/20Education
    • G06Q50/205Education administration or guidance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8166Monomedia components thereof involving executable data, e.g. software
    • H04N21/8173End-user applications, e.g. Web browser, game

Definitions

  • This application relates to the field of video education, and in particular to a video-based AR education method, smart TV, storage medium, and equipment.
  • AR technology has been the focus of a large number of companies and enterprises as a hot field today. As a technology that integrates virtual animation into people's real vision, AR technology will inevitably change human visual experience and lifestyle. Unfortunately, at this stage, in addition to assisting the professional industry, AR technology is mainly used in the game industry, and the quality and technology are not good.
  • the main purpose of the present application is to provide a video-based AR education method smart TV, storage medium and device, aiming to solve the technical problem that the existing technology cannot apply the AR technology to the education industry on a large scale due to configuration restrictions.
  • this application provides a video-based AR education method, including the following:
  • the current playback position of the target video is the location of the learning keyword, pause the playback of the target video and obtain the AR educational video corresponding to the learning keyword;
  • the method before the step of confirming the location of the learning keyword of the target video when playing the target video, the method further includes:
  • a step of confirming the location of the learning keywords of the target video is performed.
  • the step of confirming the learning keyword of the target video tag includes:
  • the method further includes:
  • the step of confirming the location of the learning keywords of the target video when playing the target video includes:
  • the source of the marked learning keywords is the playback content of the target video and other media files associated with the target video.
  • the step of pausing playback of the target video and acquiring the AR educational video corresponding to the learning keyword includes:
  • the step of reading the marked learning keywords and obtaining an AR education video corresponding to the learning keywords in a preset education video storage area includes:
  • the method further includes:
  • the preset learning scheme includes voice learning, action learning, and repeatedly playing the AR education video.
  • the step of acquiring the preset learning scheme of the AR educational video and verifying the learning information through the preset learning scheme includes:
  • the video-based AR education method further includes:
  • the method further includes:
  • the method further includes:
  • the method before the step of marking the learning keyword at the target playback position of the currently playing target video, the method further includes:
  • the AR education learning requirement is received, and the step of marking learning keywords at the target playback position of the currently playing target video is performed according to the AR education learning requirement.
  • the method before the step of marking the learning keyword at the target playback position of the currently playing target video, the method further includes:
  • the step of marking the learning keywords at the target playback position of the currently playing target video is performed through the selected learning keywords.
  • the step of marking the learning keyword at the target playback position of the currently playing target video is performed by the selected learning keyword and the determined registration position.
  • the judgment module is set to confirm the location of the learning keywords of the target video when playing the target video;
  • the acquisition module is set to pause the playback of the target video and acquire the AR educational video corresponding to the learning keyword if the current playback position of the target video is the location of the learning keyword;
  • a playback module configured to play the acquired AR education video and receive user learning information based on the AR education video
  • the confirmation module is configured to resume playing the target video when confirming that the received learning information of the user is correct.
  • the present application also provides a storage medium that stores a video-based AR education program, and the video-based AR education program includes the following steps when executed:
  • the current playback position of the target video is the location of the learning keyword, pause the playback of the target video and obtain the AR educational video corresponding to the learning keyword
  • the present application also provides a video-based AR education device.
  • the video-based AR education device includes a memory, a processor, and a video-based AR education program stored on the memory and executable on the processor.
  • the implementation of the AR education program includes the following steps:
  • the current playback position of the target video is the position of the learning keyword, pause the playback of the target video and obtain the AR educational video corresponding to the learning keyword
  • FIG. 3 is a schematic flowchart of a second embodiment of a video-based AR education method of the present application.
  • the main solution of the embodiment of the present application is: when playing the target video, confirm the location of the learning keyword of the target video; if the current playback position of the target video is the location of the learning keyword, pause the playback of the target video and Obtain an AR education video corresponding to the learning keyword; play the acquired AR education video, and receive user learning information based on the AR education video; when confirming that the received user learning information is correct, Resume playback of the target video.
  • This application provides a solution for limiting the learning position in the video of the smart TV and correspondingly playing the AR education video, so that the user can complete the AR education video by playing the current video, which increases the application scope of AR education in the education platform and thus improves Application efficiency of AR education.
  • FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment involved in a solution of an embodiment of the present application.
  • the terminal may be a PC, or may be a mobile or non-removable terminal device such as a smart phone, a tablet computer, an e-book reader, and a portable computer.
  • the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002.
  • the communication bus 1002 is used to implement connection communication between these components.
  • the user interface 1003 may include a display (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.
  • the network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).
  • the memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as disk storage.
  • the memory 1005 may optionally be a storage device independent of the foregoing processor 1001.
  • terminal structure shown in FIG. 1 does not constitute a limitation on the terminal, and may include more or fewer components than those illustrated, or combine certain components, or arrange different components.
  • the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a video-based AR education program.
  • the network interface 1004 is mainly used to connect to the background server and perform data communication with the background server;
  • the user interface 1003 is mainly used to connect to the client (user side) and perform data communication with the client; and the processor 1001 can be used to call the video-based AR education program stored in the memory 1005 and perform the following operations:
  • the current playback position of the target video is the location of the learning keyword, pause the playback of the target video and obtain the AR educational video corresponding to the learning keyword;
  • processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
  • a step of confirming the location of the learning keywords of the target video is performed.
  • processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
  • processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
  • processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
  • processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
  • the source of the marked learning keywords is the playback content of the target video and other media files associated with the target video.
  • processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
  • processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
  • processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
  • processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
  • processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
  • processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
  • processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
  • the AR education learning requirement is received, and the step of marking learning keywords at the target playback position of the currently playing target video is performed according to the AR education learning requirement.
  • processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
  • the step of marking the learning keywords at the target playback position of the currently playing target video is performed through the selected learning keywords.
  • processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
  • the step of marking the learning keyword at the target playback position of the currently playing target video is performed by the selected learning keyword and the determined registration position.
  • FIG. 2 is a schematic flowchart of a first embodiment of a video-based AR education method of the present application.
  • the video-based AR education method includes:
  • Step S10 when playing the target video, confirm the location of the learning keyword of the target video
  • the current video When playing a video on the current smart TV, the current video is used as the target video. Based on the current playing situation of the target video, it is detected whether there is a marked learning keyword in the target video, where the learning keyword is the location of the learning information based on the AR education operation pre-marked in the current playing target video.
  • the learning keywords may come from the playback content of the target video; or may also come from other media files associated with the target video, etc.
  • the content of the specific marked learning keywords may be based on the current AR Learning needs setting and marking to the target playing position of the target video. Wherein, when the current playback position of the target video is the marked learning keyword, the playback of the target video is paused.
  • Step S20 if the current playback position of the target video is the location of the learning keyword, pause the playback of the target video and obtain the AR educational video corresponding to the learning keyword;
  • the acquisition method may be to acquire the identified content by identifying the learning keywords in the target video frame.
  • the steps of educational video include:
  • the preset educational video storage area is a defined data storage area for storing AR educational videos, and when the preset educational video storage area stores the AR educational video, the content of the AR educational video is The logo is stored so that it can be played by learning the location correspondence
  • Step S30 Play the acquired AR educational video, and receive user learning information based on the AR educational video;
  • Step S40 when it is confirmed that the received learning information of the user is correct, the playback of the target video is resumed.
  • the AR education video is played after the acquired AR education video.
  • Receive the learning information corresponding to the AR education video through the currently played AR education video and the learning information is initiated based on the currently played AR education video to enable the user to perform the current AR learning operation. Therefore, the learning information is related to the video content of the AR educational video.
  • the acquired AR educational video is played, and the user’s learning information based on the AR educational video is received. After the steps, it also includes:
  • the preset learning scheme is related to the learning content of the current AR learning operation.
  • a preset learning scheme may be correspondingly set through the currently playing AR video playback, and the preset learning scheme includes but is not limited to voice learning, action learning, and repeatedly playing the AR educational video and other learning content.
  • the user learning schemes obtained can be matched with the acquired preset learning schemes for verification.
  • Different preset learning schemes have different verification methods when verifying the learning information, for example When the preset learning scheme is voice learning, the acquired learning information is voice learning information. When checking the received voice learning information through the preset learning scheme, the voice learning information may be parsed to confirm whether the learning information is correct.
  • the step of acquiring the preset learning plan of the AR education video and verifying the learning information through the preset learning plan includes:
  • the verification operation may be performed through the learning information verification conditions that have been set in the preset learning scheme.
  • the learning verification conditions may be individually set based on a preset learning scheme. For example, when the preset learning scheme is voice learning, the user’s voice learning information is received, and the learning condition is verified by the learning information. Verify that the received voice learning information is correct.
  • the learning verification condition may be a voice reading function, read the received voice learning information, and compare the read voice learning information with the voice information of the AR educational video, Confirm whether the received voice learning information is correct according to the comparison result.
  • the learning information is voice learning information
  • the reception of the voice learning information may be interfered and effective voice learning information may not be obtained.
  • a voice reminder message can also be issued to remind the user to re-initiate voice learning information; in addition, based on the currently playing AR education video, the specific learning information verification conditions are related to the current preset learning program, specific Set by relevant technicians.
  • the user can complete the AR education video through the current playback video, which increases the application range of AR education in the education platform and thus improves the AR education. Application efficiency.
  • FIG. 3 is a schematic flowchart of a second embodiment of a video-based AR education method of the present application. Based on the first embodiment shown in the above figure, the video-based AR education method includes:
  • Step S40 Mark learning keywords at the target playback position of the currently playing target video
  • Step S50 Obtain an AR education video corresponding to the learning keyword, and store the AR education video to a preset education video storage area.
  • the operation content of the current AR education learning operation is set, and the specific operation content includes but is not limited to marking the learning keyword at the target playback position of the target video, Store corresponding AR education videos, set learning plans, and set corresponding learning information verification conditions. Therefore, when implementing AR education, the learning keywords of the current AR learning operation can be marked in the selected target video.
  • videos with learning information can be selected as the target video, and different AR learning targets can correspondingly select different types of videos as the target video.
  • the specific application method can be adopted by Relevant technical personnel completed. Select the learning keywords in the video frame of the confirmed target video to mark.
  • the learning keywords can be selected according to current AR education needs. For example, in the target video, video frames with English letters, Chinese characters, calculation formulas, or sports actions that meet the learning conditions can be used as markers of the AR learning position .
  • the video-based AR education method further includes:
  • a preset learning scheme based on the current AR education operation is set, and the preset learning scheme includes, but is not limited to, voice learning, motion learning, and repeated playback.
  • a learning plan based on single or multiple AR learning operations can be set.
  • the corresponding learning information verification conditions are set according to the set learning plan to verify based on The learning information of the currently broadcast AR education video further realizes the AR education operation based on the TV platform, and improves the promotion of the AR technology on the education platform.
  • the preset learning plan can be set based on the current single AR education video corresponding to the preset learning plan; or, a preset learning plan for the AR education needs of a single terminal can be set.
  • the application range can be customized or the application range of the preset learning scheme can be determined according to the related setting conditions of the provided preset learning scheme.
  • an embodiment of the present application further provides a storage medium on which a video-based AR education program is stored, and when the video-based AR education program is executed by a processor, the following operations are implemented:
  • the current playback position of the target video is the location of the learning keyword, pause the playback of the target video and obtain the AR educational video corresponding to the learning keyword;
  • a step of confirming the location of the learning keywords of the target video is performed.
  • the source of the marked learning keywords is the playback content of the target video and other media files associated with the target video.
  • the AR education learning requirement is received, and the step of marking learning keywords at the target playback position of the currently playing target video is performed according to the AR education learning requirement.
  • the step of marking the learning keywords at the target playback position of the currently playing target video is performed through the selected learning keywords.
  • the step of marking the learning keyword at the target playback position of the currently playing target video is performed by the selected learning keyword and the determined registration position.
  • the methods of the above embodiments can be implemented by means of software plus the necessary general hardware platform, and of course, can also be implemented by hardware, but in many cases the former is better Implementation.
  • the technical solution of the present application can be embodied in the form of a software product in essence or a part that contributes to the existing technology, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above , Magnetic disks, optical disks), including several instructions to enable a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to perform the method described in each embodiment of the present application.
  • a terminal device which may be a mobile phone, computer, server, air conditioner, or network device, etc.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

A video-based AR education method, a smart television, a storage medium, and a device. Said method comprises: when a target video is played back, determining a position where a keyword to be learned is located in the target video (S10); if the current playback position of the target video is the position where the keyword to be learned is located, pausing the playback of the target video and acquiring an AR education video corresponding to the keyword to be learned (S20); playing back the acquired AR education video, and receiving learning information of a user based on the AR education video (S30); and when the received learning information of the user is determined to be correct, resuming the playback of the target video (S40).

Description

基于视频的AR教育方法、智能电视、存储介质及设备 Video-based AR education method, smart TV, storage medium and equipment The
相关申请Related application
本申请要求2018年12月05日申请的,申请号201811484871.X,名称为“基于视频的AR教育方法、智能电视、可读存储介质及系统”的中国专利申请的优先权,在此将其全文引入作为参考。This application requires the priority of the Chinese patent application with the application number 201811484871.X and the name "Video-based AR education method, smart TV, readable storage medium and system", which was applied on December 05, 2018. The full text is introduced as a reference.
技术领域Technical field
本申请涉及视频教育领域,尤其涉及一种基于视频的AR教育方法、智能电视、存储介质及设备。This application relates to the field of video education, and in particular to a video-based AR education method, smart TV, storage medium, and equipment.
背景技术Background technique
AR技术作为当今热门领域一直受到大量公司及企业的关注。作为一项将虚拟动画融入到人们的现实视觉中的技术,AR技术将势必改变人类的视觉体验和生活方式。遗憾的是现阶段来看,AR技术除了对专业行业的辅助外,最主要被应用在了游戏行业,并且质量和技术上都谈不上优秀。AR technology has been the focus of a large number of companies and enterprises as a hot field today. As a technology that integrates virtual animation into people's real vision, AR technology will inevitably change human visual experience and lifestyle. Unfortunately, at this stage, in addition to assisting the professional industry, AR technology is mainly used in the game industry, and the quality and technology are not good.
另外,基于现今人工智能的有关技术已经相对成熟,基于人工智能系统的产品可以更好地提升用户体验。教育行业一直以来是一个非常受大众重视和关注的行业。在开放二孩政策的当下中国,更是一支绝对的潜力股。但是AR技术在该行业的应用目前还十分有限。且现有技术在将AR技术应用在教育行业时,一般需通过专业的终端设备配置相关的教育内容后实现,应用成本较高,且在配置相关的AR教育内容时,需复杂的配置过程,因此,基于现有技术的AR技术在教育平台上应用的限制,极大了降低了AR在教育平台的应用范围及应用效率。 In addition, related technologies based on artificial intelligence today are relatively mature, and products based on artificial intelligence systems can better enhance the user experience. The education industry has always been an industry that is highly valued and concerned by the public. In the current era of the two-child policy, China is an absolute potential stock. However, the application of AR technology in this industry is still very limited. In addition, when applying the AR technology to the education industry in the prior art, it is generally required to configure relevant education content through professional terminal equipment, the application cost is relatively high, and when configuring the relevant AR education content, a complicated configuration process is required. Therefore, the limitation of the application of the AR technology on the education platform based on the existing technology greatly reduces the application scope and application efficiency of the AR on the education platform.
上述内容仅用于辅助理解本申请的技术方案,并不代表承认上述内容是现有技术。The above content is only used to help understand the technical solution of the present application, and does not mean that the above content is recognized as prior art.
申请内容Application content
本申请的主要目的在于提供一种基于视频的AR教育方法智能电视、存储介质及设备,旨在解决现有技术由于配置限制导致不能大范围的将AR技术应用在教育行业的技术问题。The main purpose of the present application is to provide a video-based AR education method smart TV, storage medium and device, aiming to solve the technical problem that the existing technology cannot apply the AR technology to the education industry on a large scale due to configuration restrictions.
为实现上述目的,本申请提供一种基于视频的AR教育方法,包括以下内容:To achieve the above purpose, this application provides a video-based AR education method, including the following:
在播放目标视频时,确认所述目标视频的学习关键词所在位置;When playing the target video, confirm the location of the learning keywords of the target video;
若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频;If the current playback position of the target video is the location of the learning keyword, pause the playback of the target video and obtain the AR educational video corresponding to the learning keyword;
播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息;Play the acquired AR education video, and receive user learning information based on the AR education video;
在确认接收到的所述用户的学习信息正确时,恢复所述目标视频的播放。When it is confirmed that the received learning information of the user is correct, the playback of the target video is resumed.
在一些实施方式中,所述在播放目标视频时,确认所述目标视频的学习关键词所在位置的步骤之前,还包括:In some embodiments, before the step of confirming the location of the learning keyword of the target video when playing the target video, the method further includes:
确认所述目标视频标记的学习关键词;Confirm the learning keywords of the target video tag;
在确认所述目标视频已标记学习关键词时,执行确认所述目标视频的学习关键词所在位置的步骤。When confirming that the target video has been marked with learning keywords, a step of confirming the location of the learning keywords of the target video is performed.
在一些实施方式中,所述确认所述目标视频标记的学习关键词的步骤,包括:In some embodiments, the step of confirming the learning keyword of the target video tag includes:
读取目标视频当前播放位置的视频帧信息,根据读取结果确认所述目标视频登记的学习关键词。Read the video frame information of the current playback position of the target video, and confirm the learning keywords registered in the target video according to the reading result.
在一些实施方式中,所述读取目标视频当前播放位置的视频帧信息,根据读取结果确认所述目标视频登记的学习关键词的步骤之后,还包括:In some embodiments, after the step of reading the video frame information of the current playback position of the target video and confirming the learning keywords registered with the target video according to the reading result, the method further includes:
确认登记学习关键词的视频帧所在位置;Confirm the location of the video frame where the learning keywords are registered;
将所述视频帧所在位置确认为目标播放位置。Confirm the location of the video frame as the target playback location.
在一些实施方式中,所述在播放目标视频时,确认所述目标视频的学习关键词所在位置的步骤,包括:In some embodiments, the step of confirming the location of the learning keywords of the target video when playing the target video includes:
读取目标视频当前播放位置的视频帧信息,确认标记学习关键词的视频帧所在位置;Read the video frame information of the current playback position of the target video and confirm the location of the video frame marked with the learning keywords;
若当前播放的视频帧已标记学习关键词,确认所述目标视频的当前播放位置为学习关键词所在位置。If the currently playing video frame has been marked with learning keywords, confirm that the current playing position of the target video is the position where the learning keywords are located.
在一些实施方式中,所述已标记的学习关键词来源为所述目标视频的播放内容,以及与所述目标视频关联的其他媒体文件。In some embodiments, the source of the marked learning keywords is the playback content of the target video and other media files associated with the target video.
在一些实施方式中,所述若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频的步骤,包括:In some embodiments, if the current playback position of the target video is where the learning keyword is located, the step of pausing playback of the target video and acquiring the AR educational video corresponding to the learning keyword includes:
读取已标记的所述学习关键词,在预设的教育视频存储区域获取与所述学习关键词对应的AR教育视频。Read the marked learning keywords, and obtain AR education videos corresponding to the learning keywords in a preset education video storage area.
在一些实施方式中,所述读取已标记的所述学习关键词,在预设的教育视频存储区域获取与所述学习关键词对应的AR教育视频的步骤,包括:In some embodiments, the step of reading the marked learning keywords and obtaining an AR education video corresponding to the learning keywords in a preset education video storage area includes:
根据所述学习关键词的读取结果为标识在预设的教育视频存储区域获取与所述学习关键词对应的AR教育视频。Obtain an AR education video corresponding to the learning keyword in a preset education video storage area according to the reading result of the learning keyword.
在一些实施方式中,所述播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息的步骤之后,还包括:In some embodiments, after the step of playing the acquired AR education video and receiving user learning information based on the AR education video, the method further includes:
获取所述AR教育视频的预设学习方案,通过所述预设学习方案校验所述学习信息; Acquiring a preset learning plan of the AR education video, and verifying the learning information through the preset learning plan;
根据校验结果确认所述学习信息的学习情况。Confirm the learning situation of the learning information according to the verification result.
在一些实施方式中,所述预设学习方案包括语音学习、动作学习以及重复播放所述AR教育视频。In some embodiments, the preset learning scheme includes voice learning, action learning, and repeatedly playing the AR education video.
在一些实施方式中,所述获取所述AR教育视频的预设学习方案,通过所述预设学习方案校验所述学习信息的步骤,包括:In some embodiments, the step of acquiring the preset learning scheme of the AR educational video and verifying the learning information through the preset learning scheme includes:
将所述学习信息与所述预设学习方案的学习信息验证条件比对;Comparing the learning information with the learning information verification conditions of the preset learning scheme;
在确认所述学习信息与所述学习信息验证条件一致时,确认所述学习信息正确。When it is confirmed that the learning information is consistent with the learning information verification conditions, it is confirmed that the learning information is correct.
在一些实施方式中,所述基于视频的AR教育方法,还包括:In some embodiments, the video-based AR education method further includes:
在当前播放的目标视频的目标播放位置标记学习关键词;Mark learning keywords at the target playback position of the currently playing target video;
获取与所述学习关键词对应的AR教育视频,并将所述AR教育视频存储至预设的教育视频存储区域。Obtain an AR education video corresponding to the learning keyword, and store the AR education video to a preset education video storage area.
在一些实施方式中,所述在当前播放的目标视频的目标播放位置标记学习关键词的步骤之后,还包括:In some embodiments, after the step of marking the learning keyword at the target playback position of the currently playing target video, the method further includes:
根据已标记的所述学习关键词创建基于AR教育学习的预设学习方案。Create a preset learning plan based on AR education learning based on the marked learning keywords.
在一些实施方式中,所述根据已标记的所述学习关键词创建基于AR教育学习的预设学习方案的步骤之后,还包括:In some embodiments, after the step of creating a preset learning solution based on AR education learning based on the marked learning keywords, the method further includes:
在已创建的预设学习方案中添加学习信息验证条件。Add learning information verification conditions in the created preset learning plan.
在一些实施方式中,所述在当前播放的目标视频的目标播放位置标记学习关键词的步骤之前,还包括:In some embodiments, before the step of marking the learning keyword at the target playback position of the currently playing target video, the method further includes:
接收AR教育学习需求,根据所述AR教育学习需求执行在当前播放的目标视频的目标播放位置标记学习关键词的步骤。The AR education learning requirement is received, and the step of marking learning keywords at the target playback position of the currently playing target video is performed according to the AR education learning requirement.
在一些实施方式中,所述在当前播放的目标视频的目标播放位置标记学习关键词的步骤之前,还包括:In some embodiments, before the step of marking the learning keyword at the target playback position of the currently playing target video, the method further includes:
根据所述AR教育学习需求选定学习关键词;Select learning keywords according to the AR education learning needs;
通过选定的学习关键词执行在当前播放的目标视频的目标播放位置标记学习关键词的步骤。The step of marking the learning keywords at the target playback position of the currently playing target video is performed through the selected learning keywords.
在一些实施方式中,所述在当前播放的目标视频的目标播放位置标记学习关键词的步骤之前,还包括:In some embodiments, before the step of marking the learning keyword at the target playback position of the currently playing target video, the method further includes:
根据已选定的所述学习关键词确定登记位置;Determine the registration location according to the selected learning keywords;
通过选定的所述学习关键词及已确定的登记位置执行在当前播放的目标视频的目标播放位置标记学习关键词的步骤。The step of marking the learning keyword at the target playback position of the currently playing target video is performed by the selected learning keyword and the determined registration position.
此外,为实现上述目的,本申请还提供智能电视,所述智能电视包括:In addition, to achieve the above purpose, the present application also provides a smart TV, the smart TV includes:
判断模块,设置为在播放目标视频时,确认所述目标视频的学习关键词所在位置;The judgment module is set to confirm the location of the learning keywords of the target video when playing the target video;
获取模块,设置为若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频;The acquisition module is set to pause the playback of the target video and acquire the AR educational video corresponding to the learning keyword if the current playback position of the target video is the location of the learning keyword;
播放模块,设置为播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息;A playback module, configured to play the acquired AR education video and receive user learning information based on the AR education video;
确认模块,设置为在确认接收到的所述用户的学习信息正确时,恢复所述目标视频的播放。The confirmation module is configured to resume playing the target video when confirming that the received learning information of the user is correct.
本申请还提供一种存储介质,所述存储介质存储有基于视频的AR教育程序,所述基于视频的AR教育程序执行时包括如下步骤:The present application also provides a storage medium that stores a video-based AR education program, and the video-based AR education program includes the following steps when executed:
在播放目标视频时,确认所述目标视频的学习关键词所在位置;When playing the target video, confirm the location of the learning keywords of the target video;
若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频If the current playback position of the target video is the location of the learning keyword, pause the playback of the target video and obtain the AR educational video corresponding to the learning keyword
播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息;Play the acquired AR education video, and receive user learning information based on the AR education video;
在确认接收到的所述用户的学习信息正确时,恢复所述目标视频的播放。When it is confirmed that the received learning information of the user is correct, the playback of the target video is resumed.
本申请还提供一种基于视频的AR教育设备,所述基于视频的AR教育设备包括存储器、处理器及存储在存储器上并可在处理器上运行的基于视频的AR教育程序,所述基于视频的AR教育程序执行时包括如下的步骤:The present application also provides a video-based AR education device. The video-based AR education device includes a memory, a processor, and a video-based AR education program stored on the memory and executable on the processor. The implementation of the AR education program includes the following steps:
在播放目标视频时,确认所述目标视频的学习关键词所在位置;When playing the target video, confirm the location of the learning keywords of the target video;
若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频If the current playback position of the target video is the position of the learning keyword, pause the playback of the target video and obtain the AR educational video corresponding to the learning keyword
播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息;Play the acquired AR education video, and receive user learning information based on the AR education video;
在确认接收到的所述用户的学习信息正确时,恢复所述目标视频的播放。When it is confirmed that the received learning information of the user is correct, the playback of the target video is resumed.
本申请实施例提出的一种基于视频的AR教育方法,在播放目标视频时,确认所述目标视频的学习关键词所在位置;若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频;播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息;在确认接收到的所述用户的学习信息正确时,恢复所述目标视频的播放。本申请通过在智能电视的视频中限定学习位置,并对应播放AR教育视频,使得用户通过当前播放视频即可完成AR教育视频,提高了AR教育在教育平台应用范围进而提高AR教育的应用效率。A video-based AR education method proposed in an embodiment of the present application confirms the location of the learning keywords of the target video when playing the target video; if the current playback position of the target video is the location of the learning keyword, pause the Play the target video and obtain the AR educational video corresponding to the learning keyword; play the acquired AR educational video and receive the user's learning information based on the AR educational video; after confirming the received user's When the learning information is correct, playback of the target video is resumed. In this application, by limiting the learning position in the video of the smart TV and correspondingly playing the AR education video, the user can complete the AR education video by playing the current video, which improves the application scope of AR education in the education platform and thus improves the application efficiency of AR education.
附图说明BRIEF DESCRIPTION
图1是本申请实施例方案涉及的硬件运行环境的终端\装置结构示意图;FIG. 1 is a schematic diagram of a terminal\device structure of a hardware operating environment involved in an embodiment of the present application;
图2为本申请基于视频的AR教育方法第一实施例的流程示意图;2 is a schematic flowchart of a first embodiment of a video-based AR education method of this application;
图3为本申请基于视频的AR教育方法第二实施例的流程示意图。FIG. 3 is a schematic flowchart of a second embodiment of a video-based AR education method of the present application.
本申请目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The implementation, functional characteristics and advantages of the present application will be further described in conjunction with the embodiments and with reference to the drawings.
具体实施方式detailed description
应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application.
本申请实施例的主要解决方案是:在播放目标视频时,确认所述目标视频的学习关键词所在位置;若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频;播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息;在确认接收到的所述用户的学习信息正确时,恢复所述目标视频的播放。The main solution of the embodiment of the present application is: when playing the target video, confirm the location of the learning keyword of the target video; if the current playback position of the target video is the location of the learning keyword, pause the playback of the target video and Obtain an AR education video corresponding to the learning keyword; play the acquired AR education video, and receive user learning information based on the AR education video; when confirming that the received user learning information is correct, Resume playback of the target video.
由于现有技术在将AR技术应用在教育行业时,一般需通过专业的终端设备配置相关的教育内容后实现,应用成本较高,且在配置相关的AR教育内容时,需复杂的配置过程,因此,基于现有技术的AR技术在教育平台上应用的限制,极大了降低了AR在教育平台的应用范围及应用效率。When applying the AR technology to the education industry in the prior art, it is generally required to configure relevant education content through professional terminal equipment, the application cost is relatively high, and when configuring the relevant AR education content, a complicated configuration process is required. Therefore, the limitation of the application of the AR technology on the education platform based on the existing technology greatly reduces the application scope and application efficiency of the AR on the education platform.
本申请提供一种解决方案,通过在智能电视的视频中限定学习位置,并对应播放AR教育视频,使得用户通过当前播放视频即可完成AR教育视频,提高了AR教育在教育平台应用范围进而提高AR教育的应用效率。This application provides a solution for limiting the learning position in the video of the smart TV and correspondingly playing the AR education video, so that the user can complete the AR education video by playing the current video, which increases the application scope of AR education in the education platform and thus improves Application efficiency of AR education.
如图1所示,图1是本申请实施例方案涉及的硬件运行环境的终端结构示意图。As shown in FIG. 1, FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment involved in a solution of an embodiment of the present application.
本申请实施例终端可以是PC,也可以是智能手机、平板电脑、电子书阅读器,便携计算机等可移动式或不可移动式终端设备。In this embodiment of the present application, the terminal may be a PC, or may be a mobile or non-removable terminal device such as a smart phone, a tablet computer, an e-book reader, and a portable computer.
如图1所示,该终端可以包括:处理器1001,例如CPU,网络接口1004,用户接口1003,存储器1005,通信总线1002。其中,通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard),可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1005可以是高速RAM存储器,也可以是稳定的存储器(non-volatile memory),例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。As shown in FIG. 1, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to implement connection communication between these components. The user interface 1003 may include a display (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as disk storage. The memory 1005 may optionally be a storage device independent of the foregoing processor 1001.
本领域技术人员可以理解,图1中示出的终端结构并不构成对终端的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Those skilled in the art may understand that the terminal structure shown in FIG. 1 does not constitute a limitation on the terminal, and may include more or fewer components than those illustrated, or combine certain components, or arrange different components.
如图1所示,作为一种计算机存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及基于视频的AR教育程序。As shown in FIG. 1, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a video-based AR education program.
在图1所示的终端中,网络接口1004主要用于连接后台服务器,与后台服务器进行数据通信;用户接口1003主要用于连接客户端(用户端),与客户端进行数据通信;而处理器1001可以用于调用存储器1005中存储的基于视频的AR教育程序,并执行以下操作:In the terminal shown in FIG. 1, the network interface 1004 is mainly used to connect to the background server and perform data communication with the background server; the user interface 1003 is mainly used to connect to the client (user side) and perform data communication with the client; and the processor 1001 can be used to call the video-based AR education program stored in the memory 1005 and perform the following operations:
在播放目标视频时,确认所述目标视频的学习关键词所在位置;When playing the target video, confirm the location of the learning keywords of the target video;
若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频;If the current playback position of the target video is the location of the learning keyword, pause the playback of the target video and obtain the AR educational video corresponding to the learning keyword;
播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息;Play the acquired AR education video, and receive user learning information based on the AR education video;
在确认接收到的所述用户的学习信息正确时,恢复所述目标视频的播放。When it is confirmed that the received learning information of the user is correct, the playback of the target video is resumed.
进一步地,处理器1001可以调用存储器1005中存储的基于视频的AR教育程序,还执行以下操作:Further, the processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
确认所述目标视频标记的学习关键词;Confirm the learning keywords of the target video tag;
在确认所述目标视频已标记学习关键词时,执行确认所述目标视频的学习关键词所在位置的步骤。When confirming that the target video has been marked with learning keywords, a step of confirming the location of the learning keywords of the target video is performed.
进一步地,处理器1001可以调用存储器1005中存储的基于视频的AR教育程序,还执行以下操作:Further, the processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
读取目标视频当前播放位置的视频帧信息,根据读取结果确认所述目标视频登记的学习关键词。Read the video frame information of the current playback position of the target video, and confirm the learning keywords registered in the target video according to the reading result.
进一步地,处理器1001可以调用存储器1005中存储的基于视频的AR教育程序,还执行以下操作:Further, the processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
确认登记学习关键词的视频帧所在位置;Confirm the location of the video frame where the learning keywords are registered;
将所述视频帧所在位置确认为目标播放位置。Confirm the location of the video frame as the target playback location.
进一步地,处理器1001可以调用存储器1005中存储的基于视频的AR教育程序,还执行以下操作:Further, the processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
读取目标视频当前播放位置的视频帧信息,确认标记学习关键词的视频帧所在位置;Read the video frame information of the current playback position of the target video and confirm the location of the video frame marked with the learning keywords;
若当前播放的视频帧已标记学习关键词,确认所述目标视频的当前播放位置为学习关键词所在位置。If the currently playing video frame has been marked with learning keywords, confirm that the current playing position of the target video is the position where the learning keywords are located.
进一步地,处理器1001可以调用存储器1005中存储的基于视频的AR教育程序,还执行以下操作:Further, the processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
所述已标记的学习关键词来源为所述目标视频的播放内容,以及与所述目标视频关联的其他媒体文件。The source of the marked learning keywords is the playback content of the target video and other media files associated with the target video.
进一步地,处理器1001可以调用存储器1005中存储的基于视频的AR教育程序,还执行以下操作:Further, the processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
读取已标记的所述学习关键词,在预设的教育视频存储区域获取与所述学习关键词对应的AR教育视频。Read the marked learning keywords, and obtain AR education videos corresponding to the learning keywords in a preset education video storage area.
进一步地,处理器1001可以调用存储器1005中存储的基于视频的AR教育程序,还执行以下操作:Further, the processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
根据所述学习关键词的读取结果为标识在预设的教育视频存储区域获取与所述学习关键词对应的AR教育视频。Obtain an AR education video corresponding to the learning keyword in a preset education video storage area according to the reading result of the learning keyword.
进一步地,处理器1001可以调用存储器1005中存储的基于视频的AR教育程序,还执行以下操作:Further, the processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
获取所述AR教育视频的预设学习方案,通过所述预设学习方案校验所述学习信息; Acquiring a preset learning plan of the AR education video, and verifying the learning information through the preset learning plan;
根据校验结果确认所述学习信息的学习情况。Confirm the learning situation of the learning information according to the verification result.
进一步地,处理器1001可以调用存储器1005中存储的基于视频的AR教育程序,还执行以下操作:Further, the processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
将所述学习信息与所述预设学习方案的学习信息验证条件比对;Comparing the learning information with the learning information verification conditions of the preset learning scheme;
在确认所述学习信息与所述学习信息验证条件一致时,确认所述学习信息正确。When it is confirmed that the learning information is consistent with the learning information verification conditions, it is confirmed that the learning information is correct.
进一步地,处理器1001可以调用存储器1005中存储的基于视频的AR教育程序,还执行以下操作:Further, the processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
在当前播放的目标视频的目标播放位置标记学习关键词;Mark learning keywords at the target playback position of the currently playing target video;
获取与所述学习关键词对应的AR教育视频,并将所述AR教育视频存储至预设的教育视频存储区域。Obtain an AR education video corresponding to the learning keyword, and store the AR education video to a preset education video storage area.
进一步地,处理器1001可以调用存储器1005中存储的基于视频的AR教育程序,还执行以下操作:Further, the processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
根据已标记的所述学习关键词创建基于AR教育学习的预设学习方案。Create a preset learning plan based on AR education learning based on the marked learning keywords.
进一步地,处理器1001可以调用存储器1005中存储的基于视频的AR教育程序,还执行以下操作:Further, the processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
在已创建的预设学习方案中添加学习信息验证条件。Add learning information verification conditions in the created preset learning plan.
进一步地,处理器1001可以调用存储器1005中存储的基于视频的AR教育程序,还执行以下操作:Further, the processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
接收AR教育学习需求,根据所述AR教育学习需求执行在当前播放的目标视频的目标播放位置标记学习关键词的步骤。The AR education learning requirement is received, and the step of marking learning keywords at the target playback position of the currently playing target video is performed according to the AR education learning requirement.
进一步地,处理器1001可以调用存储器1005中存储的基于视频的AR教育程序,还执行以下操作:Further, the processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
根据所述AR教育学习需求选定学习关键词;Select learning keywords according to the AR education learning needs;
通过选定的学习关键词执行在当前播放的目标视频的目标播放位置标记学习关键词的步骤。The step of marking the learning keywords at the target playback position of the currently playing target video is performed through the selected learning keywords.
进一步地,处理器1001可以调用存储器1005中存储的基于视频的AR教育程序,还执行以下操作:Further, the processor 1001 can call the video-based AR education program stored in the memory 1005, and also perform the following operations:
根据已选定的所述学习关键词确定登记位置;Determine the registration location according to the selected learning keywords;
通过选定的所述学习关键词及已确定的登记位置执行在当前播放的目标视频的目标播放位置标记学习关键词的步骤。The step of marking the learning keyword at the target playback position of the currently playing target video is performed by the selected learning keyword and the determined registration position.
参照图2,图2为本申请基于视频的AR教育方法第一实施例的流程示意图,所述基于视频的AR教育方法包括:Referring to FIG. 2, FIG. 2 is a schematic flowchart of a first embodiment of a video-based AR education method of the present application. The video-based AR education method includes:
步骤S10,在播放目标视频时,确认所述目标视频的学习关键词所在位置;Step S10, when playing the target video, confirm the location of the learning keyword of the target video;
在当前的智能电视播放视频时,以当前播放的视频为目标视频。基于所述目标视频的当前播放情况,检测所述目标视频中是否有已标记的学习关键词,所述学习关键词为基于当前播放目标视频中预先标记的基于AR教育操作的学习信息所在位置。其中,所述学习关键词可来自所述目标视频的播放内容;或者还可来自与所述目标视频关联的其他媒体文件等,其具体的已标记的学习关键词的内容,可基于当前的AR学习需求设定,并标记至所述目标视频的目标播放位置。其中,在所述目标视频的当前播放位置为已标记的学习关键词时,暂停播放所述目标视频。When playing a video on the current smart TV, the current video is used as the target video. Based on the current playing situation of the target video, it is detected whether there is a marked learning keyword in the target video, where the learning keyword is the location of the learning information based on the AR education operation pre-marked in the current playing target video. Wherein, the learning keywords may come from the playback content of the target video; or may also come from other media files associated with the target video, etc. The content of the specific marked learning keywords may be based on the current AR Learning needs setting and marking to the target playing position of the target video. Wherein, when the current playback position of the target video is the marked learning keyword, the playback of the target video is paused.
另外,在确认当前目标视频的当前播放位置是否为已标记的学习关键词时,可通过读取视频帧信息的方式实现,因此,所述在播放目标视频时,确认所述目标视频的学习关键词所在位置的步骤,包括:In addition, when confirming whether the current playback position of the current target video is the marked learning keyword, it can be achieved by reading the video frame information. Therefore, when playing the target video, the learning key of the target video is confirmed Steps where the word is located include:
读取目标视频当前播放位置的视频帧信息,确认标记学习关键词的视频帧所在位置;Read the video frame information of the current playback position of the target video and confirm the location of the video frame marked with the learning keywords;
若当前播放的视频帧已标记学习关键词,确认所述目标视频的当前播放位置为学习关键词所在位置。If the currently playing video frame has been marked with learning keywords, confirm that the current playing position of the target video is the position where the learning keywords are located.
在确认当前的播放视频是否存在已标记的学习关键词时,可通过识别当前播放视频的视频帧的方式确认。在当前的目标视频播放过程中,一一检查所述目标视频的视频帧,并将标记学习关键词的视频帧所在位置为目标播放位置,进而在确认所述目标视频的当前播放位置为所述目标播放位置时,暂停所述目标视频的播放。When confirming whether the currently playing video has marked learning keywords, it can be confirmed by identifying the video frame of the currently playing video. In the current target video playback process, check the video frames of the target video one by one, and mark the video frame of the learning keyword as the target playback position, and then confirm that the current playback position of the target video is the At the target playback position, the playback of the target video is paused.
步骤S20,若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频;Step S20, if the current playback position of the target video is the location of the learning keyword, pause the playback of the target video and obtain the AR educational video corresponding to the learning keyword;
在当前播放的目标视频暂停时,进入当前的AR学习操作。基于已标记的学习关键词的目标视频帧所在位置,获取与所述学习关键词对应的AR教育视频播放。其中,在获取与当前学习位置对应的AR教育视频时,其获取方式可通过识别所述目标视频帧中的学习关键词,以识别到的内容进行获取。When the currently playing target video is paused, enter the current AR learning operation. Based on the location of the target video frame of the marked learning keyword, an AR educational video playback corresponding to the learning keyword is obtained. Wherein, when acquiring the AR educational video corresponding to the current learning position, the acquisition method may be to acquire the identified content by identifying the learning keywords in the target video frame.
因此,在确认当前播放位置已标记学习关键词,即所述所述若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频的步骤,包括:Therefore, after confirming that the current playback position has been marked with the learning keyword, that is, if the current playback position of the target video is the position of the learning keyword, pause the playback of the target video and obtain the AR corresponding to the learning keyword The steps of educational video include:
读取已标记的所述学习关键词,在预设的教育视频存储区域获取与所述学习关键词对应的AR教育视频。Read the marked learning keywords, and obtain AR education videos corresponding to the learning keywords in a preset education video storage area.
根据目标视频中已确认标记有学习关键词的目标视频帧,识别所述目标视频帧的帧信息中标记的学习关键词,并以所述学习关键词为条件在预设的教育视频存储区域获取与所述学习关键词对应的AR教育视频。所述预设的教育视频存储区域为已定义的存储AR教育视频的数据存储区域,且所述预设的教育视频存储区域在存储所述AR教育视频时,以所述AR教育视频的内容为标识存储,以便通过学习位置对应获取播放。According to the target video frame in the target video that has been marked with the learning keyword, identify the learning keyword marked in the frame information of the target video frame, and obtain it in the preset educational video storage area under the condition of the learning keyword AR educational videos corresponding to the learning keywords. The preset educational video storage area is a defined data storage area for storing AR educational videos, and when the preset educational video storage area stores the AR educational video, the content of the AR educational video is The logo is stored so that it can be played by learning the location correspondence
步骤S30,播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息;Step S30: Play the acquired AR educational video, and receive user learning information based on the AR educational video;
步骤S40,在确认接收到的所述用户的学习信息正确时,恢复所述目标视频的播放。Step S40, when it is confirmed that the received learning information of the user is correct, the playback of the target video is resumed.
基于当前的AR学习操作,在获取到的AR教育视频后播放所述AR教育视频。通过当前已播放的AR教育视频,接收所述AR教育视频对应的学习信息,所述学习信息是基于当前播放的AR教育视频使用户执行当前的AR学习操作发起的。因此,所述学习信息与所述AR教育视频的视频内容相关。Based on the current AR learning operation, the AR education video is played after the acquired AR education video. Receive the learning information corresponding to the AR education video through the currently played AR education video, and the learning information is initiated based on the currently played AR education video to enable the user to perform the current AR learning operation. Therefore, the learning information is related to the video content of the AR educational video.
如此,根据接收到的学习信息,还需获取对应的学习方案验证接收到的学习信息,因此,所述播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息的步骤之后,还包括:In this way, according to the received learning information, it is also necessary to obtain the corresponding learning plan to verify the received learning information. Therefore, the acquired AR educational video is played, and the user’s learning information based on the AR educational video is received. After the steps, it also includes:
获取所述AR教育视频的预设学习方案,通过所述预设学习方案校验所述学习信息; Acquiring a preset learning plan of the AR education video, and verifying the learning information through the preset learning plan;
根据校验结果确认所述学习信息的学习情况。Confirm the learning situation of the learning information according to the verification result.
基于当前播放的AR教育视频,获取预设学习方案。以获取到的所述预设的学习方案校验接收到的学习信息是否正确。所述预设学习方案与当前的AR学习操作的学习内容相关。在实际应用中,可通过当前播放的AR视频播放对应设定预设学习方案,且所述预设学习方案包括但不限于语音学习、动作学习以及重复播放所述AR教育视频等学习内容。如此,由于学习方案的多变性,其获取到的用户学习方案可匹配获取到的预设学习方案进行校验,不同预设学习方案在校验学习信息时,其校验方式都存在差异,例如预设学习方案为语音学习时,获取到的学习信息为语音学习信息,在通过预设学习方案校验接收到的所述语音学习信息时,可解析所述语音学习信息确认所述学习信息是否正确。Based on the currently playing AR education video, obtain a preset learning plan. Verify whether the received learning information is correct with the acquired preset learning scheme. The preset learning scheme is related to the learning content of the current AR learning operation. In practical applications, a preset learning scheme may be correspondingly set through the currently playing AR video playback, and the preset learning scheme includes but is not limited to voice learning, action learning, and repeatedly playing the AR educational video and other learning content. In this way, due to the variability of the learning schemes, the user learning schemes obtained can be matched with the acquired preset learning schemes for verification. Different preset learning schemes have different verification methods when verifying the learning information, for example When the preset learning scheme is voice learning, the acquired learning information is voice learning information. When checking the received voice learning information through the preset learning scheme, the voice learning information may be parsed to confirm whether the learning information is correct.
另外,考虑到预设学习方案的多样性,在以预设学习方案校验学习信息时,可通过所述预设学习方案中以设定的学习信息验证条件进行学习信息的校验操作,如此,所述获取所述AR教育视频的预设学习方案,通过所述预设学习方案校验所述学习信息的步骤,包括:In addition, considering the diversity of the preset learning scheme, when the learning information is verified with the preset learning scheme, the learning information can be verified through the preset learning information verification conditions in the preset learning scheme. The step of acquiring the preset learning plan of the AR education video and verifying the learning information through the preset learning plan includes:
将所述学习信息与所述预设学习方案的学习信息验证条件比对;Comparing the learning information with the learning information verification conditions of the preset learning scheme;
在确认所述学习信息与所述学习信息验证条件一致时,确认所述学习信息正确。When it is confirmed that the learning information is consistent with the learning information verification conditions, it is confirmed that the learning information is correct.
根据当前AR学习操作的预设学习方案,在以所述预设学习方案校验接收到的学习信息时,可通过所述预设学习方案中已设定的学习信息验证条件进行校验操作。考虑到校验操作,所述学习验证条件可基于预设学习方案单独设定,例如,在所述预设学习方案为语音学习时,接收用户的语音学习信息,通过所述学习信息验证条件校验接收到的语音学习信息是否正确。其具体的校验操作,所述学习验证条件可为语音读取功能,读取接收到的语音学习信息,并将读取到的语音学习信息与所述AR教育视频的语音信息进行比对,根据比对结果确认接收到的语音学习信息是否正确。进一步的,若是所述学习信息为语音学习信息时,在接收所述语音学习信息时,由于环境声音的原因,可能会对语音学习信息的接收造成干扰而导致不能获取到有效的语音学习信息。此种情况下,还可发出语音提醒信息,以提醒用户重新发起语音学习信息;另外,基于当前播放的AR教育视频,其具体的学习信息验证条件与当前的预设的学习方案相关,具体的由相关的技术人员设定。According to the preset learning scheme of the current AR learning operation, when the received learning information is verified with the preset learning scheme, the verification operation may be performed through the learning information verification conditions that have been set in the preset learning scheme. Considering the verification operation, the learning verification conditions may be individually set based on a preset learning scheme. For example, when the preset learning scheme is voice learning, the user’s voice learning information is received, and the learning condition is verified by the learning information. Verify that the received voice learning information is correct. For the specific verification operation, the learning verification condition may be a voice reading function, read the received voice learning information, and compare the read voice learning information with the voice information of the AR educational video, Confirm whether the received voice learning information is correct according to the comparison result. Further, if the learning information is voice learning information, when receiving the voice learning information, due to environmental sounds, the reception of the voice learning information may be interfered and effective voice learning information may not be obtained. In this case, a voice reminder message can also be issued to remind the user to re-initiate voice learning information; in addition, based on the currently playing AR education video, the specific learning information verification conditions are related to the current preset learning program, specific Set by relevant technicians.
在确认接收到的学习信息正确时,确认当前的AR教育操作结束,恢复当前暂停的目标视频的播放。When confirming that the received learning information is correct, confirm that the current AR education operation is ended, and resume the playback of the currently paused target video.
本实施例中,通过在智能电视的视频中限定学习位置,并对应播放AR教育视频,使得用户通过当前播放视频即可完成AR教育视频,提高了AR教育在教育平台应用范围进而提高AR教育的应用效率。In this embodiment, by limiting the learning position in the video of the smart TV and correspondingly playing the AR education video, the user can complete the AR education video through the current playback video, which increases the application range of AR education in the education platform and thus improves the AR education. Application efficiency.
参照图3,图3为本申请基于视频的AR教育方法第二实施例的流程示意图,基于上图所示的第一实施例,所述基于视频的AR教育方法包括:Referring to FIG. 3, FIG. 3 is a schematic flowchart of a second embodiment of a video-based AR education method of the present application. Based on the first embodiment shown in the above figure, the video-based AR education method includes:
步骤S40,在当前播放的目标视频的目标播放位置标记学习关键词;Step S40: Mark learning keywords at the target playback position of the currently playing target video;
步骤S50,获取与所述学习关键词对应的AR教育视频,并将所述AR教育视频存储至预设的教育视频存储区域。Step S50: Obtain an AR education video corresponding to the learning keyword, and store the AR education video to a preset education video storage area.
本实施例中,在确认当前的智能电视能够支持AR教育操作时,设定当前AR教育学习操作的操作内容,其具体的操作内容包括但不限于在目标视频的目标播放位置标记学习关键词、存储对应的AR教育视频、设定学习方案以及设定对应的学习信息验证条件等。因此,在实现AR教育时,可在已选定的目标视频中标记当前AR学习操作的学习关键词。其中,考虑到学习严谨及降低娱乐性的问题,可选取具有学习信息的视频作为目标视频,且不同的AR学习目标可对应选取不同类型的视频作为所述目标视频,其具体的应用方式可通过相关技术人员完成。在已确认的目标视频的视频帧中选定学习关键词进行标记。其中,所述学习关键词可根据当前AR教育需求选定,例如可在目标视频中以具备学习条件的英文字母、汉字、计算公式或者体育动作等视频帧作为所述AR学习的位置的标记处。In this embodiment, when confirming that the current smart TV can support the AR education operation, the operation content of the current AR education learning operation is set, and the specific operation content includes but is not limited to marking the learning keyword at the target playback position of the target video, Store corresponding AR education videos, set learning plans, and set corresponding learning information verification conditions. Therefore, when implementing AR education, the learning keywords of the current AR learning operation can be marked in the selected target video. Among them, considering the problems of rigorous learning and reducing entertainment, videos with learning information can be selected as the target video, and different AR learning targets can correspondingly select different types of videos as the target video. The specific application method can be adopted by Relevant technical personnel completed. Select the learning keywords in the video frame of the confirmed target video to mark. The learning keywords can be selected according to current AR education needs. For example, in the target video, video frames with English letters, Chinese characters, calculation formulas, or sports actions that meet the learning conditions can be used as markers of the AR learning position .
如上所述,在当前的目标视频中标记学习关键词后,还需设定对应的学习方案以及学习信息验证条件,所述基于视频的AR教育方法,还包括:As mentioned above, after marking the learning keywords in the current target video, it is necessary to set the corresponding learning scheme and the learning information verification conditions. The video-based AR education method further includes:
根据已标记的所述学习关键词创建基于AR教育学习的预设学习方案;Create a preset learning plan based on AR education learning based on the marked learning keywords;
在已创建的预设学习方案中添加学习信息验证条件。Add learning information verification conditions in the created preset learning plan.
在确认当前的智能电视能够支持AR教育操作时,设定基于当前AR教育操作的预设学习方案,所述预设学习方案包括但不限于语音学习、动作学习以及重复播放等。并且,在设定当前的学习方案时,可设定基于单次或多次AR学习操作的学习方案,进一步的,根据已设定的学习方案设定对应的学习信息验证条件,用以验证基于当前播放的AR教育视频的学习信息进而实现基于电视平台的AR教育操作,提高AR技术在教育平台上的推广。其设定的预设学习方案可基于当前单次的AR教育视频设定对应的预设学习方案;或者,还可设定单个终端的AR教育需求的预设学习方案,其预设学习方案的应用范围可自定义或者根据提供的预设学习方案的相关设定条件确定所述预设学习方案的应用范围。When confirming that the current smart TV can support the AR education operation, a preset learning scheme based on the current AR education operation is set, and the preset learning scheme includes, but is not limited to, voice learning, motion learning, and repeated playback. In addition, when setting the current learning plan, a learning plan based on single or multiple AR learning operations can be set. Further, the corresponding learning information verification conditions are set according to the set learning plan to verify based on The learning information of the currently broadcast AR education video further realizes the AR education operation based on the TV platform, and improves the promotion of the AR technology on the education platform. The preset learning plan can be set based on the current single AR education video corresponding to the preset learning plan; or, a preset learning plan for the AR education needs of a single terminal can be set. The application range can be customized or the application range of the preset learning scheme can be determined according to the related setting conditions of the provided preset learning scheme.
此外,本申请实施例还提出一种存储介质,所述存储介质上存储有基于视频的AR教育程序,所述基于视频的AR教育程序被处理器执行时实现如下操作:In addition, an embodiment of the present application further provides a storage medium on which a video-based AR education program is stored, and when the video-based AR education program is executed by a processor, the following operations are implemented:
在播放目标视频时,确认所述目标视频的学习关键词所在位置;When playing the target video, confirm the location of the learning keywords of the target video;
若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频;If the current playback position of the target video is the location of the learning keyword, pause the playback of the target video and obtain the AR educational video corresponding to the learning keyword;
播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息;Play the acquired AR education video, and receive user learning information based on the AR education video;
在确认接收到的所述用户的学习信息正确时,恢复所述目标视频的播放。When it is confirmed that the received learning information of the user is correct, the playback of the target video is resumed.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
确认所述目标视频标记的学习关键词;Confirm the learning keywords of the target video tag;
在确认所述目标视频已标记学习关键词时,执行确认所述目标视频的学习关键词所在位置的步骤。When confirming that the target video has been marked with learning keywords, a step of confirming the location of the learning keywords of the target video is performed.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
读取目标视频当前播放位置的视频帧信息,根据读取结果确认所述目标视频登记的学习关键词。Read the video frame information of the current playback position of the target video, and confirm the learning keywords registered in the target video according to the reading result.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
确认登记学习关键词的视频帧所在位置;Confirm the location of the video frame where the learning keywords are registered;
将所述视频帧所在位置确认为目标播放位置。Confirm the location of the video frame as the target playback location.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
读取目标视频当前播放位置的视频帧信息,确认标记学习关键词的视频帧所在位置;Read the video frame information of the current playback position of the target video and confirm the location of the video frame marked with the learning keywords;
若当前播放的视频帧已标记学习关键词,确认所述目标视频的当前播放位置为学习关键词所在位置。If the currently playing video frame has been marked with learning keywords, confirm that the current playing position of the target video is the position where the learning keywords are located.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
所述已标记的学习关键词来源为所述目标视频的播放内容,以及与所述目标视频关联的其他媒体文件。The source of the marked learning keywords is the playback content of the target video and other media files associated with the target video.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
读取已标记的所述学习关键词,在预设的教育视频存储区域获取与所述学习关键词对应的AR教育视频。Read the marked learning keywords, and obtain AR education videos corresponding to the learning keywords in a preset education video storage area.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
根据所述学习关键词的读取结果为标识在预设的教育视频存储区域获取与所述学习关键词对应的AR教育视频。Obtain an AR education video corresponding to the learning keyword in a preset education video storage area according to the reading result of the learning keyword.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
根据所述学习关键词的读取结果为标识在预设的教育视频存储区域获取与所述学习关键词对应的AR教育视频。Obtain an AR education video corresponding to the learning keyword in a preset education video storage area according to the reading result of the learning keyword.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
所述预设学习方案包括语音学习、动作学习以及重复播放所述AR教育视频。The preset learning scheme includes voice learning, action learning, and repeatedly playing the AR education video.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
将所述学习信息与所述预设学习方案的学习信息验证条件比对;Comparing the learning information with the learning information verification conditions of the preset learning scheme;
在确认所述学习信息与所述学习信息验证条件一致时,确认所述学习信息正确。When it is confirmed that the learning information is consistent with the learning information verification conditions, it is confirmed that the learning information is correct.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
在当前播放的目标视频的目标播放位置标记学习关键词;Mark learning keywords at the target playback position of the currently playing target video;
获取与所述学习关键词对应的AR教育视频,并将所述AR教育视频存储至预设的教育视频存储区域。Obtain an AR education video corresponding to the learning keyword, and store the AR education video to a preset education video storage area.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
根据已标记的所述学习关键词创建基于AR教育学习的预设学习方案。Create a preset learning plan based on AR education learning based on the marked learning keywords.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
在已创建的预设学习方案中添加学习信息验证条件。Add learning information verification conditions in the created preset learning plan.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
接收AR教育学习需求,根据所述AR教育学习需求执行在当前播放的目标视频的目标播放位置标记学习关键词的步骤。The AR education learning requirement is received, and the step of marking learning keywords at the target playback position of the currently playing target video is performed according to the AR education learning requirement.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
根据所述AR教育学习需求选定学习关键词;Select learning keywords according to the AR education learning needs;
通过选定的学习关键词执行在当前播放的目标视频的目标播放位置标记学习关键词的步骤。The step of marking the learning keywords at the target playback position of the currently playing target video is performed through the selected learning keywords.
进一步地,所述基于视频的AR教育程序被处理器执行时还实现如下操作:Further, when the video-based AR education program is executed by the processor, the following operations are also implemented:
根据已选定的所述学习关键词确定登记位置;Determine the registration location according to the selected learning keywords;
通过选定的所述学习关键词及已确定的登记位置执行在当前播放的目标视频的目标播放位置标记学习关键词的步骤。The step of marking the learning keyword at the target playback position of the currently playing target video is performed by the selected learning keyword and the determined registration position.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、药品或者系统不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、药品或者系统所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、药品或者系统中还存在另外的相同要素。It should be noted that in this article, the terms "include", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, drug or system that includes a series of elements includes not only those elements, It also includes other elements that are not explicitly listed, or include elements inherent to this process, method, drug, or system. In the absence of more restrictions, the element defined by the sentence "include a..." does not exclude that there are other identical elements in the process, method, medicine or system that includes the element.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The sequence numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本申请各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus the necessary general hardware platform, and of course, can also be implemented by hardware, but in many cases the former is better Implementation. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or a part that contributes to the existing technology, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above , Magnetic disks, optical disks), including several instructions to enable a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to perform the method described in each embodiment of the present application.
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above are only the preferred embodiments of the present application, and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made by using the description and drawings of this application, or directly or indirectly used in other related technical fields , The same reason is included in the scope of patent protection in this application.

Claims (20)

  1. 一种基于视频的AR教育方法,其中,所述基于视频的AR教育方法包括以下步骤: A video-based AR education method, wherein the video-based AR education method includes the following steps:
    在播放目标视频时,确认所述目标视频的学习关键词所在位置;When playing the target video, confirm the location of the learning keywords of the target video;
    若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频;If the current playback position of the target video is the location of the learning keyword, pause the playback of the target video and obtain the AR educational video corresponding to the learning keyword;
    播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息;Play the acquired AR education video, and receive user learning information based on the AR education video;
    在确认接收到的所述用户的学习信息正确时,恢复所述目标视频的播放。When it is confirmed that the received learning information of the user is correct, the playback of the target video is resumed.
  2. 如权利要求1所述的基于视频的AR教育方法,其中,所述在播放目标视频时,确认所述目标视频的学习关键词所在位置的步骤之前,还包括:The video-based AR education method according to claim 1, wherein before the step of confirming the location of the learning keyword of the target video when playing the target video, further comprising:
    确认所述目标视频标记的学习关键词;Confirm the learning keywords of the target video tag;
    在确认所述目标视频已标记学习关键词时,执行确认所述目标视频的学习关键词所在位置的步骤。When confirming that the target video has been marked with learning keywords, a step of confirming the location of the learning keywords of the target video is performed.
  3. 如权利要求2所述的基于视频的AR教育方法,其中,所述确认所述目标视频标记的学习关键词的步骤,包括:The video-based AR education method according to claim 2, wherein the step of confirming the learning keyword marked by the target video includes:
    读取目标视频当前播放位置的视频帧信息,根据读取结果确认所述目标视频登记的学习关键词。Read the video frame information of the current playback position of the target video, and confirm the learning keywords registered in the target video according to the reading result.
  4. 如权利要求3所述的基于视频的AR教育方法,其中,所述读取目标视频当前播放位置的视频帧信息,根据读取结果确认所述目标视频登记的学习关键词的步骤之后,还包括:The video-based AR education method according to claim 3, wherein after the step of reading the video frame information of the current playback position of the target video and confirming the learning keywords registered with the target video according to the reading result, further comprising :
    确认登记学习关键词的视频帧所在位置;Confirm the location of the video frame where the learning keywords are registered;
    将所述视频帧所在位置确认为目标播放位置。Confirm the location of the video frame as the target playback location.
  5. 如权利要求1所述的基于视频的AR教育方法,其特征在于,所述在播放目标视频时,确认所述目标视频的学习关键词所在位置的步骤,包括:The video-based AR education method according to claim 1, wherein the step of confirming the location of the learning keywords of the target video when playing the target video includes:
    读取目标视频当前播放位置的视频帧信息,确认标记学习关键词的视频帧所在位置;Read the video frame information of the current playback position of the target video and confirm the location of the video frame marked with the learning keywords;
    若当前播放的视频帧已标记学习关键词,确认所述目标视频的当前播放位置为学习关键词所在位置。If the currently playing video frame has been marked with learning keywords, confirm that the current playing position of the target video is the position where the learning keywords are located.
  6. 如权利要求1所述的基于视频的AR教育方法,其中,所述已标记的学习关键词来源为所述目标视频的播放内容,以及与所述目标视频关联的其他媒体文件。The video-based AR education method according to claim 1, wherein the source of the marked learning keywords is the playback content of the target video and other media files associated with the target video.
  7. 如权利要求1所述的基于视频的AR教育方法,其中,所述若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频的步骤,包括:The video-based AR education method according to claim 1, wherein if the current playback position of the target video is where the learning keyword is located, pause the playback of the target video and obtain the AR corresponding to the learning keyword The steps of educational video include:
    读取已标记的所述学习关键词,在预设的教育视频存储区域获取与所述学习关键词对应的AR教育视频。Read the marked learning keywords, and obtain AR education videos corresponding to the learning keywords in a preset education video storage area.
  8. 如权利要求7所述的基于视频的AR教育方法,其中,所述读取已标记的所述学习关键词,在预设的教育视频存储区域获取与所述学习关键词对应的AR教育视频的步骤,包括:The video-based AR education method according to claim 7, wherein the reading of the marked learning keywords is acquired, and the AR education video corresponding to the learning keywords is acquired in a preset education video storage area The steps include:
    根据所述学习关键词的读取结果为标识在预设的教育视频存储区域获取与所述学习关键词对应的AR教育视频。Obtain an AR education video corresponding to the learning keyword in a preset education video storage area according to the reading result of the learning keyword.
  9. 如权利要求1所述的基于视频的AR教育方法,其中,所述播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息的步骤之后,还包括:The video-based AR education method according to claim 1, wherein after the step of playing the acquired AR education video and receiving user learning information based on the AR education video, the method further comprises:
    获取所述AR教育视频的预设学习方案,通过所述预设学习方案校验所述学习信息; Acquiring a preset learning plan of the AR education video, and verifying the learning information through the preset learning plan;
    根据校验结果确认所述学习信息的学习情况。Confirm the learning situation of the learning information according to the verification result.
  10. 如权利要求9所述的基于视频的AR教育方法,其中,所述预设学习方案包括语音学习、动作学习以及重复播放所述AR教育视频。The video-based AR education method according to claim 9, wherein the preset learning scheme includes voice learning, action learning, and repeatedly playing the AR education video.
  11. 如权利要求9所述的基于视频的AR教育方法,其中,所述获取所述AR教育视频的预设学习方案,通过所述预设学习方案校验所述学习信息的步骤,包括:The video-based AR education method according to claim 9, wherein the step of acquiring a preset learning scheme of the AR education video and verifying the learning information through the preset learning scheme includes:
    将所述学习信息与所述预设学习方案的学习信息验证条件比对;Comparing the learning information with the learning information verification conditions of the preset learning scheme;
    在确认所述学习信息与所述学习信息验证条件一致时,确认所述学习信息正确。When it is confirmed that the learning information is consistent with the learning information verification conditions, it is confirmed that the learning information is correct.
  12. 如权利要求1所述的基于视频的AR教育方法,其中,所述基于视频的AR教育方法,还包括:The video-based AR education method according to claim 1, wherein the video-based AR education method further comprises:
    在当前播放的目标视频的目标播放位置标记学习关键词;Mark learning keywords at the target playback position of the currently playing target video;
    获取与所述学习关键词对应的AR教育视频,并将所述AR教育视频存储至预设的教育视频存储区域。 Obtain an AR education video corresponding to the learning keyword, and store the AR education video to a preset education video storage area.
  13. 如权利要求12所述的基于视频的AR教育方法,其中,所述在当前播放的目标视频的目标播放位置标记学习关键词的步骤之后,还包括:The video-based AR education method according to claim 12, wherein after the step of marking the learning keyword at the target playback position of the currently playing target video, further comprising:
    根据已标记的所述学习关键词创建基于AR教育学习的预设学习方案。Create a preset learning plan based on AR education learning based on the marked learning keywords.
  14. 如权利要求13所述的基于视频的AR教育方法,其中,所述根据已标记的所述学习关键词创建基于AR教育学习的预设学习方案的步骤之后,还包括:The video-based AR education method according to claim 13, wherein after the step of creating a preset learning scheme based on the AR education learning based on the marked learning keywords, further comprising:
    在已创建的预设学习方案中添加学习信息验证条件。Add learning information verification conditions in the created preset learning plan.
  15. 如权利要求12所述的基于视频的AR教育方法,其中,所述在当前播放的目标视频的目标播放位置标记学习关键词的步骤之前,还包括:The video-based AR education method according to claim 12, wherein before the step of marking the learning keyword at the target playback position of the currently playing target video, further comprising:
    接收AR教育学习需求,根据所述AR教育学习需求执行在当前播放的目标视频的目标播放位置标记学习关键词的步骤。The AR education learning requirement is received, and the step of marking learning keywords at the target playback position of the currently playing target video is performed according to the AR education learning requirement.
  16. 如权利要求12所述的基于视频的AR教育方法,其中,所述在当前播放的目标视频的目标播放位置标记学习关键词的步骤之前,还包括:The video-based AR education method according to claim 12, wherein before the step of marking the learning keyword at the target playback position of the currently playing target video, further comprising:
    根据所述AR教育学习需求选定学习关键词;Select learning keywords according to the AR education learning needs;
    通过选定的学习关键词执行在当前播放的目标视频的目标播放位置标记学习关键词的步骤。The step of marking the learning keywords at the target playback position of the currently playing target video is performed through the selected learning keywords.
  17. 如权利要求12所述的基于视频的AR教育方法,其中,所述在当前播放的目标视频的目标播放位置标记学习关键词的步骤之前,还包括:The video-based AR education method according to claim 12, wherein before the step of marking the learning keyword at the target playback position of the currently playing target video, further comprising:
    根据已选定的所述学习关键词确定登记位置;Determine the registration location according to the selected learning keywords;
    通过选定的所述学习关键词及已确定的登记位置执行在当前播放的目标视频的目标播放位置标记学习关键词的步骤。The step of marking the learning keyword at the target playback position of the currently playing target video is performed by the selected learning keyword and the determined registration position.
  18. 一种智能电视,其中,所述智能电视包括:A smart TV, wherein the smart TV includes:
    判断模块,设置为在播放目标视频时,确认所述目标视频的学习关键词所在位置;The judgment module is set to confirm the location of the learning keywords of the target video when playing the target video;
    获取模块,设置为若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频;The acquisition module is set to pause the playback of the target video and acquire the AR educational video corresponding to the learning keyword if the current playback position of the target video is the location of the learning keyword;
    播放模块,设置为播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息;A playback module, configured to play the acquired AR education video and receive user learning information based on the AR education video;
    确认模块,设置为在确认接收到的所述用户的学习信息正确时,恢复所述目标视频的播放。The confirmation module is configured to resume playing the target video when confirming that the received learning information of the user is correct.
  19. 一种存储介质,其中,所述存储介质存储有基于视频的AR教育程序,所述基于视频的AR教育程序执行时包括如下步骤:A storage medium, wherein the storage medium stores a video-based AR education program, and the video-based AR education program includes the following steps when executed:
    在播放目标视频时,确认所述目标视频的学习关键词所在位置;When playing the target video, confirm the location of the learning keywords of the target video;
    若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频If the current playback position of the target video is the location of the learning keyword, pause the playback of the target video and obtain the AR educational video corresponding to the learning keyword
    播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息;Play the acquired AR education video, and receive user learning information based on the AR education video;
    在确认接收到的所述用户的学习信息正确时,恢复所述目标视频的播放。When it is confirmed that the received learning information of the user is correct, the playback of the target video is resumed.
  20. 一种基于视频的AR教育设备,其中,所述基于视频的AR教育设备包括存储器、处理器及存储在存储器上并可在处理器上运行的基于视频的AR教育程序,所述基于视频的AR教育程序执行时包括如下的步骤:A video-based AR education device, wherein the video-based AR education device includes a memory, a processor, and a video-based AR education program stored on the memory and executable on the processor, the video-based AR education program The implementation of educational procedures includes the following steps:
    在播放目标视频时,确认所述目标视频的学习关键词所在位置;When playing the target video, confirm the location of the learning keywords of the target video;
    若目标视频的当前播放位置为学习关键词所在位置,暂停所述目标视频的播放并获取与所述学习关键词对应的AR教育视频If the current playback position of the target video is the location of the learning keyword, pause the playback of the target video and obtain the AR educational video corresponding to the learning keyword
    播放获取到的所述AR教育视频,并接收用户基于所述AR教育视频的学习信息;Play the acquired AR education video, and receive user learning information based on the AR education video;
    在确认接收到的所述用户的学习信息正确时,恢复所述目标视频的播放。 When it is confirmed that the received learning information of the user is correct, the playback of the target video is resumed.
PCT/CN2019/122208 2018-12-05 2019-11-29 Video-based ar education method, smart television, storage medium, and device WO2020114333A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811484871.X 2018-12-05
CN201811484871.XA CN109543072B (en) 2018-12-05 2018-12-05 Video-based AR education method, smart television, readable storage medium and system

Publications (1)

Publication Number Publication Date
WO2020114333A1 true WO2020114333A1 (en) 2020-06-11

Family

ID=65853020

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/122208 WO2020114333A1 (en) 2018-12-05 2019-11-29 Video-based ar education method, smart television, storage medium, and device

Country Status (2)

Country Link
CN (1) CN109543072B (en)
WO (1) WO2020114333A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112116981A (en) * 2020-09-02 2020-12-22 杭州憶盛医疗科技有限公司 Rehabilitation training method, device and system based on artificial intelligence and storage medium

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109543072B (en) * 2018-12-05 2022-04-22 深圳Tcl新技术有限公司 Video-based AR education method, smart television, readable storage medium and system
CN113436478A (en) * 2021-06-22 2021-09-24 读书郎教育科技有限公司 System and method for assisting in word-back in combination with textbook content
CN115001710B (en) * 2022-06-01 2024-06-25 山东福生佳信科技股份有限公司 Video playing request management method based on signature parameter update

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030198935A1 (en) * 2002-04-18 2003-10-23 Say-Yee Wen Real-time display method for interactive teaching
CN102833490A (en) * 2011-06-15 2012-12-19 新诺亚舟科技(深圳)有限公司 Method and system for editing and playing interactive video, and electronic learning device
CN103778809A (en) * 2014-01-24 2014-05-07 杨海 Automatic video learning effect testing method based on subtitles
CN108024139A (en) * 2017-12-08 2018-05-11 广州视源电子科技股份有限公司 Playback method, device, terminal device and the storage medium of Internet video courseware
CN109543072A (en) * 2018-12-05 2019-03-29 深圳Tcl新技术有限公司 AR educational method, smart television, readable storage medium storing program for executing and system based on video

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101226543A (en) * 2008-02-02 2008-07-23 金蝶软件(中国)有限公司 Multimedia learning system
CN104575132A (en) * 2015-01-14 2015-04-29 蝶恋花动漫(天津)有限公司 Interaction education method and system based on natural image recognition and reality augmentation technology
EP3391245A1 (en) * 2015-12-17 2018-10-24 Thomson Licensing Method and apparatus for remote parental control of content viewing in augmented reality settings
CN106792215A (en) * 2016-12-12 2017-05-31 福建天晴数码有限公司 Education video order method and its system
CN106899870A (en) * 2017-02-23 2017-06-27 任刚 A kind of VR contents interactive system and method based on intelligent television and mobile terminal
CN107240319B (en) * 2017-07-25 2019-04-02 深圳市鹰硕技术有限公司 A kind of interaction Scene Teaching system for the K12 stage
CN107515674B (en) * 2017-08-08 2018-09-04 山东科技大学 It is a kind of that implementation method is interacted based on virtual reality more with the mining processes of augmented reality
KR101881295B1 (en) * 2017-12-11 2018-07-24 (주)진명아이앤씨 Video system based on layer mixer using augmented reality

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030198935A1 (en) * 2002-04-18 2003-10-23 Say-Yee Wen Real-time display method for interactive teaching
CN102833490A (en) * 2011-06-15 2012-12-19 新诺亚舟科技(深圳)有限公司 Method and system for editing and playing interactive video, and electronic learning device
CN103778809A (en) * 2014-01-24 2014-05-07 杨海 Automatic video learning effect testing method based on subtitles
CN108024139A (en) * 2017-12-08 2018-05-11 广州视源电子科技股份有限公司 Playback method, device, terminal device and the storage medium of Internet video courseware
CN109543072A (en) * 2018-12-05 2019-03-29 深圳Tcl新技术有限公司 AR educational method, smart television, readable storage medium storing program for executing and system based on video

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112116981A (en) * 2020-09-02 2020-12-22 杭州憶盛医疗科技有限公司 Rehabilitation training method, device and system based on artificial intelligence and storage medium
CN112116981B (en) * 2020-09-02 2023-12-22 杭州憶盛医疗科技有限公司 Rehabilitation training method, device and system based on artificial intelligence and storage medium

Also Published As

Publication number Publication date
CN109543072B (en) 2022-04-22
CN109543072A (en) 2019-03-29

Similar Documents

Publication Publication Date Title
WO2020114333A1 (en) Video-based ar education method, smart television, storage medium, and device
WO2019216529A1 (en) Electronic apparatus and controlling method thereof
WO2010126205A1 (en) Method and apparatus for providing multiple online advertisements using location information of scroll bar
WO2018166091A1 (en) Method, system, and terminal for face-to-face loan signing, and computer-readable storage medium
WO2013151374A1 (en) Method and system for transfering data between plurality of devices
WO2022196956A1 (en) Deep-learning transformer translation system using triple corpus
WO2018048118A1 (en) Server and method for controlling external device
WO2014157903A1 (en) Method and device for displaying service page for executing application
WO2015016627A1 (en) Method and device for connecting single ap device among multiple ap devices on same network to terminal
WO2009134032A2 (en) Apparatus and method for providing broadcast contents in internet broadcast system
EP3241129A1 (en) User terminal, service providing apparatus, driving method of user terminal, driving method of service providing apparatus, and encryption indexing-based search system
WO2015026058A1 (en) Method, terminal, and system for reproducing content
WO2017126835A1 (en) Display apparatus and controlling method thereof
WO2018076865A1 (en) Data sharing method, device, storage medium, and electronic device
WO2011155703A2 (en) Content service method
WO2017131348A1 (en) Electronic apparatus and controlling method thereof
WO2018034491A1 (en) A primary device, an accessory device, and methods for processing operations on the primary device and the accessory device
WO2016129840A1 (en) Display apparatus and information providing method thereof
WO2021012481A1 (en) System performance monitoring method and apparatus, device, and storage medium
WO2020062615A1 (en) Gamma value adjustment method and apparatus for display panel, and display device
WO2019156408A1 (en) Electronic device and operation method thereof
WO2019184436A1 (en) Video pushing method and apparatus, and computer-readable storage medium
WO2022055160A1 (en) System and method for certifying genuine product through dualization of identification code and security serial number
WO2024112108A1 (en) Real-time drm-based video streaming system and video streaming method therefor
WO2020135022A1 (en) Display panel image optimization method and device and computer readable storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19892154

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19892154

Country of ref document: EP

Kind code of ref document: A1