CN113626013A - Method and device for automatic explanation of slides - Google Patents

Method and device for automatic explanation of slides Download PDF

Info

Publication number
CN113626013A
CN113626013A CN202110898884.7A CN202110898884A CN113626013A CN 113626013 A CN113626013 A CN 113626013A CN 202110898884 A CN202110898884 A CN 202110898884A CN 113626013 A CN113626013 A CN 113626013A
Authority
CN
China
Prior art keywords
current
text
explanation
script
read
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110898884.7A
Other languages
Chinese (zh)
Inventor
杨永志
徐世波
陈小卫
孙建
赵伟峰
柯宏发
王保顺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Peoples Liberation Army Strategic Support Force Aerospace Engineering University
Original Assignee
Peoples Liberation Army Strategic Support Force Aerospace Engineering University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Peoples Liberation Army Strategic Support Force Aerospace Engineering University filed Critical Peoples Liberation Army Strategic Support Force Aerospace Engineering University
Priority to CN202110898884.7A priority Critical patent/CN113626013A/en
Publication of CN113626013A publication Critical patent/CN113626013A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/30Creation or generation of source code
    • G06F8/31Programming languages or programming paradigms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/40Transformation of program code
    • G06F8/41Compilation
    • G06F8/42Syntactic analysis
    • G06F8/427Parsing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/065Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00Speech synthesis; Text to speech systems
    • G10L13/08Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Business, Economics & Management (AREA)
  • Acoustics & Sound (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The invention discloses an automatic explanation method and a device of a slide, wherein the method comprises the following steps: writing a current explanation script for a current slide to be explained in advance, wherein the current explanation script comprises: acquiring a current explanation script under the condition that a current text to be read and a current command to be executed are received and an automatic explanation request for the current slide to be explained is received; identifying the current explanation script, and determining the current text to be read and the current command to be executed in the current explanation script; and sequentially reading the current text to be read and executing the current command to be executed. In the process, the current explanation script is written for the current slide to be explained in advance, the reading of the text to be read aloud in the explanation script and the execution of the operation instruction corresponding to the command to be executed in the explanation script are completed, the corresponding function is realized based on the operation instruction, the automatic explanation of the slide to be explained is realized, and the learning of the related knowledge in the slide is completed.

Description

一种幻灯片的自动讲解方法及装置Method and device for automatic explanation of slides

技术领域technical field

本发明涉及数据处理技术领域,尤其涉及一种幻灯片的自动讲解方法及装置。The invention relates to the technical field of data processing, and in particular, to a method and device for automatic explanation of slides.

背景技术Background technique

翻转课堂译(Flipped Classroom或Inverted Classroom),也可译为“颠倒课堂”,是指重新调整课堂内外的时间,将学习的决定权从教师转移给学生。在这种教学模式下,课堂内的宝贵时间,学生能够更专注于主动的基于项目的学习,共同研究解决本地化或全球化的挑战以及其他现实世界面临的问题,从而获得更深层次的理解。教师不再占用课堂的时间来讲授相关知识,这些相关知识要学生在课前学习完成自主学习,由于传统的课堂采用电脑播放幻灯片、教员讲解的形式完成相关知识的传授。Flipped Classroom (Flipped Classroom or Inverted Classroom), which can also be translated as "Inverted Classroom", refers to readjusting the time inside and outside the classroom, and transferring the decision-making power of learning from teachers to students. In this teaching mode, the valuable time in the classroom, students can focus more on active project-based learning, work together to solve localization or globalization challenges and other real-world problems, so as to gain a deeper understanding. Teachers no longer occupy classroom time to teach relevant knowledge, which requires students to learn and complete independent learning before class. Because traditional classrooms use computers to play slides and teachers to explain relevant knowledge.

因此,亟需提供一种幻灯片的自动讲解方法帮助学生完成幻灯片中相关知识的学习,以此支持实现翻转课堂的形式:教员在自动讲解完后进行答疑并组织学员实际练习、操作。自动讲解技术将翻转课堂的制作开销最小化,同时具有讲义增量演化、降低教员负担等优点。Therefore, it is urgent to provide an automatic explanation method of slides to help students complete the learning of relevant knowledge in the slides, so as to support the realization of the flipped classroom form: the teacher answers questions after the automatic explanation and organizes students to practice and operate. The automatic explanation technology minimizes the production overhead of the flipped classroom, and at the same time has the advantages of incremental evolution of lecture notes, reducing the burden on teachers, etc.

发明内容SUMMARY OF THE INVENTION

有鉴于此,本发明提供了一种幻灯片的自动讲解方法及装置,用以支持实现翻转课堂的形式,自动讲解技术将翻转课堂的制作开销最小化,同时具有讲义增量演化、降低教员负担等优点。具体方案如下:In view of this, the present invention provides an automatic explanation method and device for slides to support the realization of the flipped classroom. The automatic explanation technology minimizes the production cost of the flipped classroom, and at the same time, it has the incremental evolution of lecture notes and reduces the burden on teachers. Etc. The specific plans are as follows:

一种幻灯片的自动讲解方法,包括:An automatic explanation method of slides, including:

预先为当前待讲解幻灯片编写当前讲解脚本,其中,所述当前讲解脚本包括:当前待朗读文本和当前待执行命令;Pre-writing a current explanation script for the current slide to be explained, wherein the current explanation script includes: the current to-be-read text and the current to-be-executed command;

在接收到对所述当前待讲解幻灯片的自动讲解请求的情况下,获取所述当前讲解脚本;In the case of receiving an automatic explanation request for the current slide to be explained, acquiring the current explanation script;

识别所述当前讲解脚本,确定所述当前讲解脚本中的所述当前待朗读文本和所述当前待执行命令;Identifying the current explanation script, and determining the currently to-be-read text and the current to-be-executed command in the current explanation script;

依次读取所述当前待朗读文本和执行所述当前待执行命令。The current text to be read aloud is sequentially read and the current command to be executed is executed.

上述的方法,可选的,识别所述当前讲解脚本,确定所述当前讲解脚本中的所述当前待朗读文本和所述当前待执行命令,包括:The above method, optionally, identifying the current explanation script, and determining the current to-be-read text and the current to-be-executed command in the current explanation script, including:

遍历所述当前讲解脚本,依次识别所述当前讲解脚本;Traverse the current explanation script, and identify the current explanation script in turn;

将所述当前讲解脚本中起始标识和结束标识之间的部分确定为当前待执行命令,其余确定为当前待朗读文本,其中,所述当前待朗读脚本至少为一个,所述当前待执行命令至少为一个。The part between the start mark and the end mark in the current explanation script is determined as the current command to be executed, and the rest is determined as the current text to be read aloud, wherein the current script to be read aloud is at least one, the current command to be executed at least one.

上述的方法,可选的,依次读取所述当前待朗读文本和执行所述当前待执行命令,包括:The above method, optionally, sequentially reads the text to be read aloud and executes the current command to be executed, including:

依次解析所述当前讲解脚本;Parse the current explanation script in turn;

若解析到所述当前讲解脚本中的当前待朗读文本,基于文本到语音转换技术读取所述当前待朗读文本;If the current text to be read aloud in the current explanation script is parsed, the current text to be read aloud is read based on a text-to-speech conversion technology;

若解析到所述当前讲解脚本中的当前待执行命令,遍历预设的命令集,查找与所述当前待执行命令对应的方法,执行与所述方法对应的操作指令。If the current command to be executed in the current explanation script is parsed, a preset command set is traversed, a method corresponding to the current command to be executed is searched, and an operation instruction corresponding to the method is executed.

上述的方法,可选的,还包括:The above method, optionally, further includes:

添加控制界面;Add control interface;

基于所述控制界面控制展示任一待讲解幻灯片。Based on the control interface, any slide to be explained is controlled to be displayed.

上述的方法,可选的,还包括:The above method, optionally, further includes:

获取所述当前待朗读文本;obtain the current text to be read;

在读取所述待朗读文本的同时将所述当前待朗读文本在所述当前待讲解幻灯片中预设位置进行同步展示。While reading the text to be read aloud, the current text to be read aloud is synchronously displayed at a preset position in the current slide to be explained.

一种幻灯片的自动讲解装置,包括:An automatic explanation device for slides, comprising:

编写模块,用于预先为当前待讲解幻灯片编写当前讲解脚本,其中,所述当前讲解脚本包括:当前待朗读文本和当前待执行命令;A writing module, used for pre-writing a current explanation script for the current slide to be explained, wherein the current explanation script includes: the current text to be read and the current command to be executed;

第一获取模块,用于在接收到对所述当前待讲解幻灯片的自动讲解请求的情况下,获取所述当前讲解脚本;a first obtaining module, configured to obtain the current explanation script when an automatic explanation request for the current slide to be explained is received;

确定模块,用于识别所述当前讲解脚本,确定所述当前讲解脚本中的所述当前待朗读文本和所述当前待执行命令;A determination module, configured to identify the current explanation script, and determine the currently to-be-read text and the current to-be-executed command in the current explanation script;

读取和执行模块,用于依次读取所述当前待朗读文本和执行所述当前待执行命令。A reading and executing module is used to sequentially read the text to be read aloud and execute the command to be executed currently.

上述的装置,可选的,所述确定模块包括:For the above device, optionally, the determining module includes:

识别单元,用于遍历所述当前讲解脚本,依次识别所述当前讲解脚本;an identification unit, configured to traverse the current explanation script, and identify the current explanation script in turn;

确定单元,用于将所述当前讲解脚本中起始标识和结束标识之间的部分确定为当前待执行命令,其余确定为当前待朗读文本,其中,所述当前待朗读脚本至少为一个,所述当前待执行命令至少为一个。The determining unit is used to determine the part between the start mark and the end mark in the current explanation script as the current command to be executed, and the rest is determined as the current text to be read, wherein the current script to be read is at least one, so The current command to be executed is at least one.

上述的装置,可选的,所述读取和执行模块包括:The above-mentioned device, optionally, the reading and execution module includes:

解析单元,用于依次解析所述当前讲解脚本;a parsing unit, used for parsing the current explanation script in sequence;

读取单元,用于若解析到所述当前讲解脚本中的当前待朗读文本,基于文本到语音转换技术读取所述当前待朗读文本;a reading unit, configured to read the text to be read aloud based on the text-to-speech conversion technology if the current text to be read aloud in the current explanation script is parsed;

执行单元,用于若解析到所述当前讲解脚本中的当前待执行命令,遍历预设的命令集,查找与所述当前待执行命令对应的方法,执行与所述方法对应的操作指令。The execution unit is configured to traverse a preset command set, search for a method corresponding to the current command to be executed, and execute an operation instruction corresponding to the method if the current command to be executed in the current explanation script is parsed.

上述的装置,可选的,还包括:The above-mentioned device, optionally, also includes:

添加模块,用于添加控制界面;Add module for adding control interface;

控制模块,用于基于所述控制界面控制展示任一待讲解幻灯片。The control module is configured to control and display any slide to be explained based on the control interface.

上述的装置,可选的,还包括:The above-mentioned device, optionally, also includes:

第二获取模块,用于获取所述当前待朗读文本;A second acquisition module, configured to acquire the current text to be read aloud;

展示模块,用于在读取所述待朗读文本的同时将所述当前待朗读文本在所述当前待讲解幻灯片中预设位置进行同步展示。The presentation module is configured to synchronously display the currently to-be-read text in a preset position in the current to-be-explaned slide while reading the to-be-read text.

与现有技术相比,本发明包括以下优点:Compared with the prior art, the present invention includes the following advantages:

本发明公开了一种幻灯片的自动讲解方法及装置,所述方法包括:预先为当前待讲解幻灯片编写当前讲解脚本,其中,所述当前讲解脚本包括:当前待朗读文本和当前待执行命令,在接收到对所述当前待讲解幻灯片的自动讲解请求的情况下,获取所述当前讲解脚本;识别所述当前讲解脚本,确定所述当前讲解脚本中的所述当前待朗读文本和所述当前待执行命令;依次读取所述当前待朗读文本和执行所述当前待执行命令。上述过程中,预先为当前待讲解幻灯片编写当前讲解脚本,完成了读取讲解脚本中的待朗读文本和执行与讲解脚本中待执行命令对应的操作指令,基于该操作指令实现对应功能,实现了对待讲解幻灯片的自动讲解,完成幻灯片中相关知识的学习。The invention discloses an automatic explanation method and device for a slideshow. The method includes: pre-writing a current explanation script for the current slideshow to be explained, wherein the current explanation script includes: the current text to be read aloud and the current command to be executed , in the case of receiving an automatic explanation request for the current slide to be explained, obtain the current explanation script; identify the current explanation script, and determine the current to-be-read text and all the current explanation scripts in the current explanation script The current command to be executed is read; the text to be read aloud is sequentially read and the current command to be executed is executed. In the above process, the current explanation script is written for the current slide to be explained in advance, the reading of the text to be read in the explanation script and the execution of the operation instruction corresponding to the to-be-executed command in the explanation script are completed, and the corresponding function is realized based on the operation instruction. In order to deal with the automatic explanation of the slideshow, complete the learning of the relevant knowledge in the slideshow.

附图说明Description of drawings

为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained according to these drawings without creative efforts.

图1为本发明实施例公开的一种幻灯片的自动讲解方法流程图;FIG. 1 is a flowchart of a method for automatically explaining a slideshow disclosed in an embodiment of the present invention;

图2为本发明实施例公开的一种幻灯片的自动讲解装置结构框图。FIG. 2 is a structural block diagram of an apparatus for automatically explaining slides disclosed in an embodiment of the present invention.

具体实施方式Detailed ways

下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

本发明公开了一种幻灯片的自动讲解方法和装置,用于实现对幻灯片中内容的自动讲解,在面向翻转课堂的具体的实现过程宏,学生可以通过上述自动讲解方法完成知识的自主学习,员在自动讲解完后进行答疑并组织学员实际练习、操作。自动讲解技术将翻转课堂的制作开销最小化,同时具有讲义增量演化、降低教员负担等优点。因此,本发明提供了一种幻灯片的自动讲解方法,所述方法的执行流程如图1所示,包括步骤;The invention discloses an automatic explanation method and device for slides, which are used to realize the automatic explanation of the content in the slides. In the specific implementation process macro for flipped classroom, students can complete the self-learning of knowledge through the automatic explanation method. , the staff will answer questions after the automatic explanation and organize the students to practice and operate. The automatic explanation technology minimizes the production overhead of the flipped classroom, and at the same time has the advantages of incremental evolution of lecture notes, reducing the burden on teachers, etc. Therefore, the present invention provides an automatic explanation method for slides, and the execution flow of the method is shown in FIG. 1 , including steps;

S101、预先为当前待讲解幻灯片编写当前讲解脚本,其中,所述当前讲解脚本包括:当前待朗读文本和当前待执行命令;S101, writing a current explanation script for the current slide to be explained in advance, wherein the current explanation script includes: the current text to be read aloud and the current command to be executed;

本发明实施例中,预先基于经验或者具体情况编写将讲解脚本,其中,所述当前讲解脚本中包含当前待朗读文本和当前待执行命令,其中,所述待朗读文本为对所述当前待讲解幻灯片中知识的解释说明,所述当前执行命令为讲解过程中执行的操作指令,例如,适当的停顿,展示幻灯片中的动画或者打开其他文档或者应用程序等,其中,所述当前讲解文本的存在形式可以为与当前待讲解幻灯片独立的文件,通过标识将文件与对应的幻灯片建立关联,也可以为与待讲解幻灯片的备注页建立关联,本发明实施例中对具体的关联形式限定。In the embodiment of the present invention, an explanation script is written in advance based on experience or specific conditions, wherein the current explanation script includes the current text to be read and the current command to be executed, wherein the text to be read is a description of the current to be explained The explanation of the knowledge in the slide, the current execution command is the operation instruction executed during the explanation, for example, appropriate pause, show animation in the slide, or open other documents or applications, etc., wherein the current explanation text The existence form can be a file that is independent from the current slide to be explained, and the file can be associated with the corresponding slide through the identifier, or it can be associated with the remarks page of the slide to be explained. In the embodiment of the present invention, the specific association is Form restrictions.

进一步的,所述当前待讲解幻灯片至少为一个,各个幻灯片之间依据讲解顺序依次排列。Further, the current slide to be explained is at least one, and the slides are arranged in sequence according to the explanation order.

S102、在接收到对所述当前待讲解幻灯片的自动讲解请求的情况下,获取所述当前讲解脚本;S102, in the case of receiving an automatic explanation request for the current slide to be explained, obtain the current explanation script;

本发明实施例中,当接收到自动讲解指令的情况下,基于预先建立的关联关系,其中,所述预先建立的关联关系可以基于标识和备注页或者其它方式构建,确定所述当前待讲解幻灯片的当前讲解脚本,其中,所述自动讲解指令可以为用户通过点击按钮或者相关播放键等方式实现,本发明实施例中不进行具体限定。In this embodiment of the present invention, when an automatic explanation instruction is received, the current slide show to be explained is determined based on a pre-established association relationship, wherein the pre-established association relationship may be constructed based on an identification and a remarks page or in other ways. The current explanation script of the film, wherein the automatic explanation instruction may be implemented by the user by clicking a button or a related play key, etc., which is not specifically limited in this embodiment of the present invention.

S103、识别所述当前讲解脚本,确定所述当前讲解脚本中的所述当前待朗读文本和所述当前待执行命令;S103, identifying the current explanation script, and determining the current text to be read and the current command to be executed in the current explanation script;

本发明实施例中,遍历所述当前讲解脚本,依次对所述当前讲解脚本中包含的内容进行识别,优选的,由于所述当前讲解脚本中只包括当前待朗读文本和当前待执行命令,且,所述当前待朗读文本至少为一个,每个当前待朗读文本可以相同也可以不同,所述当前待执行命令至少为一个,每个当前待执行命令可以相同也可以不同,在编写所述当前讲解脚本中,针对所述当前讲解脚本中每个当前待执行命令分配起始标识和结束标识,以所述起始标识作为开始,以所述结束标识作为结束,将包含在所述起始标识和所述结束标识之间的部分作为当前待执行命令,在所述各个执行命令之间的部分作为所述当前待朗读文本,其中,本发明实施例中,对所述起始标识和所述结束标识的具体存在形式不进行限定。In this embodiment of the present invention, the current explanation script is traversed, and the content contained in the current explanation script is identified in sequence. Preferably, because the current explanation script only includes the current text to be read and the current command to be executed, and , the current text to be read aloud is at least one, each current text to be read can be the same or different, the current command to be executed is at least one, and each current command to be executed can be the same or different. In the explanation script, for each current command to be executed in the current explanation script, a start mark and an end mark are allocated, starting with the start mark, and ending with the end mark, which will be included in the start mark. The part between the end mark and the end mark is used as the current command to be executed, and the part between the execution commands is the current text to be read, wherein, in this embodiment of the present invention, the start mark and the The specific existence form of the end identifier is not limited.

例如,对所述当前讲解脚本进行举例,假设所述起始标识为【,所述结束标识为】,则所述当前讲解脚本为:A,【命令1】【命令2】BC【命令3】,上述当前讲解脚本中ABC为所述当前待朗读文本,命令1、命令2和命令为当前待执行命令For example, taking the current explanation script as an example, assuming that the start identifier is [, the end identifier is], then the current explanation script is: A, [command 1] [command 2] BC [command 3] , in the above current explanation script, ABC is the text to be read aloud, and command 1, command 2 and command are the current commands to be executed

S104、依次读取所述当前待朗读文本和执行所述当前待执行命令。S104: Read the currently to-be-read text and execute the currently-to-be-executed command in sequence.

本发明实施例中,在确定了所述当前待朗读文本和所述当前待执行命令后,针对语音讲解部分,通过文本到语音转换技术TTS(TextToSpeech)中的语音朗读引擎识别当前待朗读文本并转化为语音,具体的转换原理如下:In the embodiment of the present invention, after the current text to be read aloud and the command to be executed currently are determined, for the voice explanation part, the voice reading engine in the text-to-speech conversion technology TTS (TextToSpeech) recognizes the current text to be read aloud and generates The specific conversion principle is as follows:

文本分析-对所述当前待朗读文本进行语言学分析,逐句进行词汇的、语法的和语义的分析,以确定句子的低层结构和每个字的音素的组成,包括文本的断句、字词切分、多音字的处理、数字的处理、缩略语的处理等。Text Analysis - Linguistic analysis of the current text to be read, sentence-by-sentence lexical, grammatical and semantic analysis, to determine the low-level structure of the sentence and the composition of the phonemes of each character, including text segmentation, words Segmentation, processing of polyphonic words, processing of numbers, processing of abbreviations, etc.

语音合成-把处理好的当前待朗读文本所对应的单字或短语从语音合成库中提取,把语言学描述转化成言语波形。Speech synthesis - Extract the words or phrases corresponding to the processed text to be read aloud from the speech synthesis library, and convert the linguistic description into speech waveforms.

韵律处理-合成音质(Qualityof Synthetic Speech)是指语音合成系统所输出的语音的质量,一般从清晰度(或可懂度)、自然度和连贯性等方面进行主观评价。清晰度是正确听辨有意义词语的百分率;自然度用来评价合成语音音质是否接近人说话的声音,合成词语的语调是否自然;连贯性用来评价合成语句是否流畅。Prosody processing-synthetic quality (Quality of Synthetic Speech) refers to the quality of the speech output by the speech synthesis system, which is generally evaluated subjectively in terms of clarity (or intelligibility), naturalness and coherence. Clarity is the percentage of correct hearing and recognition of meaningful words; naturalness is used to evaluate whether the sound quality of the synthesized speech is close to the voice of a human being, and whether the intonation of the synthesized words is natural; coherence is used to evaluate whether the synthesized sentences are fluent.

由于使用了com.cloudgarden.jsapi来访问Windows的TTS功能,因此TTS管理器的实现较为简单,TTSMan提供了两个基础的功能:speak,朗读给定文本;setSpeed,设定朗读速度。Since com.cloudgarden.jsapi is used to access the TTS function of Windows, the implementation of the TTS manager is relatively simple. TTSMan provides two basic functions: speak, read the given text aloud; setSpeed, set the reading speed.

针对当前待执行命令部分,本发明实施例中,若解析到所述当前讲解脚本中的当前待执行命令,遍历预设的命令集,查找与所述当前待执行命令对应的方法,执行与所述方法对应的操作指令。如果当前待执行命令是openoffice支持的命令,就调用openoffice的API来实现相应的功能;如果命令是java,则通过java来实现相应的功能,若采用OpenOffice的脚本启动方式,我们将面向翻转课堂的自动讲解软件的启动交给BeanShell脚本来完成。脚本内容如下:For the part of the command to be executed currently, in this embodiment of the present invention, if the current command to be executed in the current explanation script is parsed, a preset command set is traversed, a method corresponding to the command to be executed currently is searched, and a method corresponding to the command to be executed is executed. Operation instructions corresponding to the above methods. If the current command to be executed is a command supported by openoffice, call the API of openoffice to realize the corresponding function; if the command is java, use java to realize the corresponding function. The startup of the automatic explanation software is handed over to the BeanShell script to complete. The content of the script is as follows:

Figure BDA0003196044850000071
Figure BDA0003196044850000071

Figure BDA0003196044850000081
Figure BDA0003196044850000081

Figure BDA0003196044850000091
Figure BDA0003196044850000091

本发明实施例中,所述当前待执行命令为beanshell脚本,以启动幻灯片放映的执行命令为例:In the embodiment of the present invention, the current command to be executed is a beanshell script, and the execution command to start a slide show is taken as an example:

Figure BDA0003196044850000092
Figure BDA0003196044850000092

实际就是调用了命令管理器,获得PPT Proxy对象,然后调用该对象的startPresenting(目标)方法,启动放映。如下给出了预设的命令集。这些命令均可在所述当前讲解脚本中按需调用。所述预设的命令集包括:CANCEL()、、DL(long)、DL1()、DL2()、DL3()、EXITFUYIN()、GOTO(int)、NE()、NOOP()、NS()、PAUSE()、PAUSEs(String)、PE()、PLAY()、PS()、q_jsapiSpeak(String)、q_parseNote(String)、q_speakAllSlides()、q_speakCurrentSlide()、q_speakFollowSlides()、RANDi(int)、RANDi2(int,int)、RANDs(String)、RESUME()、SPEAK(String)、SPEAKs(String,String)、SPEED(int)、SRTALIGN(int)、SRTBOUND(int,int,int,int)、SRTCOLOR(int,int,int,int)、SRTFONT(String,int,int)、SRTOPACITY(float)、SUBTITLE(String)和SWITCHSRT()例如,所述当前待执行命令为“【SPEED(160);】Hello World【】你们好啊”其中调用了SPEED命令设定朗读速度为每分钟160字。注意,“【】”中的就是命令,这些命令中的参数括号和语句分号等请使用英文半角符号。In fact, the command manager is called to obtain the PPT Proxy object, and then the startPresenting (target) method of the object is called to start the show. The preset command set is given below. These commands can be invoked on demand in the current tutorial script. The preset command set includes: CANCEL(), DL(long), DL1(), DL2(), DL3(), EXITFUYIN(), GOTO(int), NE(), NOOP(), NS( ), PAUSE(), PAUSEs(String), PE(), PLAY(), PS(), q_jsapiSpeak(String), q_parseNote(String), q_speakAllSlides(), q_speakCurrentSlide(), q_speakFollowSlides(), RANDi(int), RANDi2(int,int), RANDs(String), RESUME(), SPEAK(String), SPEAKs(String,String), SPEED(int), SRTALIGN(int), SRTBOUND(int,int,int,int), SRTCOLOR (int,int,int,int), SRTFONT(String,int,int), SRTOPACITY(float), SUBTITLE(String) and SWITCHSRT() For example, the current command to be executed is "[SPEED(160);]Hello World [] How are you" which calls the SPEED command to set the reading speed to 160 words per minute. Note that "[]" is the command, please use English half-width symbols for parameter brackets and statement semicolons in these commands.

本发明公开了一种幻灯片的自动讲解方法,包括:预先为当前待讲解幻灯片编写当前讲解脚本,其中,所述当前讲解脚本包括:当前待朗读文本和当前待执行命令,在接收到对所述当前待讲解幻灯片的自动讲解请求的情况下,获取所述当前讲解脚本;识别所述当前讲解脚本,确定所述当前讲解脚本中的所述当前待朗读文本和所述当前待执行命令;依次读取所述当前待朗读文本和执行所述当前待执行命令。上述过程中,预先为当前待讲解幻灯片编写当前讲解脚本,完成了读取讲解脚本中的待朗读文本和执行与讲解脚本中待执行命令对应的操作指令,基于该操作指令实现对应功能,实现了对待讲解幻灯片的自动讲解,完成幻灯片中相关知识的学习。The invention discloses an automatic explanation method for slides, which includes: pre-writing a current explanation script for the current slide to be explained, wherein the current explanation script includes: the current text to be read and the current command to be executed, In the case of the automatic explanation request of the slides to be explained at present, obtain the current explanation script; identify the current explanation script, and determine the current text to be read and the current command to be executed in the current explanation script ; Read the text to be read aloud and execute the command to be executed in sequence. In the above process, the current explanation script is written for the current slide to be explained in advance, the reading of the text to be read in the explanation script and the execution of the operation instruction corresponding to the to-be-executed command in the explanation script are completed, and the corresponding function is realized based on the operation instruction. In order to deal with the automatic explanation of the slideshow, complete the learning of the relevant knowledge in the slideshow.

本发明实施例中,所述方法中还包括:添加控制界面,基于所述控制界面控制展示任一待讲解幻灯片,其中,所述控制界面(ControlFrame)是一个简单的窗体,内有各个控制功能的按钮。点击这些按钮后,通过向命令管理器发送相应命令来完成对应操作。控制界面管理器则控制ControlFrame的生成和显示。其中,所述控制界面可以完成Current、Following、ALL、Cancel、Resume和subtitle功能。In the embodiment of the present invention, the method further includes: adding a control interface, and controlling and displaying any slide to be explained based on the control interface, wherein the control interface (ControlFrame) is a simple window, which contains various Buttons to control functions. After clicking these buttons, the corresponding operations are completed by sending corresponding commands to the command manager. The control interface manager controls the generation and display of the ControlFrame. Wherein, the control interface can complete the functions of Current, Following, ALL, Cancel, Resume and subtitle.

进一步的,获取所述当前待朗读文本;在读取所述待朗读文本的同时将所述当前待朗读文本在所述当前待讲解幻灯片中预设位置进行同步展示,用以实现字幕功能,其中,所述字幕功能就是构造一个无标题栏的JFrame,将字幕文本以给定格式显示出来,本发明实施例中对字母显示的预设位置不进行限定。Further, acquiring the current text to be read aloud; while reading the text to be read aloud, the current text to be read aloud is synchronously displayed at a preset position in the current slideshow to be explained, so as to realize a subtitle function, The subtitle function is to construct a JFrame without a title bar to display the subtitle text in a given format, and the preset position for displaying letters is not limited in the embodiment of the present invention.

进一步的,本发明实施例中采用JNA来实现对系统范围内鼠标和键盘事件的监听。JNA类库使用一个很小的本地类库sub动态的调用本地代码。程序员只需要使用一个特定的java接口描述一下将要调用的本地代码的方法的结构和一些基本属性。这样可以节省适配多个平台而大量的配置和编译代码。因为调用的都是JNA提供的公用jar包中的接口。Further, in this embodiment of the present invention, JNA is used to monitor mouse and keyboard events within the system. The JNA class library uses a small native class library sub to dynamically call native code. The programmer only needs to use a specific java interface to describe the structure and some basic properties of the method to be called by the native code. This saves a lot of configuration and compilation code for adapting to multiple platforms. Because the calls are all the interfaces in the public jar package provided by JNA.

在JNA截获鼠标键盘事件的基础上,简单的定义了一套Event和EventListener机制,用于支持用户灵活的注册事件响应代码。以此为基础,实现了对下列快捷键和命令的支持:Based on the interception of mouse and keyboard events by JNA, a set of Event and EventListener mechanisms are simply defined to support users to flexibly register event response codes. Based on this, support for the following shortcut keys and commands is implemented:

开始放映幻灯片(Alt+G,ASCII码71),执行命令:PLAY();Start the slide show (Alt+G, ASCII code 71), execute the command: PLAY();

朗读所有页(Alt+A,ASCII码65),执行命令:q_speakAllSlides();Read all pages (Alt+A, ASCII code 65), execute the command: q_speakAllSlides();

朗读后续页(Alt+F,ASCII码70),执行命令:q_speakFollowSlides();Read the following page (Alt+F, ASCII code 70), execute the command: q_speakFollowSlides();

朗读当前页(Alt+C,ASCII码67),执行命令:q_speakCurrentSlide();Read the current page (Alt+C, ASCII code 67), execute the command: q_speakCurrentSlide();

暂停讲解(Alt+K,ASCII码75),执行命令:PAUSE();Pause the explanation (Alt+K, ASCII code 75), execute the command: PAUSE();

继续讲解(Alt+R,ASCII码82),执行命令:RESUME();Continue to explain (Alt+R, ASCII code 82), execute the command: RESUME();

取消所有讲解内容(Alt+X,ASCII码88),执行命令:CANCEL();Cancel all explanation content (Alt+X, ASCII code 88), execute the command: CANCEL();

显示/隐藏字幕(Alt+S,ASCII码83),执行命令:SWITCHSRT();Display/hide subtitles (Alt+S, ASCII code 83), execute command: SWITCHSRT();

本发明实施例中,基于上述的方法设计了面向翻转课堂的自动讲解软件,该软件行在OpenOffice(兼容LibreOffice,下同)中,以OpenOffice的插件形式存在。OpenOffice(LibreOffice)为2016年12月以后能获得的最新版本。面向翻转课堂的自动讲解软件以Java语言进行开发,因此要求正确配置OpenOffice所用的JDK(版本为JDK1.6以上,32位x86)。In the embodiment of the present invention, based on the above method, an automatic explanation software for flipped classroom is designed, which runs in OpenOffice (compatible with LibreOffice, the same below) and exists in the form of a plug-in of OpenOffice. OpenOffice (LibreOffice) is the latest version available after December 2016. The automatic explanation software for flipped classroom is developed in Java language, so it is required to correctly configure the JDK used by OpenOffice (version JDK1.6 or above, 32-bit x86).

开发环境如下:The development environment is as follows:

集成开发环境:Eclipse Mars及以上版本;Integrated development environment: Eclipse Mars and above;

源码仓库:git;Source code repository: git;

Maven仓库:Nexus。Maven repository: Nexus.

本发明实施例中,所述自动讲解软件主要包括7个类:IPPTProxy接口用于抽象幻灯片播放软件,使得系统能够在未来支持更多的幻灯片播放软件。BshOpenOfficeProxy是对OpenOffice的IPPTProxy实现,它通过OpenOffice支持的BeanShell脚本获得一些必要的信息,从而实现IPPTProxy中定义的功能,以供其他模块使用。In the embodiment of the present invention, the automatic explanation software mainly includes 7 categories: the IPPTProxy interface is used to abstract the slideshow software, so that the system can support more slideshow software in the future. BshOpenOfficeProxy is an implementation of IPPTProxy for OpenOffice. It obtains some necessary information through the BeanShell script supported by OpenOffice, so as to implement the functions defined in IPPTProxy for use by other modules.

CommandMan,命令管理器,用于管理和执行各个指令。通过将指令表示为beanshell脚本的形式,可以允许用户执行和扩展各类命令。CommandMan同时持有IPPTProxy的实现对象,使得其他模块能够通过它来访问PPT播放器的功能。CommandMan, the command manager, is used to manage and execute individual commands. By expressing instructions in the form of beanshell scripts, users are allowed to execute and extend various types of commands. CommandMan also holds the implementation object of IPPTProxy, so that other modules can access the functions of the PPT player through it.

MouseKeyboardMan,鼠标键盘管理器,用于管理系统范围内的鼠标和键盘操作,它通过监听鼠标和键盘操作,将这些操作封装为事件,并支持事件监听器的。从而最终实现用户对热键的注册并执行对应的指令。注意:普通的Java代码只能监听所在界面控件(如一个窗体)范围内键盘和鼠标事件,一旦该控件失去焦点(Focus),就不能继续监听。MouseKeyboardMan用于监听系统范围内的鼠标和键盘事件,无论焦点在哪个界面。MouseKeyboardMan, a mouse and keyboard manager, is used to manage system-wide mouse and keyboard operations. It encapsulates these operations as events by monitoring mouse and keyboard operations, and supports event listeners. Thereby, the user's registration of the hot key is finally realized and the corresponding instruction is executed. Note: Ordinary Java code can only monitor keyboard and mouse events within the scope of the interface control (such as a form) where it is located. Once the control loses focus, it cannot continue to monitor. MouseKeyboardMan is used to listen for system-wide mouse and keyboard events, regardless of which interface the focus is on.

SRTMan,字幕管理器,用于控制显示字幕的窗体,GUIController,控制界面管理器,则控制主界面(ControlFrame)窗体。SRTMan, subtitle manager, is used to control the form that displays subtitles, GUIController, control interface manager, controls the main interface (ControlFrame) form.

TTSMan,TTS管理器,用于管理语音朗读引擎,采用了com.cloudgarden.jsapi包来直接调用Windows系统中安装的各类语音库,支持SAPI5。TTSMan, TTS manager, is used to manage the speech reading engine. It uses the com.cloudgarden.jsapi package to directly call various speech libraries installed in the Windows system, and supports SAPI5.

其中,PPT控制接口(IPPTProxy)定义了下述的功能:Among them, the PPT control interface (IPPPTProxy) defines the following functions:

startPresentin,启动幻灯片放映。startPresentin, start the slideshow.

isPresenting,判断是否正在放映。isPresenting, to determine whether it is showing.

getSlideCount,获得文件中幻灯片的数目。getSlideCount, get the number of slides in the file.

getCurrentShowSlideIndex,获得当前放映的幻灯片index值。getCurrentShowSlideIndex, get the current slide index value.

gatherNoteOfShowSlides,获得演示中指定范围内幻灯片的备注文字,调用本方法会导致启动放映。gatherNoteOfShowSlides, get the note text of the slides in the specified range in the presentation, calling this method will cause the show to start.

getNoteOfShowSlide,获得演示中指定index幻灯片的备注文字,调用本方法会导致启动放映。getNoteOfShowSlide, get the note text of the specified index slide in the presentation, calling this method will cause the show to start.

gatherNoteOfSlides,获得指定范围内幻灯片的备注文字,调用本方法不会启动放映幻灯片。gatherNoteOfSlides, get the note text of the slides in the specified range, calling this method will not start the slide show.

getNoteOfSlide,获得指定index幻灯片的备注文字,调用本方法不会启动放映幻灯片。getNoteOfSlide, get the note text of the specified index slide, calling this method will not start the slide show.

nextEffect,Show next effect of this slide in presentation。nextEffect, Show next effect of this slide in presentation.

nextSlide,Show next slide in presentation。nextSlide, Show next slide in presentation.

previousEffect,Show previous effect of this slide in presentation。previousEffect, Show previous effect of this slide in presentation.

previousSlide,Show previous slide in presentation。previousSlide, Show previous slide in presentation.

gotoSlide,goto given slide in presentation。gotoSlide, goto given slide in presentation.

onExiting,系统准备退出,回收所用资源。onExiting, the system is ready to exit and recycle used resources.

一旦为某个PPT播放器提供了上述功能,面向翻转课堂的自动讲解软件就能完成对备注的获取和讲解的控制。Once the above functions are provided for a PPT player, the automatic explanation software for flipped classroom can complete the control of the acquisition and explanation of notes.

BshOpenOfficeProxy则通过OpenOffice的BeanShell脚本支持,通过获取其中主要的三个对象:XScriptInvocationContext、XModel和XDesktop,就能利用OpenOffice的UNO接口,访问到相关的对象:XPresentationSupplier、XPresentation、XPresentation2、XDrawPagesSupplier,从而实现IPPTProxy中定义的功能。这些类和他们的功能请参考UNO和OpenOffice中的定义。BshOpenOfficeProxy is supported by OpenOffice's BeanShell script. By obtaining the three main objects: XScriptInvocationContext, XModel and XDesktop, you can use OpenOffice's UNO interface to access related objects: XPresentationSupplier, XPresentation, XPresentation2, XDrawPagesSupplier, thus realizing IPPTProxy defined function. These classes and their functions are defined in UNO and OpenOffice.

其中,命令管理器(CommandMan)内部有一个命令队列(CommandQueue:mainQueue),命令队列可以包括命令项(ICommandQueueItem)。ICommandQueueItem有两个子类:CommandQueueItem和CommandQueue,前者用于封装一个具体的命令,后者意味着明了那个队列之间可以嵌套,从而形成嵌套的队列。嵌套的队列在未来可以允许用户撤销指定范围内的命令序列,从而增强控制功能。The command manager (CommandMan) has a command queue (CommandQueue: mainQueue) inside, and the command queue may include command items (ICommandQueueItem). ICommandQueueItem has two subclasses: CommandQueueItem and CommandQueue. The former is used to encapsulate a specific command, and the latter means that the queues can be nested to form a nested queue. Nested queues could in the future allow users to revoke command sequences within a specified range, thereby enhancing control.

命令管理器启动后,会启动一个命令执行线程。命令执行线程不断地从mainQueue中获取命令项(调用advanceCommand方法),然后执行它。每一个命令项中的command都是一个beanshell脚本。CommandMan会在内部创建一个BeanShell解释器(并执行后面介绍的命令脚本),然后将该命令提交给解释器加以执行。After the command manager starts, a command execution thread is started. The command execution thread continuously gets the command item from the mainQueue (calling the advanceCommand method), and then executes it. The command in each command item is a beanshell script. CommandMan internally creates a BeanShell interpreter (and executes the command script described later), and then submits the command to the interpreter for execution.

本发明实施例中,为了进一步增强功能,提供了静态网页服务器和WebSocket消息转发服务器,从而能够支持手机、头戴式VR/AR眼镜等设备。其中,静态网页服务器通过监听指定端口,响应该端口的HTTP GET请求并返回请求的静态网页文件数据,从而支持对静态网页的访问。该扩展提供三个访问接口:void setRootPath(String path),设置网页的根目录;boolean start(String path,int port),启动HTTP网页服务器,参数为网页根目录和监听端口号;void stop(),停止HTTP网页服务器。其中,WebSocket消息转发服务器基于WebSocket,支持不同客户端通过网页来广播消息。该模块将监听主机所有可用网卡指定端口,接收传入的文本消息,并将其广播到所有连入的客户端。List<String>getHostIps(),获得WebSocket消息转发服务器绑定的所有网卡的IP地址;List<String>start(intport),在指定端口上启动WebSocket消息转发服务器,返回绑定的所有网卡的IP地址;voidstop(),停止WebSocket消息转发服务器。void bcastMessage(String msg),广播一条文本消息。以“:bsh:”开头的消息将被送到命令管理器并被解释执行(不会发送给各个客户端)。In the embodiment of the present invention, in order to further enhance the functions, a static web page server and a WebSocket message forwarding server are provided, so that devices such as mobile phones and head-mounted VR/AR glasses can be supported. The static web page server supports access to the static web page by monitoring the specified port, responding to the HTTP GET request of the port, and returning the requested static web page file data. This extension provides three access interfaces: void setRootPath(String path), which sets the root directory of the web page; boolean start(String path, int port), which starts the HTTP web server with the parameters of the web page root directory and listening port number; void stop() , to stop the HTTP web server. Among them, the WebSocket message forwarding server is based on WebSocket, and supports different clients to broadcast messages through web pages. This module will listen on the specified ports of all available network cards on the host, receive incoming text messages, and broadcast them to all connected clients. List<String>getHostIps(), get the IP addresses of all network cards bound to the WebSocket message forwarding server; List<String>start(intport), start the WebSocket message forwarding server on the specified port, and return the IP addresses of all bound network cards ;voidstop(), stop the WebSocket message forwarding server. void bcastMessage(String msg), broadcasts a text message. Messages starting with ":bsh:" will be sent to the command manager and interpreted (not sent to individual clients).

基于静态网页服务器和WebSocket消息转发服务器,可以支持手机、头戴式VR/AR眼镜等设备接收PPT中语音等信息,同时可以传递控制命令。例如如下的网页中,“放映”等按钮可以发送“:bsh:PLAY();”等命令,当WebSocket消息转发服务器收到后,转交给命令管理器并被解释执行(放映命令)。Based on the static web server and WebSocket message forwarding server, it can support mobile phones, VR/AR glasses and other devices to receive information such as voice in PPT, and can transmit control commands at the same time. For example, in the following web page, buttons such as "Show" can send commands such as ":bsh:PLAY();". When the WebSocket message forwarding server receives it, it is forwarded to the command manager and interpreted and executed (show command).

由于采用了WebSocket技术,客户端可以根据设备和用户偏好自定义界面,例如AR设备MadGaze的界面简化如下:Due to the use of WebSocket technology, the client can customize the interface according to the device and user preferences. For example, the interface of the AR device MadGaze is simplified as follows:

当使用MadGaze等设备时,可以实现即时的讲解内容提示,从而使得演讲者能够在佩戴该眼镜的情况下,离开讲台任意走动。使用手机等,也能达到同样效果。When using devices such as MadGaze, instant explanation content prompts can be realized, so that the speaker can walk away from the podium at will while wearing the glasses. The same effect can be achieved using mobile phones, etc.

基于上述的一种幻灯片的自动讲解方法,本发明实施例中还提供了一种自动讲解装置,所述自动讲解装置的执行流程如图2所示,包括:Based on the above-mentioned automatic explanation method of a slideshow, an automatic explanation device is also provided in the embodiment of the present invention, and the execution flow of the automatic explanation device is shown in FIG. 2 , including:

编写模块201、第一获取模块202、确定模块203和读取和执行模块204。A writing module 201 , a first acquiring module 202 , a determining module 203 and a reading and executing module 204 .

其中,in,

所述编写模块201,用于预先为当前待讲解幻灯片编写当前讲解脚本,其中,所述当前讲解脚本包括:当前待朗读文本和当前待执行命令;The writing module 201 is used to write a current explanation script for the current slide to be explained in advance, wherein the current explanation script includes: the current text to be read aloud and the current command to be executed;

所述第一获取模块202,用于在接收到对所述当前待讲解幻灯片的自动讲解请求的情况下,获取所述当前讲解脚本;The first obtaining module 202 is configured to obtain the current explanation script when an automatic explanation request for the current slide to be explained is received;

所述确定模块203,用于识别所述当前讲解脚本,确定所述当前讲解脚本中的所述当前待朗读文本和所述当前待执行命令;The determining module 203 is configured to identify the current explanation script, and determine the currently to-be-read text and the current to-be-executed command in the current explanation script;

所述读取和执行模块204,用于依次读取所述当前待朗读文本和执行所述当前待执行命令。The reading and executing module 204 is configured to sequentially read the currently to-be-read text and execute the current to-be-executed command.

本发明公开了一种幻灯片的自动讲解装置,包括:预先为当前待讲解幻灯片编写当前讲解脚本,其中,所述当前讲解脚本包括:当前待朗读文本和当前待执行命令,在接收到对所述当前待讲解幻灯片的自动讲解请求的情况下,获取所述当前讲解脚本;识别所述当前讲解脚本,确定所述当前讲解脚本中的所述当前待朗读文本和所述当前待执行命令;依次读取所述当前待朗读文本和执行所述当前待执行命令。上述过程中,预先为当前待讲解幻灯片编写当前讲解脚本,完成了读取讲解脚本中的待朗读文本和执行与讲解脚本中待执行命令对应的操作指令,基于该操作指令实现对应功能,实现了对待讲解幻灯片的自动讲解,完成幻灯片中相关知识的学习。The invention discloses an automatic explanation device for slides, comprising: writing a current explanation script for the current slide to be explained in advance, wherein, the current explanation script includes: the current to be read text and the current to be executed command, after receiving the response In the case of the automatic explanation request of the slides to be explained at present, obtain the current explanation script; identify the current explanation script, and determine the current text to be read and the current command to be executed in the current explanation script ; Read the text to be read aloud and execute the command to be executed in sequence. In the above process, the current explanation script is written for the current slide to be explained in advance, the reading of the text to be read in the explanation script and the execution of the operation instruction corresponding to the to-be-executed command in the explanation script are completed, and the corresponding function is realized based on the operation instruction. In order to deal with the automatic explanation of the slideshow, complete the learning of the relevant knowledge in the slideshow.

本发明实施例中,所述确定模块203包括:In this embodiment of the present invention, the determining module 203 includes:

识别单元205和确定单元206。Identifying unit 205 and determining unit 206 .

其中,in,

所述识别单元205,用于遍历所述当前讲解脚本,依次识别所述当前讲解脚本;The identifying unit 205 is configured to traverse the current explanation script, and sequentially identify the current explanation script;

所述确定单元206,用于将所述当前讲解脚本中起始标识和结束标识之间的部分确定为当前待执行命令,其余确定为当前待朗读文本,其中,所述当前待朗读脚本至少为一个,所述当前待执行命令至少为一个。The determining unit 206 is configured to determine the part between the start mark and the end mark in the current explanation script as the current command to be executed, and the rest as the current text to be read, wherein the current script to be read is at least One, the current command to be executed is at least one.

本发明实施例中,所述读取和执行模块204包括:In this embodiment of the present invention, the reading and executing module 204 includes:

解析单元207、读取单元208和执行单元209。Parsing unit 207 , reading unit 208 and execution unit 209 .

其中,in,

所述解析单元207,用于依次解析所述当前讲解脚本;The parsing unit 207 is configured to sequentially parse the current explanation script;

所述读取单元208,用于若解析到所述当前讲解脚本中的当前待朗读文本,基于文本到语音转换技术读取所述当前待朗读文本;The reading unit 208 is configured to read the text to be read aloud based on the text-to-speech conversion technology if the current text to be read aloud in the current explanation script is parsed;

所述执行单元209,用于若解析到所述当前讲解脚本中的当前待执行命令,遍历预设的命令集,查找与所述当前待执行命令对应的方法,执行与所述方法对应的操作指令。The executing unit 209 is configured to traverse a preset command set, search for a method corresponding to the current command to be executed, and execute an operation corresponding to the method if the current command to be executed in the current explanation script is parsed instruction.

本发明实施例中,所述装置还包括:In the embodiment of the present invention, the device further includes:

添加模块210和控制模块211。Add module 210 and control module 211 .

其中,in,

所述添加模块210,用于添加控制界面;The adding module 210 is used to add a control interface;

所述控制模块211,用于基于所述控制界面控制展示任一待讲解幻灯片。The control module 211 is configured to control and display any slide to be explained based on the control interface.

本发明实施例中,所述装置还包括:In the embodiment of the present invention, the device further includes:

第二获取模块212和展示模块213。The second acquisition module 212 and the display module 213 .

其中,in,

所述第二获取模块212,用于获取所述当前待朗读文本;The second obtaining module 212 is configured to obtain the current text to be read aloud;

所述展示模块213,用于在读取所述待朗读文本的同时将所述当前待朗读文本在所述当前待讲解幻灯片中预设位置进行同步展示。The presentation module 213 is configured to synchronously display the currently to-be-read text at a preset position in the current to-be-explained slide while reading the to-be-read text.

需要说明的是,本说明书中的各个实施例均采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似的部分互相参见即可。对于装置类实施例而言,由于其与方法实施例基本相似,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。It should be noted that the various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. For the same and similar parts among the various embodiments, refer to each other Can. As for the apparatus type embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for the relevant part, please refer to the partial description of the method embodiment.

最后,还需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。Finally, it should also be noted that in this document, relational terms such as first and second are used only to distinguish one entity or operation from another, and do not necessarily require or imply these entities or that there is any such actual relationship or sequence between operations. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device that includes a list of elements includes not only those elements, but also includes not explicitly listed or other elements inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

以上对本发明所提供的一种幻灯片的自动讲解方法及装置进行了详细介绍,本文中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本发明的限制。The method and device for automatically explaining slides provided by the present invention have been described in detail above. The principles and implementations of the present invention are described with specific examples in this paper. The method of the invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation and application scope. In summary, the content of this description should not be understood to limit the present invention.

Claims (10)

1.一种幻灯片的自动讲解方法,其特征在于,包括:1. the automatic explanation method of a slide, is characterized in that, comprises: 预先为当前待讲解幻灯片编写当前讲解脚本,其中,所述当前讲解脚本包括:当前待朗读文本和当前待执行命令;Pre-writing a current explanation script for the current slide to be explained, wherein the current explanation script includes: the current to-be-read text and the current to-be-executed command; 在接收到对所述当前待讲解幻灯片的自动讲解请求的情况下,获取所述当前讲解脚本;In the case of receiving an automatic explanation request for the current slide to be explained, acquiring the current explanation script; 识别所述当前讲解脚本,确定所述当前讲解脚本中的所述当前待朗读文本和所述当前待执行命令;Identifying the current explanation script, and determining the currently to-be-read text and the current to-be-executed command in the current explanation script; 依次读取所述当前待朗读文本和执行所述当前待执行命令。The current text to be read aloud is sequentially read and the current command to be executed is executed. 2.根据权利要求1所述的方法,其特征在于,识别所述当前讲解脚本,确定所述当前讲解脚本中的所述当前待朗读文本和所述当前待执行命令,包括:2. The method according to claim 1, wherein identifying the current explanation script, determining the current text to be read aloud and the current command to be executed in the current explanation script, comprising: 遍历所述当前讲解脚本,依次识别所述当前讲解脚本;Traverse the current explanation script, and identify the current explanation script in turn; 将所述当前讲解脚本中起始标识和结束标识之间的部分确定为当前待执行命令,其余确定为当前待朗读文本,其中,所述当前待朗读脚本至少为一个,所述当前待执行命令至少为一个。The part between the start mark and the end mark in the current explanation script is determined as the current command to be executed, and the rest is determined as the current text to be read aloud, wherein the current script to be read aloud is at least one, the current command to be executed at least one. 3.根据权利要求1所述的方法,其特征在于,依次读取所述当前待朗读文本和执行所述当前待执行命令,包括:3. The method according to claim 1, wherein sequentially reading the current text to be read aloud and executing the current command to be executed, comprising: 依次解析所述当前讲解脚本;Parse the current explanation script in turn; 若解析到所述当前讲解脚本中的当前待朗读文本,基于文本到语音转换技术读取所述当前待朗读文本;If the current text to be read aloud in the current explanation script is parsed, the current text to be read aloud is read based on a text-to-speech conversion technology; 若解析到所述当前讲解脚本中的当前待执行命令,遍历预设的命令集,查找与所述当前待执行命令对应的方法,执行与所述方法对应的操作指令。If the current command to be executed in the current explanation script is parsed, a preset command set is traversed, a method corresponding to the current command to be executed is searched, and an operation instruction corresponding to the method is executed. 4.根据权利要求1所述的方法,其特征在于,还包括:4. The method of claim 1, further comprising: 添加控制界面;Add control interface; 基于所述控制界面控制展示任一待讲解幻灯片。Based on the control interface, any slide to be explained is controlled to be displayed. 5.根据权利要求1所述的方法,其特征在于,还包括:5. The method of claim 1, further comprising: 获取所述当前待朗读文本;obtain the current text to be read; 在读取所述待朗读文本的同时将所述当前待朗读文本在所述当前待讲解幻灯片中预设位置进行同步展示。While reading the text to be read aloud, the current text to be read aloud is synchronously displayed at a preset position in the current slide to be explained. 6.一种幻灯片的自动讲解装置,其特征在于,包括:6. An automatic explanation device for slides, characterized in that, comprising: 编写模块,用于预先为当前待讲解幻灯片编写当前讲解脚本,其中,所述当前讲解脚本包括:当前待朗读文本和当前待执行命令;A writing module, used for pre-writing a current explanation script for the current slide to be explained, wherein the current explanation script includes: the current text to be read and the current command to be executed; 第一获取模块,用于在接收到对所述当前待讲解幻灯片的自动讲解请求的情况下,获取所述当前讲解脚本;a first obtaining module, configured to obtain the current explanation script when an automatic explanation request for the current slide to be explained is received; 确定模块,用于识别所述当前讲解脚本,确定所述当前讲解脚本中的所述当前待朗读文本和所述当前待执行命令;A determination module, configured to identify the current explanation script, and determine the currently to-be-read text and the current to-be-executed command in the current explanation script; 读取和执行模块,用于依次读取所述当前待朗读文本和执行所述当前待执行命令。A reading and executing module is used to sequentially read the text to be read aloud and execute the command to be executed currently. 7.根据权利要求6所述的装置,其特征在于,所述确定模块包括:7. The apparatus according to claim 6, wherein the determining module comprises: 识别单元,用于遍历所述当前讲解脚本,依次识别所述当前讲解脚本;an identification unit, configured to traverse the current explanation script, and identify the current explanation script in turn; 确定单元,用于将所述当前讲解脚本中起始标识和结束标识之间的部分确定为当前待执行命令,其余确定为当前待朗读文本,其中,所述当前待朗读脚本至少为一个,所述当前待执行命令至少为一个。The determining unit is used to determine the part between the start mark and the end mark in the current explanation script as the current command to be executed, and the rest is determined as the current text to be read, wherein the current script to be read is at least one, so The current command to be executed is at least one. 8.根据权利要求6所述的装置,其特征在于,所述读取和执行模块包括:8. The apparatus according to claim 6, wherein the read and execute module comprises: 解析单元,用于依次解析所述当前讲解脚本;a parsing unit, used for parsing the current explanation script in sequence; 读取单元,用于若解析到所述当前讲解脚本中的当前待朗读文本,基于文本到语音转换技术读取所述当前待朗读文本;a reading unit, configured to read the text to be read aloud based on the text-to-speech conversion technology if the current text to be read aloud in the current explanation script is parsed; 执行单元,用于若解析到所述当前讲解脚本中的当前待执行命令,遍历预设的命令集,查找与所述当前待执行命令对应的方法,执行与所述方法对应的操作指令。The execution unit is configured to traverse a preset command set, search for a method corresponding to the current command to be executed, and execute an operation instruction corresponding to the method if the current command to be executed in the current explanation script is parsed. 9.根据权利要求6所述的装置,其特征在于,还包括:9. The apparatus of claim 6, further comprising: 添加模块,用于添加控制界面;Add module for adding control interface; 控制模块,用于基于所述控制界面控制展示任一待讲解幻灯片。The control module is configured to control and display any slide to be explained based on the control interface. 10.根据权利要求6所述的装置,其特征在于,还包括:10. The apparatus of claim 6, further comprising: 第二获取模块,用于获取所述当前待朗读文本;A second acquisition module, configured to acquire the current text to be read aloud; 展示模块,用于在读取所述待朗读文本的同时将所述当前待朗读文本在所述当前待讲解幻灯片中预设位置进行同步展示。The presentation module is configured to synchronously display the currently to-be-read text in a preset position in the current to-be-explaned slide while reading the to-be-read text.
CN202110898884.7A 2021-08-04 2021-08-04 Method and device for automatic explanation of slides Pending CN113626013A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110898884.7A CN113626013A (en) 2021-08-04 2021-08-04 Method and device for automatic explanation of slides

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110898884.7A CN113626013A (en) 2021-08-04 2021-08-04 Method and device for automatic explanation of slides

Publications (1)

Publication Number Publication Date
CN113626013A true CN113626013A (en) 2021-11-09

Family

ID=78383002

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110898884.7A Pending CN113626013A (en) 2021-08-04 2021-08-04 Method and device for automatic explanation of slides

Country Status (1)

Country Link
CN (1) CN113626013A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114363529A (en) * 2021-12-08 2022-04-15 上海浦东发展银行股份有限公司 Video generation method, device, computer equipment, storage medium and product

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5640590A (en) * 1992-11-18 1997-06-17 Canon Information Systems, Inc. Method and apparatus for scripting a text-to-speech-based multimedia presentation
US6922702B1 (en) * 2000-08-31 2005-07-26 Interactive Video Technologies, Inc. System and method for assembling discrete data files into an executable file and for processing the executable file
CN102819392A (en) * 2012-07-25 2012-12-12 广州视睿电子科技有限公司 Method and system for controlling PPT
CN105450944A (en) * 2015-11-13 2016-03-30 北京自由坊科技有限责任公司 Method and device for synchronously recording and reproducing slides and live presentation speech
CN105679120A (en) * 2016-01-29 2016-06-15 右江民族医学院 Method for making standard mandarin speech micro-courseware based on TTS technology
CN108989776A (en) * 2017-06-05 2018-12-11 深圳市领芯者科技有限公司 Slideshow control method, device, storage medium and handheld terminal
CN109167822A (en) * 2018-08-14 2019-01-08 众安信息技术服务有限公司 A kind of internet of things equipment control method and system based on block chain
CN109509464A (en) * 2017-09-11 2019-03-22 珠海金山办公软件有限公司 It is a kind of text to be read aloud the method and device for being recorded as audio
CN111246288A (en) * 2020-01-22 2020-06-05 福建天泉教育科技有限公司 Method and terminal for demonstrating PPTX document in video mode
CN111538851A (en) * 2020-04-16 2020-08-14 北京捷通华声科技股份有限公司 Method, system, device and storage medium for automatically generating demonstration video

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5640590A (en) * 1992-11-18 1997-06-17 Canon Information Systems, Inc. Method and apparatus for scripting a text-to-speech-based multimedia presentation
US6922702B1 (en) * 2000-08-31 2005-07-26 Interactive Video Technologies, Inc. System and method for assembling discrete data files into an executable file and for processing the executable file
CN102819392A (en) * 2012-07-25 2012-12-12 广州视睿电子科技有限公司 Method and system for controlling PPT
CN105450944A (en) * 2015-11-13 2016-03-30 北京自由坊科技有限责任公司 Method and device for synchronously recording and reproducing slides and live presentation speech
CN105679120A (en) * 2016-01-29 2016-06-15 右江民族医学院 Method for making standard mandarin speech micro-courseware based on TTS technology
CN108989776A (en) * 2017-06-05 2018-12-11 深圳市领芯者科技有限公司 Slideshow control method, device, storage medium and handheld terminal
CN109509464A (en) * 2017-09-11 2019-03-22 珠海金山办公软件有限公司 It is a kind of text to be read aloud the method and device for being recorded as audio
CN109167822A (en) * 2018-08-14 2019-01-08 众安信息技术服务有限公司 A kind of internet of things equipment control method and system based on block chain
CN111246288A (en) * 2020-01-22 2020-06-05 福建天泉教育科技有限公司 Method and terminal for demonstrating PPTX document in video mode
CN111538851A (en) * 2020-04-16 2020-08-14 北京捷通华声科技股份有限公司 Method, system, device and storage medium for automatically generating demonstration video

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
谢同祥: "试析PowerPoint中Flash动画的合理接口", 计算机时代, no. 11, 30 November 2003 (2003-11-30), pages 36 - 38 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114363529A (en) * 2021-12-08 2022-04-15 上海浦东发展银行股份有限公司 Video generation method, device, computer equipment, storage medium and product

Similar Documents

Publication Publication Date Title
Moussalli et al. Intelligent personal assistants: Can they understand and be understood by accented L2 learners?
RU2352979C2 (en) Synchronous comprehension of semantic objects for highly active interface
RU2349969C2 (en) Synchronous understanding of semantic objects realised by means of tags of speech application
TW201921267A (en) Method and system for generating a conversational agent by automatic paraphrase generation based on machine translation
CN110998526B (en) User-configured and custom interactive dialog applications
McTear et al. Voice application development for Android
KR102527107B1 (en) Method for executing function based on voice and electronic device for supporting the same
KR20080042104A (en) Integration of voice engine training into interactive user tutorials
CN109389873B (en) Computer system and computer-implemented training system
KR20120044646A (en) Operation system for universal language learning and operation method thereof, and device supporting the same
CN113626013A (en) Method and device for automatic explanation of slides
Santiago et al. Building cognitive applications with IBM Watson services: Volume 6 speech to text and text to speech
Muhammad et al. Development of English conversation practice app with artificial intelligence & speech recognition
Tomko et al. Towards efficient human machine speech communication: The speech graffiti project
KR20220140304A (en) Video learning systems for recognize learners&#39; voice commands
Kehoe et al. Designing help topics for use with text-to-speech
KR20030079497A (en) service method of language study
JP4809358B2 (en) Method and system for improving the fidelity of a dialogue system
Fume et al. Implementation of automatic captioning system to enhance the accessibility of meetings
KR20000036950A (en) A communications network system for teaching and test in english
KR102098377B1 (en) Method for providing foreign language education service learning grammar using puzzle game
Kulkarni et al. Natural Language Processing Approach to Real-Time Multilingual Speech Conversion
CN112017487A (en) Flat Flash learning system based on artificial intelligence
KR102772943B1 (en) Method, server, and computer program for providing translation services utilizing speech-to-text conversion
Rupitz et al. Development of an Amazon Alexa App for a University Online Search

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination