WO2019033664A1 - Information display control method and apparatus, and intelligent teaching device and storage medium - Google Patents

Information display control method and apparatus, and intelligent teaching device and storage medium Download PDF

Info

Publication number
WO2019033664A1
WO2019033664A1 PCT/CN2017/116773 CN2017116773W WO2019033664A1 WO 2019033664 A1 WO2019033664 A1 WO 2019033664A1 CN 2017116773 W CN2017116773 W CN 2017116773W WO 2019033664 A1 WO2019033664 A1 WO 2019033664A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
gesture
information
instruction
teaching
Prior art date
Application number
PCT/CN2017/116773
Other languages
French (fr)
Chinese (zh)
Inventor
刘伟
Original Assignee
广州视源电子科技股份有限公司
广州视睿电子科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司, 广州视睿电子科技有限公司 filed Critical 广州视源电子科技股份有限公司
Publication of WO2019033664A1 publication Critical patent/WO2019033664A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/02Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Disclosed are an information display control method and apparatus, and an intelligent teaching device and a storage medium. The method comprises: capturing a gesture operation performed by a user on a writing board, and analysing a gesture control instruction corresponding to the gesture operation; and controlling, according to the gesture control instruction, a set display terminal to execute a corresponding teaching information display operation. By means of the method, a gesture operation performed by a user on the writing board can be monitored and captured in real time, thus facilitating a teacher in controlling, by means of the gesture operation, teaching information displayed on a set display terminal during the process of teaching at any time, and preventing a direct operation or a remote control operation, by means of a wireless remote control pen, of the teacher with regard to the set display terminal, so that the teaching efficiency of the teacher is effectively improved and the user experience regarding the intelligent teaching device is then improved.

Description

信息显示的控制方法、装置、智能教学设备及存储介质Control method, device, intelligent teaching device and storage medium for information display 技术领域Technical field
本发明涉及电子教学技术领域,尤其涉及信息显示的控制方法、装置、智能教学设备及存储介质。The invention relates to the field of electronic teaching technology, in particular to a method and a device for controlling information display, an intelligent teaching device and a storage medium.
背景技术Background technique
在电子教育设备改善课室教学环境的大潮中,教学显示终端及教学书写板,如触摸屏终端提供的电子白板和传统黑板的功能一直没有发生较大的变化。教学者基于电子白板进行教学时,可将待讲授的教学信息显示在电子白板上,且讲课过程中,为便于听讲者清楚观看教学信息,通常在电子白板上进行全屏显不。In the tide of improving the classroom teaching environment of electronic education equipment, the functions of the teaching display terminal and the teaching writing board, such as the electronic whiteboard and the traditional blackboard provided by the touch screen terminal, have not changed greatly. When the teacher performs teaching based on the electronic whiteboard, the teaching information to be taught can be displayed on the electronic whiteboard, and in the course of the lecture, in order to facilitate the audience to clearly view the teaching information, the full screen is usually displayed on the electronic whiteboard.
一般地,教学者对教学信息进行讲解时,需要变换当前所显示的教学信息等。通常情况下,教学者可以直接对电子白板进行触摸来控制教学信息的变换,但控制操作过程中可能影响教学信息的全屏显示。为不影响教学信息的全屏显示,教学者也可以通过额外的无线遥控笔(如激光笔)控制电子白板转换当前显示的教学信息。Generally, when the teacher explains the teaching information, it is necessary to change the teaching information currently displayed. Normally, the instructor can directly touch the electronic whiteboard to control the transformation of the teaching information, but the control operation may affect the full-screen display of the teaching information. In order not to affect the full-screen display of teaching information, the instructor can also control the electronic whiteboard to convert the currently displayed teaching information through an additional wireless remote control pen (such as a laser pointer).
然而,教学者在教学过程中也需要进行相应的教学板书,但书写板与电子白板的设置可能存在一定的距离,不方便教学者对电子白板的频繁触摸控制;此外,教学板书时还需要使用板书笔,如果教学者同时使用无线遥控笔控制电子白板,则过多的教学工具将影响教学者的教学体验。However, the teacher also needs to carry out the corresponding teaching board in the teaching process, but the setting of the writing board and the electronic whiteboard may have a certain distance, which is inconvenient for the frequent touch control of the electronic whiteboard by the teacher; in addition, the teaching board also needs to use If the teacher uses a wireless remote control pen to control the electronic whiteboard, too many teaching tools will affect the teaching experience of the teacher.
发明内容Summary of the invention
本发明实施例提供了信息显示的控制方法、装置、智能教学设备及存储介 质,以实现教学过程中教学者对设定显示终端所显示教学信息的有效控制。Embodiments of the present invention provide a method, a device, an intelligent teaching device, and a storage medium for controlling information display. Quality, in order to achieve effective control of the teaching information displayed by the teacher in setting the display terminal during the teaching process.
第一方面,本发明实施例提供了一种信息显示的控制方法,包括:In a first aspect, an embodiment of the present invention provides a method for controlling information display, including:
捕获用户在书写板上进行的手势操作,分析所述手势操作对应的手势控制指令;Capturing a gesture operation performed by the user on the tablet, and analyzing a gesture control instruction corresponding to the gesture operation;
根据所述手势控制指令,控制设定显示终端执行相应教学信息的显示操作。And according to the gesture control instruction, the control setting display terminal performs a display operation of the corresponding teaching information.
第二方面,本发明实施例提供了一种信息显示的控制装置,包括:In a second aspect, an embodiment of the present invention provides a device for controlling information display, including:
指令分析模块,用于捕获用户在书写板上进行的手势操作,并分析所述手势操作对应的手势控制指令;An instruction analysis module, configured to capture a gesture operation performed by a user on the tablet, and analyze a gesture control instruction corresponding to the gesture operation;
显示控制模块,用于根据所述手势控制指令,控制设定显示终端执行相应教学信息的显示操作。And a display control module, configured to control, according to the gesture control instruction, a display operation of the setting display terminal to execute the corresponding teaching information.
第三方面,本发明实施例提供了一种智能教学设备,包括:设定显示终端、书写板以及摄像头,还包括:In a third aspect, an embodiment of the present invention provides an intelligent teaching device, including: setting a display terminal, a writing board, and a camera, and further comprising:
一个或多个处理器;One or more processors;
存储装置,用于存储一个或多个程序;a storage device for storing one or more programs;
所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现本发明实施例提供的信息显示的控制方法。The one or more programs are executed by the one or more processors, such that the one or more processors implement the control method for information display provided by the embodiments of the present invention.
第四方面,本发明实施例提供了一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现本发明实施例提供的信息显示的控制方法。In a fourth aspect, an embodiment of the present invention provides a computer readable storage medium, where a computer program is stored, and when the program is executed by the processor, the method for controlling information display provided by the embodiment of the present invention is implemented.
在上述信息显示的控制方法、装置、智能教学设备及存储介质中,该方法首先捕获用户在书写板上进行的手势操作,并分析该手势操作对应的手势控制指令;之后可以根据手势控制指令,控制设定显示终端执行相应教学信息的显 示操作。上述技术方案,能够实时监控捕获用户在书写板上的手势操作,方便了教学者在教学过程中随时手势操作控制设定显示终端上显示的教学信息,避免了教学者对设定显示终端的直接操作或通过无线遥控笔的遥控操作,从而有效提高了教学者的教学效率,进而提高了智能教学设备的用户体验。In the above-mentioned information display control method, device, intelligent teaching device and storage medium, the method first captures a gesture operation performed by a user on a tablet, and analyzes a gesture control instruction corresponding to the gesture operation; and then can control the instruction according to the gesture. The control setting display terminal displays the corresponding teaching information Show operation. The above technical solution can monitor and capture the gesture operation of the user on the writing board in real time, which is convenient for the teacher to gesture and control the setting of the teaching information displayed on the display terminal at any time during the teaching process, thereby avoiding the direct connection of the teacher to the setting display terminal. The operation or remote operation of the wireless remote control pen effectively improves the teaching efficiency of the educator, thereby improving the user experience of the intelligent teaching device.
附图说明DRAWINGS
图1为本发明实施例一提供的一种信息显示的控制方法的流程示意图;1 is a schematic flowchart of a method for controlling information display according to Embodiment 1 of the present invention;
图2为本发明实施例二提供的一种信息显示的控制方法的流程示意图;2 is a schematic flowchart of a method for controlling information display according to Embodiment 2 of the present invention;
图3为本发明实施例三提供的一种信息显示的控制装置的结构框图;3 is a structural block diagram of a device for controlling information display according to Embodiment 3 of the present invention;
图4为本发明实施例四提供的一种智能教学设备的硬件结构示意图。FIG. 4 is a schematic structural diagram of hardware of an intelligent teaching device according to Embodiment 4 of the present invention.
具体实施方式Detailed ways
下面结合附图和实施例对本发明作进一步的详细说明。可以理解的是,此处所描述的具体实施例仅仅用于解释本发明,而非对本发明的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与本发明相关的部分而非全部结构。The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. It should also be noted that, for ease of description, only some, but not all, of the structures related to the present invention are shown in the drawings.
实施例一Embodiment 1
图1为本发明实施例一提供的一种信息显示的控制方法的流程示意图,该方法适用于教学过程中对教学信息的显示进行控制的情况,该方法可以由教学板书图像处理装置执行,其中该装置可由软件和/或硬件实现,并一般集成智能教学设备上。 FIG. 1 is a schematic flowchart of a method for controlling information display according to Embodiment 1 of the present invention. The method is applicable to a situation in which a display of teaching information is controlled during a teaching process, and the method may be performed by a teaching board image processing apparatus, wherein The device can be implemented by software and/or hardware and is generally integrated on an intelligent teaching device.
需要说明的是,本发明实施例所提供信息显示的控制方法,其主要目的在于教学者教学过程中,可以基于智能教学设备的书写板直接实现对设定显示终端上教学信息的显示控制。It should be noted that the main purpose of the control method for information display provided by the embodiment of the present invention is that the display control of the teaching information on the setting display terminal can be directly realized based on the writing board of the intelligent teaching device.
如图1所示,本发明实施例一提供的一种信息显示的控制方法,包括如下操作:As shown in FIG. 1 , a method for controlling information display according to Embodiment 1 of the present invention includes the following operations:
S101、捕获用户在书写板上进行的手势操作,并分析所述手势操作对应的手势控制指令。S101. Capture a gesture operation performed by a user on a tablet, and analyze a gesture control instruction corresponding to the gesture operation.
在本实施例中,可以通过图像/视频采集装置对用户的操作进行捕获,由此可以捕获到用户在书写板上的手势操作。本实施可认为所述图像/视频采集装置为智能教学设备中的摄像头,所述摄像头具体朝向所述书写板的表面设置,可用于捕获书写板上的板书内容,也可用于捕获用户在书写板上的操作。其中,所述书写板具体可看作本发明所提供智能教学设备的一部分,用于教学者的教学板书所述手势操作具体可以理解为用户通过手部在书写板上进行的点击或滑动操作。In the present embodiment, the user's operation can be captured by the image/video capture device, whereby the user's gesture operation on the tablet can be captured. The image/video capture device can be considered as a camera in the smart teaching device, and the camera is specifically disposed toward the surface of the tablet, and can be used to capture the content of the book on the tablet, and can also be used to capture the user on the tablet. The operation on. The writing board can be specifically regarded as a part of the intelligent teaching apparatus provided by the present invention, and the gesture operation for the teaching board of the teacher can be specifically understood as a click or slide operation performed by the user on the writing board by the hand.
具体地,本步骤可对用户所产生手势操作的具体操作轨迹及操作形态进行分析,示例性地,分析确定手势操作的具体操作轨迹为某个参照点的向上、向下、向左或向右形成的轨迹,其具有的操作形态可能点击式操作或滑动式操作,其操作次数也可以单次或多次等。Specifically, this step may analyze a specific operation trajectory and an operation mode of the gesture operation generated by the user, and exemplarily analyze and determine the specific operation trajectory of the gesture operation as upward, downward, leftward, or rightward of a certain reference point. The formed trajectory may have a click-type operation or a sliding operation, and the number of operations may be single or multiple times.
由此本步骤可根据分析结果,同时根据预先设置好的手势操作与控制指令的映射关系表,可以确定该分析结果对应的手势控制指令。所述手势控制指令具体可理解为用于触发控制智能教学设备中设定显示终端的指令信息。Therefore, according to the analysis result, the step may determine the gesture control instruction corresponding to the analysis result according to the mapping relationship table between the gesture operation and the control instruction set in advance. The gesture control instruction is specifically understood to be used to trigger instruction information for setting a display terminal in the intelligent teaching device.
S102、根据所述手势控制指令,控制设定显示终端执行相应教学信息的显 示操作。S102. Control, according to the gesture control instruction, control setting display terminal to perform corresponding teaching information Show operation.
在本实施例中,所述设定显示终端具体相当于本发明所提供智能教学设备的一部分,可以用于教学信息的显示。所述教学信息可以是摄像头捕获的教学板书图像,也可以是教学者预先编辑的教学文稿。In this embodiment, the setting display terminal is specifically equivalent to a part of the intelligent teaching device provided by the present invention, and can be used for displaying teaching information. The teaching information may be a teaching board image captured by a camera, or may be a teaching document pre-edited by a teacher.
基于上述步骤的操作可知,不同的手势操作对应不同的手势控制指令,而不同的手势控制指令包含了不同的显示控制信息,基于其显示控制信息可以对教学信息进行不同的显示控制,即,控制设定显示终端执行显示控制信息中应当显示的教学信息。Based on the operations of the foregoing steps, different gesture operations correspond to different gesture control commands, and different gesture control commands include different display control information, and different display controls may be performed on the teaching information based on the display control information, that is, control Setting the teaching information that the display terminal should display in the display control information.
示例性地,假设对手势操作分析后确定其对应的手势控制指令中包含的显示控制信息具体用于控制显示当前教学信息的前一状态的教学信息,则本步骤就可控制设定显示终端对当前所显示教学信息的前一状态的教学信息进行显不。Exemplarily, if it is determined that the display control information included in the corresponding gesture control instruction is specifically used to control the teaching information of the previous state of the current teaching information after analyzing the gesture operation, the step may control the setting display terminal pair. The teaching information of the previous state of the currently displayed teaching information is displayed.
需要说明的是,本实施例可以将设定显示终端与书写板看作两个独立结构,二者通过设定连接固件以并行形式或上下形式连接;此外,也可以将设定显示终端与书写板一个整体,使得书写板设置于设定显示终端的部分区域上。It should be noted that, in this embodiment, the setting display terminal and the writing board can be regarded as two independent structures, and the two are connected in parallel or up and down by setting the connection firmware; in addition, the setting display terminal and the writing can also be set. The board is integrally formed such that the writing board is disposed on a partial area of the set display terminal.
本发明实施例一提供的一种信息显示的控制方法,首先捕获用户在书写板上进行的手势操作,并分析该手势操作对应的手势控制指令;之后可以根据手势控制指令,控制设定显示终端执行相应教学信息的显示操作。利用该方法,能够实时监控捕获用户在书写板上的手势操作,方便了教学者在教学过程中随时手势操作控制设定显示终端上显示的教学信息,避免了教学者对设定显示终端的直接操作或通过无线遥控笔的遥控操作,从而有效提高了教学者的教学效率,进而提高了智能教学设备的用户体验。 The method for controlling information display according to the first embodiment of the present invention first captures a gesture operation performed by a user on a tablet, and analyzes a gesture control instruction corresponding to the gesture operation; and then controls the setting display terminal according to the gesture control instruction. Perform the display operation of the corresponding teaching information. By using the method, the gesture operation of capturing the user on the writing board can be monitored in real time, which facilitates the teachinger to control the teaching information displayed on the display terminal at any time during the teaching process, thereby avoiding the direct connection of the teacher to the setting display terminal. The operation or remote operation of the wireless remote control pen effectively improves the teaching efficiency of the educator, thereby improving the user experience of the intelligent teaching device.
实施例二Embodiment 2
图2为本发明实施例二提供的一种信息显示的控制方法的流程示意图,本发明实施例以上述实施例为基础进行优化,在本实施例中,进一步将捕获用户在书写板上进行的手势操作,分析所述手势操作对应的手势控制指令,具体优化为:确定预先在书写板上设定的捕获参考区域,并确定所述捕获参考区域中的手势参照点;实时监控所述捕获参考区域,并捕获用户以所述手势参照点为起始点进行的手势操作;分析所述手势操作相对于所述手势参照点的操作信息,并基于预设的信息指令映射表确定所述操作信息对应的手势控制指令,其中,所述操作信息包括:操作方向和连续操作次数。2 is a schematic flowchart of a method for controlling information display according to Embodiment 2 of the present invention. The embodiment of the present invention is optimized based on the foregoing embodiment. In this embodiment, the user is further captured on the tablet. a gesture operation, analyzing the gesture control instruction corresponding to the gesture operation, specifically optimized to: determining a capture reference area set in advance on the tablet, and determining a gesture reference point in the capture reference area; monitoring the capture reference in real time a region, and capturing a gesture operation performed by the user with the gesture reference point as a starting point; analyzing operation information of the gesture operation relative to the gesture reference point, and determining, according to the preset information instruction mapping table, the operation information The gesture control instruction, wherein the operation information includes: an operation direction and a number of consecutive operations.
在上述优化的基础上,可以将根据所述手势控制指令,控制设定显示终端执行相应教学信息的显示操作,具体优化为:如果所述手势控制指令为上一状态显示指令,则控制所述设定显示终端对当前所显示教学信息上一状态对应的上一教学信息进行显示;如果所述手势控制指令为下一状态显示指令,则控制所述设定显示终端对所述当前所显示教学信息下一状态对应的下一教学信息进行显示。On the basis of the above optimization, the display operation of the corresponding teaching information may be controlled by the setting display terminal according to the gesture control instruction, and is specifically optimized to: if the gesture control instruction is the previous state display instruction, then the control is performed. Setting the display terminal to display the previous teaching information corresponding to the previous state of the currently displayed teaching information; if the gesture control command is the next state display instruction, controlling the setting display terminal to the currently displayed teaching The next teaching information corresponding to the next state of the information is displayed.
同时,还可以将根据所述手势控制指令,控制设定显示终端执行相应教学信息的显示操作,具体优化为:如果所述手势控制指令为向上自动显示指令,则控制所述设定显示终端以设定速率对当前所显示教学信息之前的教学信息自动进行倒序显示;如果所述手势控制指令为向下自动显示指令,则控制所述设定显示终端以所述设定速率对所述当前所显示教学信息之后的教学信息自动进行顺序显示。At the same time, the display operation of the corresponding teaching information is controlled by the setting display terminal according to the gesture control instruction, and is specifically optimized to: if the gesture control instruction is an upward automatic display instruction, control the setting display terminal to Setting the rate to automatically display the teaching information before the currently displayed teaching information; if the gesture control instruction is a downward automatic display instruction, controlling the setting display terminal to the current location at the set rate The teaching information after the teaching information is displayed is automatically displayed in sequence.
此外,也可以将根据所述手势控制指令,控制设定显示终端执行相应教学 信息的显示操作,具体优化为:如果所述手势控制指令为向前切换显示指令,则控制所述设定显示终端对与当前所显示教学信息窗口相邻的前一教学信息窗口中的教学信息进行显示;如果所述手势控制指令为向后切换显示指令,则控制所述设定显示终端对与所述当前所显示教学信息窗口相邻的后一教学信息窗口中的教学信息进行显示。In addition, according to the gesture control instruction, the control display terminal can perform corresponding teaching. The display operation of the information is specifically optimized to: if the gesture control instruction is a forward switching display instruction, controlling the setting display terminal to the teaching information in the previous teaching information window adjacent to the currently displayed teaching information window And performing display; if the gesture control instruction is to switch the display instruction backward, controlling the setting display terminal to display the teaching information in the next teaching information window adjacent to the currently displayed teaching information window.
如图2a所示,本发明实施例提供的一种信息显示的控制方法,具体包括如下操作:As shown in FIG. 2a, a method for controlling information display according to an embodiment of the present invention specifically includes the following operations:
S201、确定预先在书写板上设定的捕获参考区域,并确定所述捕获参考区域中的手势参照点。S201. Determine a capture reference area set in advance on the tablet, and determine a gesture reference point in the capture reference area.
本实施例中,所述捕获参考区域具体可理解为用户可进行手势操作的,摄像头可触发进行手势操作捕获的区域。可以理解的是,书写板常规条件下具体用于用户对教学内容的板书操作,如果不设定相应的捕获参考区域,则本实施例可能无法判断何时开始进行用户手势操作的捕获。In this embodiment, the capture reference area may be specifically understood as a gesture that the user can perform, and the camera may trigger an area for capturing the gesture operation. It can be understood that the tablet is specifically used for the user's board operation on the teaching content under normal conditions. If the corresponding capture reference area is not set, the embodiment may not be able to judge when the capture of the user gesture operation is started.
本实施例可以通过摄像头实时对设定捕获参考区域进行监控,当监测到用户在捕获参考区域中存在一定操作时,相当于触发了摄像头对手势操作的捕获操作,因此,本步骤具体在进行手势操作之前确定所述捕获参考区域的具体位置。一般地,可以设定整个书写板都为捕获参考区域,此时可通过识别用户触发的手势来触发进入显示控制;本实施例优选设定书写板的部分区域为捕获参考区域。In this embodiment, the set capture reference area can be monitored in real time by the camera. When the user detects that there is a certain operation in the capture reference area, it is equivalent to triggering the capture operation of the camera on the gesture operation. Therefore, this step specifically performs the gesture. The specific location of the capture reference area is determined prior to operation. Generally, the entire writing board can be set to capture the reference area, and the entering display control can be triggered by recognizing the gesture triggered by the user; this embodiment preferably sets a partial area of the writing board as the capturing reference area.
在本实施例中,所述手势参照点具体可理解为一个对用户的手势操作进行具体分析所需的参照点。基于所述手势参照点,可以确定手势操作的具体操作方向形成的具体操作轨迹等。本实施例优选设定所述捕获参考区域的中心点为 手势参照点,且可通过突显标记进行标识,以便于用户及摄像头的识别。In this embodiment, the gesture reference point can be specifically understood as a reference point required for performing a specific analysis on the gesture operation of the user. Based on the gesture reference point, a specific operation trajectory formed by a specific operation direction of the gesture operation or the like can be determined. The embodiment preferably sets the center point of the capture reference area to Gesture reference points, and can be identified by highlighting marks for easy identification by the user and the camera.
S202、实时监控所述捕获参考区域,并捕获用户以所述手势参照点为起始点进行的手势操作。S202. Monitor the capture reference area in real time, and capture a gesture operation performed by the user with the gesture reference point as a starting point.
基于上述步骤确定捕获参考区域和手势参照点后,本步骤实时通过摄像图对捕获参考区域进行监控,并在确定用户手部出现在捕获参考区域时,捕获用户以手势参照点为起始点进行的手势操作,由此形成包含手势操作的视频或连续图像帧。After determining the capture reference area and the gesture reference point based on the above steps, this step monitors the capture reference area through the camera image in real time, and captures the user's gesture reference point as a starting point when determining that the user's hand appears in the capture reference area. Gesture operation, thereby forming a video or continuous image frame containing gesture operations.
S203、分析所述手势操作相对于所述手势参照点的操作信息,并基于预设的信息指令映射表确定所述操作信息对应的手势控制指令。S203. Analyze operation information of the gesture operation relative to the gesture reference point, and determine a gesture control instruction corresponding to the operation information based on a preset information instruction mapping table.
在本实施例,可以对捕获的手势操作进行识别分析,确定手势操作实际对应的操作信息,本实施例优选所述操作信息包括:操作方向和连续操作次数。示例性地,可以分析所述手势操作相对于所述手势参照点具体为向上操作还是向下操作,又或者为向左操作还是向右操作。一般地,用户的手势操作通常为滑动操作,由此可进一步确定手势操作的连续操作次数,如,向上单次滑动或向上连续两次滑动等。In this embodiment, the captured gesture operation may be identified and analyzed to determine the operation information that the gesture operation actually corresponds to. In this embodiment, the operation information preferably includes: an operation direction and a number of consecutive operations. Illustratively, it can be analyzed whether the gesture operation is specifically an upward operation or a downward operation with respect to the gesture reference point, or is it a leftward operation or a rightward operation. Generally, the gesture operation of the user is usually a sliding operation, whereby the number of consecutive operations of the gesture operation can be further determined, such as a single sliding up or two consecutive upward slidings.
本实施例可以预先构建操作信息与设定的手势控制指令的映射关系,由此形成信息指令映射表,因此基于该信息指令映射表及本步骤确定的操作信息,可以在位置指令映射表中查找所确定操作信息实际对应的手势控制指令。可以理解的是,位置指令映射表中不同的手势控制指令包含了不同的控制信息。In this embodiment, the mapping relationship between the operation information and the set gesture control instruction may be constructed in advance, thereby forming an information instruction mapping table. Therefore, based on the information instruction mapping table and the operation information determined in this step, the location instruction mapping table may be searched. The gesture control instruction that the determined operation information actually corresponds to. It can be understood that different gesture control instructions in the location instruction mapping table contain different control information.
本实施例根据用户对教学信息显示的实际显示需求,设定了包含不同显示控制信息的手势控制指令。优选地,根据用户需要进行上一教学信息显示的需求,由此设定了包含控制显示上一状态教学信息的上一状态显示指令;根据用 户需要进行下一教学信息显示的需求,由此设定了包含控制显示下一状态教学信息的下一状态显示指令;根据用户需要信息自动进行显示的需求,由此设定了包含控制教学信息向前或先后显示的自动显示指令;此外,根据用户需要对所显示信息的文件进行转换的需求,由此设定了包含控制对不同教学信息窗口进行转换显示的替换显示指令。In this embodiment, according to the actual display requirement of the user for the teaching information display, a gesture control instruction including different display control information is set. Preferably, the requirement for displaying the last teaching information is performed according to the user's needs, thereby setting a previous state display instruction including controlling the display of the previous state teaching information; The user needs to perform the next teaching information display requirement, thereby setting a next state display instruction including controlling to display the next state teaching information; and automatically displaying the content according to the user's required information, thereby setting the control teaching information The automatic display instruction displayed forward or sequentially; in addition, the need to convert the file of the displayed information according to the user's needs, thereby setting a replacement display instruction including controlling the conversion display of the different teaching information windows.
基于上述设定,本实施例可以优选认为所述手势控制指令包括了:上一状态显示指令、下一状态显示指令、向上自动显示指令、向下自动显示指令、向前切换显示指令以及向后切换显示指令。本实施例下述S204至S09分别给出了操作控制指令进行不同信息显示控制时的具体操作。Based on the above settings, the present embodiment may preferably consider that the gesture control instruction includes: a previous status display instruction, a next status display instruction, an upward automatic display instruction, a downward automatic display instruction, a forward switching display instruction, and a backward direction. Switch display instructions. In the present embodiment, the following S204 to S09 respectively give specific operations when the operation control command performs different information display control.
需要说明的是,所设定的手势操作的操作信息与手势控制指令的具体映射关系可以是:当操作信息为相对手势参照点向上单次滑动时,对应的手势控制指令可以为上一状态显示指令;当操作信息为相对手势参照点向下单次滑动时,对应的手势控制指令可以为下一状态显示指令;当操作信息为相对手势参照点向上连续两次滑动时,对应的手势控制指令可以为向上自动显示指令;当操作信息为相对手势参照点向下连续两次滑动时,对应的手势控制指令可以为向下自动显示指令;当操作信息为相对手势参照点向左单次滑动时,对应的手势控制指令可以为向前切换显示指令;当操作信息为相对手势参照点向右单次滑动时,对应的手势控制指令可以为向后切换显示指令。It should be noted that the specific mapping relationship between the operation information of the gesture operation and the gesture control instruction may be: when the operation information is a single sliding upward relative to the gesture reference point, the corresponding gesture control instruction may be the previous state display. When the operation information is a single sliding downward relative to the reference point of the gesture, the corresponding gesture control instruction may display the instruction for the next state; when the operation information is the relative gesture reference point, the corresponding gesture control instruction is continuously slid twice The instruction may be automatically displayed upward; when the operation information is slid downward twice in the relative gesture reference point, the corresponding gesture control instruction may be an automatic display instruction downward; when the operation information is a single sliding of the relative gesture reference point to the left The corresponding gesture control instruction may be a forward switching display instruction; when the operation information is a single sliding to the right relative to the reference reference point, the corresponding gesture control instruction may switch the display instruction backward.
S204、如果手势控制指令为上一状态显示指令,则控制设定显示终端对当前所显示教学信息上一状态对应的上一教学信息进行显示。S204. If the gesture control command is the previous state display command, the control setting display terminal displays the previous teaching information corresponding to the previous state of the currently displayed teaching information.
示例性地,在教学过程中,假设用户在书写板捕获参考区域中基于手势参照点进行手势操作对应的操作信息为向上单次滑动,则基于S203可确定其实际 对应的手势控制指令为上一状态显示指令。Illustratively, in the teaching process, it is assumed that the operation information corresponding to the gesture operation based on the gesture reference point in the tablet capture reference area is an upward single slide, and the actual determination is based on S203. The corresponding gesture control command is the previous state display instruction.
此时,可以确定设定显示终端上的当前所显示教学信息,并确定当前所显示教学信息的上一状态具体对应的上一教学信息,之后可控制设定显示终端将所显示的内容变换为上一教学信息。At this time, it may be determined to set the currently displayed teaching information on the display terminal, and determine the last teaching information corresponding to the previous state of the currently displayed teaching information, and then control the setting display terminal to convert the displayed content into Last teaching information.
S205、如果手势控制指令为下一状态显示指令,则控制设定显示终端对当前所显示教学信息下一状态对应的下一教学信息进行显示。S205. If the gesture control instruction is the next status display instruction, the control setting display terminal displays the next teaching information corresponding to the next state of the currently displayed teaching information.
示例性地,本步骤的操作类似于上述S204的操作,即,在确定手势控制指令为相应的下一状态显示指令后,同样先确定设定显示终端上的当前所显示教学信息,并确定该教学信息的下一显示状态具体对应的下一教学信息,由此可控制设定显示终端将要显示的内容变换成下一教学信息。Exemplarily, the operation of this step is similar to the operation of S204 described above, that is, after determining that the gesture control instruction is the corresponding next state display instruction, first determining the currently displayed teaching information on the setting display terminal, and determining the The next display state of the teaching information specifically corresponds to the next teaching information, thereby controlling the setting display terminal to convert the content to be displayed into the next teaching information.
S206、如果手势控制指令为向上自动显示指令,则控制设定显示终端以设定速率对当前所显示教学信息之前的教学信息自动进行倒序显示。S206. If the gesture control command is an upward automatic display instruction, the control setting display terminal automatically displays the teaching information before the currently displayed teaching information in reverse order at the set rate.
具体地,在教学过程中,用户(教学者)想向听讲者进行教学信息演示时,如果频繁的进行下一状态显示指令的手势操作,则同样会降低用户体验,此时用户可以直接通过手势操作触发手势控制指令中的信息自动显示指令,其中,所述信息自动显示指令又可以根据不同的手势操作细化为向上自动显示指令和向下自动显示指令。Specifically, in the teaching process, when the user (teacher) wants to present the teaching information to the presenter, if the gesture operation of the next state display instruction is frequently performed, the user experience is also reduced, and the user can directly pass the gesture. The information in the trigger gesture control instruction automatically displays an instruction, wherein the information automatic display instruction can be further refined into an upward automatic display instruction and a downward automatic display instruction according to different gesture operations.
本步骤可以在确定用户手势操作的操作信息为向上连续两次滑动时,具体根据向上自动显示指令控制设定显示终端对当前所显示教学信息之前的教学信息进行自动显示。其中,本实施例可以基于预先设定的跳转速率控制教学信息向前跳转并显示。本步骤对当前所显示教学信息之前的教学信息进行显示,可以方便听见者再次对已讲授教学信息的巩固加深。 In this step, when the operation information of the user gesture operation is determined to be scrolled up two times in succession, the teaching information before the currently displayed teaching information is automatically displayed according to the upward automatic display instruction control setting display terminal. The embodiment can control the teaching information to jump forward and display based on the preset jump rate. This step displays the teaching information before the currently displayed teaching information, which can facilitate the listener to deepen the consolidation of the taught teaching information.
需要说明的是,本实施例还可以通过再次触发所述向上自动显示指令控制设定显示终端停止对教学信息的自动显示。具体地,当在教学信息自动跳转显示的过程中再次确定用户进行了向上自动显示指令对应的手势操作时,可认为触发了自动显示功能的停止操作,由此可结束教学信息向前的自动显示。It should be noted that, in this embodiment, the display terminal can be stopped by automatically triggering the upward automatic display instruction to stop the automatic display of the teaching information. Specifically, when it is determined that the user performs the gesture operation corresponding to the upward automatic display instruction during the automatic jump display of the teaching information, it may be considered that the stop operation of the automatic display function is triggered, thereby ending the automatic advancement of the teaching information. display.
S207、如果手势控制指令为向下自动显示指令,则控制设定显示终端以设定速率对当前所显示教学信息之后的教学信息自动进行顺序显示。S207. If the gesture control instruction is a downward automatic display instruction, the control setting display terminal automatically displays the teaching information after the currently displayed teaching information in a sequence at a set rate.
示例性地,本步骤的操作类似于上述S206的操作,即,在确定手势控制指令为相应的向下自动显示指令后,同样可根据向下自动显示指令控制设定显示终端对当前所显示教学信息之后的教学信息进行自动显示,由此可控制设定显示终端以设定速率自动控制教学信息的向后跳转和显示。Exemplarily, the operation of this step is similar to the operation of the above S206, that is, after determining that the gesture control instruction is the corresponding downward automatic display instruction, the display terminal can also be set according to the downward automatic display instruction to control the currently displayed teaching. The teaching information after the information is automatically displayed, thereby controlling the setting display terminal to automatically control the backward jump and display of the teaching information at the set rate.
同样,当在教学信息自动跳转显示的过程中再次确定用户进行了向下自动显示指令对应的手势操作时,可认为触发了自动显示功能的停止操作,由此可结束教学信息的向后自动显示。Similarly, when it is determined that the user performs the gesture operation corresponding to the downward automatic display instruction during the automatic jump display of the teaching information, it can be considered that the stop operation of the automatic display function is triggered, thereby ending the backward automatic of the teaching information. display.
S208、如果手势控制指令为向前切换显示指令,则控制设定显示终端对与当前所显示教学信息窗口相邻的前一教学信息窗口中的教学信息进行显示。S208. If the gesture control command is a forward switching display instruction, the control setting display terminal displays the teaching information in the previous teaching information window adjacent to the currently displayed teaching information window.
需要注意的是,一般情况下,设定显示终端上可以同时打开多个教学文件,以并列窗口形式显示,在教学过程中,可以需要在多个教学文件间进行切换,现有的方法也需要直接对设定显示终端进行操作,以进行教学文件窗口间的切换。It should be noted that in general, multiple teaching files can be opened at the same time on the display terminal, and displayed in a side-by-side window. In the teaching process, it is necessary to switch between multiple teaching files, and the existing methods also need to be performed. Directly operate the setting display terminal to switch between teaching file windows.
本实施例同样可以通过用户在书写板上的手势操作实现教学文件窗口之间的切换。具体地,对于教学文件窗口的切换,本实施例设定了向前切换显示指令和向后切换显示指令,即,当用户需要由当前教学信息窗口切换到相邻的前 一个教学信息窗口时,可以在书写板上进行包含向左单词滑动操作信息的手势操作,由此基于S204确定该手势操作的手势操作指令后,可以实现本步骤的操作。In this embodiment, the switching between the teaching file windows can also be realized by the gesture operation of the user on the writing board. Specifically, for the switching of the teaching file window, the embodiment sets the forward switching display instruction and the backward switching display instruction, that is, when the user needs to switch from the current teaching information window to the adjacent one. When teaching the information window, a gesture operation including the leftward word slide operation information may be performed on the tablet, whereby the operation of this step may be implemented after determining the gesture operation instruction of the gesture operation based on S204.
S209、如果手势控制指令为向后切换显示指令,则控制设定显示终端对与当前所显示教学信息窗口相邻的后一教学信息窗口中的教学信息进行显示。S209. If the gesture control command is to switch the display instruction backward, the control setting display terminal displays the teaching information in the next teaching information window adjacent to the currently displayed teaching information window.
示例性地,本步骤的操作类似于上述S208的操作,当用户需要由当前教学信息窗口切换到相邻的后一个教学信息窗口时,可以在书写板上进行包含向右单词滑动操作信息的手势操作,由此基于S204可确定其对应的手势控制指令为先后切换指令,进而基于本步骤的操作可以实现当前教学信息窗口到后一个教学信息窗口的切换,并可对后一教学信息窗口中的教学信息进行显示。Exemplarily, the operation of this step is similar to the operation of S208 described above. When the user needs to switch from the current teaching information window to the adjacent teaching information window, a gesture including the rightward sliding operation information may be performed on the writing board. Operation, thereby determining that the corresponding gesture control instruction is a sequential switching instruction based on S204, and then switching the current teaching information window to the next teaching information window based on the operation of the step, and in the latter teaching information window Teaching information is displayed.
本发明实施例二提供的一种信息显示的控制方法,具体化了手势控制指令的确定过程,并具体化了不同手势控制指令所对应显示控制的控制过程。利用该方法,教学者无需离开教学板书的书写板,就能够通过书写板对设定显示终端的显示内容进行控制;避免了教学者对设定显示终端的直接操作或通过无线遥控笔的遥控操作,实现了设定显示终端显示内容的实时有效控制;从而有效提高了教学者的教学效率,进而提高了智能教学设备的用户体验。A control method for information display provided by the second embodiment of the present invention specifies a process of determining a gesture control command, and embodies a control process of display control corresponding to different gesture control commands. By using the method, the teacher can control the display content of the setting display terminal through the writing board without leaving the writing board of the teaching board; the direct operation of the setting display terminal by the teacher or the remote operation by the wireless remote control pen is avoided. The real-time effective control for setting the display content of the display terminal is realized; thereby effectively improving the teaching efficiency of the teaching person, thereby improving the user experience of the intelligent teaching device.
实施例三Embodiment 3
图3为本发明实施例三提供的一种信息显示的控制装置的结构框图。该装置适用于教学过程中对教学信息的显示进行控制的情况,其中该装置可由软件和/或硬件实现,并一般集成智能教学设备上。如图3所示,该装置包括:指令分析模块31以及显示控制模块32。 FIG. 3 is a structural block diagram of a device for controlling information display according to Embodiment 3 of the present invention. The device is suitable for controlling the display of teaching information during the teaching process, wherein the device can be implemented by software and/or hardware, and is generally integrated into the intelligent teaching device. As shown in FIG. 3, the apparatus includes an instruction analysis module 31 and a display control module 32.
其中,指令分析模块31,用于捕获用户在书写板上进行的手势操作,并分析所述手势操作对应的手势控制指令;The instruction analysis module 31 is configured to capture a gesture operation performed by the user on the tablet, and analyze the gesture control instruction corresponding to the gesture operation;
显示控制模块32,用于根据所述手势控制指令,控制设定显示终端执行相应教学信息的显示操作。The display control module 32 is configured to control, according to the gesture control instruction, a display operation of the setting display terminal to execute the corresponding teaching information.
在本实施例中,该装置首先通过指令分析模块31捕获用户在书写板上进行的手势操作,并分析所述手势操作对应的手势控制指令;之后通过显示控制模块32根据所述手势控制指令,控制设定显示终端执行相应教学信息的显示操作。In this embodiment, the device first captures a gesture operation performed by the user on the tablet by the instruction analysis module 31, and analyzes the gesture control instruction corresponding to the gesture operation; and then controls the instruction according to the gesture by the display control module 32. The control setting display terminal performs a display operation of the corresponding teaching information.
本发明实施例三提供的一种信息显示的控制装置,能够实时监控捕获用户在书写板上的手势操作,方便了教学者在教学过程中随时手势操作控制设定显示终端上显示的教学信息,避免了教学者对设定显示终端的直接操作或通过无线遥控笔的遥控操作,从而有效提高了教学者的教学效率,进而提高了智能教学设备的用户体验。The information display control device provided in the third embodiment of the present invention can monitor and capture the gesture operation of the user on the writing board in real time, and facilitates the teaching information displayed by the teacher at any time during the teaching process by the gesture operation control setting display terminal. The direct operation of the setting display terminal or the remote operation of the wireless remote control pen is avoided, thereby effectively improving the teaching efficiency of the teaching person, thereby improving the user experience of the intelligent teaching device.
进一步地,指令分析模块31,具体用于:Further, the instruction analysis module 31 is specifically configured to:
确定预先在书写板上设定的捕获参考区域,并确定所述捕获参考区域中的手势参照点;实时监控所述捕获参考区域,并捕获用户以所述手势参照点为起始点进行的手势操作;分析所述手势操作相对于所述手势参照点的操作信息,并基于预设的信息指令映射表确定所述操作信息对应的手势控制指令,其中,所述操作信息包括:操作方向和连续操作次数。Determining a capture reference area set in advance on the tablet, and determining a gesture reference point in the capture reference area; monitoring the capture reference area in real time, and capturing a gesture operation performed by the user starting from the gesture reference point And analyzing operation information of the gesture operation relative to the gesture reference point, and determining a gesture control instruction corresponding to the operation information based on a preset information instruction mapping table, where the operation information includes: an operation direction and a continuous operation frequency.
进一步地,所述手势控制指令包括:上一状态显示指令、下一状态显示指令、向上自动显示指令、向下自动显示指令、向前切换显示指令以及向后切换显示指令。 Further, the gesture control instruction includes: a previous status display instruction, a next status display instruction, an upward automatic display instruction, a downward automatic display instruction, a forward switching display instruction, and a backward switching display instruction.
在上述优化的基础上,显示控制模块32,可以包括:On the basis of the above optimization, the display control module 32 may include:
第一显示控制单元,用于当所述手势控制指令为上一状态显示指令时,控制所述设定显示终端对当前所显示教学信息上一状态对应的上一教学信息进行显示;a first display control unit, configured to: when the gesture control instruction is a previous state display instruction, control the setting display terminal to display a previous teaching information corresponding to a state of the currently displayed teaching information;
第二显示控制单元,用于当所述手势控制指令为下一状态显示指令时,控制所述设定显示终端对所述当前所显示教学信息下一状态对应的下一教学信息进行显示。The second display control unit is configured to: when the gesture control instruction is the next state display instruction, control the setting display terminal to display the next teaching information corresponding to the next state of the currently displayed teaching information.
进一步地,显示控制模块32,还可以包括:Further, the display control module 32 may further include:
第三显示控制单元,用于当所述手势控制指令为向上自动显示指令时,控制所述设定显示终端以设定速率对当前所显示教学信息之前的教学信息自动进行倒序显示;a third display control unit, configured to: when the gesture control instruction is an upward automatic display instruction, control the setting display terminal to automatically perform reverse display on the teaching information before the currently displayed teaching information at a set rate;
第四显示控制单元,用于当所述手势控制指令为向下自动显示指令时,控制所述设定显示终端以所述设定速率对所述当前所显示教学信息之后的教学信息自动进行顺序显示。a fourth display control unit, configured to: when the gesture control instruction is a downward automatic display instruction, control the setting display terminal to automatically sequence the teaching information after the currently displayed teaching information at the set rate display.
在上述优化的基础上,显示控制模块32,也可以包括:On the basis of the above optimization, the display control module 32 may also include:
第五显示控制单元,用于当所述手势控制指令为向前切换显示指令时,控制所述设定显示终端对与当前所显示教学信息窗口相邻的前一教学信息窗口中的教学信息进行显示;a fifth display control unit, configured to: when the gesture control instruction is a forward switching display instruction, control the setting display terminal to perform teaching information in a previous teaching information window adjacent to the currently displayed teaching information window; display;
第六显示控制单元,用于当所述手势控制指令为向后切换显示指令时,控制所述设定显示终端对与所述当前所显示教学信息窗口相邻的后一教学信息窗口中的教学信息进行显示。 a sixth display control unit, configured to: when the gesture control instruction is to switch the display instruction backward, control the setting display terminal to teach in a subsequent teaching information window adjacent to the currently displayed teaching information window The information is displayed.
实施例四Embodiment 4
本发明实施例四还提供了一种智能教学设备,图4为本发明实施例四提供的一种智能教学设备的硬件结构示意图,如图4所示,本发明实施例四提供的智能教学设备,包括:设定显示终端401,书写板402和摄像头403,还包括:处理器404和存储装置405。此外,该智能教学设备的处理器可以是一个或多个,图4中以一个处理器404为例,所述智能教学设备中的设定显示终端、书写板、摄像头可以通过总线或其他方式分别与处理器和存储装置连接,且处理器和存储装置也通过总线或其他方式连接,图4中以通过总线连接为例。The fourth embodiment of the present invention provides an intelligent teaching device. FIG. 4 is a schematic diagram of a hardware structure of an intelligent teaching device according to Embodiment 4 of the present invention. As shown in FIG. 4, the intelligent teaching device provided in Embodiment 4 of the present invention is provided. The method includes: setting the display terminal 401, the tablet 402 and the camera 403, and further comprising: a processor 404 and a storage device 405. In addition, the processor of the intelligent teaching device may be one or more. In FIG. 4, a processor 404 is taken as an example. The setting display terminal, the writing board, and the camera in the intelligent teaching device may be respectively separated by a bus or other means. The processor and the storage device are connected, and the processor and the storage device are also connected by a bus or other means. In FIG. 4, a bus connection is taken as an example.
可以理解的是,设定显示终端401和书写板402可以是独立整体上的两个部分,也可以是两个独立结构基于连接轴的拼接,本实施例中设定显示终端401与书写板402可以是独立整体的上下分割或两独立结构的上下拼接,也可以是独立整体的左右平行分割或两独立结构的平行拼接。此外,本实施例中摄像头403为设置于书写板上边缘,其摄像头朝向主要对焦于书写板402表面,用于对书写板上教学板书内容的捕获,形成教学板书图像。It can be understood that the display terminal 401 and the tablet 402 can be two parts on a single unit, or two separate structures based on the connection axis. In this embodiment, the display terminal 401 and the tablet 402 are set. It may be an independent whole upper and lower division or upper and lower splicing of two independent structures, or may be independent whole left and right parallel division or parallel structure of two independent structures. In addition, in the embodiment, the camera 403 is disposed on the edge of the tablet, and the camera is oriented mainly on the surface of the tablet 402 for capturing the content of the teaching board on the tablet to form a teaching board image.
需要说明的是,当设定显示终端401上不进行其他教学信息显示时,基于摄像头403捕获的教学板书图像可以通过处理器404的控制实时显示在设定显示终端401上。还可以知道的是,本实施例在教学过程还可以在设定显示终端401上对所需的其他教学信息(如教学演示文稿课件)进行实时显示,以便于教学者边基于设定显示终端401上的演示文稿进行教学授课,边在书写板402上通过教学板书对演示文稿中的内容进行讲解。It should be noted that when the teaching information display is not performed on the setting display terminal 401, the teaching board image captured based on the camera 403 can be displayed on the setting display terminal 401 in real time by the control of the processor 404. It can also be known that the teaching process can also display the other teaching information (such as the teaching presentation courseware) required on the setting display terminal 401 in real time, so that the teacher can display the terminal 401 based on the setting. The presentation on the presentation is taught, and the contents of the presentation are explained on the writing board 402 through the teaching board.
该智能教学设备中的存储装置405作为一种计算机可读存储介质,可用于存储一个或多个程序,所述程序可以是软件程序、计算机可执行程序以及模块, 如本发明实施例提供的信息显示的控制装置中对应的程序指令/模块(例如,附图3所示的模块,包括:指令分析模块31以及显示控制模块32)。处理器404通过运行存储在存储装置405中的软件程序、指令以及模块,从而执行智能教学设备的各种功能应用以及数据处理,即实现上述方法实施例中信息显示的控制方法。The storage device 405 in the intelligent teaching device is a computer readable storage medium, and can be used to store one or more programs, which can be software programs, computer executable programs, and modules. A corresponding program instruction/module in the control device for information display according to the embodiment of the present invention (for example, the module shown in FIG. 3 includes: the instruction analysis module 31 and the display control module 32). The processor 404 executes various functional applications and data processing of the intelligent teaching device by running software programs, instructions and modules stored in the storage device 405, that is, a control method for implementing information display in the above method embodiments.
存储装置405可包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序;存储数据区可存储根据设备的使用所创建的数据等。此外,存储装置405可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中,存储装置405可进一步包括相对于处理器404远程设置的存储器,这些远程存储器可以通过网络连接至设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The storage device 405 may include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the device, and the like. Moreover, storage device 405 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, storage device 405 can further include memory remotely located relative to processor 404, which can be connected to the device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
并且,当上述智能教学设备所包括一个或者多个程序被所述一个或者多个处理器404执行时,其中一个程序可以进行如下操作:And, when one or more programs included in the smart teaching device are executed by the one or more processors 404, one of the programs can perform the following operations:
捕获用户在书写板上进行的手势操作,并分析所述手势操作对应的手势控制指令;根据所述手势控制指令,控制设定显示终端执行相应教学信息的显示操作。The gesture operation performed by the user on the tablet is captured, and the gesture control instruction corresponding to the gesture operation is analyzed; and according to the gesture control instruction, the display terminal is controlled to perform a display operation of the corresponding teaching information.
此外,本发明实施例还提供一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现本发明实施例一或实施例二提供的信息显示的控制方法,其中,上述实施例一提供的方法包括:捕获用户在书写板上进行的手势操作,并分析所述手势操作对应的手势控制指令;根据所述手势控制指令,控制设定显示终端执行相应教学信息的显示操作。 In addition, the embodiment of the present invention further provides a computer readable storage medium, where the computer program is stored, and when the program is executed by the processor, the method for controlling information display according to the first embodiment or the second embodiment of the present invention is implemented. The method provided in the first embodiment includes: capturing a gesture operation performed by a user on a tablet, and analyzing a gesture control instruction corresponding to the gesture operation; and controlling, according to the gesture control instruction, the setting display terminal to perform display of the corresponding teaching information. operating.
通过以上关于实施方式的描述,所属领域的技术人员可以清楚地了解到,本发明可借助软件及必需的通用硬件来实现,当然也可以通过硬件实现,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在计算机可读存储介质中,如计算机的软盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、闪存(FLASH)、硬盘或光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述的方法。Through the above description of the embodiments, those skilled in the art can clearly understand that the present invention can be implemented by software and necessary general hardware, and can also be implemented by hardware, but in many cases, the former is a better implementation. . Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk of a computer. , Read-Only Memory (ROM), Random Access Memory (RAM), Flash (FLASH), hard disk or optical disk, etc., including a number of instructions to make a computer device (can be a personal computer) The server, or network device, etc.) performs the methods described in various embodiments of the present invention.
值得注意的是,上述信息显示的控制装置的实施例中,所包括的各个单元和模块只是按照功能逻辑进行划分的,但并不局限于上述的划分,只要能够实现相应的功能即可;另外,各功能单元的具体名称也只是为了便于相互区分,并不用于限制本发明的保护范围。It should be noted that, in the embodiment of the control device for displaying the above information, each unit and module included is only divided according to functional logic, but is not limited to the above division, as long as the corresponding function can be implemented; The specific names of the functional units are also only for convenience of distinguishing from each other, and are not intended to limit the scope of protection of the present invention.
需要说明的是,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。It should be noted that those skilled in the art can combine and combine the different embodiments or examples described in the specification and the features of the different embodiments or examples, without contradicting each other.
注意,上述仅为本发明的较佳实施例及所运用技术原理。本领域技术人员会理解,本发明不限于这里所述的特定实施例,对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本发明的保护范围。因此,虽然通过以上实施例对本发明进行了较为详细的说明,但是本发明不仅仅限于以上实施例,在不脱离本发明构思的情况下,还可以包括更多其他等效实施例,而本发明的范围由所附的权利要求范围决定。 Note that the above are only the preferred embodiments of the present invention and the technical principles applied thereto. Those skilled in the art will appreciate that the present invention is not limited to the specific embodiments described herein, and that various modifications, changes and substitutions may be made without departing from the scope of the invention. Therefore, the present invention has been described in detail by the above embodiments, but the present invention is not limited to the above embodiments, and other equivalent embodiments may be included without departing from the inventive concept. The scope is determined by the scope of the appended claims.

Claims (10)

  1. 一种信息显示的控制方法,其特征在于,包括:A method for controlling information display, comprising:
    捕获用户在书写板上进行的手势操作,并分析所述手势操作对应的手势控制指令;Capturing a gesture operation performed by a user on the tablet, and analyzing a gesture control instruction corresponding to the gesture operation;
    根据所述手势控制指令,控制设定显示终端执行相应教学信息的显示操作。And according to the gesture control instruction, the control setting display terminal performs a display operation of the corresponding teaching information.
  2. 根据权利要求1所述的方法,其特征在于,所述捕获用户在书写板上进行的手势操作,分析所述手势操作对应的手势控制指令,包括:The method according to claim 1, wherein the capturing a gesture operation performed by the user on the tablet and analyzing the gesture control instruction corresponding to the gesture operation comprises:
    确定预先在书写板上设定的捕获参考区域,并确定所述捕获参考区域中的手势参照点;Determining a capture reference area set in advance on the tablet, and determining a gesture reference point in the capture reference area;
    实时监控所述捕获参考区域,并捕获用户以所述手势参照点为起始点进行的手势操作;Monitoring the capture reference area in real time, and capturing a gesture operation performed by the user with the gesture reference point as a starting point;
    分析所述手势操作相对于所述手势参照点的操作信息,并基于预设的信息指令映射表确定所述操作信息对应的手势控制指令,其中,所述操作信息包括:操作方向和连续操作次数。An operation information of the gesture operation relative to the gesture reference point is analyzed, and a gesture control instruction corresponding to the operation information is determined according to a preset information instruction mapping table, where the operation information includes: an operation direction and a number of consecutive operations .
  3. 根据权利要求1或2所述的方法,其特征在于,所述手势控制指令包括:上一状态显示指令、下一状态显示指令、向上自动显示指令、向下自动显示指令、向前切换显示指令以及向后切换显示指令。The method according to claim 1 or 2, wherein the gesture control instruction comprises: a previous status display instruction, a next status display instruction, an upward automatic display instruction, a downward automatic display instruction, and a forward switching display instruction And switching the display instruction backwards.
  4. 根据权利要求3所述的方法,其特征在于,所述根据所述手势控制指令,控制设定显示终端执行相应教学信息的显示操作,包括:The method according to claim 3, wherein the controlling the display terminal to perform the display operation of the corresponding teaching information according to the gesture control instruction comprises:
    如果所述手势控制指令为上一状态显示指令,则控制所述设定显示终端对当前所显示教学信息上一状态对应的上一教学信息进行显示;And if the gesture control instruction is a previous status display instruction, controlling the setting display terminal to display a previous teaching information corresponding to a state of the currently displayed teaching information;
    如果所述手势控制指令为下一状态显示指令,则控制所述设定显示终端对所述当前所显示教学信息下一状态对应的下一教学信息进行显示。 And if the gesture control instruction is a next status display instruction, controlling the setting display terminal to display the next teaching information corresponding to the next state of the currently displayed teaching information.
  5. 根据权利要求3所述的方法,其特征在于,所述根据所述手势控制指令,控制设定显示终端执行相应教学信息的显示操作,包括:The method according to claim 3, wherein the controlling the display terminal to perform the display operation of the corresponding teaching information according to the gesture control instruction comprises:
    如果所述手势控制指令为向上自动显示指令,则控制所述设定显示终端以设定速率对当前所显示教学信息之前的教学信息自动进行倒序显示;If the gesture control instruction is an upward automatic display instruction, controlling the setting display terminal to automatically display the teaching information before the currently displayed teaching information at a set rate;
    如果所述手势控制指令为向下自动显示指令,则控制所述设定显示终端以所述设定速率对所述当前所显示教学信息之后的教学信息自动进行顺序显示。If the gesture control instruction is a downward automatic display instruction, the setting display terminal is controlled to automatically display the teaching information after the currently displayed teaching information at the set rate.
  6. 根据权利要求3所述的方法,其特征在于,所述根据所述手势控制指令,控制设定显示终端执行相应教学信息的显示操作,包括:The method according to claim 3, wherein the controlling the display terminal to perform the display operation of the corresponding teaching information according to the gesture control instruction comprises:
    如果所述手势控制指令为向前切换显示指令,则控制所述设定显示终端对与当前所显示教学信息窗口相邻的前一教学信息窗口中的教学信息进行显示;If the gesture control instruction is a forward switching display instruction, controlling the setting display terminal to display the teaching information in the previous teaching information window adjacent to the currently displayed teaching information window;
    如果所述手势控制指令为向后切换显示指令,则控制所述设定显示终端对与所述当前所显示教学信息窗口相邻的后一教学信息窗口中的教学信息进行显示。If the gesture control command is to switch the display instruction backward, the setting display terminal is controlled to display the teaching information in the next teaching information window adjacent to the currently displayed teaching information window.
  7. 一种信息显示的控制装置,其特征在于,包括:A control device for information display, comprising:
    指令分析模块,用于捕获用户在书写板上进行的手势操作,并分析所述手势操作对应的手势控制指令;An instruction analysis module, configured to capture a gesture operation performed by a user on the tablet, and analyze a gesture control instruction corresponding to the gesture operation;
    显示控制模块,用于根据所述手势控制指令,控制设定显示终端执行相应教学信息的显示操作。And a display control module, configured to control, according to the gesture control instruction, a display operation of the setting display terminal to execute the corresponding teaching information.
  8. 根据权利要求7所述的装置,其特征在于,所述指令分析模块,具体用于:The device according to claim 7, wherein the instruction analysis module is specifically configured to:
    确定预先在书写板上设定的捕获参考区域,并确定所述捕获参考区域中的手势参照点; Determining a capture reference area set in advance on the tablet, and determining a gesture reference point in the capture reference area;
    实时监控所述捕获参考区域,并捕获用户以所述手势参照点为起始点进行的手势操作;Monitoring the capture reference area in real time, and capturing a gesture operation performed by the user with the gesture reference point as a starting point;
    分析所述手势操作相对于所述手势参照点的操作信息,并基于预设的信息指令映射表确定所述操作信息对应的手势控制指令,其中,所述操作信息包括:操作方向和连续操作次数。An operation information of the gesture operation relative to the gesture reference point is analyzed, and a gesture control instruction corresponding to the operation information is determined according to a preset information instruction mapping table, where the operation information includes: an operation direction and a number of consecutive operations .
  9. 一种智能教学设备,包括:设定显示终端、书写板和摄像头,其特征在于,还包括:An intelligent teaching device includes: a display terminal, a writing pad and a camera, wherein the method further comprises:
    一个或多个处理器;One or more processors;
    存储装置,用于存储一个或多个程序;a storage device for storing one or more programs;
    所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现如权利要求1-6中任一项所述的信息显示的控制方法。The one or more programs are executed by the one or more processors, such that the one or more processors implement the control method of information display according to any one of claims 1-6.
  10. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现如权利要求1-6中任一项所述的信息显示的控制方法。 A computer readable storage medium having stored thereon a computer program, wherein the program is executed by a processor to implement the method of controlling information display according to any one of claims 1-6.
PCT/CN2017/116773 2017-08-18 2017-12-17 Information display control method and apparatus, and intelligent teaching device and storage medium WO2019033664A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710709910.0A CN107506033A (en) 2017-08-18 2017-08-18 Control method, device, intelligent instructional device and the storage medium of presentation of information
CN201710709910.0 2017-08-18

Publications (1)

Publication Number Publication Date
WO2019033664A1 true WO2019033664A1 (en) 2019-02-21

Family

ID=60691275

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/116773 WO2019033664A1 (en) 2017-08-18 2017-12-17 Information display control method and apparatus, and intelligent teaching device and storage medium

Country Status (2)

Country Link
CN (1) CN107506033A (en)
WO (1) WO2019033664A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111078100A (en) * 2019-06-03 2020-04-28 广东小天才科技有限公司 Point reading method and electronic equipment

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108762628B (en) * 2018-04-23 2020-10-02 广州视源电子科技股份有限公司 Page element mobile display method and device, terminal equipment and storage medium
CN109523849A (en) * 2018-12-29 2019-03-26 济南科明数码技术股份有限公司 A kind of simulation control subsystem applied to electronic whiteboard teaching
CN111079498B (en) * 2019-06-09 2023-07-28 广东小天才科技有限公司 Learning function switching method based on mouth shape recognition and electronic equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102520793A (en) * 2011-11-30 2012-06-27 苏州奇可思信息科技有限公司 Gesture identification-based conference presentation interaction method
CN102629161A (en) * 2012-02-28 2012-08-08 中国科学院深圳先进技术研究院 Cursor control device and method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102520793A (en) * 2011-11-30 2012-06-27 苏州奇可思信息科技有限公司 Gesture identification-based conference presentation interaction method
CN102629161A (en) * 2012-02-28 2012-08-08 中国科学院深圳先进技术研究院 Cursor control device and method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111078100A (en) * 2019-06-03 2020-04-28 广东小天才科技有限公司 Point reading method and electronic equipment
CN111078100B (en) * 2019-06-03 2022-03-01 广东小天才科技有限公司 Point reading method and electronic equipment

Also Published As

Publication number Publication date
CN107506033A (en) 2017-12-22

Similar Documents

Publication Publication Date Title
CN106776514B (en) Annotating method and device
CN109542008B (en) Multi-screen display control method and system for intelligent full-screen blackboard
WO2019033664A1 (en) Information display control method and apparatus, and intelligent teaching device and storage medium
WO2017185797A1 (en) Method, device and system for manipulating miracast presentation content
EP3470994A1 (en) Slide playback control method and apparatus
US10254960B2 (en) Electronic device that operates under one of a plurality of input modes, and method of controlling an electronic device
CN108304132B (en) Graph display method, device, equipment and storage medium
CN110297550B (en) Label display method and device, screen throwing equipment, terminal and storage medium
KR20040063153A (en) Method and apparatus for a gesture-based user interface
US20160269795A1 (en) Instructing mode switching method and device based on smart television interface
US20140045163A1 (en) Interactive response system and question generation method for interactive response system
CN110109590B (en) Automatic reading method and device
CN109388321B (en) Electronic whiteboard operation method and device
WO2018045669A1 (en) Method for controlling interface of electronic device and electronic device
WO2018010316A1 (en) Desktop page management method and device
CN107766024B (en) PPT projection control method and system based on splicing wall
WO2021258917A1 (en) Intelligent interaction method and device, and storage medium
WO2020042468A1 (en) Data processing method and device, and device for processing data
WO2015184826A1 (en) Operation processing method and device for electronic drawing board
JP2016177614A (en) Conference system, information processing device, information terminal, and program
CN111580903A (en) Real-time voting method, device, terminal equipment and storage medium
US20170315703A1 (en) Projector playing control method, device, and computer storage medium
CN116781847A (en) Blackboard writing guiding and broadcasting method, device, equipment and storage medium
US20170017632A1 (en) Methods and Systems of Annotating Local and Remote Display Screens
WO2018149352A1 (en) Electronic writing method and apparatus, and electronic terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17921737

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 13/10/2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17921737

Country of ref document: EP

Kind code of ref document: A1