WO2015196514A1 - Online synchronous class intelligent tracking method and system - Google Patents
Online synchronous class intelligent tracking method and system Download PDFInfo
- Publication number
- WO2015196514A1 WO2015196514A1 PCT/CN2014/081920 CN2014081920W WO2015196514A1 WO 2015196514 A1 WO2015196514 A1 WO 2015196514A1 CN 2014081920 W CN2014081920 W CN 2014081920W WO 2015196514 A1 WO2015196514 A1 WO 2015196514A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- tracking
- camera
- target
- video data
- data information
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Definitions
- the invention belongs to the field of online synchronous classrooms, and in particular relates to an online peer class intelligent tracking method and system.
- the teacher tracking camera does not track the students.
- the student camera does not track the teacher.
- the tracking resources cannot be shared.
- the teacher needs to present the materials in the hand (handwritten text, textbook page, film, etc.) to the students.
- the teacher needs to input the information into the computer. Displayed by a projector, or transferred to a wall through a physical projector; if it is a synchronous classroom, the data in the computer can be simultaneously transmitted to the remote classroom for presentation.
- the teacher lectures he or she often plays impromptu and needs to present some information on a temporary basis.
- the information prepared by the teacher is not convenient for inputting a computer or putting a physical projector. This will greatly change the information for the teacher. Summary of the invention
- the invention provides an online synchronization classroom intelligent tracking method and system to solve the above problems.
- the invention provides an online synchronization classroom intelligent tracking method.
- the above method comprises the following steps;
- the image collection camera collects video data information of the moving target and sends the collected video data information to the behavior analysis processor;
- the behavior analysis processor analyzes the received video data information, obtains an analysis result, and divides the score Pray the result to the tracking controller;
- the tracking controller determines, according to the obtained analysis result, that the corresponding tracking camera performs tracking shooting on the target object.
- the present invention also provides an online peer classroom intelligent tracking system, including: one or more tracking cameras, one or more image collection cameras, a behavior analysis processor, and a tracking controller; wherein the tracking camera and the tracking a controller is connected; the behavior analysis processor is respectively connected to the image collection camera and the tracking controller;
- the image collection camera wherein the video data information of the motion i3 is collected, and the collected video data information is sent to the behavior analysis processor;
- the behavior analysis processor analyzes the received video data information, obtains an analysis result, and sends the analysis result to the tracking controller;
- the tracking controller is configured to determine, according to the obtained analysis result, that the corresponding tracking camera performs tracking shooting on the target object.
- the online synchronous classroom intelligent tracking method and system realized by the present invention realizes the sharing of tracking resources, and at the same time accurately tracks and shoots teachers and students.
- FIG. 1 is a structural diagram of an online synchronous classroom intelligent tracking system according to an embodiment of the present invention
- FIG. 2 is a structural diagram of an online synchronization classroom intelligent tracking system according to Embodiment 2 of the present invention.
- FIG. 3 is a flowchart of processing an online peer class intelligent tracking method according to Embodiment 3 of the present invention. detailed description
- the present invention provides an online peer class intelligent tracking method, including the following steps: an image collecting camera collects video data information of a moving target and transmits the collected video data information to a behavior analyzing processor;
- the behavior analysis processor analyzes the received video data information, obtains an analysis result, and sends the analysis result to a tracking controller.
- the tracking controller determines a corresponding tracking according to the obtained analysis result.
- the camera tracks the target object Shooting.
- the tracking controller determines, according to the obtained analysis result, that the corresponding tracking camera performs tracking and shooting on the target object:
- the tracking controller determines that the tracking camera is a target tracking camera and performs tracking shooting by the target tracking camera;
- the tracking controller selects the target tracking camera according to the preset strategy and performs tracking shooting on the target object by the target tracking camera.
- the preset policy refers to: the tracking controller determines the target tracking camera according to the tracking camera free memory and the BT inter-slice-allocation comparison table, and the target tracking camera performs tracking shooting on the target object, where the tracking control
- the device pre-configures the tracking camera free memory and the time slice allocation comparison table.
- the video data information includes: motion information; behavior information of the moving target; and face information of the moving target.
- the analysis result includes: a moving direction of the moving target; a behavior pattern of the motion i3 target; a face recognition result.
- the behavioral manner of the moving target includes: the teacher faces the student direction and displays a drawing board, a data sheet, and a book.
- the present invention also provides an online synchronization classroom intelligent tracking system, comprising: one or more tracking cameras, one or more image collection cameras, a behavioral segmentation processor, and a tracking controller; wherein the tracking camera and the tracking a controller is connected; the behavior analysis processor is respectively connected to the image collection camera and the tracking controller;
- the image collecting camera ffl collects video data information of the sports object and transmits the collected video data information to the behavior analysis processor;
- the behavior analysis processor is configured to analyze the received video data information, obtain an analysis result, and send the analysis result to the tracking controller;
- the tracking controller is configured to determine, according to the obtained analysis result, that the corresponding tracking camera performs tracking shooting on the target object.
- Embodiment 1 is a structural diagram of an online synchronous classroom intelligent tracking system according to Embodiment 1 of the present invention, including: Tracking Camera A, Tracking Camera B, Tracking Camera (, Tracking Camera D: Image Collection Camera £, Image Collection Camera F ; Behavior Analysis Processor, tracking controller.
- Tracking camera A, tracking camera B, tracking camera C, and tracking camera D are distributed in multiple locations in the classroom, such as: the wall on the side of the lectern, the wall opposite the podium, and the wall on both sides of the classroom.
- the specific location can be as needed. Flexible and ok.
- Image Collection Camera ⁇ Image Collection Camera F - can be installed in multiple locations in the classroom to collect video data information of sports targets (including - teachers, students) (including: motion information; behavioral information of moving targets; people with sports i3 Face information)
- the collected video data information is sent to the behavior analysis processor.
- two image collection cameras are used. When actually deployed, one or more may be deployed as needed.
- the behavior analysis processor analyzes the received video data information, obtains the analysis result, and sends the analysis result to the tracking controller.
- the analysis result includes: a moving direction of the moving target: a face recognition result; wherein, if the moving direction is Upward movement means that the student stands up; if it is downward movement, it means the student is sitting down; if it is non-up and down movement, it means that the teacher or the student is moving, it may be moving forward or backward. If a face is detected, it means that the moving target faces the image collecting camera; if no face is detected, it means that the moving target is facing away from the side or facing the image collecting camera.
- FIG. 2 is a structural diagram of the online synchronous classroom intelligent tracking system according to Embodiment 2 of the present invention
- the face orientation is recognized -
- the behavior analysis processor derives the motion direction A direction motion from the video data information provided by the image collection camera F, and the face data of the motion target is not detected from the video data information provided by the image collection camera , It can be judged that the moving target is facing the ⁇ direction and moving forward, and the moving target is not considered to be laterally moving. (If considering the lateral movement of the moving target, an image collecting camera is installed on the opposite wall of the image collecting camera E. G or an image collection camera H is installed on the opposite wall of the image collection camera F. The image collection camera G or H also collects the face information of the moving target, so that the behavior analysis processor determines which direction the moving target is facing: ).
- the behavior analysis processor derives the moving target from the video data information provided by the image capturing camera F, the moving target moves to the C direction, and the face data is not detected; the target data is obtained from the video data information provided by the image collecting camera
- the ⁇ direction motion ⁇ detects the face data, it can be judged that the motion target is moving to the right rear.
- the analysis results also include: The behavior of the moving target, such as: The teacher faces the student direction and displays the drawing board, data page, books, etc.
- the tracking controller determines the corresponding tracking camera to give the teacher a close-up, so that The information in the information displayed by the teacher is clearly seen in the picture taken.
- the tracking controller determines, according to the obtained analysis result, that the corresponding tracking camera targets the tracking object. If only one tracking camera can perform tracking shooting on the target object, the tracking controller determines that the tracking camera is the target tracking camera and the target tracking object is tracked by the target tracking camera.
- the tracking controller selects the target tracking camera according to the preset strategy and the target tracking camera shoots the target object.
- the preset strategy refers to:
- the tracking controller determines the target tracking camera according to the tracking camera free memory and the time slice allocation comparison table, and performs tracking shooting on the target object by the target tracking camera; wherein the tracking controller pre-configures the tracking camera free memory and the time slice allocation Chart.
- the range of the camera's free memory X and the time slice allocation can be set according to actual needs, and no limitation is made here.
- the first priority tracking camera 4 tracks and shoots the target object for 10 seconds. If the shooting is completed within 10 seconds, it ends. If the shooting has not been completed within 10 seconds, the tracking is performed by the second priority. One of the cameras 2 or 3 tracks the target object for 6 seconds, and if the shooting is completed within 6 seconds, it ends; if the shooting has not been completed within 6 seconds, the third priority tracking camera 1 performs the target object Shoot for 2 seconds.
- FIG. 3 is a flowchart of processing an online synchronization classroom intelligent tracking method according to Embodiment 3 of the present invention, which includes the following steps: Step 301: The image collection camera collects video data information of the motion target and sends the collected video data information to behavior analysis. Processor
- Step 302 The behavior analysis processor performs the extraction of the received video data information, obtains the analysis result, and sends the analysis result to the tracking controller.
- Step 303 The tracking controller determines, according to the obtained analysis result, that the corresponding tracking camera performs tracking shooting on the target object.
- the online synchronous classroom intelligent tracking method and system realizeds the sharing of tracking resources, and at the same time accurately tracks and shoots teachers and students.
Abstract
Provided are an online synchronous class intelligent tracking method and system, comprising the following steps: an image collecting video camera collects the video data information of a moving target and transmits the collected video data information to a behavior analysis processor; the behavior analysis processor analyzes the received video data information, obtains the analysis result, and transmits the analysis result to a tracking controller; the tracking controller determines, according to the obtained analysis result, the corresponding tracking video camera for tracking and filming the target object. The online synchronous class intelligent tracking method and system of the present invention enable tracking resources sharing and also accurate tracking and filming of teachers and students.
Description
一种在线同步课堂智能跟踪方法及系统 技术领域 Online synchronization classroom intelligent tracking method and system
本发明属于在线同步课堂领域， 尤其涉及一种在线同歩课堂智能跟踪方法及系统。 The invention belongs to the field of online synchronous classrooms, and in particular relates to an online peer class intelligent tracking method and system.
在精品课堂的录制、 同步课堂的实际应用中， 需要实现摄像机对老师和学生的实时跟踪。 目前的解决方案有两种： 一种是手动跟踪， 由操作员手动控制摄像机对老师进行跟踪； 另外 一种是通过系统实现自动跟踪。 为了实现跟踪， 一般情况下是在教室的讲台端安装跟踪摄像 机， 正对着学生， 用于跟踪学生； 在教室的另一端安装跟踪摄像机， 正对着讲台， 用于跟踪 老师。 In the practical application of recording and synchronizing classrooms in the quality classroom, it is necessary to realize real-time tracking of the camera to teachers and students. There are two current solutions: one is manual tracking, the operator manually controls the camera to track the teacher; the other is automatic tracking through the system. In order to achieve tracking, it is common to install a tracking camera on the lectern of the classroom, facing the students, to track the students; to install a tracking camera at the other end of the classroom, facing the platform for tracking the teacher.
上述方案存在以下问题： The above solution has the following problems:
1、 老师跟踪摄像机不跟踪学生， 学生摄像机不跟踪老师， 导致跟踪资源无法共享， 要想 对老师进行多角度跟踪， 必须要增加老师跟踪摄像机， 而很可能此时学生跟踪摄像机处于闲 置状态 （无学生的运动需要跟踪） 1. The teacher tracking camera does not track the students. The student camera does not track the teacher. As a result, the tracking resources cannot be shared. In order to track the teacher at multiple angles, it is necessary to increase the teacher tracking camera. It is very likely that the student tracking camera is idle. Student movement needs to be tracked)
2、 当老师走下讲台进入学生区域与学生互动时， 老师站立的方向不一定总是正对着老师 跟踪摄像机， 这就导致跟踪的老师画面可能是背面或侧面， 严重影响使用效果 2. When the teacher walks down the platform and enters the student area to interact with the students, the teacher does not always face the teacher in the direction of the camera. This leads to the tracking of the teacher's screen may be the back or side, which seriously affects the use effect.
3、 在精品课堂的录制、 同步课堂的实际应用中， 老师需要把手中的资料 （手写的文字、 教材页面、 胶片等） 展现给学生看， 为了使学生看清楚， 老师需要把这些资料输入电脑通过 投影仪展示出来， 或者通过实物投影仪转投到墙面上观看； 如果是同步课堂， 则可以把电脑 中的资料同步传输给远端的教室进行展现。 但是， 老师讲课时， 往往会即兴发挥， 临时需要 展现一些资料， 但老师准备的资料并不方便输入电脑或放入实物投影仪， 这就给老师展现资 料带来极大的不变。 发明内容 3. In the actual application of the recording and synchronous classroom of the quality classroom, the teacher needs to present the materials in the hand (handwritten text, textbook page, film, etc.) to the students. In order to make the students see clearly, the teacher needs to input the information into the computer. Displayed by a projector, or transferred to a wall through a physical projector; if it is a synchronous classroom, the data in the computer can be simultaneously transmitted to the remote classroom for presentation. However, when the teacher lectures, he or she often plays impromptu and needs to present some information on a temporary basis. However, the information prepared by the teacher is not convenient for inputting a computer or putting a physical projector. This will greatly change the information for the teacher. Summary of the invention
本发明提供一种在线同步课堂智能跟踪方法及系统， 以解决上述问题。 The invention provides an online synchronization classroom intelligent tracking method and system to solve the above problems.
本发明提供一种在线同步课堂智能跟踪方法。 上述方法包括以下步骤； The invention provides an online synchronization classroom intelligent tracking method. The above method comprises the following steps;
图像收集摄像机收集运动目标的视频数据信息并将收集到的所述视频数据信息发送至行 为分析处理器； The image collection camera collects video data information of the moving target and sends the collected video data information to the behavior analysis processor;
所述行为分析处理器对接收到的所述视频数据信息进行分析， 获取分析结果并将所述分
祈结果发送至跟踪控制器； The behavior analysis processor analyzes the received video data information, obtains an analysis result, and divides the score Pray the result to the tracking controller;
所述跟踪控制器根据获得的所述分析结果， 确定对应的跟踪摄像机对目标对象进行跟踪 拍摄。 The tracking controller determines, according to the obtained analysis result, that the corresponding tracking camera performs tracking shooting on the target object.
本发明还提供一种在线同歩课堂智能跟踪系统， 包括： 一个或多个跟踪摄像机、 一个或 多个图像收集摄像机、 行为分析处理器、 跟踪控制器； 其中， 所述跟踪摄像机与所述跟踪控 制器相连； 所述行为分析处理器分别与所述图像收集摄像机、 所述跟踪控制器相连； The present invention also provides an online peer classroom intelligent tracking system, including: one or more tracking cameras, one or more image collection cameras, a behavior analysis processor, and a tracking controller; wherein the tracking camera and the tracking a controller is connected; the behavior analysis processor is respectively connected to the image collection camera and the tracking controller;
所述图像收集摄像机， ]¾于收集运动 i3标的视频数据信息并将收集到的所述视频数据信 息发送至所述行为分析处理器； The image collection camera, wherein the video data information of the motion i3 is collected, and the collected video data information is sent to the behavior analysis processor;
所述行为分析处理器， . 于对接收到的所述视频数据信息进行分析， 获取分析结果并将 所述分析结果发送至所述跟踪控制器； The behavior analysis processor, analyzes the received video data information, obtains an analysis result, and sends the analysis result to the tracking controller;
所述跟踪控制器， 用亍根据获得的所述分析结果， 确定对应的跟踪摄像机对目标对象进 行跟踪拍摄。 The tracking controller is configured to determine, according to the obtained analysis result, that the corresponding tracking camera performs tracking shooting on the target object.
相较于先前技术， 根据本发明提供的在线同步课堂智能跟踪方法及系统， 实现了跟踪资 源的共享， 同时对老师、 学生进行准确的跟踪拍摄。 擀图说明 Compared with the prior art, the online synchronous classroom intelligent tracking method and system provided by the present invention realizes the sharing of tracking resources, and at the same time accurately tracks and shoots teachers and students. Description
此处所说明的附图用来提供对本发明的进一步理解， 构成本申请的一部分， 本发明的示 意性实施例及其说明 ]¾于解释本发明， 并不构成对本发明的不当限定。 在 »图中： The drawings are intended to provide a further understanding of the present invention, and are intended to be a part of the present invention, and the present invention is not to be construed as limiting the invention. In the picture:
图 1所示为本发明实施倒 I的在线同步课堂智能跟踪系统结构图； 1 is a structural diagram of an online synchronous classroom intelligent tracking system according to an embodiment of the present invention;
图 2所示为本发明实施例 2的在线同步课堂智能跟踪系统结构图； 2 is a structural diagram of an online synchronization classroom intelligent tracking system according to Embodiment 2 of the present invention;
图 3所示为本发明实施例 3的在线同歩课堂智能跟踪方法处理流程图。 具体实施方式 FIG. 3 is a flowchart of processing an online peer class intelligent tracking method according to Embodiment 3 of the present invention. detailed description
下文中将参考險图并结合实施例来详细说明本发明。需要说明的是， 在不冲突的情况下, 本申请中的实施例及实施例中的特征可以相互组合。 The invention will be described in detail below with reference to the embodiments of the invention. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.
本发明提供一种在线同歩课堂智能跟踪方法， 包括以下步骤- 图像收集摄像机收集运动目标的视频数据信息并将收集到的所述视频数据信息发送至行 为分析处理器； The present invention provides an online peer class intelligent tracking method, including the following steps: an image collecting camera collects video data information of a moving target and transmits the collected video data information to a behavior analyzing processor;
所述行为分析处理器对接收到的所述视频数据信息进行分析， 获取分析结果并将所述分 析结果发送至跟踪控制器- 所述跟踪控制器根据获得的所述分析结果， 确定对应的跟踪摄像机对目标对象进行跟踪
拍摄。 The behavior analysis processor analyzes the received video data information, obtains an analysis result, and sends the analysis result to a tracking controller. The tracking controller determines a corresponding tracking according to the obtained analysis result. The camera tracks the target object Shooting.
其中， 所述跟踪控制器根据获得的所述分析结果， 确定对应的跟踪摄像机对目标对象进 行跟踪拍摄的过程为： The tracking controller determines, according to the obtained analysis result, that the corresponding tracking camera performs tracking and shooting on the target object:
若仅有一个跟踪摄像机可对目标对象进行跟踪拍摄， 则跟踪控制器确定该跟踪摄像机为 目标跟踪摄像机并由所述 标跟踪摄像机对 标对象进行跟踪拍摄； If only one tracking camera can perform tracking shooting on the target object, the tracking controller determines that the tracking camera is a target tracking camera and performs tracking shooting by the target tracking camera;
若有多个跟踪摄像机均可对目标对象进行跟踪拍摄， 则跟踪控制器根据预设策略选择目 标跟踪摄像机并由所述目标跟踪摄像机对目标对象进行跟踪拍摄。 If a plurality of tracking cameras can perform tracking shooting on the target object, the tracking controller selects the target tracking camera according to the preset strategy and performs tracking shooting on the target object by the target tracking camera.
其中， 所述预设策略是指； 跟踪控制器根据跟踪摄像机空闲内存及 BT间片-分配对照表， 确定目标跟踪摄像机并 所述目标跟踪摄像机对目标对象进行跟踪拍摄， 其中， 所述跟踪控 制器预先配置跟踪摄像机空闲内存及时间片分配对照表。 The preset policy refers to: the tracking controller determines the target tracking camera according to the tracking camera free memory and the BT inter-slice-allocation comparison table, and the target tracking camera performs tracking shooting on the target object, where the tracking control The device pre-configures the tracking camera free memory and the time slice allocation comparison table.
其中， 所述视频数据信息包括： 运动信息； 运动目标的行为信息； 运动目标的人脸信息。 其中， 所述分析结果包括： 运动目标的运动方向； 运动 i3标的行为方式； 人脸识别结果。 其中， 所述运动目标的行为方式包括： 老师面对学生方向且展示画板、 资料页、 书籍。 本发明还提供一种在线同步课堂智能跟踪系统， 包括： 一个或多个跟踪摄像机、 一个或 多个图像收集摄像机、 行为分祈处理器、 跟踪控制器； 其中， 所述跟踪摄像机与所述跟踪控 制器相连； 所述行为分析处理器分别与所述图像收集摄像机、 所述跟踪控制器相连； The video data information includes: motion information; behavior information of the moving target; and face information of the moving target. The analysis result includes: a moving direction of the moving target; a behavior pattern of the motion i3 target; a face recognition result. The behavioral manner of the moving target includes: the teacher faces the student direction and displays a drawing board, a data sheet, and a book. The present invention also provides an online synchronization classroom intelligent tracking system, comprising: one or more tracking cameras, one or more image collection cameras, a behavioral segmentation processor, and a tracking controller; wherein the tracking camera and the tracking a controller is connected; the behavior analysis processor is respectively connected to the image collection camera and the tracking controller;
所述图像收集摄像机， ffl于收集运动 标的视频数据信息并将收集到的所述视频数据信 息发送至所述行为分析处理器； The image collecting camera ffl collects video data information of the sports object and transmits the collected video data information to the behavior analysis processor;
所述行为分析处理器， ]¾于对接收到的所述视频数据信息进行分析， 获取分析结果并将 所述分析结果发送至所述跟踪控制器； The behavior analysis processor is configured to analyze the received video data information, obtain an analysis result, and send the analysis result to the tracking controller;
所述跟踪控制器， 用亍根据获得的所述分析结果， 确定对应的跟踪摄像机对目标对象进 行跟踪拍摄。 The tracking controller is configured to determine, according to the obtained analysis result, that the corresponding tracking camera performs tracking shooting on the target object.
图 1所示为本发明实施例 1的在线同步课堂智能跟踪系统结构图， 包括： 跟踪摄像机 A、 跟踪摄像机 B、 跟踪摄像机（、 跟踪摄像机 D: 图像收集摄像机£、 图像收集摄像机 F; 行为 分析处理器、 跟踪控制器。 1 is a structural diagram of an online synchronous classroom intelligent tracking system according to Embodiment 1 of the present invention, including: Tracking Camera A, Tracking Camera B, Tracking Camera (, Tracking Camera D: Image Collection Camera £, Image Collection Camera F ; Behavior Analysis Processor, tracking controller.
跟踪摄像机 A、 跟踪摄像机 B、 跟踪摄像机 C、 跟踪摄像机 D分布在教室的多个位置， 例 如： 讲台一侧的墙上、 讲台对面的墙上、 教室两侧的墙上， 具体位置根据需要可以灵活确定。 Tracking camera A, tracking camera B, tracking camera C, and tracking camera D are distributed in multiple locations in the classroom, such as: the wall on the side of the lectern, the wall opposite the podium, and the wall on both sides of the classroom. The specific location can be as needed. Flexible and ok.
图像收集摄像机^ 图像收集摄像机 F -可在教室的多个位置安装，用亍收集运动目标（包 括- 老师、 学生） 的视频数据信息 （包括： 运动信息； 运动目标的行为信息； 运动 i3标的人 脸信息） 并将收集到的视频数据信息发送至行为分析处理器； 本实施例中采用两个图像收集 摄像机， 实际部署时， 根据需要可以部署一个或多个。
V Image Collection Camera ^ Image Collection Camera F - can be installed in multiple locations in the classroom to collect video data information of sports targets (including - teachers, students) (including: motion information; behavioral information of moving targets; people with sports i3 Face information) The collected video data information is sent to the behavior analysis processor. In this embodiment, two image collection cameras are used. When actually deployed, one or more may be deployed as needed. V
行为分析处理器对接收到的视频数据信息进行分析， 获取分析结果并将分析结果发送至 跟踪控制器； 其中， 分析结果包括： 运动目标的运动方向： 人脸识别结果； 其中， 如果运动 方向是向上运动， 表示学生起立； 如果是向下运动的， 表示学生坐下； 如果是非上下运动， 表示老师或学生的走动， 可能是前行、 也可能是后退。 若检测出人脸， 表示运动目标面对图 像收集摄像机； 若没有检测出人脸， 则表示运动目标背对或侧对着图像收集摄像机。 The behavior analysis processor analyzes the received video data information, obtains the analysis result, and sends the analysis result to the tracking controller. The analysis result includes: a moving direction of the moving target: a face recognition result; wherein, if the moving direction is Upward movement means that the student stands up; if it is downward movement, it means the student is sitting down; if it is non-up and down movement, it means that the teacher or the student is moving, it may be moving forward or backward. If a face is detected, it means that the moving target faces the image collecting camera; if no face is detected, it means that the moving target is facing away from the side or facing the image collecting camera.
如图 2 (图 2所示为本发明实施例 2的在线同步课堂智能跟踪系统结构图） 所示， 运动 时， 面对方向的识别- As shown in FIG. 2 (FIG. 2 is a structural diagram of the online synchronous classroom intelligent tracking system according to Embodiment 2 of the present invention), when facing the movement, the face orientation is recognized -
1 )当行为分析处理器从圏像收集摄像机 F提供的视频数据信息中得出运动 标向 A方向 运动 ϋ从图像收集摄像机 Ε提供的视频数据信息中没有检测出运动目标的人脸数据， 则可以 判断该运动 标是面向 Α方向且向前运动的， 此时不考虑运动目标是横向运动的 （如果考虑 运动目标的橫向运动， 则在图像收集摄像机 E的对面墙上再安装一个图像收集摄像机 G或在 图像收集摄像机 F的对面墙上再安装一个图像收集摄像机 H， 图像收集摄像机 G或 H同样收 集该运动目标的人脸信息， 以便行为分析处理器确定该运动目标是面向哪个方向的：)。 1) when the behavior analysis processor derives the motion direction A direction motion from the video data information provided by the image collection camera F, and the face data of the motion target is not detected from the video data information provided by the image collection camera , It can be judged that the moving target is facing the Α direction and moving forward, and the moving target is not considered to be laterally moving. (If considering the lateral movement of the moving target, an image collecting camera is installed on the opposite wall of the image collecting camera E. G or an image collection camera H is installed on the opposite wall of the image collection camera F. The image collection camera G or H also collects the face information of the moving target, so that the behavior analysis processor determines which direction the moving target is facing: ).
2 )当行为分析处理器从圏像收集摄像机 F提供的视频数据信息中得出运动目标向 C方向 运动 ϋ没有检测出人脸数据； 从图像收集摄像机 Ε提供的视频数据信息中得出目标向 Β方向 运动 ϋ检测出人脸数据， 则可以判断该运动目标是向右后方前进的。 2) when the behavior analysis processor derives the moving target from the video data information provided by the image capturing camera F, the moving target moves to the C direction, and the face data is not detected; the target data is obtained from the video data information provided by the image collecting camera When the Β direction motion ϋ detects the face data, it can be judged that the motion target is moving to the right rear.
分析结果还包括： 运动目标的行为方式， 倒如： 老师面对学生方向且展示画板、 资料页、 书籍等资料， 此时， 跟踪控制器确定对应的跟踪摄像机给老师一个特写镜头， 从而可以从拍 摄的画面中看清楚老师展示的资料中的信息。 The analysis results also include: The behavior of the moving target, such as: The teacher faces the student direction and displays the drawing board, data page, books, etc. At this time, the tracking controller determines the corresponding tracking camera to give the teacher a close-up, so that The information in the information displayed by the teacher is clearly seen in the picture taken.
跟踪控制器根据获得的所述分析结果，确定对应的跟踪摄像机对 标对象进行跟踪拍摄。 若仅有一个跟踪摄像机可对目标对象进行跟踪拍摄， 则跟踪控制器确定该跟踪摄像机为 目标跟踪摄像机并由所述 标跟踪摄像机对目标对象进行跟踪拍摄。 The tracking controller determines, according to the obtained analysis result, that the corresponding tracking camera targets the tracking object. If only one tracking camera can perform tracking shooting on the target object, the tracking controller determines that the tracking camera is the target tracking camera and the target tracking object is tracked by the target tracking camera.
若有多个跟踪摄像机均可对 §标对象进行跟踪拍摄， 则跟踪控制器根据预设策略选择目 标跟踪摄像机并由所述目标跟踪摄像机对目标对象进行跟踪拍摄。 If there are multiple tracking cameras that can track the target object, the tracking controller selects the target tracking camera according to the preset strategy and the target tracking camera shoots the target object.
其中， 预设策略是指： Among them, the preset strategy refers to:
跟踪控制器根据跟踪摄像机空闲内存及时间片分配对照表， 确定目标跟踪摄像机并由所 述目标跟踪摄像机对目标对象进行跟踪拍摄； 其中， 所述跟踪控制器预先配置跟踪摄像机空 闲内存及时间片分配对照表。 The tracking controller determines the target tracking camera according to the tracking camera free memory and the time slice allocation comparison table, and performs tracking shooting on the target object by the target tracking camera; wherein the tracking controller pre-configures the tracking camera free memory and the time slice allocation Chart.
跟踪摄像机空闲內存 X (单位： G) 时间片分配 跟踪摄像机 优先级 Tracking camera free memory X (unit: G) Time slice allocation Tracking camera priority
OK I 2秒 跟踪摄像机 1 第三优先级 OK I 2 seconds Tracking camera 1 Third priority
6秒 摄像机 2-, 3 第二优先级
卜. 6 seconds camera 2, 3 second priority Bu.
10秒 跟踪摄像机 4 第一优先级 表 1 : 跟踪摄像机空闲內存及时间片分配对照表 10 seconds Tracking camera 4 First priority Table 1: Tracking camera free memory and time slice allocation table
其中， 表中跟踪摄像机空闲内存 X的范围、 时间片分配可以根据实际需要进行数值的设 置， 在此不做任何的限定。 In the table, the range of the camera's free memory X and the time slice allocation can be set according to actual needs, and no limitation is made here.
如上表所述， 先 第一优先级的跟踪摄像机 4对目标对象进行跟踪拍摄 10秒， 若 10秒 内拍摄完毕， 则结束； 若 10秒内还未拍摄完毕， 则由第二优先级的跟踪摄像机 2或 3中之一 对目标对象进行跟踪拍摄 6秒， 若 6秒内拍摄完毕， 则结束； 若 6秒内还未拍摄完毕， 则由 第三优先级的跟踪摄像机 1对 §标对象进行拍摄 2秒。 As described in the above table, the first priority tracking camera 4 tracks and shoots the target object for 10 seconds. If the shooting is completed within 10 seconds, it ends. If the shooting has not been completed within 10 seconds, the tracking is performed by the second priority. One of the cameras 2 or 3 tracks the target object for 6 seconds, and if the shooting is completed within 6 seconds, it ends; if the shooting has not been completed within 6 seconds, the third priority tracking camera 1 performs the target object Shoot for 2 seconds.
图 3所示为本发明实施例 3的在线同步课堂智能跟踪方法处理流程图， 包括以下歩骤： 步骤 301 : 图像收集摄像机收集运动 标的视频数据信息并将收集到的视频数据信息发 送至行为分析处理器； FIG. 3 is a flowchart of processing an online synchronization classroom intelligent tracking method according to Embodiment 3 of the present invention, which includes the following steps: Step 301: The image collection camera collects video data information of the motion target and sends the collected video data information to behavior analysis. Processor
歩骤 302 : 行为分析处理器对接收到的视频数据信息进行分祈， 获取分析结果并将分析 结果发送至跟踪控制器； Step 302: The behavior analysis processor performs the extraction of the received video data information, obtains the analysis result, and sends the analysis result to the tracking controller.
步骤 303 : 跟踪控制器根据获得的所述分析结果， 确定对应的跟踪摄像机对目标对象进 行跟踪拍摄。 Step 303: The tracking controller determines, according to the obtained analysis result, that the corresponding tracking camera performs tracking shooting on the target object.
相较于先前技术， 根据本发明提供的在线同步课堂智能跟踪方法及系统， 实现了跟踪资 源的共享， 同时对老师、 学生进行准确的跟踪拍摄。 Compared with the prior art, the online synchronous classroom intelligent tracking method and system provided by the present invention realizes the sharing of tracking resources, and at the same time accurately tracks and shoots teachers and students.
以上所述仅为本发明的优选实施例而已， 并不用于限制本发明， 对于本领域的技术人员 来说， 本发明可以有各种更改和变化。 凡在本发明的精神和原则之内， 所作的任何修改、 等 同替换、 改进等， 均应包含在本发明的保护范 i簡之内。
The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention are intended to be included within the scope of the present invention.
Claims
1、 一种在线同歩课堂智能跟踪方法， 其特征在于， 包括以下歩骤： 1. An online peer class intelligent tracking method, which is characterized in that it comprises the following steps:
图像收集摄像机收集运动目标的视频数据信息并将收集到的所述视频数据信息发送至行 为分析处理器； The image collection camera collects video data information of the moving target and sends the collected video data information to the behavior analysis processor;
所述行为分析处理器对接收到的所述视频数据信息进行分析， 获取分祈结果并将所述分 析结果发送至跟踪控制器； The behavior analysis processor analyzes the received video data information, obtains a score result, and sends the analysis result to the tracking controller;
所述跟踪控制器根据获得的所述分析结果， 确定对应的跟踪摄像机对目标对象进行跟踪 拍摄。 The tracking controller determines, according to the obtained analysis result, that the corresponding tracking camera performs tracking shooting on the target object.
2、根据权利要求 1所述的方法，其特征在于：所述跟踪控制器根据获得的所述分析结果， 确定对应的跟踪摄像机对 标对象进行跟踪拍摄的过程为： The method according to claim 1, wherein the tracking controller determines, according to the obtained analysis result, that the tracking camera of the corresponding tracking camera is subjected to tracking and shooting:
若仅有一个跟踪摄像机可对 标对象进行跟踪拍摄， 则跟踪控制器确定该蹑踪摄像机为 目标跟踪摄像机并由所述 标跟踪摄像机对 标对象进行跟踪拍摄； If only one tracking camera can perform tracking shooting on the target object, the tracking controller determines that the tracking camera is a target tracking camera and performs tracking shooting by the target tracking camera;
若有多个跟踪摄像机均可对目标对象进行跟踪拍摄， 则跟踪控制器根据预设策略选择目 标跟踪摄像机并 所述目标跟踪摄像机对目标对象进行跟踪拍摄。 If multiple tracking cameras can track and shoot the target object, the tracking controller selects the target tracking camera according to the preset strategy and the target tracking camera performs tracking shooting on the target object.
3、 根据权利要求 2所述的方法， 其特征在于： 3. The method of claim 2, wherein:
所述预设策略是指： 跟踪控制器根据跟踪摄像机空闲内存及时间片分配对照表， 确定目 标跟踪摄像钒并由所述 标跟踪摄像机对 标对象进行跟踪拍摄， 其中， 所述跟踪控制器预 先配置跟踪摄像机空闲内存及 0 间片分配对照表。 The preset policy is: the tracking controller determines, according to the tracking camera free memory and the time slice allocation comparison table, the target tracking imaging vanadium and the tracking object of the target tracking camera, wherein the tracking controller is in advance Configure tracking camera free memory and 0 slice allocation table.
4、 根据权利要求 3所述的方法， 其特征在于- 所述视频数据信息包括： 运动信息； 运动目标的行为信息； 运动目标的人脸信息。 4. The method according to claim 3, characterized in that - the video data information comprises: motion information; behavior information of the moving object; face information of the moving object.
5、 根据权利要求 4所述的方法， 其特征在于： 5. The method of claim 4, wherein:
所述分析结果包括： 运动 标的运动方向； 运动目标的行为方式； 人脸识别结果。 The analysis results include: the moving direction of the moving target; the behavior of the moving target; the face recognition result.
6、 根据权利要求 5所述的方法， 其特征在于： 6. The method of claim 5, wherein:
所述运动目标的行为方式包括： 老师面对学生方向且展示画扳、 资料页、 书籍。 The behavior of the sports target includes: The teacher faces the student direction and displays the drawing board, the information page, and the book.
7、 一种在线同步课堂智能跟踪系统， 其特征在于， 包括： 一个或多个跟踪摄像机、 一个 或多个圏像收集摄像机、 行为分析处理器、 跟踪控制器； 其中， 所述跟踪摄像机与所述跟踪 控制器相连； 所述行为分析处理器分别与所述图像收集摄像机、 所述跟踪控制器相连； An online synchronization classroom intelligent tracking system, comprising: one or more tracking cameras, one or more artifact collecting cameras, a behavior analysis processor, and a tracking controller; wherein the tracking camera and the camera The tracking controller is connected; the behavior analysis processor is respectively connected to the image collection camera and the tracking controller;
所述图像收集摄像机， 用于收集运动目标的视频数据信息并将收集到的所述视频数据信 息发送至所述行为分析处理器； The image collection camera is configured to collect video data information of the moving target and send the collected video data information to the behavior analysis processor;
所述行为分析处理器， 于对接收到的所述视频数据信息进行分析， 获取分析结果并将 所述分析结果发送至所述跟踪控制器； The behavior analysis processor analyzes the received video data information, obtains an analysis result, and sends the analysis result to the tracking controller;
所述跟踪控制器， 用于根据获得的所述分析结果， 确定对应的跟踪摄像机对目标对象进
行跟踪拍摄。
The tracking controller is configured to determine, according to the obtained analysis result, that the corresponding tracking camera is in the target object Line tracking shooting.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410284664.5 | 2014-06-23 | ||
| CN201410284664.5A CN104065924A (en) | 2014-06-23 | 2014-06-23 | On-line synchronization classroom intelligent tracking method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2015196514A1 true WO2015196514A1 (en) | 2015-12-30 |
Family
ID=51553429
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2014/081920 WO2015196514A1 (en) | 2014-06-23 | 2014-07-09 | Online synchronous class intelligent tracking method and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104065924A (en) |
| WO (1) | WO2015196514A1 (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104917999A (en) * | 2015-06-08 | 2015-09-16 | 深圳锐取信息技术股份有限公司 | Dual video stream directed broadcasting method and system |
| CN105049764B (en) * | 2015-06-17 | 2018-05-25 | 武汉智亿方科技有限公司 | A kind of geography teaching map based on multiple positioning shooting heads is as tracking and system |
| CN106101734A (en) * | 2016-06-15 | 2016-11-09 | 广州科技职业技术学院 | The net cast method for recording of interaction classroom and system |
| CN106934840B (en) * | 2017-03-02 | 2018-06-19 | 山东朗朗教育科技股份有限公司 | A kind of education cloud class outdoor scene drawing generating method and device |
| CN106941580B (en) * | 2017-03-22 | 2019-12-03 | 北京昊翔信达科技有限公司 | The method and system that teacher student automatically tracks is realized based on single detective camera lens |
| CN109918967A (en) * | 2017-12-12 | 2019-06-21 | 武汉东信同邦信息技术有限公司 | A kind of teacher's gesture recognition system based on shallow-layer convolutional neural networks |
| CN108846853A (en) * | 2018-04-26 | 2018-11-20 | 武汉幻视智能科技有限公司 | A kind of teaching behavior analysis method and device based on target following and attitude detection |
| CN108734724A (en) * | 2018-05-22 | 2018-11-02 | 广州长鹏光电科技有限公司 | A kind of classroom behavior parser based on image recognition |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1960479A (en) * | 2005-11-03 | 2007-05-09 | 中国科学院自动化研究所 | Method for tracking principal and subordinate videos by using single video camera |
| CN101119482A (en) * | 2007-09-28 | 2008-02-06 | 北京智安邦科技有限公司 | Overall view monitoring method and apparatus |
| CN201248107Y (en) * | 2008-04-30 | 2009-05-27 | 深圳市飞瑞斯科技有限公司 | Master-slave camera intelligent video monitoring system |
| CN101640788A (en) * | 2008-07-29 | 2010-02-03 | 深圳市朗驰欣创科技有限公司 | Method and device for controlling monitoring and monitoring system |
| CN101814242A (en) * | 2010-04-13 | 2010-08-25 | 天津师范大学 | Moving object real-time tracking recording device of classes |
| CN201690558U (en) * | 2010-04-13 | 2010-12-29 | 天津师范大学 | Real-time tracking and recording device for teaching of teachers |
| CN103093654A (en) * | 2013-01-28 | 2013-05-08 | 北京航空航天大学 | Double video camera interactive intelligent tracking teaching system |
| CN103164991A (en) * | 2013-03-01 | 2013-06-19 | 广州市信和电信发展有限公司 | Network interactive teaching and research application system |
| CN103413472A (en) * | 2013-08-14 | 2013-11-27 | 苏州阔地网络科技有限公司 | Method and system for achieving network synchronous classroom |
| CN103413471A (en) * | 2013-08-14 | 2013-11-27 | 苏州阔地网络科技有限公司 | Method and system for controlling network synchronous classroom |
| CN103414775A (en) * | 2013-08-14 | 2013-11-27 | 苏州阔地网络科技有限公司 | Method and system for achieving network synchronous classroom |
| CN103414880A (en) * | 2013-08-14 | 2013-11-27 | 苏州阔地网络科技有限公司 | Processing method and system of synchronous classroom |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7349005B2 (en) * | 2001-06-14 | 2008-03-25 | Microsoft Corporation | Automated video production system and method using expert video production rules for online publishing of lectures |
| CN103336948A (en) * | 2013-06-24 | 2013-10-02 | 深圳锐取信息技术股份有限公司 | Video tracking method based on face recognition |
-
2014
- 2014-06-23 CN CN201410284664.5A patent/CN104065924A/en active Pending
- 2014-07-09 WO PCT/CN2014/081920 patent/WO2015196514A1/en active Application Filing
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1960479A (en) * | 2005-11-03 | 2007-05-09 | 中国科学院自动化研究所 | Method for tracking principal and subordinate videos by using single video camera |
| CN101119482A (en) * | 2007-09-28 | 2008-02-06 | 北京智安邦科技有限公司 | Overall view monitoring method and apparatus |
| CN201248107Y (en) * | 2008-04-30 | 2009-05-27 | 深圳市飞瑞斯科技有限公司 | Master-slave camera intelligent video monitoring system |
| CN101640788A (en) * | 2008-07-29 | 2010-02-03 | 深圳市朗驰欣创科技有限公司 | Method and device for controlling monitoring and monitoring system |
| CN101814242A (en) * | 2010-04-13 | 2010-08-25 | 天津师范大学 | Moving object real-time tracking recording device of classes |
| CN201690558U (en) * | 2010-04-13 | 2010-12-29 | 天津师范大学 | Real-time tracking and recording device for teaching of teachers |
| CN103093654A (en) * | 2013-01-28 | 2013-05-08 | 北京航空航天大学 | Double video camera interactive intelligent tracking teaching system |
| CN103164991A (en) * | 2013-03-01 | 2013-06-19 | 广州市信和电信发展有限公司 | Network interactive teaching and research application system |
| CN103413472A (en) * | 2013-08-14 | 2013-11-27 | 苏州阔地网络科技有限公司 | Method and system for achieving network synchronous classroom |
| CN103413471A (en) * | 2013-08-14 | 2013-11-27 | 苏州阔地网络科技有限公司 | Method and system for controlling network synchronous classroom |
| CN103414775A (en) * | 2013-08-14 | 2013-11-27 | 苏州阔地网络科技有限公司 | Method and system for achieving network synchronous classroom |
| CN103414880A (en) * | 2013-08-14 | 2013-11-27 | 苏州阔地网络科技有限公司 | Processing method and system of synchronous classroom |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104065924A (en) | 2014-09-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2015196514A1 (en) | Online synchronous class intelligent tracking method and system | |
| WO2015196513A1 (en) | Online synchronous class tracking control method and system | |
| CN105049764B (en) | A kind of geography teaching map based on multiple positioning shooting heads is as tracking and system | |
| US8085302B2 (en) | Combined digital and mechanical tracking of a person or object using a single video camera | |
| EP4307700A3 (en) | Systems and methods for fast video capture and sensor adjustment | |
| JP2017507557A (en) | Process for improving the quality of experience for users who view high-definition video streams on their devices | |
| CN107809563B (en) | Blackboard writing detection system, method and device | |
| WO2019104681A1 (en) | Image capture method and device | |
| KR20150084586A (en) | Kiosk and system for authoring video lecture using virtual 3-dimensional avatar | |
| WO2015153261A1 (en) | Method and system for enhancing interactions between teachers and students | |
| JPWO2020054855A1 (en) | Class support system, judgment device, class support method and program | |
| KR101287019B1 (en) | A lecture camera system for providing images of writings on the board | |
| KR101686143B1 (en) | Image processing apparatus and image processing method thereof | |
| TW201404136A (en) | Method and device for prevention of defocus | |
| Winkler et al. | Automatic camera control for tracking a presenter during a talk | |
| Lampi et al. | An automatic cameraman in a lecture recording system | |
| TW202135516A (en) | Zone-adaptive video generation | |
| US20180091733A1 (en) | Capturing images provided by users | |
| KR20170113901A (en) | Object tracking camera system for photographing personal media broadcasting | |
| JP2016197192A (en) | Projection system and video projection method | |
| CN104906776B (en) | Somatosensory motion points-scoring system, device and method | |
| KR101502683B1 (en) | Instructor Tracing System Using 3 Dimensional Sensing Module | |
| KR101776839B1 (en) | Portable lecture storage and broadcasting system | |
| Liao et al. | An automatic lecture recording system using pan-tilt-zoom camera to track lecturer and handwritten data | |
| TWI554091B (en) | Multi-function video recorder system and control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14896109 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 14896109 Country of ref document: EP Kind code of ref document: A1 |