CN111062232A - Course information identification method and device and electronic equipment - Google Patents
Course information identification method and device and electronic equipment Download PDFInfo
- Publication number
- CN111062232A CN111062232A CN201811208499.XA CN201811208499A CN111062232A CN 111062232 A CN111062232 A CN 111062232A CN 201811208499 A CN201811208499 A CN 201811208499A CN 111062232 A CN111062232 A CN 111062232A
- Authority
- CN
- China
- Prior art keywords
- teacher
- name
- textbook
- video information
- course
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/32—Digital ink
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/103—Static body considered as a whole, e.g. static pedestrian or occupant recognition
Abstract
The invention discloses a course information identification method and device and electronic equipment, wherein the course information identification method comprises the following steps: collecting video information including teachers, students and textbooks; determining a page turning action and a lecture action through behavior analysis according to the video information; according to the video information and the book turning action, recognizing the name of the textbook; according to the video information and the lecture actions, the identity of a teacher is identified, and the face characteristics of the teacher are identified; searching a database according to the textbook name to obtain a corresponding course name, and searching the database according to the teacher face characteristic to obtain a corresponding teacher name; storing the course name, teacher name and the video information in a storage device; and the database stores the textbook name and the corresponding course name, the teacher name and the corresponding teacher face characteristic. The invention can realize the automatic identification of the course related information.
Description
Technical Field
The invention relates to the technical field of education informatization, in particular to a course information identification method and device and electronic equipment.
Background
The existing campus recording and broadcasting management system comprises a plurality of image acquisition devices (such as cameras) arranged in various classrooms, and when the image acquisition devices are used for automatically recording courses, the course information, information of a teacher who speaks and other related information need to be stored in the system together. The current method is to input the course name, the speaker, the start time of the lesson, and other course related information in advance, associate the preset course related information with the recording and broadcasting plan, and store the course video and the course related information when recording the course video according to the recording and broadcasting plan. However, once a course or teacher is adjusted temporarily, the stored course related information cannot be automatically adjusted adaptively, and needs to be reconfigured to store the correct information.
Disclosure of Invention
In view of the above, the present invention provides a course information identification method and apparatus, and an electronic device, which can automatically identify information such as a teacher and a course, do not need manual configuration, and improve the automation level of a recording and broadcasting system.
Based on the above purpose, the present invention provides a course information identification method, which includes:
collecting video information including teachers, students and textbooks;
determining a page turning action and a lecture action through behavior analysis according to the video information;
according to the video information and the book turning action, recognizing the name of the textbook;
according to the video information and the lecture actions, the identity of a teacher is identified, and the face characteristics of the teacher are identified;
searching a database according to the textbook name to obtain a corresponding course name, and searching the database according to the teacher face characteristic to obtain a corresponding teacher name;
storing the course name, teacher name and the video information in a storage device;
and the database stores the textbook name and the corresponding course name, the teacher name and the corresponding teacher face characteristic.
Optionally, according to the book turning action, the area of the textbook in the video information is locked, and the textbook name in the textbook is searched and identified in the area of the textbook.
Optionally, according to the lecture action, the area where the teacher who executes the lecture action is located in the video information is locked, the identity of the teacher is identified in the area where the teacher is located, the area where the face of the teacher in the video information is locked, and the face characteristics of the teacher are identified in the area where the face of the teacher is located.
An embodiment of the present invention further provides a course information identification apparatus, including:
the image acquisition equipment is used for acquiring video information including teachers, students and textbooks;
the behavior analysis module is used for determining a page turning action and a lecture action according to the video information;
the characteristic identification module is used for identifying the textbook name according to the book turning action and the teaching action and identifying the identity of a teacher and the facial characteristics of the teacher according to the video information;
the database is used for storing course related information, and the course related information comprises the textbook name, the corresponding course name, the teacher name and the corresponding teacher face feature;
the matching module is used for searching the database according to the textbook name and the teacher face characteristics so as to obtain a course name corresponding to the textbook name and a teacher name corresponding to the teacher face characteristics;
and the storage module is used for storing the course name, the teacher name and the video information in storage equipment.
Optionally, the feature recognition module includes:
and the textbook feature identification submodule is used for locking the area of the textbook in the video information according to the book turning action, and searching and identifying the textbook name in the textbook in the area of the textbook.
Optionally, the feature recognition module includes:
and the face feature identification submodule is used for locking the area where a teacher executing the lecture action is located in the video information according to the lecture action, identifying the identity of the teacher in the area where the teacher is located, locking the face area of the teacher in the video information, and identifying the face features of the teacher in the face area of the teacher.
The embodiment of the present invention further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the course information identification method.
From the above, the course information identification method, the course information identification device and the electronic equipment provided by the invention collect video information including teachers, students and textbooks; determining a page turning action and a lecture action through behavior analysis according to the video information; according to the video information, recognizing the name of the textbook according to the page turning action; according to the video information and the lecture actions, the identity of the teacher is identified, and the face characteristics of the teacher are identified; searching a database according to the textbook name to obtain a corresponding course name, and searching the database according to the face characteristics of the teacher to obtain a corresponding teacher name; and saving the course name, the teacher name and the video information in the storage device. The invention can realize the automatic identification of the course related information without manual configuration, thereby improving the automation level of the recording and broadcasting system.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic flow chart of a method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to specific embodiments and the accompanying drawings.
It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it should be noted that "first" and "second" are merely for convenience of description and should not be construed as limitations of the embodiments of the present invention, and they are not described in any more detail in the following embodiments.
FIG. 1 is a schematic flow chart of a method according to an embodiment of the present invention. As shown in the figure, the course information identification method disclosed by the embodiment of the invention comprises the following steps:
s10: collecting video information including teachers, students and textbooks;
the video information in the classroom is collected by utilizing the image collecting equipment which is arranged in each classroom, and the collected video information at least comprises information such as teachers, students and textbooks during class.
S11: determining a page turning action and a lecture action through behavior analysis according to the collected video information;
based on the collected video information, the behavior analysis module is used for analyzing the video information, and the book turning action of students and/or teachers and the teaching action of the teachers are determined.
S12: according to the video information, recognizing the name of the textbook according to the determined page turning action;
and locking the area of the textbook in the video information according to the determined page turning action, and further searching and identifying the textbook name in the textbook area.
S13: according to the video information and the determined teaching actions, the identity of the teacher is identified, and the face characteristics of the teacher are identified;
according to the determined teaching action, the area where the teacher who executes the teaching action in the video information is located is locked, the identity of the teacher is further identified in the area where the teacher is located, the face area of the teacher in the video information is locked, and the face characteristics of the teacher are identified in the face area of the teacher.
S14: matching the recognized textbook name with the textbook information in the database, finding out the course name according to the textbook name if the matching is successful, matching the recognized teacher face feature with the teacher information in the database, and finding out the teacher name according to the teacher face feature if the matching is successful;
the database stores the course related information, including the textbook name and the corresponding course name, the teacher name and the corresponding teacher face feature, the course time and other information. And searching the database according to the recognized textbook name to obtain a corresponding course name, and searching the database according to the recognized face characteristics of the teacher to obtain a corresponding teacher name.
S15: and storing the matched course name, teacher name and video information acquired by the image acquisition equipment in a storage device.
Fig. 2 is a schematic structural diagram of an apparatus according to an embodiment of the present invention. As shown in the drawings, the course information recognition apparatus disclosed in the embodiment of the present invention includes:
the image acquisition equipment is used for acquiring video information including teachers, students and textbooks;
the behavior analysis module is used for determining a page turning action and a lecture action according to the video information;
the characteristic identification module is used for identifying the textbook name according to the determined page turning action and the determined lecture action according to the video information, and identifying the identity of a teacher and the facial characteristics of the teacher;
the matching module is used for searching a database according to the recognized textbook name and the teacher face characteristics, and matching the textbook name and the teacher name corresponding to the teacher face characteristics from the database;
the database is used for storing course related information, including textbook names, corresponding course names, teacher names, corresponding teacher face characteristics, course time and other information;
and the storage module is used for storing the matched course name, teacher name and the video information in storage equipment.
In an embodiment of the present invention, the feature identification module includes:
the textbook feature recognition submodule is used for locking the area of the textbook in the video information according to the determined book turning action, and further searching and recognizing the textbook name in the area of the textbook;
and the face feature identification submodule is used for locking the area where the teacher who executes the lecture action in the video information is located according to the determined lecture action, further identifying the identity of the teacher in the area where the teacher is located, locking the face area of the teacher in the video information, and identifying the face features of the teacher in the face area of the teacher.
Based on the above purpose, the embodiment of the present invention further provides an embodiment of an apparatus for executing the course information identification method. The device comprises:
one or more processors, and a memory.
The apparatus for performing the course information recognition method may further include: an input device and an output device.
The processor, memory, input device, and output device may be connected by a bus or other means.
The memory, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as program instructions/modules (e.g., the behavior analysis module and the feature recognition module shown in fig. 2) corresponding to the course information recognition method in the embodiment of the present invention. The processor executes various functional applications and data processing of the server by running the nonvolatile software program, instructions and modules stored in the memory, that is, implementing the course information identification method of the above-described method embodiment.
The memory may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of a device that performs the course information identification method, and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, the memory optionally includes memory remotely located from the processor, and these remote memories may be connected to the member user behavior monitoring device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input means may receive input numeric or character information and generate key signal inputs related to user settings and function control of the apparatus performing the course information recognition method. The output device may include a display device such as a display screen.
The one or more modules are stored in the memory and, when executed by the one or more processors, perform the course information identification method of any of the above method embodiments. The technical effect of the embodiment of the device for executing the course information identification method is the same as or similar to that of any method embodiment.
The embodiment of the invention also provides a non-transitory computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions can execute the processing method of the list item operation in any method embodiment. Embodiments of the non-transitory computer storage medium may be the same or similar in technical effect to any of the method embodiments described above.
Finally, it should be noted that, as will be understood by those skilled in the art, all or part of the processes in the methods of the above embodiments may be implemented by a computer program that can be stored in a computer-readable storage medium and that, when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like. The technical effect of the embodiment of the computer program is the same as or similar to that of any of the method embodiments described above.
Furthermore, the apparatuses, devices, etc. described in the present disclosure may be various electronic terminal devices, such as a mobile phone, a Personal Digital Assistant (PDA), a tablet computer (PAD), a smart television, etc., and may also be large terminal devices, such as a server, etc., and therefore the scope of protection of the present disclosure should not be limited to a specific type of apparatus, device. The client disclosed by the present disclosure may be applied to any one of the above electronic terminal devices in the form of electronic hardware, computer software, or a combination of both.
Furthermore, the method according to the present disclosure may also be implemented as a computer program executed by a CPU, which may be stored in a computer-readable storage medium. The computer program, when executed by the CPU, performs the above-described functions defined in the method of the present disclosure.
Further, the above method steps and system elements may also be implemented using a controller and a computer readable storage medium for storing a computer program for causing the controller to implement the functions of the above steps or elements.
Further, it should be appreciated that the computer-readable storage media (e.g., memory) described herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. By way of example, and not limitation, nonvolatile memory can include Read Only Memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which can act as external cache memory. By way of example and not limitation, RAM is available in a variety of forms such as synchronous RAM (DRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The storage devices of the disclosed aspects are intended to comprise, without being limited to, these and other suitable types of memory.
The apparatus of the foregoing embodiment is used to implement the corresponding method in the foregoing embodiment, and has the beneficial effects of the corresponding method embodiment, which are not described herein again.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, is limited to these examples; within the idea of the invention, also features in the above embodiments or in different embodiments may be combined, steps may be implemented in any order, and there are many other variations of the different aspects of the invention as described above, which are not provided in detail for the sake of brevity.
In addition, well known power/ground connections to Integrated Circuit (IC) chips and other components may or may not be shown within the provided figures for simplicity of illustration and discussion, and so as not to obscure the invention. Furthermore, devices may be shown in block diagram form in order to avoid obscuring the invention, and also in view of the fact that specifics with respect to implementation of such block diagram devices are highly dependent upon the platform within which the present invention is to be implemented (i.e., specifics should be well within purview of one skilled in the art). Where specific details (e.g., circuits) are set forth in order to describe example embodiments of the invention, it should be apparent to one skilled in the art that the invention can be practiced without, or with variation of, these specific details. Accordingly, the description is to be regarded as illustrative instead of restrictive.
While the present invention has been described in conjunction with specific embodiments thereof, many alternatives, modifications, and variations of these embodiments will be apparent to those of ordinary skill in the art in light of the foregoing description. For example, other memory architectures (e.g., dynamic ram (dram)) may use the discussed embodiments.
The embodiments of the invention are intended to embrace all such alternatives, modifications and variances that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, substitutions, improvements and the like that may be made without departing from the spirit and principles of the invention are intended to be included within the scope of the invention.
Claims (7)
1. A course information identification method is characterized by comprising the following steps:
collecting video information including teachers, students and textbooks;
determining a page turning action and a lecture action through behavior analysis according to the video information;
according to the video information and the book turning action, recognizing the name of the textbook;
according to the video information and the lecture actions, the identity of a teacher is identified, and the face characteristics of the teacher are identified;
searching a database according to the textbook name to obtain a corresponding course name, and searching the database according to the teacher face characteristic to obtain a corresponding teacher name;
storing the course name, teacher name and the video information in a storage device;
and the database stores the textbook name and the corresponding course name, the teacher name and the corresponding teacher face characteristic.
2. The method as claimed in claim 1, wherein the area of the textbook in the video information is locked according to the page turning action, and the textbook name in the textbook is searched and identified in the area of the textbook.
3. The course information identification method of claim 1, wherein according to the lecture action, a region in which a teacher who performs the lecture action is located in the video information is locked, the identity of the teacher is identified in the region in which the teacher is located, a teacher face region in the video information is locked, and the characteristics of the teacher face are identified in the teacher face region.
4. A course information recognition apparatus, comprising:
the image acquisition equipment is used for acquiring video information including teachers, students and textbooks;
the behavior analysis module is used for determining a page turning action and a lecture action according to the video information;
the characteristic identification module is used for identifying the textbook name according to the book turning action and the teaching action and identifying the identity of a teacher and the facial characteristics of the teacher according to the video information;
the database is used for storing course related information, and the course related information comprises the textbook name, the corresponding course name, the teacher name and the corresponding teacher face feature;
the matching module is used for searching the database according to the textbook name and the teacher face characteristics so as to obtain a course name corresponding to the textbook name and a teacher name corresponding to the teacher face characteristics;
and the storage module is used for storing the course name, the teacher name and the video information in storage equipment.
5. The lesson information recognition device as claimed in claim 4, wherein said feature recognition module comprises:
and the textbook feature identification submodule is used for locking the area of the textbook in the video information according to the book turning action, and searching and identifying the textbook name in the textbook in the area of the textbook.
6. The lesson information recognition device as claimed in claim 4, wherein said feature recognition module comprises:
and the face feature identification submodule is used for locking the area where a teacher executing the lecture action is located in the video information according to the lecture action, identifying the identity of the teacher in the area where the teacher is located, locking the face area of the teacher in the video information, and identifying the face features of the teacher in the face area of the teacher.
7. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 1 to 3 when executing the program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811208499.XA CN111062232A (en) | 2018-10-17 | 2018-10-17 | Course information identification method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811208499.XA CN111062232A (en) | 2018-10-17 | 2018-10-17 | Course information identification method and device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111062232A true CN111062232A (en) | 2020-04-24 |
Family
ID=70296891
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811208499.XA Pending CN111062232A (en) | 2018-10-17 | 2018-10-17 | Course information identification method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111062232A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112153421A (en) * | 2020-09-23 | 2020-12-29 | 杭州海康威视系统技术有限公司 | Data processing method, device, system, electronic equipment and storage medium |
| WO2023193525A1 (en) * | 2022-04-06 | 2023-10-12 | 杭州海康威视数字技术股份有限公司 | Course information recognition |
-
2018
- 2018-10-17 CN CN201811208499.XA patent/CN111062232A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112153421A (en) * | 2020-09-23 | 2020-12-29 | 杭州海康威视系统技术有限公司 | Data processing method, device, system, electronic equipment and storage medium |
| WO2023193525A1 (en) * | 2022-04-06 | 2023-10-12 | 杭州海康威视数字技术股份有限公司 | Course information recognition |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107977390B (en) | Method, device and system for identifying picture book and electronic equipment | |
| US20200125876A1 (en) | Method and Device for License Plate Positioning | |
| CN105095919A (en) | Image recognition method and image recognition device | |
| KR20210047350A (en) | Attendance management system, method and electronic device | |
| US9798742B2 (en) | System and method for the identification of personal presence and for enrichment of metadata in image media | |
| CN110546641B (en) | Access control method and device, intelligent device and storage medium | |
| CN111353364A (en) | Dynamic face identification method and device and electronic equipment | |
| CN111382655A (en) | Hand-lifting behavior identification method and device and electronic equipment | |
| CN111062189A (en) | Data analysis method and device and electronic equipment | |
| CN111062232A (en) | Course information identification method and device and electronic equipment | |
| CN111339809A (en) | Classroom behavior analysis method and device and electronic equipment | |
| DE102017125474A1 (en) | CONTEXTUAL COMMENTING OF INQUIRIES | |
| CN110807472A (en) | Image recognition method and device, electronic equipment and storage medium | |
| CN110781139A (en) | Teaching plan resource management system and method and electronic equipment | |
| Al-Muhaidhri et al. | Smart attendance system using face recognition | |
| CN110910419A (en) | Automatic tracking method and device and electronic equipment | |
| WO2019242156A1 (en) | Method and device for controlling application in terminal, and computer readable storage medium | |
| CN111354377B (en) | Method and device for recognizing emotion through voice and electronic equipment | |
| CN108834171B (en) | Image method and device | |
| CN110689226A (en) | Student information backup management system and method based on live broadcast teaching | |
| CN111382560A (en) | Courseware making method and system and electronic equipment | |
| CN111275921A (en) | Behavior monitoring method and device and electronic equipment | |
| CN111385509A (en) | Course patrol method and device and electronic equipment | |
| CN111354096A (en) | Intelligent attendance checking method and device and electronic equipment | |
| CN111354349A (en) | Voice recognition method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |