CN106231223B - Automatic human body tracking recording and broadcasting equipment, system and method - Google Patents
Automatic human body tracking recording and broadcasting equipment, system and method Download PDFInfo
- Publication number
- CN106231223B CN106231223B CN201610841485.6A CN201610841485A CN106231223B CN 106231223 B CN106231223 B CN 106231223B CN 201610841485 A CN201610841485 A CN 201610841485A CN 106231223 B CN106231223 B CN 106231223B
- Authority
- CN
- China
- Prior art keywords
- human body
- recording
- broadcasting
- video
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 22
- 238000001514 detection method Methods 0.000 claims abstract description 78
- 239000011159 matrix material Substances 0.000 claims abstract description 57
- 230000010365 information processing Effects 0.000 claims abstract description 35
- 238000001914 filtration Methods 0.000 claims description 16
- 210000000746 body region Anatomy 0.000 claims description 7
- 238000003780 insertion Methods 0.000 claims description 7
- 230000037431 insertion Effects 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 4
- 230000006870 function Effects 0.000 claims description 3
- 238000002955 isolation Methods 0.000 claims description 3
- 125000006850 spacer group Chemical group 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 13
- 235000008331 Pinus X rigitaeda Nutrition 0.000 description 2
- 235000011613 Pinus brutia Nutrition 0.000 description 2
- 241000018646 Pinus brutia Species 0.000 description 2
- 230000003321 amplification Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000010438 heat treatment Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 230000036760 body temperature Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/33—Transforming infrared radiation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Photometry And Measurement Of Optical Pulse Characteristics (AREA)
- Studio Devices (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The invention discloses an automatic human body tracking recording and broadcasting device, a system and a method, wherein the device comprises the following components: the infrared matrix sensor integrated circuit corresponds to the lecture pot and is used for measuring the thermal body infrared rays of different detection areas by utilizing the passive thermopile temperature difference detection principle by utilizing a plurality of detection points of the infrared matrix sensor so as to detect the human body; the information processing unit is used for determining the area where the human body is located according to the detection result of the infrared matrix sensor integrated circuit and controlling the camera holder module according to the determined result so as to realize human body tracking and shooting; the camera holder module comprises a holder control interface, a driving circuit and a camera holder, and realizes human body tracking shooting under the control of the information processing unit.
Description
Technical Field
The invention relates to an automatic human body tracking recording and broadcasting device, system and method, in particular to an automatic human body tracking recording and broadcasting device, system and method based on a human body pyroelectric infrared sensor.
Background
The recording and broadcasting system used in schools and training units needs to automatically track teachers and lecturers (hereinafter collectively referred to as "teacher") to pick up images at the positions of the lectures, one path of cameras are generally adopted in the traditional technology to shoot the panorama of the lectures, the video stream is analyzed, and the other path of camera holder is controlled according to the positions of the teacher, so that the positions of the teachers are automatically tracked, for example, a recording and broadcasting system of the Guangzhou Owei electronic technology limited company, a recording and broadcasting system of the Guangzhou visual electronic technology limited company, and the like are realized. Such techniques are expensive, require extensive video data processing, and are prone to interference when there are multiple moving objects in the lecture pot or when there are variations in the teaching projector picture.
At present, some other enterprises adopt the infrared reflection/correlation principle to track areas, namely an infrared correlation/reflector is arranged in a lecture pot, the lecture pot is divided into 3-5 areas to carry out shooting tracking, and the principle is that a teacher walks to a certain infrared correlation/reflector trigger signal to distinguish which area the teacher is in, so that a camera holder is arranged to align with the area where the teacher is located. The method has the advantages of simple structure and low cost, but the defects are obvious: the infrared correlation/reflector installation requirement is high, other objects can not be shielded by the lecture pot, and the resolution ratio is low.
In addition, in the application of the current recording and broadcasting system in schools, if the system can be popularized, each classroom needs to be realized, and each class can be recorded, so that a normalized recording and broadcasting system is formed. However, most of the current recording and broadcasting systems on the market are exquisite course recording and broadcasting systems designed for grading schools and uploading exquisite courses, have too many shooting channels, complex automatic tracking and shooting technology, unreasonable video storage architecture, lack of automatic division of time points of going up and down class and other factors, so that the cost of the recording and broadcasting systems is high, video storage and retrieval are very complicated, and practical use of teachers cannot be fully automated and are difficult to popularize.
Disclosure of Invention
In order to overcome the defects in the prior art, the invention aims to provide an automatic human body tracking recording and broadcasting device, an automatic human body tracking recording and broadcasting system and an automatic human body tracking recording and broadcasting method, which are characterized in that an array or an infrared matrix sensor integrated circuit formed by human body pyroelectric infrared sensors is used for detecting human body infrared rays to determine whether a human body exists in a detection area, amplification and filtering processing are carried out on detection results, the detection results are output to an information processing unit after being compared with reference values, the information processing unit is used for realizing human body position detection according to the detection results of the human body pyroelectric infrared sensors, determining the area where a human body exists, and controlling a camera tripod head module according to the determined results, so that automatic human body tracking and shooting and recording and broadcasting are realized.
To achieve the above and other objects, the present invention provides an automatic body tracking recording and broadcasting device, comprising:
the infrared matrix sensor integrated circuit is used for corresponding to the lecture jar, and a plurality of detection points of the sensor are used for measuring the infrared rays of the heating bodies in different detection areas by adopting a passive thermopile temperature difference detection principle so as to detect the human body;
the information processing unit is used for determining the area where the human body is located according to the detection result of the infrared matrix sensor integrated circuit and controlling the camera holder module according to the determined result so as to realize human body tracking and shooting;
the camera holder module comprises a holder control interface, a driving circuit and a camera holder, and realizes human body tracking shooting under the control of the information processing unit.
Further, the infrared matrix sensor integrated circuit has 64 lattices, is installed at a certain distance from the lecture pot, and reduces the 8×8=64 matrix to a 4×4=16 matrix adjacent to one detection area of four points.
In order to achieve the above purpose, the present invention also provides an automatic human body tracking recording and broadcasting device, comprising:
the sensor array is an array formed by human body pyroelectric infrared sensors, so as to detect human body infrared rays to determine whether a human body exists in a detection area;
the amplifying and filtering module comprises a plurality of amplifying and filtering circuits, and each amplifying and filtering circuit corresponds to a human pyroelectric infrared sensor so as to amplify and filter data detected by the human pyroelectric infrared sensor and send the amplified and filtered data into the analog switch matrix;
the analog switch matrix is used for outputting data detected by the human body pyroelectric infrared sensors to the comparison circuit;
the comparison circuit is used for comparing the output of the analog switch matrix with a reference value and sending the comparison result to the information processing unit;
the information processing unit is used for analyzing and processing the output of the comparison circuit to realize human body position detection, determining the region where a human body is located, and controlling the camera holder module according to the determined result so as to realize human body tracking and shooting;
the camera holder module comprises a holder control interface, a driving circuit and a camera holder, and realizes human body tracking shooting under the control of the information processing unit.
Further, the array of human pyroelectric infrared sensors is arranged at the platform, and each human pyroelectric infrared sensor corresponds to a detection area of the platform.
Further, the sensor array is separated by using a separation plate of human infrared wavelength band to realize region separation.
In order to achieve the above purpose, the present invention further provides an automatic human body tracking recording and broadcasting system, comprising:
the recording and broadcasting equipment realizes tracking and detecting of a human body region by utilizing an array formed by human body pyroelectric infrared sensors or an infrared matrix sensor integrated circuit, and controls a camera holder to carry out human body tracking and shooting according to a tracking and detecting result;
the video acquisition equipment is used for acquiring video information tracked and shot by the recording and broadcasting equipment under the control of the distributed multimedia central control module;
and the distributed multimedia central control module forms linkage control by combining the human body pyroelectric infrared sensor in the recording and broadcasting equipment with a local starting device or a remote server so as to realize the acquisition of control video and complete recording point insertion signals of the entering and exiting lessons.
Further, the local opening device comprises an IC/ID card, a digital microphone transmitter, a mobile phone and other devices related to the identity of the teacher.
Further, the recording and broadcasting system further comprises a central and distributed memory, wherein the central and distributed memory comprises a cloud distributed storage and retrieval system, and the cloud distributed storage and retrieval system is used for storing video information acquired by the video acquisition equipment in a distributed mode and providing retrieval/live broadcast/on-demand functions.
In order to achieve the above purpose, the invention also provides an automatic human body tracking recording and broadcasting method, which comprises the following steps:
detecting human body infrared rays in a corresponding detection area by adopting an array or an infrared matrix sensor integrated circuit formed by human body pyroelectric infrared sensors so as to determine whether a human body exists in the detection area;
amplifying and filtering the detection result, comparing the detection result with a reference value, and outputting the comparison result to an information processing unit;
and thirdly, the information processing unit realizes human body region position detection according to detection results of the pyroelectric infrared sensors or the infrared matrix sensor integrated circuits of the human bodies, determines the region where the human bodies are located, and controls the camera holder module according to the determined results so as to realize human body tracking and shooting.
Further, in the third step, if only one human pyroelectric infrared sensor detects a human body, the information processing unit determines that the area where the human body is located is the center of the detection area corresponding to the human pyroelectric infrared sensor; if two or more human pyroelectric infrared sensors detect a human body, the information processing unit determines that the region where the human body is located is an overlapping region of the detection regions corresponding to the human pyroelectric infrared sensors.
Compared with the prior art, the automatic human body tracking recording and broadcasting equipment, system and method provided by the invention have the advantages that the human body infrared rays are detected by utilizing the array or the infrared matrix sensor integrated circuit formed by the human body pyroelectric infrared sensors to determine whether a human body exists in a detection area, the detection result is amplified and filtered, the detection result is output to the information processing unit after being compared with the reference value, the information processing unit is utilized to realize human body position detection according to the detection result of each human body pyroelectric infrared sensor, the area where a human body is positioned is determined, and the camera holder module is controlled according to the determined result, so that the automatic human body tracking and shooting and recording and broadcasting are realized.
Drawings
FIG. 1 is a system architecture diagram of a first preferred embodiment of an automatic body tracking recording and playing device according to the present invention;
fig. 2 is a schematic diagram of a pyroelectric infrared sensor array of a human body according to a preferred embodiment of the present invention;
FIG. 3 is a system architecture diagram of a second preferred embodiment of an automatic body tracking recording and playing device according to the present invention;
FIG. 4 is a schematic diagram of the operation of an integrated circuit employing an infrared matrix sensor in accordance with a preferred embodiment of the present invention;
FIG. 5 is a system architecture diagram of an automatic body tracking recording and broadcasting system of the present invention;
FIG. 6 is a schematic diagram of an automatic body tracking recording and playing system according to a preferred embodiment of the present invention;
FIG. 7 is a topology diagram of a preferred embodiment of the present invention employing distributed storage (mode one);
FIG. 8 is a topology diagram of a preferred embodiment of the present invention employing distributed storage (mode two);
fig. 9 is a flowchart illustrating steps of an automatic body tracking recording and broadcasting method according to the present invention.
Detailed Description
Other advantages and effects of the present invention will become readily apparent to those skilled in the art from the following disclosure, when considered in light of the accompanying drawings, by describing embodiments of the present invention with specific embodiments thereof. The invention may be practiced or carried out in other embodiments and details within the scope and range of equivalents of the various features and advantages of the invention.
FIG. 1 is a system architecture diagram of an automatic body tracking recording and playing device according to a first preferred embodiment of the present invention. As shown in fig. 1, the automatic human body tracking recording and broadcasting device of the present invention comprises: the camera comprises a sensor array 101, an amplifying and filtering module 102, an analog switch matrix 103, a comparison circuit 104, an information processing unit 105 and a camera head module 106.
The sensor array 101 is an array formed by human pyroelectric infrared sensors, the array formed by the human pyroelectric infrared sensors is arranged at a platform (such as the top), each human pyroelectric infrared sensor corresponds to a detection area of the platform so as to detect human infrared rays to determine whether a human body exists in the detection area, and the detection result is transmitted to the amplifying and filtering module 102; the amplifying and filtering module 102 comprises a plurality of amplifying and filtering circuits, and each amplifying and filtering circuit corresponds to a human pyroelectric infrared sensor so as to amplify and filter data detected by the human pyroelectric infrared sensor and send the amplified and filtered data to the analog switch matrix 103; the analog switch matrix 103 is used for selecting and outputting data detected by a plurality of human pyroelectric infrared sensors to the comparison circuit 104, and the analog switch matrix 103 is an N-in-out switch matrix in the invention; the comparison circuit 104 is used for comparing the output of the analog switch matrix 103 with a reference voltage and sending the comparison result to the information processing unit 105; the information processing unit 105 realizes human body location detection according to the output of the comparison circuit 104, determines the region where the human body is located, and controls the camera head module 106 according to the determined result so as to realize human body tracking and shooting; the camera pan-tilt module 106 includes a pan-tilt control interface, a driving circuit, and a camera pan-tilt, and performs body tracking and image capturing under the control of the information processing unit 105. Of course, for normal operation, the automatic body tracking recording and broadcasting device of the present invention further includes a power supply and some peripheral circuits, which are not described herein because they are conventional circuits.
In the preferred embodiment of the present invention, taking a 2 m by 8 m lecture pot as an example, the sensor array 101 adopts a 3 by 4 matrix, that is, 12 human pyroelectric infrared sensors form a 3 by 4 matrix, as shown in fig. 2, the 3×4 matrix of the infrared sensor array corresponds to a 2×8 m lecture pot, that is, each human pyroelectric infrared sensor needs to be controlled in a 0.5×4 m area, and a circle in the center of a rectangle in the figure represents a human pyroelectric infrared sensor for detecting human infrared rays to determine whether a human exists in the detection range.
The principle of the present invention for human body region detection using a human body pyroelectric infrared sensor will be described with reference to fig. 2 as follows: according to the sensor array shown in fig. 2, the left to right sensors are numbered S1-S8 (each circle is schematically a sensor) from top to bottom. Assume that the initial status bit teacher position is at S5, walking from an arbitrary random direction to the next neighborhood bit S1 or S2 or S3 or S4 or S6 or S7 or S8 or S9. Since the sensor cannot achieve accurate area edge discrimination, there is an overlap in the edges, which in this embodiment is:
an overlap region U1 (S5, S1); (S5, S2); (S5, S3); (S5, S4); (S5, S6); (S5, S7); (S5, S8); (S5, S9).
It is also possible that the overlap region U2: (S5, S1, S2); (S5, S1, S3); (S5, S1, S4); (S5, S2, S3); (S5, S2, S4); (S5, S2, S6); (S5, S3, S6); (S5, S4, S7); (S5, S4, S8); (S5, S6, S8); (S5, S6, S9); (S5, S7, S8); (S5, S8, S9).
It is also possible that the overlap region U3: (S5, S1, S2, S4); (S5, S2, S3, S6); (S5, S4, S7, S8); (S5, S6, S8, S9).
The above-mentioned region numbers in parentheses are that the human body infrared signal is detected by the region sensor.
Which combination of overlapping areas is determined by the teacher's movement path, the sensor area detection accuracy, and the sensor detection time during the teacher's movement. It can be seen from U1-U3 that the amount of overlap is determined by the number of adjacent areas in the current area. For the area S5, 8 adjacent areas are the most complex case, plus one that forms a standard nine-square grid by itself. For the areas S1, S2, S4, S5, the next time the detection area is:
s1 is positioned in the center of the S1 area;
s2 is positioned in the center of the S2 area;
s3, positioning in the center of the S3 area;
s4, positioning in the center of the S4 area;
(S5, S1) is positioned at the junction point of S5 and S1, namely the center of the dotted rectangle in the upper drawing;
(S5, S2) is positioned at the midpoint of the boundary between S5 and S2, namely the center of the diamond-shaped frame with a broken line in the upper drawing;
(S5, S4) and (S5, S2), namely the center of the broken line triangle frame in the upper graph;
(S5, S1, S2) is the same as (S5, S1);
(S5, S1, S4) is the same as (S5, S1);
(S5, S1, S2, S4) is the same as (S5, S1);
other areas are the same as the above, and will not be described here again, the information processing unit 105 may detect the body location according to the above scheme, determine the area where the body is located, and further implement the infrared matrix positioning for tracking the body.
In the first preferred embodiment of the present invention, the sensor array 101 is formed by combining single pyroelectric infrared sensors of human body, and the isolation plates of human body infrared wavelength bands are used to realize the region isolation at intervals, but the present invention is not limited thereto, and the sensor array 101 may also be implemented by using an infrared matrix sensor integrated circuit, for example, AMG88xx series Infrared Array Sensor "Grid-EYE" infrared matrix sensor of japan pine company (PANASONIC CORPORATION), and how to implement automatic tracking and imaging of human body by using the infrared matrix sensor integrated circuit is described as follows:
fig. 3 is a schematic structural diagram of a second preferred embodiment of an automatic body tracking recording and playing device according to the present invention. As shown in fig. 3, an automatic human body tracking recording and broadcasting device of the present invention includes: the infrared matrix sensor integrated circuit 301, the information processing unit 302 and the camera pan-tilt module 303, wherein the information processing unit 302 and the camera pan-tilt module 303 are the same as those of the first preferred embodiment, and are not described herein, unlike the first preferred embodiment, the present embodiment adopts the infrared matrix sensor integrated circuit 301 to realize automatic tracking and shooting of the human body. Corresponding to the first preferred embodiment, the infrared matrix sensor integrated circuit itself integrates amplification filtering, analog switch matrix and comparison circuit, and can be, for example, an AMG88xx series Infrared Array Sensor "Grid-EYE" infrared matrix sensor of japan pine company (PANASONIC CORPORATION), and the following description will be given of how to use the infrared matrix sensor integrated circuit to realize automatic tracking and image capturing of human body:
the AMG88xx series is an infrared array sensor of Songshi corporation, which adopts the passive thermopile temperature difference detection principle to measure the infrared of a heating body, and the shell is provided with a non-human infrared band filter lens, so that the anti-interference capability is strong. The working principle is shown in figure 4.
Because the density of the device is higher, a passive thermopile temperature difference detection principle is adopted, if each of 64 dot matrixes is corresponding to one lecture pot according to the design of the device, a teacher human body temperature pattern is drawn, and the tracking difficulty is increased. It is therefore necessary to install the sensor at a distance from the lecture pot, to enlarge the physical area of the monitoring point contrast, and to consider several detection points as one area. For example, the 8×8=64 matrix is reduced to a 4×4=16 matrix adjacent to a region of four points, and the tracking position algorithm is the same as the sensor array formed by the independent sensors in fig. 1. The detection points of the AMG88xx series can be divided into two rows on the left and right sides and three rows of the upper and lower 3,3 and 2, for example, to form a matrix distribution diagram consistent with the independent sensor array of FIG. 1
In addition, the AMG88xx series temperature difference detection technology can provide 12-bit temperature resolution (one bit of sign position) for each monitoring point, so that the position of a teacher on the lecture jar can be judged by adopting the highest temperature area without the need of partitioning a large physical area to remotely install a sensor.
Fig. 5 is a system architecture diagram of an automatic body tracking recording and broadcasting system according to the present invention. As shown in fig. 5, the automatic human body tracking recording and broadcasting system of the present invention comprises: a recording and playing device 501, a video acquisition device 502 and a distributed multimedia central control module 503.
Wherein, the recording and playing device 501 realizes the tracking and detection of the human body region by using an array or an infrared matrix sensor integrated circuit which is arranged at the corresponding platform and consists of human body pyroelectric infrared sensors, and controls the camera cradle head to carry out human body tracking and shooting; the video acquisition device 502 is configured to acquire video information captured by the recording and playing device 501 under the control of the distributed multimedia central control module 503, and in a preferred embodiment of the present invention, the video acquisition device 502 is disposed in each classroom, i.e. one video acquisition device in each classroom; the distributed multimedia central control module 503 forms linkage control by combining a human body sensor (i.e. a human body pyroelectric infrared sensor) in the recording and playing device 501 with a local starting device or a remote server, so as to realize the acquisition of control video and perfect recording point insertion signals (certain mark) for the lesson taking and taking, for example, the automatic recording of the start and stop point mark for teaching of a teacher, thereby avoiding the condition that the teacher needs to process the starting and stop points of course video by himself or herself in the current recording and playing system. In the preferred embodiment of the present invention, the local opening device may be an IC/ID card, a digital microphone transmitter, a mobile phone, etc. related to the identity of the teacher, and the distributed multimedia central control module 503 automatically determines that the recording time insertion point of the lesson is performed according to the following conditions:
(1) The device is in a non-working state, a teacher of teaching a lesson swipes a card (at this time, a human body is detected through a human body sensor), then video recording is started, a lesson-taking sign is inserted, and meanwhile, the audio-visual teaching device is started, namely, when the recording and broadcasting device detects a human body through the human body sensor and receives a trigger signal of swiping the card, the recording and broadcasting device starts video recording, and the lesson-taking sign is inserted.
(2) The device is in a non-working state, a teacher gives lessons to start a portable digital microphone transmitter to be matched with a corresponding receiver arranged in a classroom, then starts video recording, inserts a lesson sign and simultaneously starts the electrified education device. That is, when the recording and broadcasting device detects a human body through the human body sensor and receives the trigger signal of the digital microphone, the recording and broadcasting device starts to record a video and inserts a lesson-taking sign
(3) The equipment is in a non-working state, a teaching teacher starts the mobile phone APP of the system, after the mobile phone APP passes the identity authentication of the near-field control panel of the mobile phone, an opening command is sent, video recording is started, a teaching sign is inserted, and the electrified education equipment is simultaneously opened. That is, when the recording and broadcasting device detects a human body through the human body sensor and receives the triggering and authentication information of the mobile phone APP, the recording and broadcasting device starts to record a video and inserts a lesson mark
(4) The equipment is in a non-working state, and the remote server starts the system in advance according to the time of the class schedule, so that the video is started, a class mark is inserted, and meanwhile, the electrified education equipment is started. That is, when the recording and broadcasting device receives the trigger signal of the remote server, the recording and broadcasting device starts to record video and inserts a lesson mark
(5) The equipment is in a non-working state, an administrator starts the system through a remote server, then starts video recording, inserts a lesson-taking sign and simultaneously starts the electrified education equipment. That is, when the recording and broadcasting device receives the control signal of the remote server, the recording and broadcasting device starts to record video and inserts a lesson-taking sign.
(6) The device is in a working state, and a teacher gives lessons to swipe a card to close the video and insert a lesson-giving sign and close the electrified education device. When the recording and broadcasting equipment receives a trigger signal of swiping a card and detects a human body through a human body sensor, the recording and broadcasting equipment closes the video and inserts a lesson-going sign.
(7) The equipment is in a working state, a teaching teacher starts the mobile phone APP of the system, after the identity authentication of a near-field control panel close to the mobile phone passes, a closing command is sent, video recording is closed, a teaching mark is inserted, and the electrified education equipment is closed at the same time. When the recording and broadcasting equipment receives triggering and authentication information of the mobile phone APP and detects a human body through the human body sensor, the recording and broadcasting equipment closes the video and inserts a lesson-taking sign.
(8) The equipment is in a working state, the remote server turns off the system according to the time lag of the class schedule, then turns off the video, inserts a class-setting sign and turns off the electrified education equipment. When the recording and broadcasting equipment receives the trigger signal of the remote server, the recording and broadcasting equipment closes the video and inserts a lesson-setting mark.
(9) The equipment is in a working state, and an administrator closes the system through the remote server, so that the video is closed, a lesson-taking sign is inserted, and meanwhile, the electrified education equipment is closed. When the recording and broadcasting equipment receives the control signal of the remote server, the recording and broadcasting equipment closes the video and inserts a lesson-taking sign.
(10) If the device is in a working state, if no person is detected in the lecture altar and the student area, namely the whole classroom, the video is closed, a lesson-taking sign is inserted, and meanwhile the electrified education device is closed. When the recording and broadcasting equipment detects that no person exists in the whole classroom through the human body sensor, the recording and broadcasting equipment closes the video and inserts a lesson-taking sign.
FIG. 6 is a schematic diagram of an automatic body tracking recording and playing system according to a preferred embodiment of the present invention. The recording and broadcasting device 501, the video capturing device 502 and the distributed multimedia central control module 503 are the same as those of fig. 5, which are not described herein, and the automatic body tracking recording and broadcasting system of the present invention further includes a central and distributed memory 504, where the central and distributed memory 504 may be deployed in a set of classrooms, for example, one teaching building, and includes a cloud distributed storage and retrieval system for storing video information captured by the video capturing device 502 and providing functions of retrieval/live broadcast/on-demand. In a preferred embodiment of the present invention, the central and distributed memory 504 uses a cloud-distributed memory architecture to store video of each class of each classroom of a school and for at least one year to achieve annual assessment of teacher lectures.
In one embodiment of the present invention, the video capture device 502 may employ local storage, i.e., the video capture device host of each classroom has local storage functionality. Video recorded in a teaching time period of a certain day is stored locally, and at night or other free time, a video acquisition equipment host of each classroom is controlled by server scheduling, and local video is uploaded to a central and distributed memory in batches, so that network congestion is avoided, as shown in fig. 7.
In another embodiment of the present invention, classrooms may be grouped, each group being provided with a local distributed storage, and the video capturing device 502 uploads the captured video information to the local distributed storage, and then to the central and distributed storage, as shown in fig. 8.
Fig. 9 is a flowchart illustrating steps of an automatic body tracking recording and broadcasting method according to the present invention. As shown in fig. 9, the automatic human body tracking recording and broadcasting method of the invention comprises the following steps:
In step 903, the information processing unit detects the body region according to the detection result of each pyroelectric infrared sensor or infrared matrix sensor integrated circuit, determines the region where the body is located, and controls the camera holder module according to the determined result, so as to realize tracking and shooting of the body. Specifically, if only a certain human pyroelectric infrared sensor detects a human body, determining the region where the human body is located as the center of the detection region corresponding to the human pyroelectric infrared sensor, if two or more human pyroelectric infrared sensors detect the human body, determining the region where the human body is located as the overlapping region of the detection regions corresponding to the human pyroelectric infrared sensors, specifically, if the detection regions are in common, determining the region where the human body is located as the midpoint of the common edge, if the detection regions are in common vertex, determining the region where the human body is located as the common vertex, and if the detection regions are in common edge and common vertex, determining the region where the human body is located as the common vertex.
Preferably, after step 903, the method further comprises the following steps:
video acquisition is carried out on the tracking camera by utilizing video acquisition equipment, so as to acquire video information;
and carrying out local storage or cloud storage on the video information.
Preferably, the automatic human body tracking recording and broadcasting method of the invention further comprises the following steps:
the human body sensor (i.e. the human body pyroelectric infrared sensor) of the recording and broadcasting equipment is combined with the local starting equipment or the remote server to form linkage control so as to realize the acquisition of control video and perfect recording point insertion signals (certain mark) for the lesson taking and taking, for example, the automatic recording of the start and stop point mark for teaching of a teacher, thereby avoiding the condition that the teacher needs to process the starting and stop points of the course video by the current recording and broadcasting system. In a preferred embodiment of the present invention, the local opening device may be an RF IC/ID card, a digital microphone transmitter, a mobile phone, etc. that is related to the identity of the teacher.
In summary, the automatic human body tracking recording and broadcasting device, system and method of the invention detect human body infrared rays by using an array or an infrared matrix sensor integrated circuit formed by human body pyroelectric infrared sensors to determine whether a human body exists in a detection area, amplify and filter the detection result, output the detection result to an information processing unit after comparing the detection result with a reference value, realize human body position detection by using the information processing unit according to the detection result of each human body pyroelectric infrared sensor, determine the area where the human body exists, and control a camera cradle head module according to the determined result, thereby realizing automatic human body tracking and shooting and recording and broadcasting.
Compared with the prior art, the invention has the following advantages:
1. the main difference between the invention and the prior art is that no way is available for realizing misjudgment caused by non-human movement no matter the prior method is an image tracking technology or infrared correlation/reflection, the invention uses the human infrared tracking technology to detect the infrared rays with the wavelength of 8-10 microns radiated by the human body, and can accurately judge the human movement.
2. The invention adopts a distributed storage structure to store a large amount of video data in a distributed way, can be set not to be uploaded during video recording so as to reduce the network bandwidth pressure, and automatically schedules the uploading according to batches in a non-working time period so as to fully utilize the idle network bandwidth;
3. the recording and broadcasting system also forms linkage control with the digital microphone, the RF IC/ID card system, the mobile phone near field control panel, the course class list of the background server and the like, realizes perfect recording point insertion signals of the upper and lower courses, ensures that the system automatically judges the recording time of the upper and lower courses and automatically inserts the zone bit, automatically searches the identity information of a teaching teacher, realizes full-automatic video recording, and solves the industrial problem which must be solved by the standardized recording and broadcasting of schools. Greatly promotes the schedule of popularizing application of the standardized recording and broadcasting in schools.
The above embodiments are merely illustrative of the principles of the present invention and its effectiveness, and are not intended to limit the invention. Modifications and variations may be made to the above-described embodiments by those skilled in the art without departing from the spirit and scope of the invention. Accordingly, the scope of the invention is to be indicated by the appended claims.
Claims (10)
1. An automatic body tracking recording and broadcasting system, comprising:
the recording and broadcasting equipment realizes tracking and detecting of a human body region by utilizing an array formed by human body pyroelectric infrared sensors or an infrared matrix sensor integrated circuit, and controls a camera holder to carry out human body tracking and shooting according to a tracking and detecting result;
the video acquisition equipment is used for acquiring video information tracked and shot by the recording and broadcasting equipment under the control of the distributed multimedia central control module;
the distributed multimedia central control module forms linkage control by combining a human body pyroelectric infrared sensor in the recording and broadcasting equipment with a local starting equipment or a remote server so as to realize the acquisition of control video and complete insertion signals of recording points of entering and leaving lessons;
the method is characterized in that the distributed multimedia central control module automatically judges that the recording point insertion signals of the lessons are carried out according to the following conditions:
(1) When the recording and broadcasting equipment detects a human body through a human body sensor and receives a triggering signal of swiping a card, the recording and broadcasting equipment starts to record a video and inserts a lesson mark;
(2) The equipment is in a non-working state, when the recording and broadcasting equipment detects a human body through a human body sensor and receives a trigger signal of the digital microphone, the recording and broadcasting equipment starts to record a video and inserts a lesson-taking sign;
(3) The equipment is in a non-working state, when the recording and broadcasting equipment detects a human body through a human body sensor and receives triggering and authentication information of the mobile phone APP, the recording and broadcasting equipment starts to record a video and inserts a lesson-taking sign;
(4) When the recording and broadcasting equipment receives a trigger signal of a remote server, the recording and broadcasting equipment is started to record video and insert a lesson-taking sign;
(5) When the recording and broadcasting equipment receives a control signal of a remote server, the recording and broadcasting equipment is started to record the video and inserts a lesson-taking sign;
(6) The equipment is in a working state, and a teacher gives lessons to close the video when swiping a card, inserts a lesson-giving sign and simultaneously closes the electrified education equipment; when the recording and broadcasting equipment receives a triggering signal of swiping a card and detects a human body through a human body sensor, the recording and broadcasting equipment closes the video and inserts a lesson-taking sign;
(7) The equipment is in a working state, a teaching teacher starts the mobile phone APP of the system, after the identity authentication of a near-field control panel of the mobile phone passes, a closing command is sent, video recording is closed, a teaching mark is inserted, and the electrified teaching equipment is closed at the same time; when the recording and broadcasting equipment receives triggering and authentication information of the mobile phone APP and detects a human body through a human body sensor, the recording and broadcasting equipment closes the video and inserts a lesson-taking sign;
(8) The equipment is in a working state, the remote server turns off the system according to the time lag of the class schedule, then turns off the video, inserts a class-setting sign and turns off the electrified education equipment at the same time; when the recording and broadcasting equipment receives a trigger signal of the remote server, the recording and broadcasting equipment closes the video and inserts a lesson-taking mark;
(9) The equipment is in a working state, an administrator turns off the system through a remote server, then turns off the video and inserts a lesson-giving sign and turns off the electrified education equipment at the same time; when the recording and broadcasting equipment receives a control signal of the remote server, the recording and broadcasting equipment closes the video and inserts a lesson-taking mark;
(10) If the device is in a working state, if the lecture jar and the student area are detected, namely, no person exists in the whole classroom, the video is closed, a lesson-taking sign is inserted, and meanwhile, the electrified education device is closed; when the recording and broadcasting equipment detects that no person exists in the whole classroom through the human body sensor, the recording and broadcasting equipment closes the video and inserts a lesson-taking sign.
2. The automated body tracking recording and broadcasting system of claim 1, wherein the recording and broadcasting device comprises:
the infrared matrix sensor integrated circuit corresponds to the lecture pot and is used for measuring the thermal body infrared rays of different detection areas by utilizing the passive thermopile temperature difference detection principle by utilizing a plurality of detection points of the infrared matrix sensor so as to detect the human body;
the information processing unit is used for determining the area where the human body is located according to the detection result of the infrared matrix sensor integrated circuit and controlling the camera holder module according to the determined result so as to realize human body tracking and shooting;
the camera holder module comprises a holder control interface, a driving circuit and a camera holder, and realizes human body tracking shooting under the control of the information processing unit.
3. The automatic body tracking recording and broadcasting system according to claim 2, wherein said infrared matrix sensor integrated circuit has 64 dot matrices, which are installed at a distance from a lecture pot, and reduces the 8x 8 = 64 matrix to a 4 x 4 = 16 matrix adjacent to one detection area of four dots.
4. The automated body tracking recording and broadcasting system of claim 1, wherein the recording and broadcasting device comprises:
the sensor array is an array formed by human body pyroelectric infrared sensors, so as to detect human body infrared rays to determine whether a human body exists in a detection area;
the amplifying and filtering module comprises a plurality of amplifying and filtering circuits, and each amplifying and filtering circuit corresponds to a human pyroelectric infrared sensor so as to amplify and filter data detected by the human pyroelectric infrared sensor and send the amplified and filtered data into the analog switch matrix;
the analog switch matrix is used for outputting data detected by the human body pyroelectric infrared sensors to the comparison circuit;
the comparison circuit is used for comparing the output of the analog switch matrix with a reference value and sending the comparison result to the information processing unit;
the information processing unit is used for analyzing and processing the output of the comparison circuit to realize human body position detection, determining the region where a human body is located, and controlling the camera holder module according to the determined result so as to realize human body tracking and shooting;
the camera holder module comprises a holder control interface, a driving circuit and a camera holder, and realizes human body tracking shooting under the control of the information processing unit.
5. The system of claim 4, wherein the array of pyroelectric infrared sensors is disposed at a platform, each pyroelectric infrared sensor corresponding to a detection area of the platform.
6. The system of claim 4, wherein the sensor array is spaced apart by a spacer plate of human infrared wavelength band to achieve zonal isolation.
7. The automatic body tracking recording and broadcasting system according to claim 1, wherein: the local opening device comprises an IC/ID card, a digital microphone transmitter, a mobile phone and other devices related to the identity of a teaching teacher.
8. The automatic body tracking recording and broadcasting system according to claim 1, wherein: the recording and broadcasting system also comprises a central and distributed memory, wherein the central and distributed memory comprises a cloud distributed storage and retrieval system, and the cloud distributed storage and retrieval system is used for storing video information acquired by the video acquisition equipment in a distributed mode and providing retrieval/live broadcast/on-demand functions.
9. An automatic body tracking recording method of an automatic body tracking recording system according to any one of claims 1-8, comprising the steps of:
detecting human body infrared rays in a corresponding detection area by adopting an array or an infrared matrix sensor integrated circuit formed by human body pyroelectric infrared sensors so as to determine whether a human body exists in the detection area;
amplifying and filtering the detection result, comparing the detection result with a reference value, and outputting the comparison result to an information processing unit;
and thirdly, the information processing unit realizes human body region position detection according to detection results of the pyroelectric infrared sensors or the infrared matrix sensor integrated circuits of the human bodies, determines the region where the human bodies are located, and controls the camera holder module according to the determined results so as to realize human body tracking and shooting.
10. The automatic body tracking recording and broadcasting method according to claim 9, wherein: in the third step, if only one human pyroelectric infrared sensor detects a human body, the information processing unit determines that the area where the human body is located is the center of the detection area corresponding to the human pyroelectric infrared sensor; if two or more human pyroelectric infrared sensors detect a human body, the information processing unit determines that the region where the human body is located is an overlapping region of the detection regions corresponding to the human pyroelectric infrared sensors.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610841485.6A CN106231223B (en) | 2016-09-22 | 2016-09-22 | Automatic human body tracking recording and broadcasting equipment, system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610841485.6A CN106231223B (en) | 2016-09-22 | 2016-09-22 | Automatic human body tracking recording and broadcasting equipment, system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106231223A CN106231223A (en) | 2016-12-14 |
| CN106231223B true CN106231223B (en) | 2023-05-12 |
Family
ID=58076878
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610841485.6A Active CN106231223B (en) | 2016-09-22 | 2016-09-22 | Automatic human body tracking recording and broadcasting equipment, system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106231223B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106052890A (en) * | 2016-05-06 | 2016-10-26 | 努比亚技术有限公司 | Communication terminal and temperature detection method |
| CN107167851B (en) * | 2017-05-18 | 2023-12-26 | 深圳通感微电子有限公司 | Partition type infrared detector and partition type infrared detection method |
| CN107038908A (en) * | 2017-06-08 | 2017-08-11 | 杨传安 | A kind of rail mounted automatic recording broadcasting system |
| CN108152532B (en) * | 2017-12-29 | 2020-11-27 | 浙江摩根智能技术有限公司 | Method for detecting existence and movement of human body |
| CN110211155A (en) * | 2019-05-30 | 2019-09-06 | 浙江大华技术股份有限公司 | Method for tracking target and relevant apparatus |
| CN110866473B (en) * | 2019-11-04 | 2022-11-18 | 浙江大华技术股份有限公司 | Target object tracking detection method and device, storage medium and electronic device |
| CN112817342A (en) * | 2020-12-23 | 2021-05-18 | 上海工程技术大学 | Speaker tracking system integrating human body detection technology and wireless sensing technology and application |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201307345Y (en) * | 2008-10-29 | 2009-09-09 | 北京中庆现代技术有限公司 | Course automatic recording broadcasting system |
| CN103426336A (en) * | 2013-06-26 | 2013-12-04 | 西安科技大学 | College teaching resource digitization system and using method thereof |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201682561U (en) * | 2009-05-26 | 2010-12-22 | 北京同步科技有限公司 | Course recording system |
| CN201541325U (en) * | 2009-09-21 | 2010-08-04 | 张长宇 | Infrared multi-point automatic following and positioning image pick-up device |
| JP5673921B2 (en) * | 2010-03-31 | 2015-02-18 | 独立行政法人産業技術総合研究所 | Positioning system and positioning method using pyroelectric infrared sensor array |
| CN202770533U (en) * | 2012-08-17 | 2013-03-06 | 常熟开关制造有限公司(原常熟开关厂） | Two-dimensional area temperature detection device |
| CN206023967U (en) * | 2016-09-22 | 2017-03-15 | 广州东文信息科技有限公司 | A kind of automatic body tracking recorded broadcast equipment and system |
-
2016
- 2016-09-22 CN CN201610841485.6A patent/CN106231223B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201307345Y (en) * | 2008-10-29 | 2009-09-09 | 北京中庆现代技术有限公司 | Course automatic recording broadcasting system |
| CN103426336A (en) * | 2013-06-26 | 2013-12-04 | 西安科技大学 | College teaching resource digitization system and using method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106231223A (en) | 2016-12-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106231223B (en) | Automatic human body tracking recording and broadcasting equipment, system and method | |
| CN102131047B (en) | 360-degree automatic tracking hunting camera and working method thereof | |
| CN206058576U (en) | A kind of teaching writing/playing system | |
| KR100989142B1 (en) | System and method for supplying e-learning contents | |
| CN103905734A (en) | Method and device for intelligent tracking and photographing | |
| CN106846957A (en) | A kind of long-distance intelligent interactive education system | |
| CN102625036A (en) | Image processing apparatus, image capturing apparatus and recording medium | |
| CN109685017B (en) | Real-time target detection system and detection method based on lightweight neural network | |
| CN105075237A (en) | Image processing apparatus, image processing method, and program | |
| CN107766788A (en) | Information processor, its method and computer-readable recording medium | |
| US20060173909A1 (en) | Automated image annotation | |
| KR20170058827A (en) | Security system and security process and security controller of throw trash, by detected humans action or shape image | |
| CN102096930A (en) | Student standing and sitting detection method for intelligent recorded broadcasting system for teaching | |
| CN102158649A (en) | Photographic device and photographic method thereof | |
| CN206023967U (en) | A kind of automatic body tracking recorded broadcast equipment and system | |
| EP3432575A1 (en) | Method for performing multi-camera automatic patrol control with aid of statistics data in a surveillance system, and associated apparatus | |
| CN106530160A (en) | Education platform operation method based on monitoring positioning | |
| CN108805774A (en) | A kind of campus electronics class's board and the class's of walking Course Arrangement and method | |
| CN203193774U (en) | Automatic tracing machine based on space grid technology | |
| EP3576012A3 (en) | Video capturing system and network system to support privacy mode | |
| CN103546679A (en) | Device and method for reducing separation of shot object from shooting window | |
| CN105578100A (en) | Teaching video system | |
| CN103916615A (en) | Recording and broadcasting system with automatic recognition function and working method thereof | |
| RU2298150C2 (en) | Multispectral complex for the aerial surveying of the earth surface wildlife objects and the method of the aerial surveying | |
| CN108038524A (en) | One kind is taken photo by plane formula book data Compare System |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240327 Address after: Room 401, No.1 Kehui Fourth Street, Science City, Guangzhou High tech Industrial Development Zone, Guangdong Province, 510670 Patentee after: GUANGZHOU EVERLASTING ELECTRONIC CO.,LTD. Country or region after: China Address before: A413-414, Creative Center, Phase II, TCL Cultural Industrial Park, No. 69, West Spectra Road, Science City, Guangzhou Hi tech Industrial Development Zone, Guangdong 510600 Patentee before: GUANGZHOU DONGWEN INFORMATION TECHNOLOGY CO.,LTD. Country or region before: China |