CN115278004B - Method, device, equipment and storage medium for transmitting monitoring video data - Google Patents

Method, device, equipment and storage medium for transmitting monitoring video data Download PDF

Info

Publication number
CN115278004B
CN115278004B CN202210790783.2A CN202210790783A CN115278004B CN 115278004 B CN115278004 B CN 115278004B CN 202210790783 A CN202210790783 A CN 202210790783A CN 115278004 B CN115278004 B CN 115278004B
Authority
CN
China
Prior art keywords
image acquisition
monitoring
image
monitoring area
personnel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210790783.2A
Other languages
Chinese (zh)
Other versions
CN115278004A (en
Inventor
付何俭
徐志秀
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Haikang Auto Software Co ltd
Original Assignee
Hangzhou Haikang Auto Software Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Haikang Auto Software Co ltd filed Critical Hangzhou Haikang Auto Software Co ltd
Priority to CN202210790783.2A priority Critical patent/CN115278004B/en
Publication of CN115278004A publication Critical patent/CN115278004A/en
Application granted granted Critical
Publication of CN115278004B publication Critical patent/CN115278004B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/587Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/30Transforming light or analogous information into electric information
    • H04N5/33Transforming infrared radiation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The application provides a transmission method, device and equipment of monitoring video data and a storage medium, and relates to the field of data transmission. The method is applied to an image transmission device connected to an image receiving device, and includes: determining whether personnel are active in a first preset duration of the monitoring area of the image acquisition equipment at the current moment; when no personnel are active in the monitoring area within a first preset time, determining that the image acquisition equipment within a second preset time after the current moment acquires the inserted private frame in the monitoring video, and transmitting the monitoring video inserted with the private frame to the image receiving equipment; the private frame is a custom frame. The method is suitable for the transmission process of the monitoring video data and is used for solving the problem of privacy disclosure of users.

Description

Method, device, equipment and storage medium for transmitting monitoring video data
Technical Field
The present application relates to the field of data transmission, and in particular, to a method, an apparatus, a device, and a storage medium for transmitting surveillance video data.
Background
At present, when a monitoring camera transmits collected video images, a scheme of variable bit rate (variable bit rate, VBR) is adopted to encode the video images into encoded video data.
The variable code rate means that the monitoring camera dynamically adjusts the data volume of the coded video data generated by the video image coding per second according to the change of the video image so as to achieve the effects of ensuring the quality of the video image and reducing the transmission or storage pressure.
However, by using the transmission scheme with the variable code rate, other people may acquire the activity rule of the user in the video image by using the sniffing technology, so that the privacy information of the user is revealed.
Disclosure of Invention
Based on the technical problems, the application provides a transmission method, a device, equipment and a storage medium of monitoring video data, which are used for filling private frames in a monitoring video as interference when no personnel are active in a monitoring area, so as to destroy regularity when a monitoring camera adopts a scheme of changing code rate to encode and protect privacy information of a user.
In a first aspect, the present application provides a method for transmitting surveillance video data, the method being applied to an image capturing device, the image capturing device being connected to an image receiving device, the method comprising:
determining whether personnel are active in a first preset duration of the monitoring area of the image acquisition equipment at the current moment; when no personnel are active in the monitoring area within a first preset time, determining that the image acquisition equipment within a second preset time after the current moment acquires the inserted private frame in the monitoring video, and transmitting the monitoring video inserted with the private frame to the image receiving equipment; the private frame is a custom frame.
In a possible implementation manner, determining whether a monitoring area of the image acquisition device has personnel activity within a first preset duration of a current moment, includes: for a first monitoring video acquired by image acquisition equipment within a first preset duration, determining whether the data volume of video data encoded by the first monitoring video is lower than a data volume threshold value; and when the data volume is lower than the data volume threshold value, determining that no personnel are active in the monitoring area for a first preset time period.
In another possible implementation manner, determining whether the monitoring area of the image capturing device has personnel activity within a first preset duration of the current moment, includes: acquiring the code rate of the image acquisition equipment in the first preset duration for encoding the monitoring image; and when the code rate is lower than the code rate threshold value, determining that the monitoring area of the image acquisition equipment does not have personnel activity within a first preset duration.
In yet another possible implementation, an image acquisition device includes an infrared detection module; the infrared detection module is used for detecting whether personnel move in the monitoring area; determining whether personnel are active in a first preset duration of a monitoring area of the image acquisition equipment at the current moment, including: and detecting whether personnel are active in the monitoring area by using an infrared detection module.
Optionally, the infrared detection module comprises at least one of a pyroelectric infrared sensor, or a matrix type infrared sensor.
Optionally, determining whether the monitoring area of the image capturing device has personnel activity within a first preset duration at the current moment, includes: and periodically determining whether personnel are active in a first preset duration of the current moment of the monitoring area of the image acquisition equipment according to a preset period.
Optionally, the second preset duration includes a delay duration; the delay time is the time between the time when no personnel activity in the monitoring area is detected and the time when the image acquisition equipment starts to insert the private frame in the monitoring video.
Optionally, the second preset duration is a duration randomly generated by the image capturing device.
In the transmission method of the monitoring video, when the image acquisition equipment detects that no personnel are moving in the monitoring area, a private frame can be inserted into the monitoring video. Compared with the monitoring video without the private frame, the data volume of the encoded video data obtained after the monitoring video with the private frame is encoded is larger, the encoded video data with the larger data volume can camouflage the false activity rule (including but not limited to the action rule and the like) of the user in the monitoring video, other people acquire the camouflage false activity rule when acquiring the activity rule of the user according to the data volume of the encoded video data, and the real activity rule of the user can be prevented from being acquired by other people, so that the privacy information of the user is protected.
In a second aspect, the present application provides a transmission device for monitoring video, the device comprising respective modules for the method described in the first aspect above.
In a third aspect, the present application provides an image acquisition apparatus comprising: a processor and a memory; the memory stores instructions executable by the processor; the processor is configured to execute the instructions to cause the image acquisition apparatus to implement the method of the first aspect described above.
In a fourth aspect, the present application provides a computer program product for, when run on an image acquisition apparatus, causing the image acquisition apparatus to perform the steps of the related method of the first aspect described above, to carry out the method of the first aspect described above.
In a fifth aspect, the present application provides a readable storage medium comprising: a software instruction; the image acquisition apparatus when the software instructions are run in the image acquisition apparatus implements the method described in the first aspect above.
In a sixth aspect, the present application provides a chip comprising a processor and an interface, the processor being coupled to a memory via the interface, which when executed by the processor causes the method of the first aspect described above to be performed, when executed by a computer program or image acquisition device in the memory.
The advantageous effects of the second aspect to the sixth aspect described above may be described with reference to the first aspect, and will not be repeated.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic diagram of an implementation environment related to a transmission method of monitoring video data according to an embodiment of the present application;
fig. 2 is another schematic diagram of an implementation environment related to a transmission method of surveillance video data according to an embodiment of the present application;
FIG. 3 is a schematic diagram of the structure of encoded video data;
fig. 4 is a flowchart of a method for transmitting surveillance video data according to an embodiment of the present application;
fig. 5 is another flow chart of a transmission method of monitoring video data according to an embodiment of the present application;
fig. 6 is a schematic diagram of a transmission device for monitoring video data according to an embodiment of the present application;
fig. 7 is a schematic diagram of an image capturing device according to an embodiment of the present application.
Detailed Description
Hereinafter, the terms "first," "second," and "third," etc. are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first", "a second", or "a third", etc., may explicitly or implicitly include one or more such feature.
The technical terms related to the embodiments of the present application will be explained first.
1. Sniffer (sniffer): refers to a technique for intercepting data messages destined for other computing devices using a network interface of the computing device.
2. Webcam/internet protocol camera (internet protocol camera, IPC): the network camera is a new generation camera generated by combining the traditional camera and the network technology, and can transmit video images to the other end of the earth through the network, and a remote browser can monitor the video images without any professional software as long as a standard network browser (such as Microsoft IE or Netscape) is used. The IPC generally consists of a lens, an image sensor, a sound sensor, a signal processor, an a/D converter, a coding chip, a main control chip, a network, a control interface, and the like.
3. Network hard disk recorder (network video recorder, NVR): the most important function of NVR is to receive the digital video code stream transmitted by IPC (network video camera) equipment through a network, store and manage the digital video code stream, and therefore realize the advantage of a distributed architecture brought by networking. Through NVR, video images acquired by a plurality of network cameras can be watched, browsed, played back, managed and stored at the same time.
4. Group of pictures (GOP): a GOP is a set of consecutive pictures. The GOP is the basic unit of encoder (in IPC) and decoder access (in NVR). A GOP may include one I frame, multiple B frames, and multiple P frames.
5. I frame: an intra-coded frame (I frame) is an independent frame with all information, and can be decoded independently without reference to other pictures, and can be simply understood as a still picture. The first frame in a GOP is always an I-frame because it is a key frame.
6. P frame: a forward prediction-frame (P frame) is a frame in which an I frame is used as a reference frame and a content different from the I frame is encoded and stored. The complete P-frame picture must be reconstructed from the I-frames at decoding time.
7. B frame: the bi-predictive interpolated encoded frame (bi-directional interpolated prediction frame, B frame) may also be referred to as a bi-predictive frame. The B frame is a coded frame in which the difference between the present frame and the preceding and following frames is recorded with the I frame or the P frame preceding the present frame and the P frame following the present frame as reference frames.
8. Private frame: the customized frame can be used for storing customized data, the private frame (equivalent to an invalid monitoring picture) can be discarded when the standard player analyzes the video, and only the player which is self-developed by a developer can analyze the customized data stored in the private frame, and the data can be written in the private frame according to the requirement. That is, the private frame may be a video frame of a non-real monitoring picture generated based on a preset content generation rule according to a preset video processing algorithm. The embodiment of the application does not limit the specific content of the data carried by the private frame.
As described above, a GOP is a basic unit of encoder and decoder access. That is, the encoder may encode a plurality of video images to generate a plurality of GOPs one by one, and the decoder may read and decode the plurality of GOPs one by one during playback. According to the characteristics of the I frame, the P frame, and the B frame, it can be seen that the GOP is distinguished according to the differences between the video images, and when a certain video image is very different from the previous video image, the previous video image cannot be referred to for encoding, and at this time, the previous GOP needs to be ended, and the next GOP is started.
When a variable rate encoding scheme is employed, if there is no person activity in the video pictures, the difference between the video pictures is not large, the encoder can encode the video pictures into a small number of GOPs, and the amount of encoded video data output by the encoder is small. If personnel are moving in the video images, the difference between the video images is larger, the GOP generated by encoding the video images is larger, and the data volume of the encoded video data output by the encoder is larger.
In this case, for a target person (for example, a user) in a video image captured by the monitoring camera, other persons can acquire the data amount of the encoded video data output by the monitoring camera by using a sniffing technique, and a time period when the person is active and a time period when the person is not active in the video image are determined according to the size of the data amount, so that the activity rule of the user is mastered, and the privacy information of the user is leaked.
Based on the above, the embodiment of the application provides a transmission method, device and storage medium of monitoring video data, which can fill private frames in the encoded video data as interference under the condition that the encoded video data output by a monitoring camera meets preset conditions, so as to protect privacy information of a user.
The following description will be made with reference to the accompanying drawings.
Referring to fig. 1, fig. 1 is a schematic diagram illustrating an implementation environment related to a transmission method of surveillance video data according to an embodiment of the present application. As shown in fig. 1, the implementation environment may include: an image acquisition device 10 and an image receiving device 20. The image capturing apparatus 10 may be connected to the image receiving apparatus 20 through a wired network or a wireless network.
The image acquisition device 10 may be used to acquire video images (or surveillance video) of a surveillance area.
The image capturing apparatus 10 may be, for example, the IPC described above, or other image capturing apparatus having a function of capturing images, or the like.
In fig. 1, the image capturing apparatus 10 is illustrated as a barrel camera (or may also be referred to as a gun camera), and the image capturing apparatus 10 may be a hemispherical IPC, a high-speed dome camera, a panoramic camera, a radar integrated machine, or the like. The embodiment of the present application is not limited to the specific form of the image capturing apparatus 10.
Optionally, the image capturing apparatus 10 may further include: and the infrared detection module. The infrared detection module can be used for detecting whether personnel are active in the monitoring area. For example, the infrared detection module may be a pyroelectric infrared sensor, a matrix type infrared sensor, a combination thereof, or the like. The embodiment of the present application does not limit the specific form of the infrared detection module.
In some embodiments, as shown in fig. 2, the image acquisition device 10 may include: an encoder 11. The encoder 11 may be configured to acquire the video image acquired by the image acquisition device 10, and encode the video image using a specific compression standard (for example, h.264 compression standard), to obtain encoded video data (code stream), that is, encoded video data of the surveillance video.
Wherein the encoded video data may include one or more GOPs. Each GOP may include one I frame, one or more P frames, and one or more B frames. As shown in fig. 3, taking as an example the encoded video data of a video sequence (segment), the encoded video data of the video sequence may include a video sequence header, GOP1, GOP2, …, GOPn, and a video sequence trailer. GOP1 may include, among other things, I frames (illustrated in fig. 3 by the box with the letter "I"), P frames (illustrated in fig. 3 by the box with the letter "P"), B frames (illustrated in fig. 3 by the box with the letter "B"), B frames, P frames, …, B frames, and P frames.
In some embodiments, image acquisition device 10 is also used to transmit encoded video data to image receiving device 20.
As described above, the image pickup apparatus 10 and the image receiving apparatus 20 are connected through a wired network or a wireless network. The wired or wireless network may include one or more media or devices capable of transmitting encoded video data from image acquisition device 10 to image receiving device 20.
In some embodiments, the wired or wireless network may include one or more communication media that enable image-capturing device 10 to transmit encoded video data directly to image-receiving device 20 in real-time. In this embodiment, image-capturing device 10 may modulate the encoded video data according to a communication standard (e.g., a wireless communication protocol) and transmit the modulated video data to image-receiving device 20. The one or more communication media may include wireless and/or wired communication media such as a Radio Frequency (RF) spectrum or one or more physical transmission lines. Alternatively, the one or more communication media may form part of a packet-based network, which may be, for example, a local area network, a wide area network, or a global network (e.g., the Internet). Alternatively, the one or more communication media may include a router, switch, base station, or other device that facilitates communication from image acquisition device 10 to image receiving device 20.
An image receiving device 20 for receiving and storing the encoded video data transmitted by the image capturing device 10. In some embodiments, image receiving device 20 is also used to decode encoded video data.
For example, the image receiving apparatus 20 may be the above-described NVR, or other electronic apparatus having a decoding function. For example, the other electronic device having the decoding function may be a computer, a server, or the like. The server may be a single server, or may be a server cluster formed by a plurality of servers. In some embodiments, the server cluster may also be a distributed cluster. Optionally, the server may also be implemented on a cloud platform, which may include, for example, a private cloud, public cloud, hybrid cloud, community cloud (community cloud), distributed cloud, inter-cloud, multi-cloud (multi-cloud), and the like, or any combination thereof. The embodiment of the application does not limit the specific form of the image receiving device.
Optionally, the image receiving device 20 may further include a display module. The display module may be used to display video images resulting from decoding the encoded video data by image receiving device 20.
Note that the display module may be a component in the image receiving apparatus 20. Such as a display screen or a touch screen in the image receiving device 20. Alternatively, the display module may also be a separate display device connected to the image receiving device 20. Such as a liquid crystal display (liquid crystal display, LCD), a plasma display, an organic light-emitting diode (OLED) display, or other type of display. Still alternatively, the display module may be an intelligent terminal device connected to the image receiving device 20. For example, cell phones, tablet computers, wearable devices, in-vehicle devices, enhanced display (augmented reality, AR)/virtual display (VR) devices, notebook computers, ultra-mobile personal computer (UMPC), netbooks, personal digital assistants (personal digital assistant, PDA), and the like. Alternatively, the image receiving apparatus 20 may also be an intelligent terminal apparatus.
It should be noted that, when the image receiving apparatus is an intelligent terminal apparatus, the intelligent terminal apparatus may also implement control and control information input to the image capturing apparatus 10.
The following describes a transmission method of monitoring video data provided by the embodiment of the application.
The transmission method of the surveillance video data provided by the embodiment of the present application may be performed by the image capturing apparatus 10 shown in fig. 1. As shown in fig. 4, the method includes S101 to S102.
S101, determining whether personnel are active in a first preset time period of the monitoring area of the image acquisition equipment (before) at the current moment.
The monitoring area may be a living room, a small shop, a supermarket, a mall, a bank, or the like of a resident house, which relates to user privacy. The first preset time period may be preset by a manager. For example, the first preset time period may be 10 seconds, 30 seconds, 1 minute, 5 minutes, or the like. The embodiment of the application does not limit the specific duration of the first preset duration.
In one possible implementation, the image capturing device 10 may determine whether a person is active in the monitored area based on the encoding parameters when encoding the monitored video using a specific compression standard (e.g., h.264).
Alternatively, the encoding parameters may include a data amount of the encoded video data within a first preset time period. In this case, determining whether there is personnel activity in the monitored area may include: for a first monitoring video acquired by image acquisition equipment within a first preset duration, determining whether the data volume of video data encoded by the first monitoring video is lower than a data volume threshold value; and when the data volume is lower than the data volume threshold value, determining that no personnel are active in the monitoring area for a first preset time period.
Optionally, the image capturing apparatus 10 may further determine whether the data amount of the video data encoded by the second monitoring video is lower than the data amount threshold according to the second monitoring video captured in a time period longer than the first preset time period; and when the data volume is lower than the data volume threshold value, determining that no personnel are active in the monitoring area for a first preset time period.
It should be appreciated that the image capturing device 10 may not begin to insert the private frame into the encoded video data until the data amount of the encoded video data within the preset time period is below the data amount threshold for a long time, so that frequent switching of the transmission policy may be avoided, and the stability of the image capturing device 10 in transmitting the encoded video data may be improved.
Alternatively, the first preset statistical duration may be 1 second per unit duration, that is, the encoding parameter may be a code rate when the image capturing device 10 encodes the surveillance video using a specific compression standard. In this case, determining whether there is personnel activity in the monitored area may include: acquiring the code rate of the image acquisition equipment in the first preset duration for encoding the monitoring image; and when the code rate is lower than the code rate threshold value, determining that the monitoring area of the image acquisition equipment does not have personnel activity within a first preset time period.
Wherein the code rate threshold is related to the maximum code rate of the image acquisition device 10. For example, the code rate threshold may be 60%, 65%, or 70% of the maximum code rate, etc. The embodiment of the application does not limit the specific numerical value of the code rate threshold. The maximum code rate may be preset when the image capturing apparatus 10 leaves the factory, or set by a user during use, or adaptively set during operation of the image capturing apparatus 10. The embodiments of the present application are not limited in this regard.
Optionally, before acquiring the code rate of the current coding, the method may further include: obtaining a maximum code rate; and determining a code rate threshold according to the maximum code rate and the preset proportion.
The preset proportion may be described with reference to the above-mentioned code rate threshold and the position related to the maximum code rate of the image capturing device 10, which will not be described herein.
In another possible implementation, image capture device 10 may also include an infrared detection module, as described above. In this case, the image acquisition apparatus 10 may also detect whether there is a person activity in the monitored area by the infrared detection module.
Wherein, as described above, the infrared detection module may comprise any one or a combination of the following: pyroelectric infrared sensors, or matrix infrared sensors.
Alternatively, when the infrared detection module is a pyroelectric infrared sensor, the image acquisition device 10 can determine that the monitoring area has personnel activity by detecting an infrared signal emitted by a human body through the pyroelectric infrared sensor.
It should be noted that, the human body has a constant body temperature, generally about 37 ℃, at which the human body emits an infrared signal with a specific wavelength (for example, about 10 micrometers), and the pyroelectric infrared sensor can determine that the monitored area has personnel activity according to the infrared signal with the specific wavelength.
For example, the pyroelectric infrared sensor may include a phenanthrell filter and an infrared sensing source. The infrared signal about 10 microns emitted by the human body is enhanced by the phenanthrene mud filter and then is gathered on the infrared induction source, and the infrared induction source usually adopts a pyroelectric element, when the element receives the infrared signal (or the infrared radiation temperature changes) emitted by the human body, the element loses charge balance and releases charge outwards, a subsequent circuit can generate a detection signal after detection processing, and the image acquisition device 10 can determine that personnel are in the monitoring area according to the detection signal and can be approximately regarded as personnel activities.
Alternatively, the matrix type infrared sensor may include a plurality of infrared sensing units. For example, the matrix type infrared sensor may include M rows and N columns of infrared sensing units, each of which may sense an infrared signal emitted from a human body, and the image capturing device 10 may determine a posture of the human body according to the infrared signals emitted from the human body sensed by the M rows and N columns of infrared sensing units, and when the posture of the human body is changed, the image capturing device 10 may determine that a person is moving in the monitoring area.
Wherein M and N are integers greater than 1. M and N may be the same or different.
Alternatively, the image capturing apparatus 10 may further include a stepping motor, on the rotation shaft of which the two types of infrared sensors may be mounted, and the stepping motor may be used for forward rotation or reverse rotation, and the two types of infrared sensors may be driven to swing through the rotation shaft to increase the detection fields of the two types of infrared sensors.
In yet another possible implementation, as described above, the image acquisition device 10 may be connected to an intelligent terminal device. A plurality of video data transmission modes may be preset in the image capturing apparatus 10. The plurality of video data transmission modes may include a first transmission mode and a second transmission mode. In the first transmission mode, the image capturing apparatus 10 inserts a private frame in the monitoring video; in the second transmission mode, the image capturing apparatus 10 does not insert a private frame in the monitoring video.
An image acquisition device control program can be installed in the intelligent terminal device; the intelligent terminal equipment can respond to the triggering operation of a user on the control program of the image acquisition equipment and display a control interface; the control interface may include a first option and a second option; the first option is used for indicating that no personnel are active in the monitoring area; the second option is used for indicating personnel activities in the monitoring area; the intelligent terminal equipment responds to the triggering operation of the user on the first option and sends a first control instruction to the image acquisition equipment 10; the first control instruction is used for indicating that no personnel are active in the monitoring area.
The image acquisition apparatus 10 receives a first instruction; the image capturing apparatus 10 determines that no person is active in the monitoring area in response to the first control instruction, and transmits the monitoring video using the first transmission mode.
It should be noted that, in still another possible implementation manner, the intelligent terminal device sends the control instruction to the image capturing device 10 to control the image capturing device 10 to select the video data transmission mode is described. Alternatively, the above-described step of transmitting a control instruction to the image capturing apparatus 10 to control the image capturing apparatus 10 to select the video data transmission mode may also be performed by the above-described image receiving apparatus 20.
S102, when no personnel are active in the monitoring area within a first preset time, determining that a private frame is inserted into the monitoring video acquired by the image acquisition equipment within a second preset time after the current moment, and sending the monitoring video inserted with the private frame to the image receiving equipment.
The second preset duration may be a duration preset by an administrator, or the second preset duration may also be a duration randomly generated by the image capturing device 10. For example, the second preset time period may be 20 minutes, 30 minutes, or the like. The embodiment of the application does not limit the specific duration of the second preset duration.
Alternatively, the second preset duration may include a delay duration; the delay time is the time between the time when no personnel activity in the monitoring area is detected and the time when the image acquisition equipment starts to insert the private frame in the monitoring video.
Wherein the delay period may be preset by a manager. For example, the delay period is 1 minute, 5 minutes, 10 minutes, or the like. The embodiment of the application does not limit the specific time length of the delay time length. Furthermore, it should be understood that when the monitoring area has no personnel activity for the first preset time period, it is intended to express that the condition that the monitoring area has no personnel activity for the first preset time period is satisfied, and the specific time is not limited.
As described above, the image capturing device 10 may be connected to the image receiving device 20 via a wired or wireless network, which may include one or more media or devices capable of transmitting the surveillance video encoded video data from the image capturing device 10 to the image receiving device 20. The image capture device 10 may transmit the surveillance video encoded video data inserted with the private frames to the image receiving device via the one or more media or devices.
Alternatively, the image capturing device 10 may insert a private frame at a preset location in the encoded video data.
Optionally, the image acquisition device 10 may also insert private frames at random locations in the encoded video data. I.e. inserting the private frame at an arbitrary position.
In some embodiments, the image capture device 10 may also acquire a private frame prior to S103.
In one possible implementation, image capture device 10 may receive a private frame of user input.
In another possible implementation, the image capture device 10 may generate a private frame.
Alternatively, the image capturing apparatus 10 may generate the private frame according to a preset file size.
Alternatively, the image capturing apparatus 10 may generate the private frame in a random file size. The image capturing device 10 generates the private frame according to a random file size may also be understood as the private frame being random in size.
In the method for transmitting the monitoring video, when the image acquisition equipment detects that no personnel are moving in the monitoring area, the private frame can be inserted into the monitoring video. Compared with the monitoring video without the private frame, the data volume of the encoded video data obtained after the monitoring video with the private frame is encoded is larger, the encoded video data with the larger data volume can camouflage the false activity rule of the user in the monitoring video, other people acquire the camouflage false activity rule when acquiring the activity rule of the user according to the number of the encoded video data, and the real activity rule of the user can be prevented from being acquired by other people, so that the protection of the privacy information of the user is realized.
The above step of inserting the private frame in one period is described. The image capturing device 10 may also detect whether a person is active in the monitored area in a preset cycle, and insert a private frame into the encoded video data when no person is active in the monitored area, so as to achieve continuous protection of user privacy. In this case, the S101 may specifically include: and periodically determining whether personnel are active in a first preset duration of the current moment of the monitoring area of the image acquisition equipment according to a preset period.
Wherein the preset period may be preset by a manager. For example, the preset period is 30 minutes, 60 minutes, or the like. The embodiment of the application does not limit the specific duration of the preset period.
In an exemplary embodiment, the embodiment of the application also provides another flow of the monitoring video data transmission method. Fig. 5 is a schematic flow chart of another method for transmitting surveillance video data according to an embodiment of the present application. The subject of execution of the method may be the image capturing apparatus 10 described above as shown in fig. 5, and the method may include S201 to S205.
S201, obtaining the current coding rate.
S202, judging whether the current coding rate is lower than a rate threshold.
If yes, executing S203; if not, go back to S201.
In one possible implementation, the code rate threshold is preset by an administrator.
In another possible implementation, the code rate threshold may be determined according to a maximum code rate of the image acquisition device.
S203, judging whether the duration of the current code rate lower than the code rate threshold is greater than a time threshold.
If yes, executing S204; if not, go back to S201.
Wherein the time threshold is preset by the manager.
S204, inserting a private frame into the monitoring video.
S205, stopping inserting the private frame when a set time length is after inserting the private frame in the monitoring video.
The foregoing description of the solution provided by the embodiments of the present application has been mainly presented in terms of a method. To achieve the above functions, it includes corresponding hardware structures and/or software modules that perform the respective functions. Those of skill in the art will readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. The technical aim may be to use different methods to implement the described functions for each particular application, but such implementation should not be considered beyond the scope of the present application.
In an exemplary embodiment, the embodiment of the present application further provides a transmission device for monitoring video data, which can be applied to the image capturing apparatus 10 described above. Fig. 6 is a schematic diagram of a transmission device for monitoring video data according to an embodiment of the present application. As shown in fig. 6, the apparatus may include a processing module 601 and a transmitting module 602.
A processing module 601, configured to determine whether a monitoring area of the image capturing device has personnel activity within a first preset duration at a current time; when no personnel are active in the monitoring area within a first preset time, determining that the image acquisition equipment within a second preset time after the current moment acquires the monitoring video and inserts a private frame; the private frame is a custom frame.
And the sending module 602 is used for sending the monitoring video inserted with the private frame to the image receiving device.
In some possible embodiments, the processing module 601 is specifically configured to determine, for a first surveillance video acquired by the image capturing device within a first preset duration, whether a data amount of video data encoded by the first surveillance video is lower than a data amount threshold; and when the data volume is lower than the data volume threshold value, determining that no personnel are active in the monitoring area for a first preset time period.
In other possible embodiments, the processing module 601 is specifically configured to obtain a code rate of the monitoring image encoded by the image capturing device within a first preset duration; and when the code rate is lower than the code rate threshold value, determining that the monitoring area of the image acquisition equipment does not have personnel activity within a first preset duration.
In still other possible embodiments, the processing module 601 may include an infrared detection module, where the infrared detection module is configured to detect whether personnel are active in the monitored area; the processing module 601 is specifically configured to detect whether a person is active in the monitoring area by using the infrared detection module.
In still other possible embodiments, the infrared detection module includes at least one of a pyroelectric infrared sensor, or a matrix type infrared sensor.
In still other possible embodiments, the processing module 601 is specifically configured to periodically determine, according to a preset period, whether the monitoring area of the image capturing device has personnel activity within a first preset duration at the current moment.
In still other possible embodiments, the second preset time period includes a delay time period; the delay time is the time between the time when no personnel activity in the monitoring area is detected and the time when the image acquisition equipment starts to insert the private frame in the monitoring video.
In still other possible embodiments, the second preset duration is a duration randomly generated by the image capturing device.
It should be noted that the division of the modules in fig. 6 is schematic, and is merely a logic function division, and other division manners may be implemented in practice. For example, two or more functions may also be integrated in one processing module. The integrated modules may be implemented in hardware or in software functional modules.
In an exemplary embodiment, the embodiment of the application further provides an image acquisition device. Fig. 7 is a schematic diagram illustrating the composition of an image capturing apparatus according to an embodiment of the present application. As shown in fig. 7, the image capturing apparatus may include: a processor 701, a memory 702, a communication line 703 and a communication interface 704.
The processor 701, the memory 702, and the communication interface 704 may be connected by a communication line 703.
The processor 701 is configured to execute the instructions stored in the memory 702, so as to implement the method for transmitting surveillance video data according to the embodiment of the present application. The processor 701 may be a central processing unit (central processing unit, CPU), a general purpose processor network processor (network processor, NP), a digital signal processor (digital signal processing, DSP), a microprocessor, a microcontroller, a programmable logic device (programmable logic device, PLD), or any combination thereof. The processor 701 may also be any other apparatus having processing functions, such as a circuit, a device, or a software module, to which embodiments of the application are not limited. In one example, processor 701 may include one or more CPUs, such as CPU0 and CPU1 in fig. 6. As an alternative implementation, the first image acquisition device may comprise a plurality of processors, e.g. in addition to the processor 701, a processor 705.
Memory 702 is used to store instructions, which may be computer programs. Alternatively, memory 702 may be a read-only memory (ROM) or other type of static storage device that may store static information and/or instructions, an access memory (random access memory, RAM) or other type of dynamic storage device that may store information and/or instructions, an electrically erasable programmable read-only memory (electrically erasable programmable read-only memory, EEPROM), a compact disc read-only memory (compact disc read-only memory, CD-ROM) or other optical storage, optical storage (including compact disc, laser disc, optical disc, digital versatile disc, blu-ray disc, etc.), magnetic disk storage media, or other magnetic storage devices, etc., as embodiments of the application are not limited in this respect.
It should be noted that, the memory 702 may exist separately from the processor 701 or may be integrated with the processor 701. The memory 702 may be located within the image capture device or may be located outside the image capture device, as embodiments of the application are not limited in this respect.
Communication line 703 for communicating information between the various components included in the image acquisition device.
A communication interface 704 for communicating with other devices (e.g., the monitoring camera described above) or other communication networks. The other communication network may be an ethernet, a radio access network (radio access network, RAN), a wireless local area network (wireless local area networks, WLAN), etc. The communication interface 704 may be a module, circuit, transceiver, or any device capable of communicating.
It should be noted that the structure shown in fig. 6 does not constitute a limitation of the image capturing apparatus, and the image capturing apparatus may include more or less components than those shown in fig. 6, or may combine some components, or may be arranged in different components.
In an exemplary embodiment, a computer-readable storage medium is also provided, comprising computer-executable instructions that, when run on an image acquisition device, cause the image acquisition device to perform any of the methods provided by the above embodiments.
In an exemplary embodiment, the application also provides a computer program product comprising computer-executable instructions which, when run on an image acquisition apparatus, cause the image acquisition apparatus to perform any one of the methods provided in the above embodiments.
In an exemplary embodiment, the present application further provides a chip, including: a processor and an interface, the processor being coupled to the memory through the interface, the processor, when executing the computer program or the image acquisition device in the memory, executing instructions, causing any one of the methods provided by the above embodiments to be performed.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using a software program, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer-executable instructions. When the computer-executable instructions are loaded and executed on a computer, the processes or functions in accordance with embodiments of the present application are fully or partially produced. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer-executable instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, from one website, computer, server, or data center by wired (e.g., coaxial cable, fiber optic, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). Computer readable storage media can be any available media that can be accessed by a computer or data storage devices including one or more servers, data centers, etc. that can be integrated with the media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a Solid State Disk (SSD)), or the like.
Although the application is described herein in connection with various embodiments, other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed application, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word "Comprising" does not exclude other elements or steps, and the "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
Although the application has been described in connection with specific features and embodiments thereof, it will be apparent that various modifications and combinations can be made without departing from the spirit and scope of the application. Accordingly, the specification and drawings are merely exemplary illustrations of the present application as defined in the appended claims and are considered to cover any and all modifications, variations, combinations, or equivalents that fall within the scope of the application. It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the spirit or scope of the application. Thus, it is intended that the present application also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
The foregoing is merely illustrative of specific embodiments of the present application, and the scope of the present application is not limited thereto, but any changes or substitutions within the technical scope of the present application should be covered by the scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims (11)

1. The transmission method of the monitoring video data is characterized in that the method is applied to image acquisition equipment; the image acquisition equipment is connected with the image receiving equipment; the method comprises the following steps:
determining whether personnel are active in a first preset time period of the monitoring area of the image acquisition equipment at the current moment;
when the monitoring area does not have personnel activity in the first preset time, determining that the image acquisition equipment in the second preset time after the current time acquires the monitoring video, inserting a private frame into the monitoring video, and sending the monitoring video inserted with the private frame to the image receiving equipment so as to protect privacy of a user in the monitoring video; the private frame is a custom frame.
2. The method of claim 1, wherein the determining whether the monitoring area of the image capturing device has personnel activity within a first preset time period at a current time of day comprises:
For a first monitoring video acquired by the image acquisition equipment in the first preset time period, determining whether the data volume of video data coded by the first monitoring video is lower than a data volume threshold value;
and when the data volume is lower than the data volume threshold value, determining that no personnel are active in the monitoring area within the first preset duration.
3. The method of claim 1, wherein the determining whether the monitoring area of the image capturing device has personnel activity within a first preset time period at a current time of day comprises:
acquiring the code rate of the monitoring image coded by the image acquisition equipment in the first preset time length;
and when the code rate is lower than a code rate threshold value, determining that the monitoring area of the image acquisition equipment does not have personnel activity within the first preset time period.
4. The method of claim 1, wherein the image acquisition device comprises an infrared detection module; the infrared detection module is used for detecting whether personnel move in the monitoring area; the determining whether personnel are active in the monitoring area of the image acquisition device within a first preset time period at the current moment includes:
And detecting whether personnel are active in the monitoring area by using the infrared detection module.
5. The method of claim 4, wherein the infrared detection module comprises at least one of a pyroelectric infrared sensor, or a matrix infrared sensor.
6. The method of claim 1, wherein the determining whether the monitoring area of the image capturing device has personnel activity within a first preset time period at a current time of day comprises:
and periodically determining whether personnel are active in a first preset time period of the monitoring area of the image acquisition equipment at the current moment according to a preset period.
7. The method of claim 1, wherein the second preset duration comprises a delay duration; the delay time is the time between the time when no personnel activity in the monitoring area is detected and the time when the image acquisition equipment starts to insert a private frame in the monitoring video.
8. The method according to any one of claims 1 to 7, wherein the second preset duration is a duration randomly generated by the image capturing device.
9. The transmission device of the monitoring video is characterized in that the device is applied to image acquisition equipment; the image acquisition equipment is connected with the image receiving equipment; the device comprises: the processing module and the sending module;
The processing module is used for determining whether personnel are active in a first preset time length of the monitoring area of the image acquisition equipment at the current moment; when the monitoring area does not have personnel activity in the first preset time, determining that the image acquisition equipment in the second preset time after the current time acquires the private frame inserted into the monitoring video so as to protect the privacy of a user in the monitoring video; the private frame is a self-defined frame;
and the sending module is used for sending the monitoring video inserted with the private frame to the image receiving equipment.
10. An image acquisition apparatus, the apparatus comprising: processor and memory
The memory stores instructions executable by the processor;
the processor is configured to, when executing the instructions, cause the image acquisition device to implement the method of any one of claims 1-8.
11. A readable storage medium, the readable storage medium comprising: a software instruction;
the software instructions, when run in an image acquisition apparatus, cause the image acquisition apparatus to implement the method of any one of claims 1-8.
CN202210790783.2A 2022-07-06 2022-07-06 Method, device, equipment and storage medium for transmitting monitoring video data Active CN115278004B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210790783.2A CN115278004B (en) 2022-07-06 2022-07-06 Method, device, equipment and storage medium for transmitting monitoring video data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210790783.2A CN115278004B (en) 2022-07-06 2022-07-06 Method, device, equipment and storage medium for transmitting monitoring video data

Publications (2)

Publication Number Publication Date
CN115278004A CN115278004A (en) 2022-11-01
CN115278004B true CN115278004B (en) 2023-10-31

Family

ID=83764161

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210790783.2A Active CN115278004B (en) 2022-07-06 2022-07-06 Method, device, equipment and storage medium for transmitting monitoring video data

Country Status (1)

Country Link
CN (1) CN115278004B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2495692A1 (en) * 2011-03-03 2012-09-05 Robert Bosch GmbH Monitoring system for monitoring the inactivity of a supervisor, method and computer program
KR101648190B1 (en) * 2015-02-13 2016-08-16 경일대학교산학협력단 Apparatus for processing image of dynamic object adapted to protect privacy according to changing circumstance, method thereof and computer recordable medium storing the method
CN108806146A (en) * 2018-06-06 2018-11-13 合肥嘉仕诚能源科技有限公司 A kind of safety monitoring dynamic object track lock method and system
CN110087099A (en) * 2019-03-11 2019-08-02 北京大学 A kind of monitoring method and system for protecting privacy
CN209208612U (en) * 2018-12-18 2019-08-06 杭州海康汽车技术有限公司 A kind of intelligent back vision mirror and automobile
CN114009012A (en) * 2019-04-24 2022-02-01 内维尔明德资本有限责任公司 Method and apparatus for encoding, communicating and/or using images
US11282367B1 (en) * 2020-08-16 2022-03-22 Vuetech Health Innovations LLC System and methods for safety, security, and well-being of individuals
CN114513629A (en) * 2020-10-23 2022-05-17 安讯士有限公司 Alert generation based on event detection in video feeds
CN114531528A (en) * 2020-11-05 2022-05-24 安讯士有限公司 Method for video processing and image processing apparatus

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8752197B2 (en) * 2002-06-18 2014-06-10 International Business Machines Corporation Application independent system, method, and architecture for privacy protection, enhancement, control, and accountability in imaging service systems
JP6421422B2 (en) * 2014-03-05 2018-11-14 日本電気株式会社 Video analysis device, monitoring device, monitoring system, and video analysis method
US10440229B2 (en) * 2017-11-15 2019-10-08 Dean Drako Aerial imaging privacy enhancement system
CN114079750A (en) * 2020-08-20 2022-02-22 安霸国际有限合伙企业 Capturing video at intervals of interest person-centric using AI input on a residential security camera to protect privacy

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2495692A1 (en) * 2011-03-03 2012-09-05 Robert Bosch GmbH Monitoring system for monitoring the inactivity of a supervisor, method and computer program
KR101648190B1 (en) * 2015-02-13 2016-08-16 경일대학교산학협력단 Apparatus for processing image of dynamic object adapted to protect privacy according to changing circumstance, method thereof and computer recordable medium storing the method
CN108806146A (en) * 2018-06-06 2018-11-13 合肥嘉仕诚能源科技有限公司 A kind of safety monitoring dynamic object track lock method and system
CN209208612U (en) * 2018-12-18 2019-08-06 杭州海康汽车技术有限公司 A kind of intelligent back vision mirror and automobile
CN110087099A (en) * 2019-03-11 2019-08-02 北京大学 A kind of monitoring method and system for protecting privacy
CN114009012A (en) * 2019-04-24 2022-02-01 内维尔明德资本有限责任公司 Method and apparatus for encoding, communicating and/or using images
US11282367B1 (en) * 2020-08-16 2022-03-22 Vuetech Health Innovations LLC System and methods for safety, security, and well-being of individuals
CN114513629A (en) * 2020-10-23 2022-05-17 安讯士有限公司 Alert generation based on event detection in video feeds
CN114531528A (en) * 2020-11-05 2022-05-24 安讯士有限公司 Method for video processing and image processing apparatus

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
面向监控视频的隐私信息保护与隐藏;彭许红;《中国优秀硕士论文全文数据库信息科技辑》;全文 *

Also Published As

Publication number Publication date
CN115278004A (en) 2022-11-01

Similar Documents

Publication Publication Date Title
CN108073890B (en) Method and system for motion recognition in video sequences captured by a camera
JP4197048B2 (en) Surveillance camera system, photographing device and video display device
US9521377B2 (en) Motion detection method and device using the same
CN108965883A (en) The system and method that video content is encoded using virtual intra frame
JP2005045550A (en) Imaging device, its imaging system and method
KR102264275B1 (en) Violent behavior management system and method
US10417884B2 (en) Method and system for incident sharing in a monitoring system
FR2861245A1 (en) Video surveillance movement detection having two distinct movement detection modes and producing alarm signal
CN110740290A (en) Monitoring video previewing method and device
CN112714320A (en) Decoding method, decoding device and computer readable storage medium
CN110557603A (en) Method and device for monitoring moving target and readable storage medium
US7451473B2 (en) Video distribution method and video distribution system
CN111277800A (en) Monitoring video coding and playing method and device, electronic equipment and storage medium
KR20140094953A (en) Cloud image recording system of ip camera
CN102196249A (en) Monitoring data playback method, EC (Encoder) and video management server
JP6809114B2 (en) Information processing equipment, image processing system, program
CN115278004B (en) Method, device, equipment and storage medium for transmitting monitoring video data
Ji et al. User presence inference via encrypted traffic of wireless camera in smart homes
JP2000032437A (en) Image transmission system
KR102125022B1 (en) Method for operating video analyzing server, and method for providing video surveillance service using the same
CN107734278B (en) Video playback method and related device
CN109698932B (en) Data transmission method, camera and electronic equipment
JP2002133558A (en) Communication method of monitoring signal, and communication device of monitoring signal
US20130006571A1 (en) Processing monitoring data in a monitoring system
US20120162417A1 (en) Security control system and method thereof, computer readable media and computer readable program product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant