Classifications

• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V20/00—Scenes; Scene-specific elements
  • G06V20/40—Scenes; Scene-specific elements in video content
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V20/00—Scenes; Scene-specific elements
  • G06V20/50—Context or environment of the image
  • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V20/00—Scenes; Scene-specific elements
  • G06V20/40—Scenes; Scene-specific elements in video content
  • G06V20/44—Event detection

Definitions

• FIG. 7 illustrates an example of FIG. 6 where subsets of regions are indicated as neighborhoods
• FIG. 20 is a diagram of a method of operation at an electronic device of one or more of the systems disclosed herein;
• the JPEG compression engine 125a when the JPEG compression engine 125a is to compress a frame of a video clip, the JPEG compression engine 125a may receive the data for the frame of the video clip directly from the video encoder 125b or the ISP 110, and direct the compressed output of the frame to the DDR memory 130 and further to the storage SD card 135.
• the ISP 110 may receive image frames 202 from the imaging system 105.
• the image frames 202 may correspond to a video stream.
• the ISP 110 may generate second image frames from the image frames 202.
• the second image frames may be a lower resolution copy of the image frames 202.
• the ISP 110 may provide the image frames 202 to the ZSL picture buffer 120a and may provide the second image frames to the video buffer 120b.
• the image frames 202 may include a first image frame 204.
• the second image frames may include a second image frame 206.
• the first image frame 204 may represent a first camera view that is substantially the same as a second camera view represented by the second image frame 206.
• the trigger detector 215 may detect a trigger (or designate the second image frame 206 as an action frame) by analyzing the second image frame 206 based on the ISP statistics received from the ISP 110, the video statistics (e.g., MB statistics) received from the video encoder 125b, audio data received from the audio signal processor 208, or a combination thereof, as described herein.
• the audio data may indicate a characteristic (e.g., the signal energy data) of the audio samples.
• the trigger detector 215 may update a trigger detection threshold based on the characteristic of the audio samples, as described with reference to FIG. 24.
• the trigger detector 215 may detect the trigger in response to determining that motion data associated with the second image frame 206 satisfies a threshold value (e.g., the trigger detection threshold), as described with reference to FIGS. 3-4, 13-14, 17, and 24.
• a threshold value e.g., the trigger detection threshold
• the processor 115 may designate the second image frame 206 as a non-key frame (e.g., not an action frame) or use another algorithm to analyze the second image frame 206. For example, the processor 115 may designate the second image frame 206 as a non-key frame in response to determining that, for each MB, either a size of a corresponding subset for the MB is less than or equal to half of the size of a kernel, or that a corresponding motion vector length for the MB is less than or equal to the threshold value.
• the method 1300 may be used to perform motion detection using a micro-kernel (e.g., a small neighborhood of macro-blocks). Using a micro-kernel may enable motion detection of small objects. The method 1300 may be used to identify an image frame corresponding to a dynamic event that includes motion associated with small objects.
• a micro-kernel e.g., a small neighborhood of macro-blocks.
• the method 1400 further includes, in response to determining that the connected component size satisfies the connected component threshold, at 1412, designating the frame as a key frame, at 1414.
• the processor 115 of FIG. 1 may designate the second image frame 206 as a key frame (e.g., an action frame) in response to determining that the connected component size satisfies the connected component threshold.
• the processor 115 may detect a trigger in the second image frame 206 in response to determining that the connected component size satisfies the connected component threshold.
• the processor 115 may refrain from detecting a trigger in the second image frame 206 in response to determining that the second image frame 206 is a non-key frame.
• the processor 115 may, in response to determining that the second image frame 206 is a non-key frame, generate a trigger notification indicating that the second image frame 206 is a non-key frame (e.g., not an action frame).
• the group score may be an average of the frame scores of the image frames.
• the group score may indicate a level of motion activity corresponding to the temporal group.
• a higher group score may indicate a higher level of motion activity.
• the temporal groups may be prioritized based on corresponding group scores. For example, a first temporal group having a first group score may have a higher priority than a second temporal group having a second group score that is lower than the first group score.
• Image frames may be deleted based on priority (e.g., group scores, frame scores, or both). For example, an image frame from the second temporal group may be deleted prior to deletion of an image frame from the first temporal group. As another example, a first image frame having a first frame score may be deleted prior to deletion of a second image frame having a second frame score that is higher than the first frame score.
• the comparator 1508 may adjust a signal energy threshold based on the noise estimate data. For example, the comparator 1508 may decrease the signal energy threshold in response to determining that the noise estimate data indicates a noise level that is greater than a threshold noise level.
• the comparator 1508 may generate an audio level trigger 1510 in response to determining that a signal energy indicated by the signal energy data satisfies the signal energy threshold.
• the audio level trigger 1510 may indicate whether the signal energy satisfies the signal energy threshold.
• the trigger detector 215 may determine whether a trigger is detected based on the audio level trigger 1510, as described with reference to FIG. 17.
• the tracker 2110 may provide the trigger notification to the trigger JPEG snapshot.
• the tracker 2110 may generate the trigger notification in response to detecting a sudden movement in a head/eye direction of the user.
• the trigger notification may include the first timestamps of the user images.
• the trigger JPEG snapshot 2116 may access the first image frame 204 in response to determining that a timestamp of the first image frame 204 is within a threshold duration of the first timestamps of the user images.
• the method 2200 also includes storing, at the device, the first image frame in a first memory after receiving the first image frame, at 2204.
• the ISP 110 may store the first image frame 204 in the ZSL picture buffer 120a, the DDR memory 121, or both, after receiving the first image frame 204.
• the method 2400 also includes receiving audio data at the device, at 2404.
• the trigger detector 215 of FIG. 2 may receive audio data, as described with reference to FIGS. 2 and 15-17.
• the audio data may correspond to the video stream.
• the audio data may correspond to the image frames 202, as described with reference to FIG. 2.
• an apparatus includes means for storing a plurality of image frames corresponding to a video stream.
• the means for storing may include the ZSL picture buffer 120a, the DDR memory 121, the video buffer 120b, the DDR memory 130, the SD card 135, the device 100 of FIG. 1, the device 200 of FIG. 2, the device 1500 of FIG. 15, the device 1600 of FIG. 16, the device 1700 of FIG. 17, the device 2100 of FIG. 21, the memory 2632, one or more other devices, circuits, modules, or instructions configured to store a plurality of image frames, or a combination thereof.
• a computer-readable medium may be tangible and non-transitory.
• computer-program product refers to a computing device or processor in combination with code or instructions (e.g., a "program”) that may be executed, processed or computed by the computing device or processor.
• code may refer to software, instructions, code or data that is/are executable by a computing device or processor.

Landscapes

• Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Multimedia (AREA)
• Theoretical Computer Science (AREA)
• Studio Devices (AREA)
• Image Analysis (AREA)
• Television Signal Processing For Recording (AREA)
• Compression Or Coding Systems Of Tv Signals (AREA)
• Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
• Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Priority Applications (1)

Applications Claiming Priority (3)

Related Child Applications (1)

Publications (1)

Family

ID=55304752

Family Applications (2)

Family Applications After (1)

Country Status (3)

Families Citing this family (2)

Family Cites Families (21)

• 2015
  • 2015-08-11 EP EP15756717.3A patent/EP3180739A2/en not_active Ceased
  • 2015-08-11 WO PCT/US2015/044660 patent/WO2016025485A2/en active Application Filing
  • 2015-08-11 CN CN202010396251.1A patent/CN111540387B/zh active Active
  • 2015-08-11 CN CN201580042994.6A patent/CN106575359B/zh active Active
  • 2015-08-11 EP EP20189585.1A patent/EP3855350A1/en active Pending

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events