CN117395497A - Preview image generation method and device, storage medium and electronic device - Google Patents

Preview image generation method and device, storage medium and electronic device Download PDF

Info

Publication number
CN117395497A
CN117395497A CN202311568379.1A CN202311568379A CN117395497A CN 117395497 A CN117395497 A CN 117395497A CN 202311568379 A CN202311568379 A CN 202311568379A CN 117395497 A CN117395497 A CN 117395497A
Authority
CN
China
Prior art keywords
target
image
preview image
event
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311568379.1A
Other languages
Chinese (zh)
Inventor
豆红雷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Huacheng Software Technology Co Ltd
Original Assignee
Hangzhou Huacheng Software Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Huacheng Software Technology Co Ltd filed Critical Hangzhou Huacheng Software Technology Co Ltd
Priority to CN202311568379.1A priority Critical patent/CN117395497A/en
Publication of CN117395497A publication Critical patent/CN117395497A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/44—Event detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Image Analysis (AREA)

Abstract

The embodiment of the invention provides a preview image generation method, a preview image generation device, a storage medium and an electronic device, wherein the method comprises the following steps: detecting an event occurring in a target area in the case of photographing the target area with an image pickup apparatus; under the condition that a target event occurs in the target area is detected, capturing a first image of the target area, and determining the first image as a target preview image of a target video containing the target event; before the end of the target event, repeating the following operations until the end of the target event: capturing a second image of a target picture when detecting that the target picture with higher image priority than the target preview image appears in the target area; and updating the target preview image to the second image.

Description

Preview image generation method and device, storage medium and electronic device
Technical Field
The embodiment of the invention relates to the field of communication, in particular to a preview image generation method and device, a storage medium and an electronic device.
Background
Video monitoring is an important component of a security system, and with rapid development of technologies such as computers, network communication and image processing, video monitoring technology has also been developed. In the related art, an image capturing apparatus generally captures a first image when a specific event is detected as a preview image, but the image captured in this manner generally includes less screen information (i.e., specific information of a specific object cannot be clearly obtained, such as a front face cannot be seen, a license plate cannot be seen, etc.), which causes a problem that a user cannot quickly obtain event information by browsing the preview image, thereby resulting in low browsing efficiency.
No effective solution to this problem has been proposed.
Disclosure of Invention
The embodiment of the invention provides a preview image generation method, a device, a storage medium and an electronic device, which are used for at least solving the problem that a user cannot quickly acquire event information by browsing a preview image due to improper selection of the preview image in the related technology, thereby causing low browsing efficiency.
According to an embodiment of the present invention, there is provided a preview image generating method including: detecting an event occurring in a target area in the case of photographing the target area with an image pickup apparatus; under the condition that a target event occurs in the target area is detected, capturing a first image of the target area, and determining the first image as a target preview image of a target video containing the target event; before the end of the target event, repeating the following operations until the end of the target event: capturing a second image of a target picture when detecting that the target picture with higher image priority than the target preview image appears in the target area; and updating the target preview image to the second image.
In an exemplary embodiment, before capturing the second image of the target frame, the method further comprises: determining a target priority of the target preview image based on first element information included in the target preview image for indicating the target event; in the case that the target picture with the higher image priority than the target preview image appears in the target area is detected, the step of capturing the second image of the target picture comprises the following steps: in the case that the target picture including more second element information indicating the target event than the first element information appears in the target area is detected, the second image of the target picture is grabbed.
In an exemplary embodiment, in case that only one target object of a predetermined type is included in the target event, the element information for indicating the target event includes at least one of: the moving range of the target object reaches a preset range threshold, the front image of the target object appears in the field of view of the camera, the definition of the front image of the target object reaches a preset definition threshold, the distance between the target object and a warning area is smaller than a preset distance threshold, and the target object collides with other types of objects; in the case that a plurality of target objects of a predetermined type are included in the target event, the element information for indicating the target event includes at least one of: the method comprises the steps that the moving ranges of a plurality of target objects reach a preset range threshold value, the front image of any target object appears in the visual field of the camera, the definition of the front image of any target object reaches a preset definition threshold value, the distance between any target object and a warning area is smaller than a preset distance threshold value, the number of the target objects changes, target objects carried on any target object are separated from the target objects, any two or more target objects collide, and any target object collides with other types of objects.
In an exemplary embodiment, before the end of the target event, the method further comprises: and grabbing a third image of the target area when the preset time length is up under the condition that the target picture is not detected within the preset time length after grabbing the target preview image.
In an exemplary embodiment, the method further comprises: uploading all images captured before the end of the target event and a video file comprising the target event to a platform to instruct the platform to push all images and the video file to a target application so as to generate a preview image folder of the target event in the target application according to the capture time of all images.
In an exemplary embodiment, after uploading all images captured before the end of the target event and the video file including the target event to the platform, the method further comprises: and the target application displays the preview image folder on a target interface, wherein the display modes of the images with different priorities in the preview image folder are different.
In one exemplary embodiment, the target application exposing the preview image folder on a target interface includes: the target application displays the preview image folder on the target interface according to the priority of each image included in the whole images and a preset display mode, wherein the preset display mode comprises at least one of the following modes: the colors of frames of the images with different priorities are different; the background colors of the images with different priorities are different; the display sizes of the images of different priorities are different.
In an exemplary embodiment, before the target application presents the preview image folder on the target interface, the method further comprises: the target application intercepts part of image areas from each image to be displayed, wherein the proportion of element information which is included in the intercepted image areas and used for indicating the target event reaches a preset proportion value; the target application determines the preview image folder comprising each intercepted partial image area.
In an exemplary embodiment, before the target application presents the preview image folder on the target interface, the method further comprises: the target application determines a predetermined number of images according to the order of the priority of each image included in the whole images from high to low; the target application determines the preview image folder that includes the predetermined number of images.
In an exemplary embodiment, after the target application presents the preview image folder on a target interface, the method further comprises: the target application receives a selection instruction for selecting target images included in the preview image folder; and the target application plays a target segment included in the video file, wherein the target segment includes the target image.
According to another embodiment of the present invention, there is provided a preview image generating apparatus including: a detection module for detecting an event occurring in a target area when the target area is photographed by an image pickup apparatus; the first grabbing module is used for grabbing a first image of the target area and determining the first image as a target preview image of a target video containing the target event under the condition that the target event occurs in the target area; the second grabbing module is used for repeatedly executing the following operations until the target event is ended before the target event is ended: capturing a second image of a target picture when detecting that the target picture with higher image priority than the target preview image appears in the target area; and updating the target preview image to the second image.
In a further embodiment of the invention, a computer readable storage medium is provided, in which a computer program is stored, wherein the computer program is arranged to perform the steps of any of the method embodiments described above when run.
According to a further embodiment of the invention, there is also provided an electronic device comprising a memory having stored therein a computer program and a processor arranged to run the computer program to perform the steps of any of the method embodiments described above.
According to the invention, before the detected target event is finished, the priority of the image of the shot image is continuously detected, and the image of the image with higher priority is continuously updated into the target preview image of the target video of the target event, and the information of the event contained in the image with higher priority is richer, so that the content of the target video of the target event can be rapidly acquired by browsing the information displayed in the target preview image, the problem that a user cannot rapidly acquire event information by browsing the preview image due to improper selection of the preview image in the related technology is solved, and the browsing efficiency is low is further achieved.
Drawings
Fig. 1 is a block diagram of a hardware structure of a mobile terminal of a preview image generating method according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method of detection of generation of a preview image in accordance with an embodiment of the present invention;
FIG. 3 is a diagram of the actual effect of an application interface according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a target preview image presentation method according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a method for displaying images in a preview image folder according to an embodiment of the present invention;
FIG. 6 is a second actual effect diagram of an application interface according to an embodiment of the present invention;
FIG. 7 is a third actual effect diagram of an application interface according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of a user manually sliding a preview picture according to an embodiment of the present invention;
fig. 9 is a block diagram of a structure of a preview image generating apparatus according to an embodiment of the present invention.
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings in conjunction with the embodiments.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order.
At present, the video monitoring technology is widely applied to various fields with good timeliness, intuitiveness and accuracy, especially some fields such as public safety, emergency command and the like.
In the related art, when a specific event occurs (or referred to as an alarm event occurs), the image capturing device captures a preview picture and synchronizes the preview picture to the client through the platform (or referred to as a server), and in addition, information presentation of alarm types such as a common picture, a person shape, a vehicle model alarm and the like can be additionally executed. However, these alarms and preview pictures are associated with the video following the current event, and the video can be skipped to be played through the alarm message. However, the preview picture in the related art generally has little content information of the video, the captured preview picture may be only a back image, and the picture information in the corresponding additional video of the preview image actually includes more and more pictures than the preview picture information. In the related art, the preview picture may be only the picture detected by the video for the first time, often the information is minimal, such as only the back, and even if the front is snapped later, the front picture is not updated to the preview picture. In addition, when the number of the alarm messages is large, the content which can be displayed in the tab of the client is relatively small, for example, only 5 messages can be displayed, and a user needs to read a large number of alarm messages, so that the monitoring effect is poor. In addition, it is also impossible to determine whether the several messages belong to the same video in the related art.
In view of the foregoing problems in the related art, corresponding solutions are respectively provided in the embodiments of the present invention, and the present invention is described below with reference to the embodiments:
the method embodiments provided in the embodiments of the present application may be performed in a mobile terminal, a computer terminal or similar computing device. Taking the operation on a mobile terminal as an example, fig. 1 is a block diagram of a hardware structure of a mobile terminal according to a preview image generating method according to an embodiment of the present invention. As shown in fig. 1, a mobile terminal may include one or more (only one is shown in fig. 1) processors 102 (the processor 102 may include, but is not limited to, a microprocessor MCU or a processing device such as a programmable logic device FPGA) and a memory 104 for storing data, wherein the mobile terminal may also include a transmission device 106 for communication functions and an input-output device 108. It will be appreciated by those skilled in the art that the structure shown in fig. 1 is merely illustrative and not limiting of the structure of the mobile terminal described above. For example, the mobile terminal may also include more or fewer components than shown in fig. 1, or have a different configuration than shown in fig. 1.
The memory 104 may be used to store a computer program, for example, a software program of application software and a module, such as a computer program corresponding to a preview image generating method in an embodiment of the present invention, and the processor 102 executes the computer program stored in the memory 104 to perform various functional applications and data processing, that is, to implement the above-described method. Memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory remotely located relative to the processor 102, which may be connected to the mobile terminal via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission means 106 is arranged to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, simply referred to as NIC) that can connect to other network devices through a base station to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used to communicate with the internet wirelessly.
In this embodiment, a method for generating a preview image is provided, fig. 2 is a flowchart of a method for generating a preview image according to an embodiment of the present invention, and as shown in fig. 2, the flowchart includes the following steps:
step S202 of detecting an event occurring in a target area in the case of photographing the target area with an image pickup apparatus;
step S204, grabbing a first image of the target area and determining the first image as a target preview image of a target video containing the target event under the condition that the target event occurs in the target area is detected;
Step S206, before the end of the target event, repeating the following operations until the end of the target event: capturing a second image of a target picture when detecting that the target picture with higher image priority than the target preview image appears in the target area; and updating the target preview image to the second image.
The main execution body of the steps comprises the image capturing device, a controller or a control system for controlling the image capturing device, a control device with an association relation with the image capturing device, or other devices or systems with similar processing capability, and the like.
In the above steps, the execution precondition of each step may be that the image capturing apparatus is in a video recording mode, and the target event includes, but is not limited to: the action behavior, state change of the single object (the state change includes but is not limited to any object change which can be judged by video information acquired by the camera equipment, such as motion state change, appearance state change and the like), wherein the object includes people, animals, plants, objects and the like; action behavior, state change of a plurality of objects, for example: the person interacts with other objects. The target event may be more extensive as algorithms are updated and usage scenarios are trained. The following exemplifies the target event, including but not limited to:
1. Detecting a moving object: the presence or movement of a moving object (e.g., a person, car, animal, etc.) within the target area is detected.
2. Personnel activity detection: an activity of a person in the target area, such as walking, running, staying, etc., is detected.
3. And (3) vehicle running detection: the condition that the vehicle runs in the target area is detected, including the in-out and the stop of the vehicle and the like.
4. Object carry-over detection: it is detected that an object is left behind or stays for a long time in the target area.
5. Smoke and fire detection: the presence of smoke or flame in the target area is detected.
6. And (3) detecting emergency: and detecting the sudden events, such as explosion, fire, robbery and the like, occurring in the target area.
7. Environmental anomaly detection: an environmental abnormality in the target area, such as water immersion, destruction, etc., is detected.
The following exemplifies the steps described above by taking a specific action taking a target event as a single target object: when a target object enters a picture for the first time, capturing a first image of the target area, and determining the first image as a target preview image of a target video containing the target event; when a picture with higher image priority is detected, capturing the image of the picture with higher image priority again, and replacing the target preview image with the captured image again, wherein the scene of the captured image comprises at least one of the following (the priorities of the pictures in different scenes can be divided again): when the moving range of the target object is detected to exceed a certain picture range (for example, 1/4 picture size), grabbing the picture of the target area; if the target object does not catch the face when entering the picture for the first time, determining an image when the target object catches the face as the target preview image; and if the target object reaches the warning area, capturing the picture of the target area, and determining the picture as the target preview image. And if only one target object exists in the picture along with the occurrence of the event, capturing the picture according to the method and updating the target preview image. In addition, it should be noted that, if the target object does not perform the activity requiring attention in the target area and reaches the preset time, the frame of the target area may be captured, but the image of the captured frame may be used as a normal preview image instead of the target preview image.
The following exemplifies the steps described above, taking the specific actions that occur for a plurality of target objects by using a target event as an example: when the target object is newly added or reduced in the shot picture, the picture of the target area is grabbed, and the currently grabbed image is determined to be the target preview image, wherein fig. 3 is an actual effect diagram of an application interface according to an embodiment of the present invention, if the target preview image priority is relatively low, for example, faces of a plurality of target objects are not displayed in the target preview image, then image grabbing is performed again when a picture with higher image priority is detected subsequently, for example, the picture with one or more faces is grabbed, and the target preview image is replaced by the image grabbed again; furthermore, the scene of the re-grabbing image includes at least one of the following (the priorities of the pictures in the different scenes may be divided again): capturing images of the target area when the movable range of one or more of the plurality of target objects in the target area reaches a threshold value; grabbing the picture of the target area when one or more of the target objects enter the picture range to leave the object; when one or more of the plurality of target objects perform interaction (e.g. fight), capturing a picture of the target area, wherein the algorithm can analyze a first picture of the start party from the video. The target preview image of the target video is an image which can embody the most information content in the target video, the target video is stored along with time, and the target preview image is changed into the latest image with higher richness until the target video is finished. In addition, it should be noted that, if a plurality of target objects do not perform an activity requiring attention in the target area and reach a preset time, the frame of the target area may be captured, but the image of the captured frame in this case may be used as a normal preview image instead of the target preview image.
Through the steps, before the detected target event is finished, the priority of the image of the shot image is continuously detected, the image of the image with higher priority is continuously updated into the target preview image of the target video of the target event, and the information of the event contained in the image with higher priority is richer, so that the content of the target video of the target event can be quickly acquired by browsing the information displayed in the target preview image, the problem that a user cannot quickly acquire event information by browsing the preview image due to improper selection of the preview image in the related technology is solved, and the problem of low browsing efficiency is caused.
In an alternative embodiment, the method further comprises, prior to capturing the second image of the target frame: determining a target priority of the target preview image based on first element information included in the target preview image for indicating the target event; in the case that the target picture with the higher image priority than the target preview image appears in the target area is detected, the step of capturing the second image of the target picture comprises the following steps: in the case that the target picture including more second element information indicating the target event than the first element information appears in the target area is detected, the second image of the target picture is grabbed.
In the above steps, with updating the algorithm and continuous training of the usage scenario, more target events and priorities of different images can be obtained, and in addition, the scenario can be extended to perform capture processing (for short, priority capture) based on the picture priority when interaction is generated between multiple objects, for example: the priority of the capture images performed by different scenes and action behaviors of a single person, the priority of the capture images performed by different scenes and actions of a plurality of persons, and the priority of the capture images between the person and objects can be expanded, and the actions between the person and other movable bodies such as animals, vehicles, robots with automatic driving capability and the like can be expanded, and the actions between objects can be included, for example, the actions between motor vehicles and non-motor vehicles (such as the actions of scraping, collision and the like).
Through the steps, the target picture with more second element information than the first element information of the target event is grabbed, so that when the higher-priority or new target event occurs, the related image can be timely captured.
In an alternative embodiment, in case that only one target object of a predetermined type is included in the target event, the element information for indicating the target event includes at least one of: the moving range of the target object reaches a preset range threshold, the front image of the target object appears in the field of view of the camera, the definition of the front image of the target object reaches a preset definition threshold, the distance between the target object and a warning area is smaller than a preset distance threshold, and the target object collides with other types of objects; in the case that a plurality of target objects of a predetermined type are included in the target event, the element information for indicating the target event includes at least one of: the method comprises the steps that the moving ranges of a plurality of target objects reach a preset range threshold value, the front image of any target object appears in the visual field of the camera, the definition of the front image of any target object reaches a preset definition threshold value, the distance between any target object and a warning area is smaller than a preset distance threshold value, the number of the target objects changes, target objects carried on any target object are separated from the target objects, any two or more target objects collide, and any target object collides with other types of objects.
In the above step, the predetermined range threshold includes, but is not limited to: 1/4, 3/4, etc. of the target picture; the frontal image of the target object includes, but is not limited to: a frontal face image of a person, a front or rear license plate image of a vehicle, a frontal head image of an animal, and the like; the predetermined sharpness threshold includes, but is not limited to: a sharpness score comprehensively evaluated based on contrast, resolution, sharpness, noise, etc. of the image; the distance threshold includes, but is not limited to: 0.5 meters, 1 meter, etc.; collisions between the target object and other types of objects include, but are not limited to: collision between a person and a vehicle, collision between a person and an object in a picture, and the like; the number of target objects varies, including but not limited to: an increase or decrease in the number of people, an increase or decrease in the number of vehicles, an increase or decrease in the number of objects in a screen, and the like; the separation of the target object from any target object carried on the target object includes, but is not limited to: people put down the mobile phone, the driver leaves the car, etc.; conflict between any two or more of the target objects includes, but is not limited to: limb contact between multiple persons, and so on.
Through the steps, the element information of the target event comprises a plurality of contents such as the moving range of the target object, the appearance of the front image, the definition, the distance from the warning area, the change of the number of the target objects, the separation of the target objects, the collision among the target objects, the collision with other objects and the like, and the event reflected by the image with more element information is more complete, so that the content of the target event can be more comprehensively captured and recorded through the image with higher priority, and richer information is provided for a user for subsequent browsing, analysis and processing, thereby improving the processing efficiency of the event.
In an alternative embodiment, before the end of the target event, the method further comprises: and grabbing a third image of the target area when the preset time length is up under the condition that the target picture is not detected within the preset time length after grabbing the target preview image.
In the above step, there may be no additional behavior (for example, no action is performed by the target object, no collision occurs between the target object and any other object) that needs to be focused on by the target object in the target area, where the image of the target area may be captured according to a certain period, and the image may be used as a preview image of a common level, so that the integrity of the overall preview image is ensured.
Through the steps, before the target event is ended, the third image of the target area is captured when the target picture is not detected within a certain time, so that the traceability of the target event can be increased, more data and information can be provided for subsequent event tracing and analysis, the comprehensive review and evaluation of the event can be facilitated, and the reliability and the practicability of the system are improved.
In an alternative embodiment, the method further comprises: uploading all images captured before the end of the target event and a video file comprising the target event to a platform to instruct the platform to push all images and the video file to a target application so as to generate a preview image folder of the target event in the target application according to the capture time of all images.
In the above step, configuration attribute information (which may be configured by the image capturing apparatus, or may be configured by the platform, or may be configured by another related apparatus) including an image in the preview image folder may be set in advance, and the attribute information includes, but is not limited to: the name of the target event corresponding to the image, the time of the image capture, the URL (Uniform Resource Locator ) of the target video corresponding to the image, and so on. And the user can check the target video at the moment corresponding to the image by clicking the image in the preview image folder, so that the content to be checked included in the target video is quickly browsed, the video playing time is saved, and the video playing efficiency is improved.
In the above steps, when the image capturing apparatus detects that an event (for example, an alarm event) occurs, a message including an alarm occurrence time stamp may be reported and a picture for detecting the alarm message (that is, the above captured image, it should be noted that the captured image that is not finally selected as the target preview image is taken as the normal preview image) is pushed to the cloud server (corresponding to the above platform), and the cloud server receives and stores and pushes the stored image to the client, such as mobile client mobile phone APP (Application). APP presents an alert message and with a preview picture.
By uploading all the images and video files to the platform and generating the preview image folder in the target application, comprehensive event records can be provided, visual presentation effects are improved, subsequent analysis and processing are facilitated, and operability and practicability of the system are improved. Optionally, the partial images and video files may be uploaded to the platform, the image capturing device may store the images and video files generated before the end of the target event, and after the end of the target event, sort all the images corresponding to the target event according to the priority, and select a predetermined number of images with higher priority to upload to the platform.
In an alternative embodiment, after uploading all images captured before the end of the target event and the video file including the target event to the platform, the method further comprises: and the target application displays the preview image folder on a target interface, wherein the display modes of the images with different priorities in the preview image folder are different.
In the above step, the displaying modes of the images with different priorities in the preview image folder include, but are not limited to: and the display area of the target preview image in the preview image folder is larger than that of other images, and the other images are folded. FIG. 4 is a schematic diagram of a target preview image displaying method according to an embodiment of the present invention, where when a user opens a video segment, the target preview image is displayed, and the rest of the images are not simply folded, but the most valuable information in the screen is displayed in the narrower screen, for example: fig. 5 is a schematic diagram of an image display method in a preview image folder according to an embodiment of the present invention, after uploading an image, the images corresponding to alarm messages in a target video are all concentrated under one preview image folder, and compared with the target preview image of the target video, if the new image priority is high, the new image is determined to be the target preview image, if the new image priority is low, the target preview image is not updated, or the most valuable image is analyzed by a warning algorithm, and is determined to be the target preview image, when a user clicks and plays again, the target video is played preferentially from the time corresponding to the target preview image, instead of playing the video at the beginning time of the target video. Fig. 6 is a second actual effect diagram of the application interface according to the embodiment of the present invention, as shown in fig. 6, the preview image folder includes all the alarm information of the target video and the images corresponding to the alarm information.
In an alternative embodiment, the target application presents the preview image folder on a target interface includes: the target application displays the preview image folder on the target interface according to the priority of each image included in the whole images and a preset display mode, wherein the preset display mode comprises at least one of the following modes: the colors of frames of the images with different priorities are different; the background colors of the images with different priorities are different; the display sizes of the images of different priorities are different.
Fig. 7 is a third actual effect diagram of the application interface according to the embodiment of the present invention, as shown in fig. 7, where the priority of the image may be represented by a border color of the image. When the number of the images in the preview image folder is small, the image folder can be expanded, and each image can be scaled according to the picture content. When the number of images is large, the images can be displayed equidistantly. In particular, each narrow frame of the picture only presents the content of optimal value in the picture, such as the narrow picture face, license plate, etc. shown in fig. 8. By carrying out the narrowing processing on the images, only valuable contents of each image are reserved, a user can slide the preview image folder, images with high content information in time sequence in the period can be quickly browsed, the time for watching video by the user can be greatly reduced, and the video browsing efficiency of the user is improved. And because the alarm information of the target video is all filed in a certain video, the alarm information is better managed.
In an alternative embodiment, before the target application presents the preview image folder on the target interface, the method further comprises: the target application intercepts part of image areas from each image to be displayed, wherein the proportion of element information which is included in the intercepted image areas and used for indicating the target event reaches a preset proportion value; the target application determines the preview image folder comprising each intercepted partial image area.
In the above step, when the user enters the alert message page or the video page, the frame of the target video may be tiled, where the target preview image may be fully displayed when the number of images in the preview image folder is small, and when the number of images is large, only the vertical frame of the target object may be intercepted. When the user manually slides the preview picture or the cursor operation image of the mouse, the selected image is enlarged and the target preview image is narrowed laterally. The magnified region of the image includes, but is not limited to: above the image, previewing a specific area of the page, any area of the page that the user can manually drag to. Fig. 8 is a schematic diagram when a user manually slides a preview picture according to an embodiment of the present invention, as shown in fig. 8, in order to enable other images than the target preview image to be displayed when there are more images, the target preview image only presents a picture of valid information, such as a human face. When more images are recorded, video segmentation can be performed or images with lower priority are narrowed, only less key information is reserved, and a user can perform selection operation.
In an alternative embodiment, before the target application presents the preview image folder on the target interface, the method further comprises: the target application determines a predetermined number of images according to the order of the priority of each image included in the whole images from high to low; the target application determines the preview image folder that includes the predetermined number of images.
In the above steps, the predetermined number may be a fixed value that is set in advance, or may be set individually by the user each time, and the predetermined number includes, but is not limited to: 5 and 10.
In an alternative embodiment, after the target application presents the preview image folder on a target interface, the method further comprises: the target application receives a selection instruction for selecting target images included in the preview image folder; and the target application plays a target segment included in the video file, wherein the target segment includes the target image.
In the above step, after receiving the selection instruction, the URL of a part of the video segment in the target video carried in the target image may be obtained, and then the target segment may be played based on the URL of the part of the video segment, in an actual application, the URL carried in the target image may also be the URL of the whole target video, after receiving the selection instruction, the target segment may be determined based on the position of the target image in the target video, and then the target segment may be played, where the target image may be located at the head of the target segment, or may be located at the tail of the target segment, or may be located at a certain position in the target segment, and the length of the target segment may also be flexibly set, for example, the length of the target segment may be determined based on the capture time difference between the target image and the adjacent image included in the preview image folder, or may also be set to a fixed length, for example, to be fixed to 1min, or fixed to 2min, or may of course, be configured in advance based on the user preference of the target segment. In addition, the implementation manner of playing the target segment included in the video file by the target application includes, but is not limited to: using HTML5 Video tags, playing only a partial segment of a Video can be achieved by setting the start time and end time of the Video; a user-defined video player is compiled by using JavaScript, the playing range of the video can be controlled in a programming mode, for example, the video is played in a specific time period, and then the video is paused; the play range and time of the video can be controlled by setting API (Application Programming Interface, chinese name is application programming interface) and parameters.
From the description of the above embodiments, it will be clear to a person skilled in the art that the method according to the above embodiments may be implemented by means of software plus the necessary general hardware platform, but of course also by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The embodiment also provides a preview image generating device, which is used for implementing the foregoing embodiments and preferred embodiments, and is not described in detail. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. While the means described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
Fig. 9 is a block diagram of a preview image generating apparatus according to an embodiment of the present invention, as shown in fig. 9, including: a detection module 92 for detecting an event occurring in a target area in the case of photographing the target area with an image pickup apparatus; a first capturing module 94, configured to capture a first image of the target area and determine the first image as a target preview image of a target video including the target event when it is detected that the target event occurs in the target area; a second grabbing module 96, configured to, before the end of the target event, repeat the following operations until the end of the target event: capturing a second image of a target picture when detecting that the target picture with higher image priority than the target preview image appears in the target area; and updating the target preview image to the second image.
In an alternative embodiment, the apparatus further comprises: and the first determining module is used for determining the target priority of the target preview image based on the first element information which is included in the target preview image and used for indicating the target event before capturing the second image of the target picture.
In an alternative embodiment, the second grasping module 96 includes: and a grabbing unit configured to grab the second image of the target picture when it is detected that the target picture including more second element information indicating the target event than the first element information appears in the target area.
In an alternative embodiment, in case that only one target object of a predetermined type is included in the target event, the element information for indicating the target event includes at least one of: the moving range of the target object reaches a preset range threshold, the front image of the target object appears in the field of view of the camera, the definition of the front image of the target object reaches a preset definition threshold, the distance between the target object and a warning area is smaller than a preset distance threshold, and the target object collides with other types of objects; in the case that a plurality of target objects of a predetermined type are included in the target event, the element information for indicating the target event includes at least one of: the method comprises the steps that the moving ranges of a plurality of target objects reach a preset range threshold value, the front image of any target object appears in the visual field of the camera, the definition of the front image of any target object reaches a preset definition threshold value, the distance between any target object and a warning area is smaller than a preset distance threshold value, the number of the target objects changes, target objects carried on any target object are separated from the target objects, any two or more target objects collide, and any target object collides with other types of objects.
In an alternative embodiment, the apparatus further comprises: and the third grabbing module is used for grabbing a third image of the target area when the preset time length reaches under the condition that the target picture is not detected within the preset time length after grabbing the target preview image before the target event is ended.
In an alternative embodiment, the apparatus further comprises: and the uploading module is used for uploading all the images captured before the end of the target event and the video file comprising the target event to a platform so as to instruct the platform to push all the images and the video file to a target application, and generating a preview image folder of the target event in the target application according to the capture time of all the images.
In an alternative embodiment, the target application includes: and the display module is used for displaying the preview image folder on a target interface after the image pickup equipment uploads all images captured before the end of the target event and the video file comprising the target event to a platform, wherein the display modes of the images with different priorities in the preview image folder are different.
In an alternative embodiment, the display module includes: a display unit, configured to display, on the target interface, the preview image folder according to a predetermined display manner according to a priority of each image included in the all images, where the predetermined display manner includes at least one of: the colors of frames of the images with different priorities are different; the background colors of the images with different priorities are different; the display sizes of the images of different priorities are different.
In an alternative embodiment, the target application further comprises: the intercepting module is used for intercepting part of image areas from each image to be displayed before the preview image folder is displayed on a target interface, wherein the proportion of element information which is included in the intercepted image areas and used for indicating the target event reaches a preset proportion value; and the second determining module is used for determining the preview image folder comprising each intercepted partial image area.
In an alternative embodiment, the target application further comprises: a third determining module, configured to determine, before the preview image folder is displayed on the target interface, a predetermined number of images according to a sequence from high to low of priority of each image included in the all images; and a fourth determining module configured to determine the preview image folder including the predetermined number of images.
In an alternative embodiment, the target application further comprises: the receiving module is used for receiving a selection instruction for selecting target images included in the preview image folder after the preview image folder is displayed on a target interface; and the playing module is used for playing the target segment included in the video file, wherein the target segment includes the target image.
It should be noted that each of the above modules may be implemented by software or hardware, and for the latter, it may be implemented by, but not limited to: the modules are all located in the same processor; alternatively, the above modules may be located in different processors in any combination.
Embodiments of the present invention also provide a computer readable storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the method embodiments described above when run.
In one exemplary embodiment, the computer readable storage medium may include, but is not limited to: a usb disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing a computer program.
An embodiment of the invention also provides an electronic device comprising a memory having stored therein a computer program and a processor arranged to run the computer program to perform the steps of any of the method embodiments described above.
In an exemplary embodiment, the electronic apparatus may further include a transmission device connected to the processor, and an input/output device connected to the processor.
It will be appreciated by those skilled in the art that the modules or steps of the invention described above may be implemented in a general purpose computing device, they may be concentrated on a single computing device, or distributed across a network of computing devices, they may be implemented in program code executable by computing devices, so that they may be stored in a storage device for execution by computing devices, and in some cases, the steps shown or described may be performed in a different order than that shown or described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple modules or steps of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only of the preferred embodiments of the present invention and is not intended to limit the present invention, but various modifications and variations can be made to the present invention by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the principle of the present invention should be included in the protection scope of the present invention.

Claims (13)

1. A method for generating a preview image, comprising:
detecting an event occurring in a target area in the case of photographing the target area with an image pickup apparatus;
under the condition that a target event occurs in the target area is detected, capturing a first image of the target area, and determining the first image as a target preview image of a target video containing the target event;
before the end of the target event, repeating the following operations until the end of the target event: capturing a second image of a target picture when detecting that the target picture with higher image priority than the target preview image appears in the target area; and updating the target preview image to the second image.
2. The method of claim 1, wherein the step of determining the position of the substrate comprises,
Before capturing the second image of the target frame, the method further comprises: determining a target priority of the target preview image based on first element information included in the target preview image for indicating the target event;
in the case that the target picture with the higher image priority than the target preview image appears in the target area is detected, the step of capturing the second image of the target picture comprises the following steps: in the case that the target picture including more second element information indicating the target event than the first element information appears in the target area is detected, the second image of the target picture is grabbed.
3. The method according to claim 2, characterized in that:
in the case where only one target object of a predetermined type is included in the target event, the element information for indicating the target event includes at least one of: the moving range of the target object reaches a preset range threshold, the front image of the target object appears in the field of view of the camera, the definition of the front image of the target object reaches a preset definition threshold, the distance between the target object and a warning area is smaller than a preset distance threshold, and the target object collides with other types of objects;
In the case that a plurality of target objects of a predetermined type are included in the target event, the element information for indicating the target event includes at least one of: the method comprises the steps that the moving ranges of a plurality of target objects reach a preset range threshold value, the front image of any target object appears in the visual field of the camera, the definition of the front image of any target object reaches a preset definition threshold value, the distance between any target object and a warning area is smaller than a preset distance threshold value, the number of the target objects changes, target objects carried on any target object are separated from the target objects, any two or more target objects collide, and any target object collides with other types of objects.
4. The method of claim 1, wherein before the end of the target event, the method further comprises:
and grabbing a third image of the target area when the preset time length is up under the condition that the target picture is not detected within the preset time length after grabbing the target preview image.
5. The method according to any one of claims 1 to 4, further comprising:
Uploading all images captured before the end of the target event and a video file comprising the target event to a platform to instruct the platform to push all images and the video file to a target application so as to generate a preview image folder of the target event in the target application according to the capture time of all images.
6. The method of claim 5, wherein after uploading all images captured before the end of the target event and video files comprising the target event to a platform, the method further comprises:
and the target application displays the preview image folder on a target interface, wherein the display modes of the images with different priorities in the preview image folder are different.
7. The method of claim 6, wherein the target application exposing the preview image folder on a target interface comprises:
the target application displays the preview image folder on the target interface according to the priority of each image included in the whole images and a preset display mode, wherein the preset display mode comprises at least one of the following modes:
The colors of frames of the images with different priorities are different;
the background colors of the images with different priorities are different;
the display sizes of the images of different priorities are different.
8. The method of claim 6, wherein the target application is further comprised of, prior to exposing the preview image folder on a target interface:
the target application intercepts part of image areas from each image to be displayed, wherein the proportion of element information which is included in the intercepted image areas and used for indicating the target event reaches a preset proportion value;
the target application determines the preview image folder comprising each intercepted partial image area.
9. The method of claim 6, wherein the target application is further comprised of, prior to exposing the preview image folder on a target interface:
the target application determines a predetermined number of images according to the order of the priority of each image included in the whole images from high to low;
the target application determines the preview image folder that includes the predetermined number of images.
10. The method of claim 6, wherein after the target application presents the preview image folder on a target interface, the method further comprises:
The target application receives a selection instruction for selecting target images included in the preview image folder;
and the target application plays a target segment included in the video file, wherein the target segment includes the target image.
11. A preview image generating apparatus, comprising:
a detection module for detecting an event occurring in a target area when the target area is photographed by an image pickup apparatus;
the first grabbing module is used for grabbing a first image of the target area and determining the first image as a target preview image of a target video containing the target event under the condition that the target event occurs in the target area;
the second grabbing module is used for repeatedly executing the following operations until the target event is ended before the target event is ended: capturing a second image of a target picture when detecting that the target picture with higher image priority than the target preview image appears in the target area; and updating the target preview image to the second image.
12. A computer readable storage medium, characterized in that a computer program is stored in the computer readable storage medium, wherein the computer program, when being executed by a processor, implements the steps of the method according to any of the claims 1 to 10.
13. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the method as claimed in any one of claims 1 to 10 when the computer program is executed.
CN202311568379.1A 2023-11-21 2023-11-21 Preview image generation method and device, storage medium and electronic device Pending CN117395497A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311568379.1A CN117395497A (en) 2023-11-21 2023-11-21 Preview image generation method and device, storage medium and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311568379.1A CN117395497A (en) 2023-11-21 2023-11-21 Preview image generation method and device, storage medium and electronic device

Publications (1)

Publication Number Publication Date
CN117395497A true CN117395497A (en) 2024-01-12

Family

ID=89437434

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311568379.1A Pending CN117395497A (en) 2023-11-21 2023-11-21 Preview image generation method and device, storage medium and electronic device

Country Status (1)

Country Link
CN (1) CN117395497A (en)

Similar Documents

Publication Publication Date Title
US11210526B2 (en) Video surveillance system, video processing apparatus, video processing method, and video processing program
CN109919009A (en) The monitoring method of target object, apparatus and system
EP2659433A2 (en) Inference engine for video analytics metadata-based event detection and forensic search
CN112042184B (en) Image processing device, image processing system and image processing method
US7428314B2 (en) Monitoring an environment
US8107680B2 (en) Monitoring an environment
CN112969049B (en) Intelligent detection system for ship violation behaviors
CN111010547A (en) Target object tracking method and device, storage medium and electronic device
EP3229174A1 (en) Method for video investigation
CA3140923A1 (en) Forensic video exploitation and analysis tools
CN110750311A (en) Data classification method, device and equipment
CN112464755A (en) Monitoring method and device, electronic equipment and storage medium
KR101990789B1 (en) Method and Apparatus for Searching Object of Interest by Selection of Object
EP2913997B1 (en) Information processing system, information processing method, and program
CN111260869B (en) Method and device for extracting video frames in monitoring video and computer equipment
CN109598120A (en) Security postures intelligent analysis method, device and the storage medium of mobile terminal
CN111553328A (en) Video monitoring method, system and readable storage medium based on block chain technology and deep learning
CN114490063A (en) Business management method, platform, service delivery system and computer storage medium
CN112182295A (en) Business processing method and device based on behavior prediction and electronic equipment
CN112115867A (en) Method for processing customized event rule through intelligent video analysis
CN101325727B (en) Use the geometric digital video scanning system of 3D and method
KR101964230B1 (en) System for processing data
CN117395497A (en) Preview image generation method and device, storage medium and electronic device
CN113032630A (en) Displaying a video stream
KR102375686B1 (en) Managing service Method for Non-smoking area and system thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination