WO2022078091A1

WO2022078091A1 - Terminal, and video record analysis and display method and device therefor

Info

Publication number: WO2022078091A1
Application number: PCT/CN2021/115717
Authority: WO
Inventors: 钟浩华
Original assignee: Oppo广东移动通信有限公司
Priority date: 2020-10-15
Filing date: 2021-08-31
Publication date: 2022-04-21
Also published as: CN112218150A

Abstract

The present application disclosed a terminal, and a video record analysis and display method and device therefor. Said method comprises: acquiring video record data; analyzing whether there is at least one target event in the video record data; and if so, controlling a display screen to display a display interface, and displaying, on the display interface, a video record time axis and a respective time stamp of the at least one target event corresponding to the video record time axis, so as to more clearly display the time stamp corresponding to each target event.

Description

Terminal and video analysis and display method and device thereof

The present invention claims the priority of the prior application with the title of "terminal and video analysis and display method and device thereof" filed on October 15, 2020, and the content of the aforementioned prior application is incorporated into this text by way of introduction middle.

technical field

The present application relates to the field of video recording processing of camera equipment, and in particular, to a terminal and a video analysis and display method and device thereof.

Background technique

When the existing terminal recognizes that there are some specific events in the video, such as: screen changes, someone moves, recognizes a human face, a baby crying, etc., it will be displayed in a color block on the same mark on the video timeline.

SUMMARY OF THE INVENTION

In view of this, the present application provides a terminal and a video analysis and display method and device thereof, which can more clearly display the time mark corresponding to each target event, so that the user can clearly understand the time when each target event occurs, so as to solve the above problems. technical problem.

A video analysis and display method provided by an embodiment of the present application is applied to a terminal, and the video analysis and display method includes the steps:

Obtain the video data within a preset time period recorded by the camera equipment;

analyzing whether there is at least one target event in the video recording data;

When there is at least one target event in the recording data, control the display screen to display a display interface, and display the recording time axis and the at least one target event corresponding to the recording time axis on the display interface. Time stamps, each of the time stamps is used to mark the time when the corresponding target event occurs.

A terminal provided by an embodiment of the present application includes a processor, a memory, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to perform the following steps:

A video analysis and display device provided by an embodiment of the present application includes:

an acquisition module, used to acquire video data within a preset time period recorded by the camera device;

an analysis module for analyzing whether there is at least one target event in the video recording data;

A display module, configured to control the display screen to display a display interface when there is at least one target event in the video recording data, and display a video recording time axis and the at least one corresponding to the video recording time axis on the display interface A respective time stamp of a target event, each of the time stamps is used to mark the time when the corresponding target event occurs.

An embodiment of the present application provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and after the computer program is invoked by a processor to run, the steps in the video analysis and display method are executed.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1 is a schematic flowchart of a video analysis and display method in an embodiment of the present application.

FIG. 2 is a schematic diagram of a display interface in an embodiment of the present application.

FIG. 3 is a schematic diagram of a display interface in another embodiment of the present application.

FIG. 4 is a schematic block diagram of a terminal in an embodiment of the present application.

FIG. 5 is a schematic block diagram of a video analysis and display apparatus according to an embodiment of the present application.

FIG. 6 is a schematic structural diagram of a terminal in another embodiment of the present application.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the scope of protection of the present application.

Unless otherwise defined, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this application belongs. Words like "a," "an," or "the" used in this application also do not denote a limitation of quantity, but are merely used to denote the presence of at least one. "Comprising" or "comprising" and similar words mean that the elements or things appearing before the word encompass the elements or things recited after the word and their equivalents, but do not exclude other elements or things. "Connected" or similar words are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect.

Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor a separate or alternative embodiment that is mutually exclusive of other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

The terminals involved in the embodiments of the present application may include various handheld devices with display screens, vehicle-mounted devices, wearable devices, computing devices, or other processing devices connected to wireless modems, and various forms of user equipment (User Equipment, UE), mobile station (Mobile Station, MS), terminal device (terminal device) and so on. For the convenience of description, the devices mentioned above are collectively referred to as terminals.

Please refer to FIG. 1 , which is a schematic flowchart of a video analysis and display method in an embodiment of the present application. It should be noted that, the execution sequence of the video analysis and display method is not limited to the sequence shown in FIG. 1 , and may also be adjusted according to actual conditions. Please refer to Figure 1 and Figure 2 at the same time, the video analysis and display method includes the steps:

Step 101 : Acquire video recording data recorded by the imaging device 40 within a preset time period.

Step 102: Analyze whether there is at least one target event in the video recording data.

Step 103: When there is at least one target event in the video recording data, control the display screen 30 to display a display interface 11, and display the video recording time axis 111 and the corresponding video recording time axis 111 on the display interface 11. The respective time marks 112 of the at least one target event, each of the time marks 112 is used to mark the time when the corresponding target event occurs.

Therefore, in the present application, when there is at least one target event in the recording data, the display screen 30 is controlled to display a display interface 11 , and the recording time axis 111 and the recording time axis 111 are displayed on the display interface 11 . The respective time marks 112 of the corresponding at least one target event, each of the time marks 112 is used to mark the time when the corresponding target event occurs, and the time mark 112 corresponding to each target event is more clearly displayed, so that Users can clearly understand the moment when each target event occurs, which improves the user's experience when viewing video data.

Further, in one embodiment, the target event is at least one of the target object appearing in the recording picture, the target object moving in the recording picture, the overall switching of the recording picture, or the appearance of the target sound in the recording. Wherein, the target object may be a type of thing or a specific thing, for example, a certain type of person, a certain specific person, a certain type of animal, or a certain specific animal. The sound may be, but limited to, a child crying, a dog barking, a sound made by things falling, and the like. Optionally, in other embodiments, the target event may be defined for a certain type of thing or a specific thing according to an application scenario and/or a user's viewing requirement, and the application scenario may be a common photographing One of the scenarios, home surveillance scenarios, and specific area surveillance scenarios. Wherein, when the camera device 40 is a common electronic device with a camera function, the camera device 40 can be applied to a common shooting scene; when the camera device 40 is a common camera device dedicated to shooting, the The camera device 40 can be used in home monitoring scenarios, etc.; when the camera device 40 is a monitoring system composed of several camera devices, the camera device 40 can be used in specific area monitoring scenarios, such as community security scenarios, traffic monitoring scene etc. When the application scene is a common photographing scene, the target event may be defined according to certain things in the photographing scene, for example, the target event is a person or an activity of a person in the photographing scene; when the When the application scenario is a home monitoring scene, etc., the target event can be defined according to certain things in the home monitoring scene, for example, objects that need attention such as children, elderly or pets at home; of course, the target event can not only be A certain or a certain type of things can also be scene movements, sounds, etc., for example, the cry of a child, the cry of an elderly person falling, the scream of a pet, etc.; when the application scene is a monitoring scene in a specific area, The target event can be an event specific to a certain thing, for example, a specific person, so that it is convenient to find out the movement track of a certain person through video recording; it can also be applied to search people through surveillance video, for example, to find lost people. Children or the elderly, find criminals, etc. It can be understood that the target event may be pre-defined according to the application scenario, or may also be defined on-site according to current requirements, for example, searching for a currently lost person. There is no specific limitation here. Specifically, in this embodiment, the target event includes "recognized face", "screen change", "someone moves", "baby crying" and the like.

Further, in one embodiment, there may be one or more target events in the video recording data, and when there is one target event in the video recording data, the video recording time axis is displayed on the display interface 11 A time mark 112 corresponding to a target event corresponding to 111; when there are two or more target events in the video recording data, the video recording time axis 111 and the video recording time are displayed on the display interface 11. Time marks 112 corresponding to two or more target events corresponding to the axis 111 respectively.

Further, in one embodiment, the recording time axis 111 is based on the selected preset time period, and different time marks 112 are set corresponding to the recording time axis 111 and displayed side by side.

Further, in one of the embodiments, when the at least one target event includes two or more target events, the time marks 112 corresponding to the two or more target events are displayed side by side and displayed in parallel. do not overlap each other.

Optionally, in one of the embodiments, the side-by-side display may be, but not limited to, horizontal side-by-side display, vertical side-by-side display, and the like.

Further, in one embodiment, please refer to FIG. 3 , the display interface 11 includes a first display area 110 , and the first display area 110 is used for displaying the recording time axis 111 and the recording time Time marks 112 corresponding to the at least one target event corresponding to the axis 111 respectively, wherein the time marks 112 correspond to the moments on the recording time axis 111 .

Therefore, the user can know the time marks 112 corresponding to each current target event through the first display area 110, which is convenient for the user to quickly know the target events existing in the video recording data and the time mark 112 of each target event.

Optionally, in one embodiment, since the display area of the first display area 110 is limited, when there are too many target events in the recorded data, the limited display area of the first display area 110 When the target event in the video recording data cannot be completely displayed in the region at one time, the first display area 110 will temporarily display a part of the target event existing in the video recording data and its corresponding time mark 112, and for all the target events in the video recording data. Other target events existing in the recorded video data are displayed based on the user's control operation.

Specifically, in one of the embodiments, a sliding bar is displayed on one side of the first display area 110, the sliding bar is used for the user to slide, and the control operation is a sliding operation by the user on the sliding bar , so that the first display area 110 slides to display the target event existing in the video recording data. Even if there are too many target events in the first display area 110, the first display area 110 can display each target event and its corresponding time mark 112 in a limited display area, saving display space.

Optionally, in one embodiment, the display screen 30 is a touch display screen, and the control operation is a user's sliding operation on the touch display screen. The touch display screen generates a corresponding sliding control signal in response to the user's sliding operation, and the sliding control signal controls the first display area 110 to slide and display the target event and the corresponding time mark 112 in response. Therefore, even if there are too many target events in the first display area 110, the first display area 110 can display each target event and its corresponding time mark 112 in a limited display area, saving display space.

Further, in one embodiment, after the analysis of all data of the recorded data is completed, the first display area 110 displays all target events existing in the recorded data at one time.

Optionally, in another embodiment, in the process of analyzing the video recording data, each time a target event is determined, the target event is controlled to be displayed on the first display area 110, if all When the first display area 110 cannot display all the analyzed target events at one time due to its limited display area, the first display area 110 will scroll through the first display area 110 to make the first determination in the first display area 110 The target event is scrolled and hidden, and the latest determined target event is scrolled and displayed. In this way, even if there are too many target events in the first display area 110, the first display area 110 can display each target event and its corresponding time mark 112 in a limited display area, saving display space.

Further, in one of the embodiments, the time mark 112 corresponding to the target event is also used to represent the duration period corresponding to each target event.

Therefore, the user can clearly know the duration time period corresponding to the time mark 112 of each target event and all target events occurring in a certain time period, which is convenient for the user to quickly understand each target event occurring within the preset time period.

Further, in one of the embodiments, the time marks 112 respectively corresponding to the two or more target events are displayed in parallel. For example, as shown in FIG. 2 and FIG. 3, each time mark 112 is displayed in parallel, and different time marks 112 are displayed side by side on different display tracks, so that the time marks 112 of each target event will be clear at a glance, which is convenient for users to quickly understand the video data The target events that exist in , and their corresponding time stamps 112 .

Further, in one of the embodiments, the time mark 112 corresponding to the target event may represent the duration period corresponding to each target event in different ways.

Specifically, in one of the embodiments, different time marks 112 on the recording timeline 111 may display the duration corresponding to each target event through text. For example, as shown in FIG. 2, a corresponding target event is displayed on one side of each time mark 112, for example, "track 1: face recognition"; "track 2: picture change;" "track 3: someone moves" ; "Track 4: Baby Cries" etc. In this way, the target event represented by each time mark 112 can be identified through text.

Optionally, in one of the embodiments, different time marks 112 on the recording timeline 111 can display the duration corresponding to each target event through color distinction. For example, as shown in Figure 2, the duration of track 1 is purple, the duration of track 2 is yellow, the duration of track 3 is cyan, the duration of track 4 is red, etc. In this way, the target event represented by each track can be distinguished by color.

Optionally, in one embodiment, not only the durations of each time mark 112 are displayed differently by color, but also the text located on one side of the time mark 112 can be displayed differently by adding a corresponding background color. For example, "Track 1: Face Recognized" is purple; "Track 2: Picture changes in yellow;" "Track 3: Someone moves" is in cyan; "Track 4: Baby crying" is in red, etc.

Optionally, in one of the embodiments, different time marks 112 on the recording timeline 111 may display the duration corresponding to each target event through a graphical distinction. For example, as shown in FIG. 3 , the target event "baby crying" is represented by a face icon image; the target event "someone is moving" is represented by a running-shaped human icon image; and a screen-shaped icon image including an arrow is represented The target event "screen change", etc.

Optionally, in one of the embodiments, the video analysis and display method further includes the steps of:

When a certain target event does not exist in the video recording data, the time mark 112 corresponding to the target event is controlled to be hidden. For example, when the target event "baby cry" does not exist in the video recording data, the time mark 112 corresponding to the target event "baby cry" may be hidden from display.

Therefore, when the target event does not exist in the video recording data, the time mark 112 corresponding to the target event can be not displayed, and the display space of other time marks 112 can be enlarged.

Optionally, in one of the embodiments, the start time and the end time corresponding to each target event are displayed on the time mark 112 corresponding to each target event.

In this way, through the start time and end time corresponding to each target time, the continuation of each target event can also be known.

Further, in one embodiment, the display interface 11 includes a second display area 114, and the second display area 114 is used for previewing or playing the recorded data.

Therefore, the user can view the playback content of the video recording data through the second display area 114 .

Further, in one embodiment, the display interface 11 includes a third display area 115, and the third display area 115 is used to list and display a plurality of target events occurring within a preset time period, and to display each target The start time 1151 of the event.

Optionally, in one embodiment, when the third display area 115 cannot display all the target events at the start time 1151 due to the limitation of the display area, the recording data may be displayed in the recorded data by responding to the user's sliding. All target events can be displayed on the third display area 115 .

Therefore, the user can quickly understand the target events that have occurred and the starting time 1151 of each target event that has occurred through the third display area 115, and can quickly grasp the situation of each target event that has occurred within a preset time. .

Further, in one embodiment, the event list sorts the multiple target events according to the start time 1151 .

Thus, a series of target events occurring in a predetermined time period can be known in a more orderly manner.

Further, in one embodiment, each target event in the third display area 115 further includes a virtual button 1152, and the video analysis and display method further includes the steps:

In response to the click operation on the virtual key 1152, the second display area 114 jumps to the start time 1151 of the target event and starts to play the video.

Therefore, when the user needs to know a certain target event, he/she selects and clicks the virtual button 1152, that is, the video can be played from the start time 1151 of the target time.

Further, in one embodiment, the second display area 114 , the first display area 110 and the third display area 115 are displayed on the display interface 11 in order from top to bottom. It can be understood that, in other embodiments, the arrangement order of the second display area 114 , the first display area 110 and the third display area 115 can be adjusted, which is not limited herein.

When the duration of the time mark 112 of one of the target events is selected, the control will play the video corresponding to the target event in the second display area 114 .

Therefore, as long as the duration period of the time mark 112 corresponding to the target event is clicked in the first display area 110, the video corresponding to the target time can be played, which is convenient for the user.

When the video corresponding to the target event is played in the second display area 114, if the target event is the appearance of the target object or the movement of the target object, things related to the target event in the video are marked and tracked. For example, things related to the target event in the marked video are marked and tracked by red boxes, blue circles, etc.

Therefore, it is convenient for the user to quickly find the things related to the target event, for example, a specific person, to avoid long-time watching video fatigue resulting in losing the things related to the target event and need to look back again, increasing the burden on the user.

When a duration period of the time mark 112 of a target event is selected and the interception operation is performed, the recorded video within a duration period of the time mark 112 of the target event is controlled to be intercepted as a new video and stored; or ,

When a plurality of duration periods of the time mark 112 of a target event are selected and the interception operation is performed, the recorded videos in the plurality of duration periods of the time mark 112 of the target event are controlled to be synthesized into a new video and stored.

It can be understood that the interception operation may be a gesture touch operation, a click operation of clicking a function button, etc., which is not limited herein.

Therefore, when responding to the interception operation, the video clips associated with the target event in the video recording data can be intercepted, and a new video can be synthesized and stored in chronological order, so that the user can view the video related to the target event next time. .

Please refer to FIG. 4 , which is a block diagram of a terminal in an embodiment of the present application. The terminal 100 is used to analyze and display the video data recorded by the camera device 40 . Wherein, the camera device 40 may be a common electronic device with a camera function, such as a smart phone, a tablet computer, a desktop computer, etc.; the camera device 40 may also be a common camera device dedicated to photography, such as a camera ; The camera device 40 may also be a monitoring system composed of several camera devices, for example, a community monitoring system, a traffic monitoring system, etc., which are not limited here. When the camera device 40 is an ordinary electronic device with a camera function, the camera device 40 may be the terminal 100 itself. When the camera device 40 is another type of camera device, a wired or wireless network connection is established between the terminal 100 and the camera device 40, and the terminal 100 obtains the video of the camera device 40 through the network connection Data is analyzed and displayed. Specifically, the terminal 100 includes a processor 10 , a memory 20 and a computer program stored in the memory 20 and executable on the processor 10 . It should be noted that the processor 10 may be, but not limited to, a central processing unit (Central Processing Unit, CPU), other general-purpose processors, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated) Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The memory 20 is used to store various files, information and/or data. The memory 20 may include high-speed random access memory, and may also include non-volatile memory, such as hard disk, internal memory, plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card, Flash Card, multiple disk storage devices, flash memory devices, or other volatile solid state storage devices. The terminal 100 further includes a display screen 30 . The display screen 30 is any electronic display screen with display function. The display screen 30 is electrically connected to the processor 10 . It can be understood that the terminal 100 may be a design in which the display screen 30 and the host are integrated, or a design in which the display screen 30 and the host are separated, wherein the processor 10 and the memory 20 are provided in the host.

The processor 10 executes the computer program to perform the steps:

Acquiring video recording data within a preset time period recorded by the camera device 40;

When there is at least one target event in the recording data, the display screen 30 is controlled to display a display interface 11 , and a recording time axis 111 and the at least one corresponding to the recording time axis 111 are displayed on the display interface 11 . A respective time mark 112 of a target event, each of the time marks 112 is used to mark the time when the corresponding target event occurs.

Further, in one of the embodiments, the relevant definition of the target event is the same as above, and details are not repeated here.

Further, in one embodiment, the display interface 11 includes a first display area 110 , and the first display area 110 is used to display the recording time axis 111 and all the corresponding recording time axis 111 . The time mark 112 corresponding to each of the at least one target event, wherein the time mark 112 corresponds to the moment on the recording time axis 111 . It should be noted that, the display manner of the target event in the first display area 110 is the same as that described above, and will not be described in detail here.

Specifically, in one of the embodiments, different time marks 112 on the recording timeline 111 may display the duration corresponding to each target event through text.

Optionally, in one of the embodiments, different time marks 112 on the recording timeline 111 can display the duration corresponding to each target event through color distinction.

Optionally, in one embodiment, only the durations of each time mark 112 are displayed differently by color, and a corresponding background color can also be added to the text located on one side of the time mark 112 to be displayed differently.

Optionally, in one of the embodiments, different time marks 112 on the recording timeline 111 may display the duration corresponding to each target event through a graphical distinction.

Optionally, in one of the embodiments, the processor 10 executes the computer program to perform the steps:

When a certain target event does not exist in the video recording data, the time mark 112 corresponding to the target event is controlled to be hidden.

Further, in one of the embodiments, the display interface 11 includes a third display area 115, and the start time and the end time corresponding to each target event are displayed on the time mark 112 corresponding to each target event. It should be noted that the display of the target event by the third display area 115 is the same as above, and will not be described in detail here.

Further, in one embodiment, each target event of the third display area 115 further includes a virtual key 1152, and the processor 10 executes the computer program to perform the steps:

When the video corresponding to the target event is played in the second display area 114, if the target event is the appearance of the target object or the movement of the target object, things related to the target event in the video are marked and tracked.

FIG. 5 is a schematic block diagram of a video analysis and display apparatus according to an embodiment of the present application. The video analysis and display device 500 includes an acquisition module 510 , an analysis module 520 and a display module 530 . The acquiring module 510 is configured to acquire video recording data recorded by the camera device 40 within a preset time period. The analyzing module 520 is configured to analyze whether there is at least one target event in the video recording data. The display module 530 is used to control the display screen 30 to display a display interface 11 when there is at least one target event in the video recording data, and display the video recording timeline 111 and the video recording timeline on the display interface 11. The respective time marks 112 of the at least one target event corresponding to 111, each of the time marks 112 is used to mark the time when the corresponding target event occurs.

Optionally, in one of the embodiments, the target event is at least one of the target object appearing in the recording picture, the target object moving in the recording picture, the overall switching of the recording picture, and the target sound appearing in the recording; and/or, the target event is User-defined events.

Optionally, in one embodiment, the display interface includes a first display area, and the first display area is used to display a recording time axis and a time mark corresponding to the at least one target event, the time mark and the moment on the recording time axis correspond.

Optionally, in one embodiment, when at least one target event includes two or more target events, time marks corresponding to the two or more target events are displayed side by side without overlapping each other.

Optionally, in one of the embodiments, the time stamp corresponding to the target event is also used to represent the duration period corresponding to each target event.

Optionally, in one of the embodiments, time marks corresponding to two or more target events respectively are displayed in parallel.

Optionally, in one of the embodiments, the time stamp corresponding to the target event represents a duration period corresponding to each target event, including at least one of the following:

Display the duration corresponding to each target event through text distinction on the time mark corresponding to each target event;

Display the duration corresponding to each target event by color distinction on the time mark corresponding to each target event;

The duration corresponding to each target event is displayed graphically on the time stamp corresponding to each target event.

Optionally, in one of the embodiments, the display interface includes a second display area, and the second display area is used for previewing or playing video data.

Optionally, in one embodiment, the display interface includes a third display area, and the third display area is used to list and display a plurality of target events occurring within a preset time period, and to display the start time of each target event.

Optionally, in one embodiment, each target event in the third display area further includes a virtual key, and the display module is further used for:

In response to the click operation on the virtual key, the second display area jumps to the start time of the target event and starts to play the video.

Optionally, in one of the embodiments, the list sorts the multiple target events according to the starting time.

Optionally, in one embodiment, the display module 530 is further configured to:

When the duration time period of the time stamp of one of the target events is selected, the control to play the video corresponding to the target event in the second display area.

Optionally, in one embodiment, the display module 530 is further configured to:

When the video corresponding to the target event is played in the second display area, if the target event is the appearance of the target object or the movement of the target object, the thing related to the target event in the video is marked and tracked.

Optionally, in one embodiment, the display module 530 is further configured to:

When a duration period of the time stamp of a target event is selected and the interception operation is performed, the recorded video in the duration period of the time mark of the control target event is intercepted as a new video and stored; or,

When a plurality of durations of time stamps of a target event are selected and the interception operation is performed, the recorded videos in the multiple durations of time stamps of the control target event are synthesized into a new video and stored.

FIG. 6 is a block diagram showing a partial structure of a mobile phone related to a terminal provided by an embodiment of the present application. 6, the mobile phone includes: a radio frequency (Radio Frequency, RF) circuit 610, a memory 620, an input and output unit 630, a sensor 650, an audio circuit 660, a wireless fidelity (Wireless Fidelity, WiFi) module 670, a processor 680, and a power supply 690 and other components. Those skilled in the art can understand that the structure of the mobile phone shown in FIG. 6 does not constitute a limitation on the mobile phone, and may include more or less components than the one shown, or combine some components, or arrange different components.

Below in conjunction with Figure 6, the various components of the mobile phone are introduced in detail:

The input and output unit 630 can be used to receive input numerical or character information, and generate key signal input related to user setting and function control of the mobile phone. Specifically, the input and output unit 630 may include a touch display screen 633 and other input devices 632 . Other input devices 632 may include, but are not limited to, one or more of physical keys, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, joysticks, and the like.

Wherein, the processor 680 is configured to perform the following steps:

The processor 680 is the control center of the mobile phone, using various interfaces and lines to connect various parts of the entire mobile phone, by running or executing the software programs and/or modules stored in the memory 620, and calling the data stored in the memory 620. Various functions of the mobile phone and processing data, so as to monitor the mobile phone as a whole. Optionally, the processor 680 may include one or more processing units, and the processing unit may be an artificial intelligence chip or a quantum chip; preferably, the processor 680 may integrate an application processor and a modulation and demodulation processor, wherein the application processing The processor mainly deals with the operating system, display interface and application programs, etc., and the modem processor mainly deals with wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 680 .

Additionally, memory 620 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

RF circuitry 610 may be used for the reception and transmission of information. Typically, the RF circuit 610 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, RF circuitry 610 may communicate with networks and other devices via wireless communications. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division) Multiple Access, CDMA), Wideband Code Division Multiple Access (Wideband Code Division Multiple Access, WCDMA), Long Term Evolution (Long Term Evolution, LTE), email, Short Messaging Service (Short Messaging Service, SMS), etc.

The cell phone may also include at least one sensor 650, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor can include an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the touch display screen according to the brightness of the ambient light, and the proximity sensor can turn off the touch display screen when the mobile phone is moved to the ear and/or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes), and can detect the magnitude and direction of gravity when it is stationary. games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. Repeat.

The audio circuit 660, the speaker 661, and the microphone 662 can provide an audio interface between the user and the mobile phone. The audio circuit 660 can transmit the electrical signal converted from the received audio data to the speaker 661, and the speaker 661 converts it into a sound signal for playback; on the other hand, the microphone 662 converts the collected sound signal into an electrical signal, which is converted into an electrical signal by the audio circuit 660. After receiving, it is converted into audio data, and then the audio data is processed by the processor 680, and then sent to, for example, another mobile phone through the RF circuit 610, or the audio data is played to the memory 620 for further processing.

WiFi is a short-distance wireless transmission technology. The mobile phone can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 670. It provides users with wireless broadband Internet access. Although FIG. 6 shows the WiFi module 670, it can be understood that it is not a necessary component of the mobile phone, and can be completely omitted as required within the scope of not changing the essence of the invention.

The mobile phone also includes a power supply 690 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 680 through a power management system, so as to manage charging, discharging, and power consumption management functions through the power management system.

Although not shown, the mobile phone may also include a camera, a Bluetooth module, and the like, which will not be repeated here.

In the aforementioned embodiment shown in FIG. 1 , the method flow of each step can be implemented based on the structure of the mobile phone.

In the aforementioned embodiment shown in FIG. 5 , the functions of each unit can be implemented based on the structure of the mobile phone.

Embodiments of the present application further provide a computer storage medium, wherein the computer storage medium is used to store a computer program, and the computer program enables the computer to execute part or all of the steps of any video analysis and display method described in the above method embodiments .

The embodiments of the present application further provide a computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute the methods described in the foregoing method embodiments. Part or all of the steps of any video analysis display method.

It should be noted that, for the sake of simple description, the foregoing method embodiments are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited by the described action sequence. Because in accordance with the present application, certain steps may be performed in other orders or concurrently. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative, for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation, for example, multiple units or components may be combined or Integration into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware, and can also be implemented in the form of software program modules.

The integrated unit, if implemented in the form of a software program module and sold or used as a stand-alone product, may be stored in a computer readable memory. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence, or the part that contributes to the prior art, or all or part of the technical solution, and the computer software product is stored in a memory, Several instructions are included to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable memory, and the memory can include: a flash disk , Read-only memory (English: Read-Only Memory, referred to as: ROM), random access device (English: Random Access Memory, referred to as: RAM), magnetic disk or optical disk, etc.

As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: The technical solutions described in the embodiments are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

A video analysis and display method, applied to a terminal, wherein the video analysis and display method comprises the steps:

Obtain the video data within a preset time period recorded by the camera equipment;

analyzing whether there is at least one target event in the video recording data;

When there is at least one target event in the recording data, control the display screen to display a display interface, and display the recording time axis and the at least one target event corresponding to the recording time axis on the display interface. Time stamps, each of the time stamps is used to mark the time when the corresponding target event occurs.
The video recording analysis and display method according to claim 1, wherein the target event is at least one of the target object appearing in the video recording picture, the target object moving in the video recording picture, the overall switching of the video recording picture, and the target sound appearing in the video recording; and/ Or, the target event is a user-defined event.
The video analysis and display method according to claim 2, wherein the display interface includes a first display area, and the first display area is used to display the video time axis and the time corresponding to the at least one target event. mark, the time mark corresponds to the moment on the recording time axis.
The video analysis and display method according to any one of claims 1 to 3, wherein when the at least one target event includes two or more target events, it is different from the two or more target events. The corresponding time stamps are displayed side by side without overlapping each other.
The video analysis and display method according to claim 4, wherein the time mark corresponding to the target event is further used to represent the duration period corresponding to each target event.
The video analysis and display method according to claim 5, wherein the time marks corresponding to the two or more target events are displayed in parallel.
The video analysis and display method according to claim 5, wherein the time mark corresponding to the target event represents a duration period corresponding to each target event, including at least one of the following:

Display the duration corresponding to each target event through text distinction on the time mark corresponding to each target event;

Display the duration corresponding to each target event by color distinction on the time mark corresponding to each target event;

The duration corresponding to each target event is displayed graphically on the time stamp corresponding to each target event.
The video analysis and display method according to claim 1, wherein the display interface includes a second display area, and the second display area is used for previewing or playing the video data.
The video analysis and display method according to claim 8, wherein the display interface includes a third display area, and the third display area is used to list and display multiple target events occurring within a preset time period, and to display The start time of each target event.
The video analysis and display method according to claim 9, wherein each target event in the third display area further comprises a virtual button, and the video analysis and display method further comprises the steps of:

In response to the click operation on the virtual key, the second display area jumps to the start time of the target event and starts to play the video.
The video analysis and display method according to claim 9, wherein the list sorts a plurality of target events according to the starting time.
The video analysis and display method according to claim 5, wherein the video analysis and display method further comprises the steps of:

When the duration of the time stamp of one of the target events is selected, the video recording corresponding to the target event is controlled to be played in the second display area.
The video analysis and display method according to claim 12, wherein the video analysis and display method further comprises the steps of:

When the video corresponding to the target event is played in the second display area, if the target event is the appearance of the target object or the movement of the target object, things related to the target event in the video are marked and tracked.
The video analysis and display method according to claim 5, wherein the video analysis and display method further comprises the steps of:

When a duration period of the time stamp of a target event is selected and the interception operation is performed, the recorded video within a duration period of the time mark of the target event is controlled to be intercepted as a new video and stored; or,

When a plurality of duration periods of the time stamp of a target event are selected and the interception operation is performed, the recorded videos in the multiple duration periods of the time stamp of the target event are controlled to be synthesized into a new video and stored.
A terminal comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, the processor running the several computer programs to execute any one of claims 1 to 14. The video analysis display method described above.
A video analysis and display device, comprising:

an acquisition module, used to acquire video data within a preset time period recorded by the camera device;

an analysis module for analyzing whether there is at least one target event in the video recording data;

A display module, configured to control the display screen to display a display interface when there is at least one target event in the video recording data, and display a video recording time axis and the at least one corresponding to the video recording time axis on the display interface A respective time stamp of one target event, and the respective time stamp of the at least one target event is used to mark the time when the corresponding target event occurs.
The device according to claim 16, wherein the target event is at least one of the target object appearing in the recording picture, the movement of the target object in the recording picture, the overall switching of the recording picture, and the appearance of the target sound in the recording; and/or, all The target event described is a user-defined event.
The device according to claim 17, wherein the display interface comprises a first display area, and the first display area is used to display the recording time axis and the respective time marks corresponding to the at least one target event, the The time mark corresponds to the time on the recording time axis.
The device according to any one of claims 16 to 18, wherein, when the at least one target event includes two or more target events, corresponding to the two or more target events respectively Time stamps are displayed side by side and do not overlap each other.
A computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and after the computer program is invoked by a processor to run, executes the steps in the video analysis and display method described in any one of claims 1 to 14 .