WO2022007545A1

WO2022007545A1 - Video collection generation method and display device

Info

Publication number: WO2022007545A1
Application number: PCT/CN2021/097699
Authority: WO
Inventors: 王光强; 王学磊
Original assignee: 聚好看科技股份有限公司
Priority date: 2020-07-06
Filing date: 2021-06-01
Publication date: 2022-01-13

Abstract

The present application relates to the technical field of intelligent devices and video detection, and in particular to a video collection generation method and a display device. To a certain extent, the problems of incapability to automatically obtain a video clip, a slow editing speed, error-prone splicing, and incapability to intelligently generate a video highlight can be solved. The display device comprises: a camera, a microphone, a display screen, used for displaying a user interface; and a first controller, configured to: control, in response to a received trigger signal, the camera to obtain a video clip; perform image recognition on the video clips within a preset period of time to obtain a first video set, the first video set being a set of video clips containing the same element; and splice the video clips in the first video set into a first video collection file.

Description

A method for generating a video collection and a display device

This application requires that the Chinese patent application with the application number of 202010640381.5 and the invention titled "An interactive method for generating a video collection file, a display device, and a smart terminal" be filed with the China Patent Office on July 6, 2020, and a Chinese patent application filed on July 2020. The priority of the Chinese patent application with the application number 202010710550.8 and the invention titled "A method for generating a video collection and a display device" filed with the Chinese Patent Office on 22nd of January, the entire contents of which are incorporated in this application by reference.

technical field

The present application relates to the technical field of smart devices and video detection, and in particular, to a method for generating a video collection and a display device.

Background technique

Video Highlights is a compilation of different videos or video clips with similar content into one video. For example, video highlights can be obtained by splicing active videos of different time periods.

In the implementation of some video collections, users are required to use professional photography tools to obtain video clips, watch and filter each video, and then manually intercept and stitch them into a video collection.

SUMMARY OF THE INVENTION

Some embodiments of the present application provide a display device, including: a camera; a microphone; a display screen for displaying a user interface; a first controller, configured to: in response to a received trigger signal, control the camera to acquire video clips ; Perform image recognition on the video clips in the preset time period to obtain a first video set, which is a video clip set containing the same elements; splicing the video clips in the first video set into the first video collection file.

Some embodiments of the present application provide a method for generating a video collection, the method includes: in response to a received trigger signal, controlling the camera to acquire video clips; performing image recognition on the video clips within a preset time period to obtain A first video set, where the first video set is a set of video clips containing the same elements; the video clips in the first video set are spliced into a first video highlight file.

Some embodiments of the present application provide a display device, including: a camera; a microphone; a display screen for displaying a user interface; a first controller configured to: in response to a received trigger signal, control the camera to perform a preset time period The video clips containing the shooting target are acquired in the system to obtain a first video collection; the video clips in the first video collection are spliced to generate a first video collection.

Some embodiments of the present application provide a method for generating a video highlight, the method comprising: in response to a received trigger signal, controlling the camera to acquire a video clip containing a shooting target within a preset time period to obtain a first video Collection; splicing the video clips in the first video collection to generate a first video collection.

Description of drawings

1 is a schematic diagram of an operation scenario between a display device and a control device in some embodiments;

2 is a structural block diagram of a display device in some embodiments;

3 is an interface schematic diagram of a user interface in some embodiments;

4 is a schematic interface diagram of a function effect display interface in some embodiments;

5 is a schematic interface diagram of a video recording function startup page in some embodiments;

6 is a schematic diagram of a first interface of an image material list interface in some embodiments;

7 is a schematic diagram of a second interface of an image material list interface in some embodiments;

8 is a schematic diagram of a TV application interface in some embodiments;

9 is a schematic diagram of an interface for selecting a video highlight application slave program in some embodiments;

10 is a schematic diagram of an interface after the video collection is generated in some embodiments;

11 is a schematic diagram of an interface after a video collection is generated in some embodiments;

12 is a schematic diagram of an interface for playing a first video collection in some embodiments;

13 is a schematic flowchart of a method for generating a video collection in some embodiments;

14 is a method for generating a video highlight in some embodiments;

FIG. 15 is a schematic diagram of displaying a watermark in some embodiments;

16 is a schematic diagram of an interactive interface for executing a function of sharing to a circle of relatives and friends in some embodiments;

17 is a schematic diagram of an interactive interface for performing a function of deleting a selected record in some embodiments;

18 is a schematic diagram of an interactive interface for performing a function of clearing all records in some embodiments;

19 is a schematic diagram of an interactive interface for performing an operation of closing this function in some embodiments;

20 is a schematic diagram of an interface for displaying a video highlight file in an image material list interface in some embodiments;

21 is a schematic diagram of an interface for displaying push notifications in some embodiments;

Figure 22 is an interface schematic diagram of a user interface in some embodiments;

23 is a schematic interface diagram of a video list interface in some embodiments;

24 is a schematic interface diagram of a setting interface in some embodiments;

FIG. 25 is an interface schematic diagram of an operation interface in some embodiments.

detailed description

In order to make the objectives, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the exemplary embodiments of the present application. Obviously, , the described exemplary embodiments are only a part of the embodiments of the present application, but not all of the embodiments.

The term "gesture" used in this application refers to a user's behavior that is used by a user to express an expected thought, action, purpose/or result through an action such as a change of hand shape or hand movement.

FIG. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in FIG. 1 , a user may operate the display apparatus 200 through the mobile terminal 300 and the control apparatus 100 .

Wherein, the control apparatus 100 can control the display device 200 by a remote control, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., by wireless or other wired methods. The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, or the like. For example, the user can control the display device 200 by inputting corresponding control commands through the volume up/down key, channel control key, up/down/left/right movement keys, voice input key, menu key, power-on/off key, etc. on the remote control. function.

In some embodiments, mobile terminals, tablet computers, computers, notebook computers, and other smart devices may also be used to control the display device 200 . For example, the display device 200 is controlled using an application running on the smart device. The app can be configured to provide users with various controls in an intuitive user interface (UI) on the screen associated with the smart device.

For example, the mobile terminal 300 may install a software application with the display device 200, and realize connection communication through a network communication protocol, so as to realize the purpose of one-to-one control operation and data communication. For example, a control command protocol can be established between the mobile terminal 300 and the display device 200, the remote control keyboard can be synchronized to the mobile terminal 300, and the function of controlling the display device 200 can be realized by controlling the user interface on the mobile terminal 300. The audio and video content displayed on the mobile terminal 300 may also be transmitted to the display device 200 to implement a synchronous display function.

As also shown in FIG. 1 , the display device 200 also performs data communication with the server 400 through various communication methods. The display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200 . For example, the display device 200 interacts by sending and receiving information, and electronic program guide (EPG), receiving software program updates, or accessing a remotely stored digital media library. The server 400 may be in one group, or in multiple groups, or in one or more types of servers. Other network service contents such as video-on-demand and advertising services are provided through the server 400 .

The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The specific display device type, size and resolution are not limited. Those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as required.

The display device 200 may additionally provide an intelligent network television function that provides a computer-supported function in addition to the function of broadcasting and receiving television. Examples include Internet TV, Smart TV, Internet Protocol TV (IPTV), and the like.

Some embodiments of the present application may be applied to various types of display devices (including but not limited to: smart TVs, set-top boxes, and other devices). The technical solution will be described below with regard to the relevant UI for generating video highlights on the TV.

In some embodiments, the display device adopts the usage scenario of the camera, for example, to record the daily life of pets or people by means of video recording. Taking a pet as an example, since the existing display device is recording video of the pet, it is usually necessary for the user to operate the display device in real time to call the camera to realize image acquisition, and then the video file can be obtained. Therefore, in order for the user to be away from home during the day, the display device can still call the camera to record the wonderful life of the pet, and the video recording function can be configured in the display device to improve the richness of the usage scenarios of the display device using the camera.

After the video recording function in the display device is activated, the display device can call the camera in real time to collect moving image material of the pet. The process of invoking the camera to collect images by the display device in real time does not require real-time operation by the user. As long as the display device is powered on and connected to the Internet, the display device can automatically realize the process. Finally, the display device can also generate a video highlight file based on multiple moving image materials collected by the camera in one day, and push it to the user, so as to prevent the user from missing the wonderful life of pets after leaving home during the day.

In addition to recording the wonderful life of pets, the video recording function can also record other sports targets, such as the user's baby at home. When the video recording function is activated on the display device, as long as moving objects such as pets or babies appear in the shooting area of the camera, the camera will collect moving image materials, and finally generate a video collection file from multiple moving image materials collected in one day. Pushed to the user for viewing the next time the user turns on the display device. The user can know the daily life of the pet or baby at home according to the video collection file, which will bring the user a good experience.

FIG. 2 exemplarily shows a structural block diagram of a display device according to some embodiments. Referring to FIG. 2, in order to facilitate the user to call the camera to record the wonderful life of the pet and generate a video highlight file when he is not at home, some embodiments of the present application provide a display device 200, including a display 275 and a controller 250, and also A camera 232 may be included. The display is configured to present a user interface displaying a video recording start entry for enabling a function to record a moving image and generate a video highlight file by video recording within a preset recording duration; the camera is configured to follow the preset recording duration. Set the collection frequency to collect the moving image material of the moving target, and the moving target refers to the target that needs to record the moving image through video recording within the preset recording duration to generate the video highlight file. In some embodiments, the camera 232 may be built-in to the display device, or may be configured by the user later.

The controller is respectively connected with the camera and the display, and the controller is used to start the video recording function configured in the display device, and call the camera to collect the moving image material of the moving target, and finally generate a video collection file. In order to facilitate the user to operate more quickly and conveniently when interacting with the display device, an interactive method for generating a video collection file is provided, which can instruct the user how to start the video recording function and how to perform an interactive operation on the video collection file.

In order to realize the video recording function, a target application program is configured in the display device, specifically, the target application program is configured in the controller, and the target application program is displayed on the system home page interface of the display device. The target application is used to provide the entry to start the video recording function.

In order for the user interface displaying the video recording initiation portal to be presented on the display, the controller is further configured to:

Step 011A: In response to the device startup instruction generated when the user starts the display device, a system home page interface is presented in the display, and the target application program is displayed on the system home page interface.

Step 012A: In response to the activating instruction generated when the target application is triggered, present a user interface on the display, and the user interface displays a video recording startup entry.

When the user turns on the display device, a device startup instruction is generated. The controller can call up the system home page interface according to the device startup instruction, and display it on the display, and the target application program is displayed on the system home page interface.

The user triggers the target application program through the remote control or voice to generate a call-up command, and the controller calls up the user interface according to the call-up command and displays it on the display. At this time, the content displayed on the display is switched from the home page interface of the display system to the user interface. The user interface is the main page of the target application.

When the user interface is called up, the video recording startup entry is displayed in the user interface. The user clicks the video recording startup entry through the remote control or voice, and the video recording function of the display device can be turned on, that is, the moving image of the moving target can be started. The collection of material, and the generation of video highlight files.

An interface diagram of a user interface according to some embodiments is exemplarily shown in FIG. 3 . Taking the corresponding application as "Xiaojujia at home", see Figure 3, if the target application is "Xiaojuan at home", the user interface displayed after triggering "Xiaojuan at home" will display a video recording start entrance, such as "A Day of My Pet" displayed in the upper right corner of the user interface. Trigger "One day for cute pets" to turn on the video recording function of the display device.

In some embodiments, a video recording startup entry can also be added to the system home page interface in the form of a shortcut, so that after turning on the display device, the user can quickly turn on the display device through the video recording startup entry on the system home page interface. Video recording function.

The user triggers the video recording start entry on the user interface or the system home page interface to generate a video recording start instruction, so that the controller enables the video recording function of the display device, that is, the camera is called to start capturing images. Specifically, the controller generates a video recording start instruction when executing the triggering video recording start entry, and is further configured as:

Step 021A: In response to the start-up instruction generated when the video recording start-up entry is triggered, a function effect display interface is presented on the display, and a confirmation start entry is displayed on the function effect display interface.

Step 022A, in response to triggering the confirmation command generated by the confirmation start entry, cancel the display of the function effect display interface on the display, and generate a video recording start command.

In order to facilitate the user to clearly understand the realization effect of the video recording function when using the video recording function for the first time, a function effect display interface can be displayed on the display when the video recording startup entry is triggered. The content displayed on the function effect display interface includes the function introduction and the effect display that can be obtained.

FIG. 4 exemplarily shows a schematic interface diagram of a function effect display interface according to some embodiments. The pages shown in (a) and (b) of FIG. 4 are exemplary display interfaces of the function effect display interface, and the user can have a certain understanding of the video recording function according to the content displayed on the function effect display interface.

The user triggers the video recording start entry on the user interface or the system homepage interface through the remote control, and a start command will be generated. The controller can call up the function effect display interface shown in FIG. 4 according to the start instruction and display it on the display. At this time, the content displayed on the display is switched from the display user interface to the function effect display interface.

In order to facilitate the user to quickly start the video recording function, a confirmation start entry may be displayed on the last interface of the function effect display interface, such as the "enable" control shown in (b) of FIG. 4 .

The user triggers the confirmation start entry through the remote control, and a confirmation instruction will be generated, indicating that the user wants to start the video recording function. At this time, the controller cancels the display of the function effect display interface on the display according to the confirmation instruction, and generates a video recording start instruction to enable the video recording function of the display device.

In some embodiments, if the user activates the video recording function of the display device for the second or subsequent times (the user activates the video recording function for the first time and then turns it off), when the user triggers the video recording start entry on the user interface, the user can no longer Display the function effect display interface, but directly display the video recording function start interface.

FIG. 5 exemplarily shows a schematic interface diagram of a video recording function startup page according to some embodiments. Referring to FIG. 5 , the user triggers the video recording startup entry in the user interface shown in FIG. 3 to generate a startup instruction, and the controller calls up the video recording function startup interface according to the startup instruction and displays it on the display. At this time, the content displayed in the display The display is switched from the user interface shown in FIG. 3 to the video recording function startup interface shown in FIG. 5 .

A confirmation startup entry is displayed on the video recording function startup interface, such as the “ON” control shown in FIG. 5 . When the user triggers the confirmation start entry, a confirmation command will be generated. At this time, the controller cancels the display of the video recording function startup interface on the display according to the confirmation instruction, and generates a video recording startup instruction to enable the video recording function of the display device.

After the video recording function of the display device is turned on, an image material list interface is displayed on the display, that is, the controller calls up the image material list interface and displays it on the display in response to the confirmation instruction. The image material list interface is used to display moving image materials. and Video Highlights files. At this time, the content displayed on the display is switched from displaying the function effect display interface shown in FIG. 4 (or the video recording function startup interface shown in FIG. 5 ) to the image material list interface.

In some embodiments, if the user starts the video recording function of the display device for the first time, it means that the camera has not captured any moving image material, and no video collection file has been generated, therefore, nothing is displayed in the image material list interface. .

FIG. 6 exemplarily shows a first interface diagram of an image material list interface according to some embodiments. When the user starts the video recording function for the first time, the content displayed in the image material list interface is as shown in (a) of FIG. 6 . At this time, the prompt content "No pet has been found" is displayed in the image material list interface, and the operation prompt item "Press the menu button to close the function or share and delete the video" is displayed in the upper right corner of the image material list interface.

Since nothing is displayed in the image material list interface, the menu key is triggered at this time, and only the closing function can be realized. According to the operation prompt, the user triggers the menu key configured on the remote control to call up the floating layer, as shown in (b) in Figure 6, "Close this function". The user can then trigger the confirm button on the remote control to execute "close this function" to close the video recording function.

In some embodiments, if the user starts the video recording function of the display device for the second or subsequent times instead of starting it for the first time, it means that the camera has collected moving image material, and may also have generated a video highlight file. At this time, the image In the material list interface, the moving image material collected by the camera and the video collection file generated by the controller history will be displayed.

FIG. 7 exemplarily shows a second interface diagram of an image material list interface according to some embodiments. When the user activates the video recording function for the second or subsequent times, the content displayed in the image material list interface is as shown in FIG. 7 . At the same time, the upper right corner of the image material list interface presents the operation prompt item "Press the menu key to close the function or share and delete the video".

After the user triggers the video recording startup entry through the remote control, the video recording function of the display device can be turned on. That is to say, the display device can actively call the camera in real time to collect the moving image material of the moving target without the user's real-time operation, and after completing the video recording of the day, generate a video collection file from multiple moving image materials. The file is a record of the daily life of the sports target.

In some embodiments, in a display device provided by some embodiments of the present application, when executing the interactive method for generating a video highlight file, the controller of the display device is configured to perform the following steps:

S11A. Receive a video recording start instruction generated when a video recording start entry is triggered, where the video recording start instruction is used to instruct the camera to collect moving image material of a moving target according to a preset collection frequency within a preset recording duration.

The user triggers the video recording start entry on the user interface or the system home page interface, and the video recording start command can be generated. Moving image footage. The moving image material includes moving pictures or moving videos.

Since the separation time between the user and the pet or the baby is usually during the day, that is to say, the display device only needs to record the living conditions of the pet or the baby during the day, so the preset recording duration can be set. The preset recording duration is the time period during which the controller automatically calls the camera to collect moving image materials.

In some embodiments, the preset recording duration may be set to 6:00-18:00, that is, the controller invokes the camera to capture the moving image material within the time period of 6:00-18:00. In other embodiments, the preset recording duration may also be set to other time periods according to the actual application situation of the user.

When the camera collects the moving image material of the moving target, if the moving target always maintains a posture and does not move within the shooting range of the camera, then the moving image material collected by the camera has the same content. In order to prevent the camera from collecting the same material for a long time and occupying too much storage space, in some embodiments, the camera may be controlled to collect the moving image material of the moving target according to the preset collection frequency.

In some embodiments, the camera is further configured to perform the following steps when performing acquisition of moving image material of a moving target according to a preset acquisition frequency:

S111A. Receive a camera calling instruction generated by the controller in response to the video recording start instruction.

After the controller receives the video recording start instruction, it can call the camera for image acquisition. To this end, after the controller receives the video recording start command, it generates a camera call command and sends it to the camera, and the camera can start and start collecting moving image materials of the moving target according to the camera call command.

However, since the camera may be called by other applications, at this time, the controller cannot call the camera to collect the moving image material of the moving target. To this end, the controller needs to first determine that the camera can be called, and if it can be called, send a camera calling instruction to the camera.

In some embodiments, the controller is further configured to perform the following steps before sending the camera invocation instruction to the camera, i.e., when executing the video recording start instruction in response to the execution of the camera invocation instruction:

Step 1111A: Acquire the current operating state of the camera in response to the video recording start instruction.

Step 1112A: If the current operating state of the camera is not called, generate a camera calling instruction, and the camera calling instruction is used to call the camera to collect moving image materials.

The controller obtains the current operating state of the camera according to the video recording start instruction to determine whether the camera can be called. And when it is determined that the camera is not in a state of being called, it means that at this time, the camera can be called to execute the collection of moving image materials of the moving target.

At this time, the controller generates a camera call instruction and sends it to the camera to start the camera and call the camera to collect moving image materials.

After the video recording function is activated, as long as the camera is not occupied by other applications, the controller calls the camera to continuously collect the moving image material of the moving target.

In some embodiments, a moving object refers to a non-static object in the image captured by the camera. In some embodiments, the moving target representation is a pet, a person, a movable object.

In some embodiments, a moving image refers to an image containing a moving object.

S112A, in response to the camera calling instruction, from the initial moment of the preset recording duration, collect the moving image material of the moving target according to the preset collection frequency.

S113A. When the end time of the preset recording duration is reached, the collection of the moving image material of the moving object is ended.

After the camera receives the camera calling instruction sent by the controller, the camera will execute the instruction every day to collect moving image materials for the moving target. Therefore, the moment when the image material of the camera starts to be collected is the initial moment of the preset recording duration.

The camera collects the moving image material of the moving target according to the preset collection frequency every day from the initial moment of the preset recording duration, until the end time of the preset recording duration is reached. For example, the camera starts to collect moving image material of the moving target at 6:00 every day, and ends the collection at 18:00.

When the end time of the preset recording duration is reached, the controller generates a camera stop calling instruction and sends it to the camera to control the camera to end the collection of moving image material of the moving target.

After the camera is called, it does not always collect images, but starts to collect moving image materials after the moving target appears within the shooting range of the camera, so as to prevent the camera from collecting useless image materials and causing waste of resources.

In some embodiments, in order to accurately determine that the camera can capture the moving image material including the moving target, the controller collects the moving image material of the moving target according to the preset collection frequency from the initial moment when the camera performs the preset recording duration, is further configured to perform the following steps:

Step 1121A: Acquire a preview image captured by the camera from the initial moment of the preset recording duration.

Step 1122A: Perform image recognition on the preview image to determine whether there is a moving object in the preview image.

Step 1123A: If there is a moving object in the preview image, call the camera to collect the moving image material of the moving object according to the preset collection frequency.

After the camera is called, from the initial moment of the preset recording duration, the camera will capture the preview image in real time. Since the preview image indicates that no video recording is performed, the problem of occupying storage space will not occur.

The controller performs image recognition on the preview image collected by the camera in real time, and determines whether the moving target appears in the shooting area of the camera according to the image recognition result. Only when the moving target appears in the shooting area of the camera, will the camera be called to collect the moving image material of the moving target.

After judging that there is a moving target in the preview screen, the controller can send a control command to the camera. At this time, the camera receives the control command and can collect the moving image material of the moving target according to the preset collection frequency.

In some embodiments, in order to avoid the situation that the camera continuously collects the moving object that has not changed its motion state in a short period of time, the collection process may be performed only once when the moving object appears in the shooting area of the camera. The preset collection frequency collects the moving image material of the moving object, and is further configured to: when there is a moving object in the preview screen, call the camera to perform a process of collecting the moving image material of the moving object.

When the controller determines that there is a moving target in the camera shooting area through image recognition, it only calls the camera to collect a piece of moving image material of the moving target. If the moving target exits the camera shooting area and enters the camera shooting area again, it calls the camera again A moving image footage of a moving target.

For example, if the moving object enters the shooting area of the camera at 9:00, the camera is called to collect the first piece of moving image material, and the moving object exits the camera shooting area at 9:10; When it enters the shooting area of the camera again, the camera is called again to collect the second piece of moving image material, and the moving target exits the shooting area of the camera at 10:40. It can be seen that between 9:00 and 9:10, the camera only collects a piece of moving image material, and between 10:23 and 10:40, the camera also collects only one piece of moving image material. The acquisition process of the camera is analogous and will not be repeated here.

In other embodiments, the preset collection frequency includes a preset collection duration and a preset collection interval; then, the camera is further configured to:

Step 11231A: From the moment when it is determined that there is a moving object in the preview screen, collect the first piece of moving image material of the moving object according to the preset collection duration.

Step 11232A: After the preset collection interval has elapsed, collect the second segment of moving image material of the moving target according to the preset collection time.

From the moment when it is determined that there is a moving object in the preview screen, that is, after receiving the control command sent by the controller, the first piece of moving image material of the moving object starts to be collected, and the duration of the first piece of moving image material is the preset collection time. .

In order to avoid the situation that the camera collects the moving target that has not changed its motion state in a short time, it is necessary to control the camera to wait for a period of time after completing the collection of a piece of moving image material, and then collect the next piece of moving image material. That is, after collecting the first piece of moving image material, the camera waits for the preset collection interval, and then collects the second piece of moving image material of the moving target again, and the duration of the second piece of moving image material is the preset collection time.

It should be noted that the "first" and "second" here are only the process of distinguishing two adjacent acquisitions by the camera, and do not limit the number of segments of the moving image material.

In some embodiments, the preset collection duration may be set to 5s, and the preset collection interval duration may be set to 2s. That is to say, when the moving target is located in the shooting area of the camera, the moving image material collected by the camera is 5s long, and the interval between two adjacent collections is 2s.

If the moving object walks out of the shooting area of the camera again, the controller performs image recognition on the image captured by the camera again. If it is recognized that there is no moving object in the shooting area of the camera, the camera is controlled to stop collecting moving images.

That is to say, in the process of capturing the moving image material of the moving target by the camera, image recognition is performed on the captured image of the camera in real time. Once it is recognized that the motion does not appear in the captured image, a stop control instruction is immediately sent to the camera, so that the camera Stop collecting.

Within the preset recording time, the moving target may appear in the shooting area of the camera for many times, and there will be various motion states in the shooting area of the camera, so the camera may collect multiple moving images according to the preset collection frequency material.

S12A. When the end time of the preset recording duration is reached, acquire several moving image materials of the moving target captured by the camera within the preset recording duration.

After the display device starts the video recording function, as long as the camera is not occupied by other applications, it will always be in the state of collecting image materials. The moment when the camera stops capturing the moving image material of the moving target is the end moment when the preset recording duration is reached. For example, when the current 18:00 is reached, the controller generates a stop control instruction and sends it to the camera to control the camera to stop capturing motion. Targeted moving image footage.

At this time, within the preset recording duration, the camera may collect several moving image materials, and the controller may acquire several moving image materials to synthesize the video highlight file.

S13A, splicing and synthesizing a specified number of moving image materials to generate a video collection file for recording the moving target within a preset recording time length.

In order to ensure that the synthesized video collection file meets the requirements of short videos, when synthesizing multiple moving image materials into a video collection file, it is necessary to synthesize a specified number of video collection files. In some embodiments, the specified number may be set to 6 segments, and the 6 segments of moving image materials are synthesized in the order of acquisition time. For example, if the duration of each moving image material can be 5s, the total duration of the video highlight file synthesized from 6 segments of the moving image material is 30s.

Each moving image material includes the movement of the moving object, and the video collection file is to record the movement of the moving object within the preset recording duration. When viewing a video collection file, users can watch the wonderful life of a moving target, such as a pet or a baby, within a preset recording time.

Due to the preset recording duration, the camera may collect a large number of moving image materials, or may only collect a few pieces of moving image materials. Therefore, in order to ensure that the controller can generate a short video that meets the requirements of the duration when generating the video highlight file, before generating the video highlight file, it can be judged whether the total number of moving image materials collected by the camera within the current preset recording duration meets the specified number. requirements.

In some embodiments, in order to quickly and accurately generate a video collection file that meets the short video requirements, the controller performs splicing and synthesis of a specified number of moving image materials to generate a video collection that records the moving object within a preset recording duration. file, is further configured to perform the following steps:

S131A: Acquire the total number of moving image materials collected by the camera within a preset recording time period.

S132A. If the total number of materials is less than or equal to the specified number, splicing and synthesizing the moving image materials of the total number of materials in chronological order.

S133A. If the total number of materials is greater than a specified number, select a specified number of target moving image materials in the moving image material set.

S134A, splicing and synthesizing a specified number of target moving image materials in a chronological order to generate a video collection file that records the moving target within a preset recording duration.

Every time a piece of moving image material is collected by the camera, it will be sent to the controller. Within the preset recording time, the controller can count the total number of moving image materials collected by the camera.

In some embodiments, the total duration of the synthesized video collection file is about 30s, which meets the duration requirement of short videos. That is to say, a maximum of 6 moving image materials are required for synthesis. If the total number of materials exceeds 6, the From the total number of materials, 6 suitable moving image materials are selected for synthesis.

Compare the total number of moving image materials collected by the camera with the specified number. If the total number of materials is less than or equal to the specified number, it means that the duration requirements for synthesizing short videos are met. Time sequence for splicing synthesis.

If the total number of materials is greater than the specified number, it means that if the moving image materials of the total number of materials are combined into a video collection file, the total length of the video collection file will exceed the duration of the short video, and the video collection file is not in compliance with the requirements. Therefore, in order to ensure the smooth synthesis of the video highlight file, the controller may select a specified number of target moving image materials in the moving image material set corresponding to the total number of materials. The specified number of target moving image materials are then spliced and synthesized in time sequence to generate a video highlight file that records the moving target within the preset recording duration.

For example, if the specified number is set to 6 segments, and the total number of moving image materials is 5 segments, then the 5 segments of moving image materials can be directly spliced and synthesized to obtain a video collection file; and if the total number of moving image materials is 5 segments 10 segments, then it is necessary to select a suitable target moving image material from the 10 segments of moving image materials, and then splicing and synthesizing the 6 segments of the target moving image material to obtain a video highlight file.

In some embodiments, when the total number of materials exceeds a specified number, and a specified number of target moving image materials are selected from the moving image material set corresponding to the total number of materials, the time span between the selected target moving image materials may be large according to the Some. For example, if the camera captures moving image materials in the first, middle, and last time periods of the preset recording duration, then when selecting the target moving image material, it is necessary to ensure that there are moving materials in the first, middle, and last time periods. was selected to ensure a richer life situation for moving objects contained in composite video highlight files.

To this end, when the controller performs step 133, that is, if the total number of materials is greater than the specified number, selecting a specified number of target moving image materials in the moving image material set, is further configured to perform the following steps:

Step 1331A: Acquire the start time of acquisition of each piece of moving image material.

Step 1332A: Divide the start acquisition time corresponding to each piece of moving image material into multiple material collection periods according to the period of the start acquisition time, and each material acquisition period includes multiple motion image materials.

Step 1333A: Select a target number of moving image materials in each material collection period, respectively, as the target moving image material, and the sum of the respectively selected target numbers in each material collection period is equal to the specified number.

When the camera is collecting moving image material, it will use the start time to mark the time of each moving image material. Therefore, the time period when each moving image material is collected can be determined, that is, before, in the middle or after the preset recording time. period of time.

For example, if the preset recording duration is 6:00-18:00, the former period may refer to the morning period, the middle period may refer to the noon period, and the latter period may refer to the afternoon period. According to different settings of the preset recording duration, the division of the time period will also be different, and the number of divisions of the time period may also be determined according to the actual situation.

After each piece of moving image material is marked with the time period to which it belongs, it can be divided into multiple material collection periods according to the start time of collection, for example, the material collection periods are morning period, noon period and afternoon period. Each material collection period will include at least one piece of moving image material.

In order to ensure that the time span of multiple moving image materials of the composite video collection file is large, a certain number of moving image materials may be selected respectively in each material collection period. _{For example, n 1} moving image materials are selected in the morning period _{, n 2} moving image materials are selected in the noon period _{, and n 3} moving image materials are selected in the afternoon period. Among them, it is necessary to ensure that n ₁ +n ₂ +n ₃ = the specified number.

Finally, the selected n ₁ moving image materials located in the morning period, n ₂ _{moving image materials located in the noon period, and n 3} moving image materials located in the afternoon period are spliced according to the chronological order of the starting time of collection Synthesize to get a video highlight file.

In some embodiments, in order to improve the viewing effect of the video collection file, background music may be automatically superimposed when synthesizing the video collection file, and a start-up watermark may be added to the video collection file.

In some embodiments, in order to improve the viewing effect of the video highlight file, the controller is further configured to:

S141A, splicing and synthesizing a specified number of moving image materials to obtain a video file for recording the moving object within a preset recording duration.

S142A: Acquire a preset audio file and a broadcast start watermark, where the start broadcast watermark is used to identify product information of the display device.

S143A, superimposing the audio file, the start-up watermark and the video file to generate a video highlight file for recording the moving target within a preset recording duration.

First, splicing and synthesizing a specified number of moving image materials, which can be pictures or videos, to obtain a video file. There are multiple audio files preset in the controller, and one of the audio files is randomly selected to be synthesized with the video file.

At the same time, obtain the start-up watermark and add it to the screen of the video file. In order to avoid blocking the video content, the start-up watermark can be added in the lower right corner of the screen, and the actual addition position can be set according to the user's preference. The start-up watermark is used to identify the product information of the display device.

FIGS. 8-12 show schematic diagrams of operation interfaces of video highlights in a TV according to some embodiments of the present application.

Among them, FIG. 8 shows a schematic diagram of a possible TV application interface in some embodiments of the present application.

In some embodiments, this function may be performed by a separate application, or may be a function integrated in a system application.

The figure shows the application UI interface of the TV displayed on the display screen. For example, the application UI interface includes 4 applications installed on the TV, namely news headlines, theater on-demand, video highlights, K-songs, and so on. Different applications, or other function buttons can be selected by moving the focus on the display using a controller such as a remote control.

In some embodiments, the TV display screen is configured to display other interactive elements while displaying the application UI interface, and the interactive elements may include, for example, TV homepage controls, search controls, message button controls, mailbox controls, browsing Controls, Favorites Controls, Signal Bar Controls, etc.

In order to improve the convenience and visualization of the UI of the TV, in some embodiments, the first controller of the display device in some embodiments of the present application controls the UI of the TV in response to the operation of the interactive element. For example, when a user clicks a search control through a controller such as a remote control, the search UI can be displayed on top of other UIs, that is, the UI of the application component that controls the mapping of interactive elements can be enlarged, or run and displayed in full screen.

In some embodiments, the interactive element may also be operable by a sensor, which may be, but is not limited to, an acoustic input sensor, such as a microphone, that can detect voice commands that include an indication of the desired interactive element. For example, the user may identify the desired interactive element using "video highlights" or any other suitable identification, such as a search control, and may also describe the desired action to be performed in relation to the desired interactive element. The first controller may recognize the voice command and submit data characterizing the interaction to the UI or its processing component or engine.

FIG. 9 shows a schematic diagram of an interface for selecting a slave program of a video collection application according to some embodiments of the present application.

In some embodiments, the user can control the focus of the display screen through the remote control, select the Video Highlights application, and engage in having its icon highlighted on the display screen; then by clicking on the highlighted icon, it can be opened Icon mapping application.

It should be noted that the icons and text of the UI interface in some embodiments of the present application are only used as examples to illustrate the technical solution for generating video collections. The icons and text of the UI interface in the accompanying drawings can also be implemented as other contents. No specific restrictions are made.

FIG. 10 shows a schematic interface diagram of how to browse the video collection after the video collection is generated according to some embodiments of the present application.

In some embodiments, the first controller of the display device provided by the present application generates multiple video highlights according to different elements, as shown in FIG. 10 .

Among them, the first video collection file is generated with pet elements, the second video collection file is generated with highlights as elements, the third video collection file is generated with smiles as elements, and the fourth video collection file is generated with other content as elements. .

In some embodiments, the video collection icon includes a schematic diagram and an editing area defined to display the type of elements of the video collection, or the time it was generated, or other information. For the selected first video collection file, the first controller will highlight it and lock the other video collections in gray.

It should be noted that the element types of the video collection in the figure are only examples. This application describes the technical solutions and display devices for generating video collection files with the theme of pets, wonderful moments, and smiles. The video collection is summarized into other types of fourth video collection files. In some embodiments, the subject type of the first video highlight file may also be "father", "stranger", or "designated person", and the first controller of the display device uses an image recognition algorithm to identify the video highlight file to configure.

FIG. 11 shows a schematic diagram of an interface after a video collection is generated according to another embodiment of the present application.

The first controller of the display device selects part of the videos uniformly according to the time sequence of the acquired video clips to generate a video highlight file.

In some embodiments, the generation date of the first video collection file is June 2, the generation date of the second video collection file is June 3, and the generation date of the third video collection file is June 4. The first controller automatically generates video highlight files at fixed time intervals, and displays them on the UI, for example, the fixed time can be implemented as 8:30 am every day.

In some embodiments, the element type of the first video collection file may be preset, or by default, the constituent video segments of the first video collection file are moving target videos randomly obtained by a TV camera. For example, the video clips such as the active person and the active pet captured by the camera may constitute the first video highlight file.

In some embodiments, the display device is configured to display the most recent 30 video collections on its display screen, and when the generated video collection files exceed 30, the first controller deletes the video collection files with an earlier generation time.

In some embodiments, after the video highlight file of the day is generated, the first controller actively deletes the video clips involved in the video highlight file, so as to optimize the storage resources of the TV.

In some embodiments, the video clips collected by the display device and the generated video highlight files may be stored in a NAS (Network Attached Storage: network attached storage). For example, it can be implemented to allow up to 30 video highlight files to be stored on the NAS to optimize storage resources. In some embodiments, if the NAS space is insufficient, the video collection file with an earlier generation time can be deleted.

FIG. 13 shows a schematic flowchart of a method for generating a video highlight in some embodiments of the present application.

In step 701, in response to the received trigger signal, the camera is controlled to acquire video clips.

The display device provided in this application includes a camera, a microphone, a display screen, and a first controller. The camera is a TV image collector, which can be used to collect external environmental scenes; the display screen is used to display a user interface; the first controller correspondingly displays the trigger signal received by the device, and controls the camera to obtain its monitoring range video clips inside.

In some embodiments, the trigger signal includes a signal of movement of an object within a detection range monitored by the camera or a sound signal within a detection range monitored by the microphone.

The first controller controls the camera to capture a preset moving target and record and obtain corresponding video clips. When the camera of the TV detects an active target, video recording is started to obtain video clips. For example, the movement of objects and sounds within the detection range are monitored by a camera and a microphone, and the first controller adjusts the camera so that the shooting target is located at the center of the video clip. After the camera captures the moving image in the field of view, the first controller will adjust the steering and angle of the camera to achieve automatic follow focus on the shooting target, so that the shooting target is always dynamically in the center of the video clip during the recording stage, so as to improve the performance of the camera. The image quality of the video clip.

For another example, the microphone is a sound collector of a TV, and is used to receive the user's voice, control commands, or ambient sound. For the sound detected by the microphone, the first controller adjusts the steering and angle of the camera according to the sound source localization algorithm, so that the shooting target enters the field of view of the camera, and further uses the camera to accurately capture the shooting target through the above method. In some embodiments, different users are first determined by collecting the voiceprint features of the users. Everyone's pronunciation capacity and pronunciation frequency are different, which leads to the formation of each person's unique voiceprint.

For another example, the voiceprint feature can be extracted according to the audio collected by the microphone, such as through Mel Frequency Cepstral Coefficents (MFCC), short-term energy, short-term average amplitude, short-term average zero-crossing rate, resonance Peak, Linear Prediction Cepstral Coefficient (LPCC) and other methods. Then, sound source localization technology is used to determine the speaker's position in the space. Specifically, the position of the speaker corresponding to the audio can be determined through the time delay of the audio collected by the multiple sound collection modules. Finally, according to the located position, the first controller adjusts the camera so that the speaker corresponding to the audio is located in the center of the camera's shooting screen, and the adjustment includes adjusting the camera's shooting angle and/or adjusting the camera's focal length. Based on the located position, the bearing and distance of the speaker corresponding to the audio relative to the camera can be determined.

It should be noted that, for image acquisition, especially for image acquisition aimed at the speaker, the camera is adjusted for the purpose of acquiring a clear and easily recognizable image of the speaker. Therefore, the adjustment can be to adjust the shooting angle of the camera, so that the adjusted camera is aimed at the speaker corresponding to the audio; it can also be to adjust the focal length of the camera, so as to ensure the proportion of the speaker's portrait in the collected image and ensure that the audience is watching. The speaker can be accurately identified through the image; it is also possible to adjust the shooting angle and focal length of the camera at the same time, which is determined according to the actual situation, that is, according to the determined distance and orientation to determine whether the shooting angle and focal length need to be adjusted. Wherein, the shooting target may also be pets or other elements.

In some embodiments, the camera is configured to stop acquiring the video clip for the first controller when called by other applications.

When the camera is called by other applications, the first controller stops acquiring video clips; when the video highlight function is enabled, the first controller starts to control the camera to acquire the video clips. When the video collection function of the TV is turned on, the first controller will control the camera to automatically capture video clips and store them. When the first controller detects and determines that the camera is called by another application, it stops acquiring video clips, or suspends acquiring video clips. For example, when the camera is used for a video call, the Video Highlights application pauses, or stops capturing video clips. If the video highlight function of the TV is turned off, even if the camera is not occupied, the first controller will not control the camera to record video clips, and the first controller stops the camera from performing monitoring activities.

Continuing to refer to FIG. 13 , in step 702 , image recognition is performed on the video clips within a preset time period to obtain a first video set, where the first video set is a video clip set containing the same elements.

Taking the first video collection file of the pet cat type as an example, the first controller performs image recognition on multiple video clips obtained by the camera based on an image recognition algorithm, and takes all the video clips containing the pet cat as the first video set. , the pets contained therein are also called elements, that is, the first video set is a set of video clips containing the same element of pet cats.

The first controller identifies that the video segment can generate a plurality of video collections, corresponding to different video collection files. As shown in FIG. 6C , the first video collection file of the pet type corresponds to the first video collection; the second video collection file of the highlight type type corresponds to the second video collection; the third video collection file of the smile type corresponds to the third video Collection; other types of fourth video collection files, corresponding to the fourth video collection.

The first video collection is a collection of video clips containing the same elements, which may be implemented as highlights, or pets, or smiles, or people, or others. For example, when the element of the first video highlight file is a person, the first controller will identify a video clip containing a person and construct a first video set, wherein the first video set can be implemented as a video set of the same person, or can also be implemented A collection of videos for different people.

In some embodiments, to identify the video clips whose elements are highlight moments, for example, by detecting the sound in the video clips, that is, to determine the video clips containing audience applause or applause content, the elements are considered as highlight moments; another example It can be determined whether the key frame in the video clip contains a character or object movement or whether the key action in the change contains a preset motion trajectory, such as a flip, or a preset stance, etc. By detecting whether the voice contained in the video clip matches the preset voice model, for example, the model is set to "great", "really amazing", etc., it is determined that the elements of the video clip are wonderful moments.

In some embodiments, identifying and classifying video clips whose elements are pets, for example, can identify and classify whether there are active pets in the video clips; Identify and classify the presence of active characters; identify the video clips whose elements are smiles, for example, by identifying whether there is a smiling face in the video clips for identification and classification; Video clips of smiles, people, highlight elements are categorized as other video collections.

In some embodiments, the first controller splicing the video clips in the first video set into a first video clip file includes the first controller performing a video clip in the first video set The importance is scored to obtain the first video sequence; the first video sequence is sorted from high to low according to the importance score, and the video clips of the pre-set number of splices are set as the target video; the first video sequence is The target video in the splicing is performed to generate a first video collection file.

The first controller evaluates the importance degree of the video clips in the first video set through the identification algorithm, and evaluates the importance score to obtain the first video sequence, and then sorts the video clips from high to low according to the importance score of each video clip , and set the video clips of the previous preset splicing number as the target video.

In some embodiments, the image set of the same recognition target may also be divided into different sets according to time periods. In some embodiments, the same identification target within a predetermined time period may generate highlights corresponding to different time periods.

Taking the first video set whose elements are highlights as an example, which includes 8 video clips, in some embodiments, the first controller is configured to classify the importance of the cheering sound by identifying the length of the cheering sound in the 8 video clips. value, the longer the cheering sound, the higher its importance score, then determine the video clips in the first video sequence with the pre-set number of splicing as the target video, and splicing the determined target video to generate the first video highlight file .

For another example, the first controller inputs the video clips into the trained neural network model, analyzes and obtains the video dimension features of the video clips, and then inputs the video dimension features into the binary classification algorithm model to obtain the wonderful probability distribution and the non-wonderful probability distribution of the video clips. , so as to obtain the first video sequence. The neural network model can be implemented as an I3D model, which has a pre-trained model on the largest 400-category dataset in the recognition field, kinetics. The kinetics 400-category dataset has about 250,000 video clips, which can fully and effectively train the neural network and make the network Has a certain generalization ability. The output of the two-class algorithm model is a 2-dimensional data, which is also the probability distribution of the wonderful and non-wonderful video clips. For example, the output two-dimensional data is [0.8, 0.2], then 0.8 means that the corresponding video clip is The probability of a highlight moment is 0.8, and 0.2 means that the probability that the corresponding video clip is a non-highlight moment is 0.2.

In some embodiments, taking another first video set as an example, the importance score of the video segment, the first controller may be implemented to perform the importance score by identifying the color feature value of the video segment, the image quality The higher the feature value is, the higher the importance score is, and the first video sequence whose importance score is arranged from high to low is obtained. For example, the picture quality feature value is implemented as a weighted summation of the chrominance, luminance, and saturation of the images in the video segment. The chromaticity is the sum of the background chromaticity of the image and the foreground chromaticity, the background chromaticity refers to the chromaticity of the background area of the image, and the foreground chromaticity refers to the chromaticity of the foreground area of the image. The size of the weight can be preset according to the actual situation, for example, the weights of chroma, brightness, and saturation are set to 0.5, 0.3, and 0.2 respectively; then the chroma, brightness, and saturation of the image are weighted and summed to obtain a video clip image quality characteristic value.

For another example, taking the first video set whose elements are people, pets, or smiles as an example, and the importance scores of the video clips, the first controller may be implemented to identify people, pets, or smiles in the video clips. The first video sequence is obtained by scoring the importance of the number of frames. The higher the number of frames, the higher the importance score. It can be determined that the video clips with the pre-set number of splicing can be set as the target video, and the determined target video can be spliced to generate First Video Highlights file.

The execution of the first video set and the subsequent processing steps by the first controller may be performed at fixed time intervals, so that the television can obtain enough video clip materials. It can also be implemented as triggering the generation of the first video collection in real time after receiving the user's instruction. For example, the first controller processes the video clips to generate the first video collection within a preset time period after the user turns on for the first time every day; for another example, the first controller may be configured to generate the first video collection at a fixed time every day; and For example, the first controller may be configured to execute the generation of the first video collection at a preset time point every day when the TV is turned on.

In some embodiments, the first controller performs image recognition on the video clips within a preset time period to obtain the first video set, including the first controller receiving an input bright screen instruction; after receiving the bright screen When the time of the screen command is earlier than the preset time point, continue to control the camera to obtain video clips; when the time when the screen brightening command is received is later than the preset time point, the video clips within the preset time period are processed. Image recognition is performed to obtain a first video set, and the video clips in the first video set are spliced into a first video collection file.

For example, the preset time point is configured as 20:00, and the preset time period is configured as 6:00-22:00. When the user turns on the TV using the remote control at 19:00 at night, the first controller receives the input Bright screen command, since the time when the display device receives the screen bright command is earlier than the preset time point 20:00, the first controller continues to control the camera of the display device to obtain video clips; when the user uses the remote control at 20:10 in the evening Turn on the TV, and the first controller receives the input bright-screen instruction. Since the time when the display device receives the bright-screen instruction is later than the preset time point 20:00, the first controller is responsible for the preset time period from 6:00 to 20:00. Perform image recognition on the video clips within 22:00 to obtain a first video set, and splicing the video clips in the first video set into a first video highlight file.

In some embodiments, after the first controller receives the bright-screen instruction, the first controller is further configured to: after monitoring the generated first video highlight file, control the display to display a video highlight interface, so that the The video collection interface is provided with a control for jumping to the playback interface of the first video collection file; when the generated first video collection file is not detected, the display is not controlled to display the video collection interface.

For example, after the display device is powered on, the first controller detects the video collection file produced on the previous day, and the first controller will display the video collection UI, where the video collection UI includes a plurality of video collection files of different types of elements, or all The video collection UI may include a plurality of video collection files generated on different dates. In some embodiments, as shown in FIG. 10 , the video collection UI is further provided with a control for jumping to the playback interface of the first video collection file. For example, by clicking the highlighted icon of the first video collection file, you can enter all Describe the playback UI of the first video collection file.

In some embodiments, the first controller performing image recognition on the video clips within a preset time period to obtain the first video set includes that, at a preset time point, the first controller performs image recognition on the video clips within the preset time period. The first video set is obtained by performing image recognition on the video clips of , wherein the preset time point is located after the preset time period.

For example, the preset time point is configured as 20:00, and the preset time period is configured as 8:00-17:00. When the TV is turned on at 20:00 in the evening, the first controller presets A first video set is obtained by performing image recognition on the video clips acquired in the time period of 8:00-17:00, and the video clips in the first video set are spliced into a first video highlight file.

The user configures the display device to generate a first video collection after the display device is turned on, and the first controller splicing the video clips in the first video collection into a first video collection file includes that the first controller receives the input brightness. A screen instruction; in response to the screen bright instruction, splicing the video clips in the first video collection into a first video collection file.

For example, the preset time period is configured as 8:00-17:00. When the user turns on the TV at any time, the first controller receives the input bright screen instruction, and the first controller responds to the preset time period 8:00-17. : Perform image recognition on the video clips within 00 to obtain a first video collection, and splicing the video clips in the first video collection into a first video collection file. When the user's power-on time is earlier than the preset time period, the first controller performs image recognition on the video clips in the preset time period 8:00-17:00 of the previous day to obtain a first video set, and converts the The video clips in the first video collection are spliced into a first video collection file; when the user's power-on time is in the preset time period, the first controller converts the video collected from the time period 8:00 to the current power-on time Perform image recognition on the clip to obtain a first video set, and splicing the video clips in the first video set into a first video clip file; when the user's boot time is later than the preset time period, the first control The device performs image recognition on the video clips in the preset time period of the day from 8:00 to 17:00 to obtain a first video set, and splices the video clips in the first video set into a first video highlight file.

Continuing to refer to FIG. 13, in step 703, the video clips in the first video collection are spliced into a first video collection file.

Obtain the first video sequence with the importance score from high to low in the first video set, set the video clips of the pre-set splicing quantity as the target video, and splicing the target video to obtain the first video collection file. For example, the first video collection file consists of 5 video clips, and the first video sequence includes 8 video clips, and the 5 video clips constituting the final first video collection are the target videos. By splicing the target videos, a final first video collection file can be generated.

In some embodiments, the first controller sorts the first video sequence from high to low according to the importance score, and sets the video segments of the first preset number of splicing as the target video. Wherein, the preset number of splicing is configured as the number of video clips constituting the first video collection. For example, the preset number of splices is set to 5, the first video sequence includes 8 video clips, and is sorted according to the importance score from high to low. The first controller will select the first 5 video clips and splicing them to generate the first video collection file.

In some embodiments, after the display device generates the first video highlight file, the first controller deletes the video segment. After the first video sequence is generated, if the preset number of splices is determined, in order to save the storage resources of the TV, the first controller will delete other video clips except the target video, so that the first video set and the first video sequence are Only the target video is included; or after the first video collection file is generated, in order to save the storage resources of the TV, the first controller will delete all video clips in the first video collection.

In some embodiments, after the display device generates the first video highlight file, the first controller deletes the video segment. After the first video collection file is generated, in order to save the storage resources of the TV, the first controller will delete all video clips in the first video collection.

In some embodiments, according to different elements, the first controller configures different background music for the first video highlight file. When the first video collection is generated, the first controller configures different background music for the first video collection according to different elements, that is, different theme types and different types of video clip materials. For example, in the first video collection file about pets in FIG. 10 , its background music is configured as light music; for the second video collection file about highlight moments, its background music is configured as rock music and so on.

In some embodiments, after the first video collection file is generated, the first controller pushes the first video collection file to display on the display screen, and deletes the video clips in the first video collection. The first controller pushes the generated first video collection to the user on the TV side. It should be noted that the pushed video collection file that the user receives every day is not necessarily the last generated video collection file, and it can also be implemented as a random push video collection file. Generated and saved video highlight files. And after the first video highlight file is obtained, the first controller will delete its corresponding video segment.

FIG. 12 shows a schematic diagram of an interface for playing the first video collection in some embodiments of the present application.

Click to confirm the playback control of the selected high-brightness video collection file, and the video can be played. As shown in the first video collection shown in the figure, the element of the first video collection is pets. In some embodiments, the area of the play area of the first video highlight file is relatively large, for example, the play area occupies at least two-thirds of the display UI, so that the content can be displayed more clearly, the UI of the TV Corresponding application components can be defined.

In some embodiments, the playback area of the first video collection file may further define a timeline component, and the user can control the playback progress of the first video collection file by operating the timeline component.

Based on the above-mentioned embodiments, the present application also provides a display device and a method for generating a video collection. The same points as the above-mentioned embodiments will not be repeated in the following embodiments, and the following will focus on the differences from the above-mentioned embodiments. Expand the elaboration.

FIG. 14 shows a method for generating a video collection according to another embodiment of the present application.

In step 801, in response to the received trigger signal, the camera is controlled to acquire a video clip containing a shooting target within a preset time period to obtain a first video set.

In response to the received trigger signal, the first controller controls the camera to acquire a video clip containing a shooting target within a preset time period to obtain a first video set.

The first control is to control the camera to acquire a video clip containing a shooting target within a preset time period, and obtain a first video set. The shooting target can be preset, such as pets, people, or smiles. The detection period can be set according to the actual situation, which is not specifically limited in this application, wherein, the preset period can be implemented as, for example, 0:00-22:00. During the preset period, the camera is in When it is not occupied, the monitoring action will be carried out all the time.

When the shooting target is defined as a pet cat, when the first controller recognizes that the video picture is a pet cat through the camera, it will perform video recording to obtain different video clips of multiple time periods.

In some embodiments, the first controller configures the time length of the video segment to be less than or equal to a second threshold; and the first controller configures the time length of the first video highlight file to a fixed value.

For example, when the second threshold value is 6 seconds, the length of the video clip recorded by the first controller is less than or equal to 6 seconds since the pet cat is detected. The monitor only obtains the video clips of the first 6 seconds, and the length of the video clips is 6 seconds; when the pet cat is within the video capture range of the camera for less than 6 seconds, that is, it leaves the capture range of the camera within 6 seconds, and the first control The device only obtains the video clips of the pet cat within the scope of the camera, and the length of the video clips is less than 6 seconds.

For another example, when the fixed value is 30 seconds, the first controller will perform length detection on the generated first video collection file, and remove content clips that exceed 30 seconds in the video clips to ensure that the first video Highlights files will not exceed a preset fixed length of time.

In some embodiments, the first controller adds a temporal watermark to the video segment. By adding a time watermark to the video clips, the first video collection file finally generated also contains the corresponding time watermark, and the user can know the occurrence time of the video content when viewing the video collection file.

In step 802, the video clips in the first video collection are spliced to generate a first video collection.

For many video clips in the first video set, the first controller determines that some or all of them are target videos, and splices the target videos to generate a first video highlight.

In some embodiments, when the number of video clips in the first video set is greater than a first threshold, the first controller approximately uniformly selects a first threshold number of video clips according to their shooting order as the target video for splicing; otherwise, The first controller splices all the video clips according to the shooting sequence.

For example, when the first threshold is 5, and the TV is turned on for 2 minutes the next day, the first controller will select 5 video clips from the first video collection for splicing to generate a first video collection file. The 5 video clips will be uniformly selected according to their shooting time, and the time span of shooting will be increased as much as possible. When the number is less than 5, for example, 3, the first controller directly splices all the 3 video clips. In some embodiments, the first controller splices the video segments in the first video collection at fixed time intervals to generate the first video collection.

Based on the above description of the video highlight generation method, the present application further provides a display device, comprising: a camera; a microphone; a display screen for displaying a user interface; a first controller, configured to: in response to a received triggering a signal to control the camera to acquire video clips; perform image recognition on the video clips within a preset time period to obtain a first video set, where the first video set is a video clip set containing the same elements; The video clips in a video collection are spliced into a first video collection file. The specific operation method and steps of the display device have been described in detail in the corresponding video collection generation method above, and will not be repeated here.

Based on the above description of the video highlight generation method, the present application further provides another display device, comprising: a camera; a microphone; a display screen for displaying a user interface; a first controller, configured to: in response to receiving a trigger signal, control the camera to obtain video clips containing shooting targets within a preset time period to obtain a first video collection; splicing the video clips in the first video collection to generate a first video collection . The specific operation method and steps of the display device have been described in detail in the corresponding video collection generation method above, and will not be repeated here.

The beneficial effects of some embodiments of the present application are that, by constructing a first video set, the classification of video clips can be realized; further, by constructing the first video sequence, the screening of video clips that meet the requirements can be realized; and further by constructing a target video, it can be realized Secondary screening of video clips; further optimization of TV storage resources can be achieved by deleting video clips after obtaining video highlight files; furthermore, by constructing preset time points and preset time periods, the automation of video highlight file acquisition can be realized; further By controlling the camera to dynamically track the shooting target, the effective acquisition of video clips can be achieved; further, by constructing the first threshold and the second threshold, the length of the video collection file can be controlled, so as to achieve automatic acquisition of video clips, increase the editing speed, and reduce the error rate of video splicing , Intelligently generate video collection files.

In some embodiments, a watermark can be added to the recorded video file, and the watermark can be preset or set according to the user's choice.

FIG. 15 exemplarily shows a schematic diagram of displaying a watermark enabled according to some embodiments. The start-up watermark can include title watermark and product watermark, see (a) in Figure 15, when the video file starts to play, the title watermark "My Family Diary, April 30, 2020" is displayed, and the title watermark is displayed a few seconds later disappear; see (b) in Figure 15, add the product watermark "XX Social TV, see you now, get together on one screen" in the lower right corner of the video file screen, the product watermark is always displayed on the video file screen.

By superimposing the audio file, the start-up watermark and the video file, a video highlight file that records the moving target within the preset recording duration can be generated.

In order to provide users with more operation requirements, the moving image material collected by the camera can be stored and displayed on the display. Users can perform functions such as deletion and editing according to the displayed moving image material.

In some embodiments, in order to facilitate the user to operate several moving image materials, the controller is further configured to: when the camera starts to collect the moving image material of the moving object in response to the video recording start instruction, acquire each piece of moving image captured by the camera material; generate an image material list interface in the user interface, and display each piece of moving image material in the image material list interface in chronological order.

The user interface displays a video recording startup entry, and after the user triggers the video recording startup entry, an image material list interface can be presented on the display. The image material list interface is used to display moving image material and video collection files. Each piece of moving image material collected by the camera will be displayed in the image material list interface.

In some embodiments, the list interface may also only display the spliced video collection, or only display the moving image material. It is also possible to display video highlights in one state and moving image material in another state.

The image material list interface is shown in FIG. 7 , and the image material list interface is displayed in sequence according to the chronological order of the start acquisition time of each piece of moving image material.

The user can operate the moving image material displayed in the image material list interface to realize different functions, such as sharing to the circle of friends, deleting the selected record, clearing the record and closing the video recording function, etc. The upper right corner of the image material list interface presents the operation prompt item "Press the menu button to disable the function or share and delete the video", and the user can perform the operation indicated by the operation prompt item to realize the above-mentioned interactive function.

In some embodiments, in order to facilitate the user to perform corresponding operations on the moving image material displayed in the image material list interface, the controller is further configured to perform the following steps:

Step 151A: Receive an interactive function invocation instruction generated when the user performs a corresponding operation according to the operation prompt item.

Step 152A: In response to the interactive function invocation instruction, a functional interactive floating layer is presented in the image material list interface, and the functional interactive floating layer includes a plurality of function controls.

Step 153A: Execute the target operation corresponding to the target function control in response to the target control instruction generated when the target function control is triggered.

When the image material list interface displays content normally, the interactive function entry is not displayed. If the user wants to realize an interactive function, he needs to call up the interactive function entrance first, that is, the user can call up the interactive function entrance by triggering the menu key through the remote control according to the content of the operation prompt item.

When the user performs a corresponding operation according to the operation prompt item, an interactive function invocation instruction is generated, and the controller invokes the interactive function invocation instruction according to the interactive function invocation instruction, and calls out the functional interactive floating layer as the interactive function entrance, and displays it on the display. The function interaction floating layer is covered at the bottom of the image material list interface in the form of a floating layer. When the function interaction floating layer is displayed, the image material list interface does not disappear.

The function interaction floating layer includes multiple function controls, for example, including the "Share to friends and relatives" control, the "Delete selected record" control, the "Clear all records" control, the "Close this function" control and so on. If the user wants to perform a certain interactive function on the moving image material, he can trigger the corresponding function control through the remote control.

The "Share to Friends and Family" control is used to perform the sharing operation, the "Delete Selected Record" control is used to perform the operation of deleting a moving image material or video collection file, and the "Clear All Records" control is used to perform the clearing of the image material list interface. For all display operations, the "Turn this off" control is used to perform operations that turn off the video recording function of the display device.

FIG. 16 exemplarily shows a schematic diagram of an interactive interface for executing the function of sharing to a circle of friends and relatives according to some embodiments. Referring to (a) in Figure 16, if the user wants to share a certain moving image material or video collection file to the circle of friends, after selecting the file to be shared, select the "Share to circle of relatives and friends" control as the target function through the remote control controls.

The user clicks the target function control "Share to friends and relatives" through the remote controller again, then the display interface on the display jumps to the sharing interface, and the sharing interface is shown in (b) of Figure 16 . In the sharing interface, you can share a certain moving image material or video collection file to the circle of friends.

FIG. 17 exemplarily shows a schematic diagram of an interactive interface for performing a function of deleting a selected record according to some embodiments. Referring to (a) in FIG. 17 , if the user wants to delete a certain moving image material or video collection file, after selecting the file to be shared, select the “delete selected record” control as the target function control through the remote control.

The user clicks the target function control "Delete Selected Record" through the remote controller again, and the display interface on the display jumps to the delete interface at this time. The delete interface is shown in Figure 17(b). In the delete interface, you can delete a certain moving image material or video collection file. The user can execute the delete operation by triggering the "Delete" control based on the delete interface, and the prompt "Deleted" is displayed in the delete interface.

FIG. 18 exemplarily shows a schematic diagram of an interactive interface for performing the function of clearing all records according to some embodiments. Referring to (a) in FIG. 18 , if the user wants to clear all the moving image material collected by the camera or the generated video collection file, he can select the "Clear All Records" control as the target function control through the remote control.

The user clicks the target function control "Clear All Records" through the remote controller again, then the display interface on the display jumps to the clear interface, and the clear interface is shown in Figure 18(b). In the clear interface, you can clear all the moving image materials or video collection files displayed in the image material list interface. The user can perform the clearing operation by triggering the "clearing" control based on the clearing interface, and a prompt "all housekeeping records have been cleared" is displayed on the clearing interface.

FIG. 19 exemplarily shows a schematic diagram of an interactive interface for performing an operation of closing this function according to some embodiments. Referring to (a) of FIG. 19 , if the user wants to turn off the video recording function of the display device, he can select the “turn off this function” control as the target function control through the remote control.

The user clicks the target function control "close this function" again through the remote control, and the display interface on the display jumps to the close interface at this time, and the close interface is shown in (b) of FIG. 19 . In the shutdown interface, the video recording function of the display device can be turned off. The user can perform the closing operation by triggering the "close" control based on the closing interface, and the prompt "closed" is displayed in the closing interface.

After the user turns off the video recording function of the display device, the user can also click the sharing link to view the video previously shared by the user. If the user wants to enable this function again, he can continue to view the moving image material and the generated video highlight file of the previous camera.

In some embodiments, to facilitate the user to view each moving image material based on the image material list interface, a time watermark may be added to each moving image material when the moving image material is displayed in the image material list interface.

Therefore, the controller is further configured to perform the following steps when performing the chronological display of each piece of moving image material in the image material list interface:

Step 161A: Acquire the start acquisition time of each piece of moving image material.

Step 162A: Generate a time watermark including the start time of acquisition, and the time watermark is in one-to-one correspondence with the moving image material.

Step 163A: Display each piece of moving image material and the corresponding time watermark in the image material list interface according to the time sequence of the start of collection, and display the time watermark at the bottom or top of the corresponding moving image material.

In order to identify each piece of moving image material, a time watermark can be used to mark it. The time watermark is a watermark generated according to the start time of each piece of moving image material, and each piece of moving image material has an independent corresponding time watermark.

Each piece of moving image material is displayed in the image material list interface in the chronological order of the starting time of collection. Similarly, each time watermark is also displayed in the image material list interface in the chronological order of the starting time of collection, so that the time watermark is consistent with the moving image material. One-to-one correspondence. The time sequence may be in the order from the nearest to the farthest from the current time, so that the newly collected moving image material is displayed in the front row of the image material list interface.

The display position of the time watermark can be determined according to the actual usage, for example, it can be displayed on the bottom, top, left or right of the corresponding moving image material. Taking the image material list interface shown in FIG. 7 as an example, the time watermark is displayed at the bottom of the corresponding moving image material, such as "9:28 on March 23" and the like.

In some embodiments, since the moving image material collected by the camera and the video collection file synthesized by the controller are displayed in the image material list interface, in order to identify the video collection file, a time watermark can also be added to the video collection file. .

To this end, when adding a time watermark to the video highlight file, the controller is further configured to perform the following steps:

Step 171A: Obtain the generation time of each video collection file.

Step 172A, creating a generation time watermark including the generation time.

Step 173A: Display each video collection file and the corresponding generation time watermark in the image material list interface according to the time sequence of generation time, and display the generation time watermark at the bottom or top of the corresponding video collection file.

Step 174A: Delete the moving image material used to generate the video collection file.

In order to identify each video collection file, it can be marked by generating a time watermark. The generation time watermark is a watermark generated according to the generation time of each video collection file, and each video collection file has an independent corresponding generation time watermark.

Each video collection file is displayed in the image material list interface in the chronological order of the generation time. Similarly, each generation time watermark is also displayed in the image material list interface in the chronological order of the generation time, so that the generation time watermark and the video collection file are One-to-one correspondence. The time sequence may be in order from the current time to the farthest, so that the newly generated video collection file is displayed in the front row of the image material list interface, and the video collection file is displayed before the moving image material.

FIG. 20 exemplarily shows a schematic diagram of an interface for displaying a video collection file in an image material list interface according to some embodiments. The display position of the generated time watermark may be determined according to the actual usage, for example, it may be displayed at the bottom, top, left or right of the corresponding video collection file. Taking the image material list interface shown in FIG. 20 as an example, the generation time watermark is displayed at the bottom of the corresponding video collection file, such as "19:30 on March 23" and so on.

Since the controller will synthesize a video collection file based on the moving image material collected by the camera on that day every day, the controller will store each moving image material and video collection file. In order to avoid occupying too much storage space of the display device, the controller may delete the moving image material that has been synthesized into the video highlight file.

The rest of the moving image materials for which no video highlight file is generated can be saved in the controller, and displayed together with the video highlight file in the image material list interface, so that the user can interact with the moving image material or the video highlight file.

The video highlight file and the moving image material for which the video highlight file is not generated are stored in the home cloud storage NAS. If the display device is not equipped with a home cloud storage NAS, it is stored locally on the display device. Video collection files and moving image materials without video collection files can be saved for 30 days. After 30 days, the corresponding video collection files or moving image materials without video collection files will be deleted to avoid excessive storage in the display device. files that take up a lot of space.

Since the moving image material collected by the camera and the video collection file synthesized by the controller are displayed in the image material list interface, in order to distinguish the video collection file from the moving image material, the user can quickly select the desired operation. The target video highlight file or the target moving image material.

In some embodiments, the distinction may take the form of adding a video record mark to the video highlight file. To this end, the controller is further configured to perform the following steps: creating a video record mark, the video record mark is used to identify the video highlight file generated according to the video record; adding the video record mark to the video highlight file displayed in the image material list interface on the thumbnail.

When video collection files and moving image materials are displayed in the image material list interface, what the user can view are displayed in the form of picture thumbnails. Therefore, for the convenience of distinguishing, a video record mark may be displayed on the thumbnail of the video collection file when the video collection file is displayed in the image material list interface.

The video record mark can be created when the video highlight file is generated, or it can be stored in the controller in advance, that is, when the video highlight file is generated, the controller will call the video record mark, and the video highlight file will be displayed in the image material list interface. , synchronously displays the video record mark on the thumbnail of the video highlight file.

In some embodiments, a video log marker may be added to a corner of the thumbnail of the video highlight file, and the marker content may be "Vlog", such as the markers on the first and second thumbnails as shown in FIG. 20 .

By adding a video record mark on the thumbnail of the video collection file, the video collection file displayed in the image material list interface can be clearly distinguished from the moving image material, which is convenient for users to view and select.

In order to remind the user to be able to timely view the video collection file that the controller automatically calls the camera to collect and synthesize when the user is not at home, the video collection file synthesized on the day needs to be pushed to the user.

To this end, when the video highlight file is pushed to the user, the controller is further configured to perform the following steps: generate a push notification according to the video highlight file, the push notification includes push content and operation prompts; when the display device is started, on the display Push notifications are displayed on the rendered system home page interface.

Since the video collection file is generated from moving image material collected from a moving target within the preset recording duration of the day, the user may not activate the display device within the preset recording duration. Therefore, when the user starts the display device for the first time after the video highlight file is generated, the video highlight file can be pushed to the user. That is, when the user starts the display device for the first time, a push notification is generated according to the video highlight file and displayed on the system home page interface presented on the display.

FIG. 21 exemplarily shows a schematic diagram of an interface for displaying push notifications according to some embodiments. Referring to Figure 21, the push notification includes push content and operation prompts, such as "your cute pet exclusive Vlog has been generated, come and have a look", and operation prompts such as "press the menu button to view details". Users can view the pushed video collection files by triggering the menu button on the remote control.

In some embodiments, the video collection file is pushed only once, and is pushed when the user starts the display device for the first time after the generation of the video collection file. For example, if the preset recording time is 6:00-18:00, when it reaches 18:00, the controller controls the camera to stop collecting moving image materials, and at the same time, splicing and synthesizing the specified number of moving image materials to obtain a video collection document. After 18:00, if the user starts the display for the first time at 19:00, the video collection file will be displayed on the system home page interface in the form of a push notification to prompt the user to view and record the wonderful moments of the pet or baby's day.

It can be seen that, in a display device provided by some embodiments of the present application, the display is configured to present a user interface displaying a video recording start entry, and the video recording start entry is used to start a video recording function of the display device. The controller receives the video recording start instruction generated when the video recording start entry is triggered, so as to instruct the camera to collect the moving image material of the moving target according to the preset collection frequency within the preset recording duration; when the end time of the preset recording duration is reached, The specified number of moving image materials are spliced and synthesized to generate a video collection file that records the moving target within the preset recording time. It can be seen that in the display device provided by some embodiments of the present application, after the user starts the video recording function, the controller can actively call the camera in real time to collect the moving image material of the moving target without the need for the user to operate in real time, and synthesize the video collection after the image collection is completed. The user can know the movement of the moving target within the preset recording time according to the video collection file, which will bring a good experience to the user.

The implementation process of starting the video recording function of the display device provided by the above embodiments is realized by the controller in the display device, and in other embodiments, the device that can realize the video recording function of starting the display device may also be an intelligent device connected to the display device. terminal. On the smart terminal side, it supports the activation of the video recording function of the display device, the browsing and editing of moving image materials, and the viewing and sharing of video collection files.

In some embodiments, the device for capturing images may be a first terminal device, and the first terminal device may share the captured video with the second terminal device.

In some embodiments, an embodiment of the invention provides an intelligent terminal, when executing an interactive method for generating a video highlight file, its processor is configured to perform the following steps:

S21A. Receive a video recording function activating instruction generated when a specified application program is triggered.

In order to start the video recording function of the display device on the intelligent terminal side, a designated application program needs to be configured in the processor of the intelligent terminal, and the designated application program is displayed on the terminal homepage. Specifies that the application provides the entry point for starting the video recording function.

The user manually triggers the designated application program to generate a video recording function activating instruction, and the processor can call up the entry for starting the video recording function according to the video recording function activating instruction.

In some embodiments, the smart terminal is the second terminal device. The application in the second terminal device may send a call-up instruction to the first terminal device.

S22A. In response to the video recording function activating instruction, present in the display a terminal user interface displaying a video recording startup entry.

After receiving the instruction to activate the video recording function, the processor presents the terminal user interface on the display 320 of the second intelligent terminal, and displays the video recording start entry in the terminal user interface.

FIG. 22 exemplarily shows a schematic interface diagram of a user interface of a second smart terminal according to some embodiments. After the user triggers the designated application, the terminal user interface is displayed on the display, and the video recording start portal is presented in the terminal user interface, as shown in FIG. 22 . The user clicks "A Day of My Pet" to generate the video recording function startup interface, as shown in Figure 22. The page displays the "Enable" control, and the user triggers the "Enable" control to realize the video recording function. on.

S23A. Receive the video recording start instruction generated by triggering the video recording start entry, and send the video recording start instruction to the controller, where the video recording start instruction is used to instruct the controller to call the camera in the display device to record according to the preset recording duration within the preset recording time. The collection frequency collects the moving image material of the moving object, and splices and synthesizes a specified number of moving image materials to generate a video collection file that records the moving object within the preset recording duration.

The user can generate a video recording start instruction based on the video recording startup entry displayed on the user interface of the terminal, and triggering the entry, that is, the "open" control. Then, the processor sends the video recording start instruction to the controller in the display device (the first terminal device). After receiving the video recording start instruction, the controller can start the video recording function of the display device, that is, execute the call to the display device. Within the preset recording time, the camera collects the moving image material of the moving target according to the preset collection frequency, and splices and synthesizes the specified number of moving image materials to generate a video collection file that records the moving target within the preset recording time. related steps. The relevant steps for the controller to perform the video recording function may refer to the content of the display device-based part of the foregoing embodiment, which will not be repeated here.

After the smart terminal side starts the video recording function of the display device, the display of the smart terminal will present a video list interface. When presenting the video listing interface, the processor is further configured to perform the following steps:

Step 241A, in response to the video recording start instruction, present a video list interface on the display.

Step 242A: Acquire the moving image material and the video collection file stored in the controller, and display the moving image material and the video collection file in the video list interface.

After the processor receives the video recording start command generated when the user triggers the video recording start entry, it sends the video recording start command to the controller to start the video recording function of the display device, and switches the display of the smart terminal according to the video recording start command. The display content, that is, the terminal user interface displayed on the display of the second intelligent terminal is switched to display the video list interface.

The video list interface is similar to the image material list interface in the display device, and both are used to display moving image materials and video collection files. The moving image material and the synthesized video collection file collected by the camera of the display device will be stored in the controller, and the controller will display the moving image material and the synthesized video collection file on the image material list interface and send it to the second intelligent terminal for processing. The processor displays the moving image material and the synthesized video collection file on the video list interface. That is to say, the content displayed on the video list interface is the same as that displayed on the image material list interface.

In some embodiments, if the user activates the video recording function of the display device for the first time, it means that the camera has not captured any moving image material, and thus no video highlight file has been generated. Therefore, nothing is displayed in the video list interface.

FIG. 23 exemplarily shows an interface diagram of a video list interface according to some embodiments. When the user starts the video recording function for the first time, the content displayed in the video list interface is shown in (a) of FIG. 23 . At this time, the prompt content "No pet has been found" is displayed in the video list interface.

In some embodiments, if the user starts the video recording function of the display device for the second or subsequent times instead of starting it for the first time, it means that the camera has collected moving image material, and may also have generated a video highlight file. At this time, the video In the list interface, the moving image material collected by the camera and the video collection file generated by the controller history will be displayed, as shown in the video list interface in (b) of Figure 23.

The display order of moving image materials and video collection files in the video list interface can be the same as that in the image material list interface, and will not be repeated here.

Users can personalize the moving image material and video collection files displayed in the video list interface to achieve different functions, such as sharing and downloading. To this end, when the user performs a personalized operation based on the video list interface, the processor is further configured to perform the following steps:

Step 251A: Display personalized operation controls at the bottom of each moving image material and video collection file displayed in the video list interface.

Step 2452A: In response to triggering the personalized operation instruction generated by the target personalized operation control, execute the target personalized operation corresponding to the target personalized operation control.

In the video list interface, personalized operation controls are displayed at the bottom of each moving image material and each video highlight file. In some embodiments, the personalized operation controls include a "share" control and a "download" control, as shown in Figure 23 ( b) shown. The "Share" control can perform the operation of sharing a certain moving image material or video collection file to other platforms, and the "Download" control is used to perform the operation of downloading a certain moving image material or video collection file to the local.

When a user triggers a personalized operation control, a personalized operation instruction can be generated, and the processor can perform a corresponding personalized operation according to the personalized operation instruction, such as sharing to other platforms, or downloading locally.

FIG. 24 exemplarily shows a schematic interface diagram of the setting interface of the second smart terminal according to some embodiments. Since the second smart terminal can perform turning on and off of the video recording function of the display device, a quick start entry can be configured in the terminal setting interface of the second smart terminal. Referring to FIG. 24 , a "setting" entry is displayed in the user interface of the second intelligent terminal, and the user triggers the "setting" entry, and the terminal setting interface can be presented on the display of the second intelligent terminal. The user triggers the quick start entry in the terminal setting interface to enable the video recording function, and triggers the quick start entry again to disable the video recording function.

In some embodiments, in order to facilitate family members to perform personalized operations on the moving image materials and video collection files displayed in the video list interface through the intelligent terminal, the local intelligent terminal may authorize other intelligent terminals to operate the video list interface. .

When the local intelligent terminal (the first intelligent terminal) authorizes other intelligent terminals (the second intelligent terminal) to perform personalized operations on the video list interface, the processor is further configured to perform the following steps:

Step 261A: Receive a device sharing instruction generated when the device sharing control is triggered, where the device sharing instruction is used to establish an association relationship with the second intelligent terminal.

Step 262A: Send the device sharing instruction to at least one second intelligent terminal to establish an association relationship between the local intelligent terminal and at least one second intelligent terminal, and the device sharing instruction is used to instruct the second intelligent terminal to execute the video collection file according to the association relationship. personalized operation.

The user interface of the second intelligent terminal displays a "settings" entry, and the user triggers the "settings" entry, and the terminal setting interface is displayed on the display of the second intelligent terminal. The second intelligent terminal setting interface is configured with device sharing controls, such as The Device Sharing control shown in Figure 24.

When the user triggers the device sharing control in the terminal setting interface, the device sharing instruction can be generated. The processor of the local intelligent terminal sends the device sharing instruction to the second intelligent terminal that needs to perform personalized operation on the video list interface. After receiving the device sharing instruction, the second intelligent terminal can establish an association relationship with the local (or first) intelligent terminal, so that the second intelligent terminal can operate the video list interface.

FIG. 25 exemplarily shows a schematic diagram of an interface for presenting an operation interface in a smart terminal according to some embodiments. When the second intelligent terminal operates the video list interface, an operation interface is presented on the display of the second intelligent terminal, as shown in (a) of FIG. 25 . Based on the operation page, the second user can perform personalized operations on the moving image material and the video collection file in the video list interface, for example, perform viewing, sharing or downloading operations on the moving image material and the video collection file.

The operation steps of the second terminal corresponding to the user operating the second intelligent terminal and the operation steps of the local user operating the local intelligent terminal and the page presented by the corresponding display are the same. The only difference is that the second user cannot operate the video of the display device by the second intelligent terminal. The recording function performs on and off operations.

If the local user does not enable the video recording function of the display device, nothing is displayed in the video list interface. At this time, if the second user triggers the video recording startup entry on the terminal user interface of the second smart terminal, a prompt will be displayed on the terminal user interface, as shown in (b) in FIG. This function can be viewed only if the administrator has enabled this function”, the administrator refers to the local user. That is, after the local user enables the video recording function of the display device based on the local intelligent terminal, the corresponding user of the second terminal can perform personalized operations on the moving image material and video collection file on the opposite terminal intelligent terminal.

It can be seen that, in a smart terminal provided by some embodiments of the present application, the display is configured to present a terminal user interface displaying a video recording start entry, and the video recording start entry is used to start the video recording function of the display device. The processor is connected to the controller in the display device, and the processor is configured to: receive a video recording function activating instruction generated when a specified application is triggered, and present a terminal user interface with a video recording startup entry in the display; receive the trigger video The video recording start command generated by the recording start entry is sent to the controller. The video recording start command is used to instruct the controller to call the camera in the display device to collect the moving image material of the moving target according to the preset collection frequency within the preset recording time. , and splicing and synthesizing a specified number of moving image materials to generate a video collection file that records the moving target within a preset recording time period. It can be seen that in the smart terminal provided by some embodiments of the present application, the user enables the video recording function of the display device through the smart terminal, and the display device can realize the function of collecting the moving image material of the moving target and synthesizing the video collection file without the user operating the display device in real time. , the user can know the movement of the moving target within the preset recording duration according to the video collection file, which will bring a good experience to the user.

The present application also provides an interactive method for generating a video highlight file, which is applied to a display device, and the method includes:

S11A. Receive a video recording start instruction generated when the video recording start entry is triggered, where the video recording start instruction is used to instruct the camera to collect moving image material of a moving target according to a preset collection frequency within a preset recording time period, and the The video recording startup entry is used to start the function of recording moving images through video recording within a preset recording duration and generating a video highlight file, and the moving target refers to the need to record moving images through video recording within the preset recording duration to generate The target of the video highlight file;

S12A, when reaching the end time of the preset recording duration, acquiring several moving image materials of the moving target captured by the camera within the preset recording duration;

S13A, splicing and synthesizing a specified number of the moving image materials, and generating a video highlight file that records the moving object within a preset recording duration.

The present application also provides an interactive method for generating a video collection file, which is applied to an intelligent terminal, and the method includes:

S21A, receiving the video recording function call-up instruction generated when triggering the designated application program;

S22A. In response to the video recording function activating instruction, present in the display a terminal user interface that displays a video recording start entry, where the video recording start entry is used to start and realize the video recording within a preset recording duration. A video recording function for recording moving images and generating a video highlight file, the video recording function is configured in the controller of the display device;

S23A. Receive a video recording start command generated by triggering the video recording start entry, and send the video recording start command to a controller, where the video recording start command is used to instruct the controller to call the camera in the display device to pre- During the preset recording time period, the moving image material of the moving target is collected according to the preset collection frequency, and a specified number of the moving image material is spliced and synthesized to generate a video collection file that records the moving object within the preset recording time period.

For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussions are not intended to be exhaustive or to limit implementations to the specific forms disclosed above. Numerous modifications and variations are possible in light of the above teachings. The above embodiments are chosen and described to better explain the principles and practical applications, so as to enable those skilled in the art to better utilize the described embodiments and various modified embodiments suitable for specific use considerations.

Claims

A display device comprising:

a display screen for displaying the user interface;

The first controller, configured as:

In response to the received trigger signal, the receiving camera obtains the video clip;

Perform image recognition on the video clips within a preset time period to obtain a first video set, where the first video set is a video clip set containing the same elements;

The video clips in the first video collection are spliced into a first video collection file.
The display device according to claim 1, wherein the first controller splicing the video clips in the first video collection into a first video collection file comprises: the first controller

Carry out importance scoring to the video clips in the first video set to obtain a first video sequence;

Sorting the first video sequence from high to low according to the importance score, and setting the video clips of the previous preset number of splices as the target video;

The target videos in the first video sequence are spliced to generate a first video collection file.
The display device of claim 2, wherein the first controller deletes the video segment after generating the first video highlight file.
The display device according to claim 1, wherein the first controller performs image recognition on the video clips within a preset time period to obtain the first video set comprising: the first controller

At a preset time point, image recognition is performed on the video clips within a preset time period to obtain a first video set, wherein the preset time point is located after the preset time period;

The first controller splicing the video clips in the first video collection into a first video collection file includes, the first controller

Receive the input bright screen command;

In response to the screen brightening instruction, the video clips in the first video collection are spliced into a first video collection file.
The display device according to claim 1, wherein the first controller performs image recognition on the video clips within a preset time period to obtain a first video set, comprising the first controller

Receive the input bright screen command;

When the time when the screen brightening instruction is received is earlier than a preset time point, continue to receive the camera to obtain video clips;

When the time when the screen brightening instruction is received is later than a preset time point, image recognition is performed on the video clips within the preset time period to obtain a first video set, and the The video clips are spliced into a first video highlight file.
The display device according to claim 4 or 5, after receiving the screen brightening instruction, the first controller is further configured to:

After monitoring the generated first video collection file, control the display to display a video collection interface, and the video collection interface is provided with a control for jumping to the playback interface of the first video collection file;

When the generated first video highlight file is not detected, the display is not controlled to display the video highlight interface.
The display device according to claim 1, wherein the trigger signal comprises a signal of movement of an object within a detection range monitored by the camera or a sound signal within a detection range monitored by a microphone.
The display device of claim 1, wherein the camera is configured to stop acquiring the video clip for the first controller when the camera is configured to be called by another application.
A method for generating a video collection, the method comprising:

In response to the received trigger signal, the receiving camera obtains the video clip;

Perform image recognition on the video clips within a preset time period to obtain a first video set, where the first video set is a video clip set containing the same elements;

The video clips in the first video collection are spliced into a first video collection file.
The method for generating a video collection according to claim 9, wherein splicing the video clips in the first video collection into a first video collection file comprises:

Carry out importance scoring to the video clips in the first video set to obtain a first video sequence;

Sorting the first video sequence from high to low according to the importance score, and setting the video clips of the previous preset number of splices as the target video;

The target videos in the first video sequence are spliced to generate a first video collection file.
The method for generating a video collection according to claim 9, wherein performing image recognition on the video clips within a preset time period to obtain the first video collection comprises:

At a preset time point, image recognition is performed on the video clips within a preset time period to obtain a first video set, wherein the preset time point is located after the preset time period;

Splicing the video clips in the first video collection into a first video collection file includes:

Receive the input bright screen command;

In response to the screen brightening instruction, the video clips in the first video collection are spliced into a first video collection file.
A display device comprising:

a display screen for displaying the user interface;

The first controller, configured as:

In response to the received trigger signal, the receiving camera acquires a video clip containing the shooting target within a preset time period to obtain a first video set;

The video clips in the first video collection are spliced to generate a first video collection.
The display device according to claim 12, when the number of video clips in the first video set is greater than the first threshold, the first controller approximately uniformly selects the video clips of the first threshold according to their shooting order for splicing; otherwise, the first The controller stitches all the video clips in the order of shooting.
The display device of claim 12, wherein the first controller splices video clips in the first video collection at fixed time intervals to generate a first video collection.
A method for generating a video collection, the method comprising:

In response to the received trigger signal, receiving the camera to obtain a video clip containing a shooting target within a preset time period to obtain a first video set;

The video clips in the first video collection are spliced to generate a first video collection.