WO2022007568A1

WO2022007568A1 - Display device, smart terminal, and video highlight generation method

Info

Publication number: WO2022007568A1
Application number: PCT/CN2021/098617
Authority: WO
Inventors: 鲍姗娟; 于文钦; 杨鲁明; 宁静; 孙娜; 王学磊; 王之奎; 丁佳一; 刘兆磊
Original assignee: 海信视像科技股份有限公司
Priority date: 2020-07-06
Filing date: 2021-06-07
Publication date: 2022-01-13
Also published as: CN116391358A

Abstract

Provided are a display device, a smart terminal, and a video highlight generation method. The display device comprises: a camera; a display, used for displaying a user interface; and a controller, configured to: when a target user is within a monitoring range of the display device, receive video clips collected by the camera; and generate a video highlight file on the basis of the plurality of obtained video clips. For the video highlight file, after a confirmation operation is received, the controller controls the user interface to play the video highlight file.

Description

Display device, smart terminal, and method for generating video highlights

This application is required to be submitted on October 23, 2020, the application number is 202011149949.X, and the application name is "a display device and a method for generating watermarks for video collection files"; submitted on October 23, 2020, application number It is 202011148295.9, and the application name is "a method for generating a display device and a video collection file"; submitted on October 23, 2020, the application number is 202011148312.9, and the application name is "a display device and a camera control method"; Submitted on July 6, 2020, the application number is 202010640381.5, and the application name is "An interactive method for generating a video collection file, display device, and intelligent terminal"; submitted on August 21, 2020, the application number is 202010850122.5 , the priority of the Chinese patent application entitled "A Display Device", the entire contents of which are incorporated herein by reference.

technical field

The present application relates to the technical field of display devices, and in particular, to a display device, an intelligent terminal, and a method for generating a video collection.

Background technique

A video collection file is a video file that combines different videos or video clips with similar content or the same elements into one video file. In the implementation of some video collection files, users are required to use professional photography tools to obtain video clips, watch and filter each video, and then manually cut and spliced into a video collection. However, when the family needs to make a video collection file for the cute baby, that is, the target user's children, the user cannot operate the photography tool for a long time, the number of video clips is huge, and the video scene is complex, which will lead to the user's inability to obtain video clips, slow editing, and video clips. Fragment splicing omission error.

SUMMARY OF THE INVENTION

Some embodiments of the present application provide a display device, including: a camera; a display screen for displaying a user interface; and a controller configured to: when a target user is within a monitoring range of the display device, receive video clips collected from the camera ; Generate a video collection file based on the acquired multiple video clips, wherein the controller controls the user interface to play the video collection file after receiving the confirmation operation for the video collection file.

Some embodiments of the present application provide a method for generating a video highlight file, the method includes: recording a video clip when a target user is within a monitoring range; generating a video highlight file based on a plurality of the acquired video clips, wherein the The Video Highlights file plays in the UI after receiving the confirmation action.

Some embodiments of the present application provide an intelligent terminal, including:

a display configured to present a terminal user interface displaying a video recording start entry, the video recording start entry being used to start a video recording function for recording a moving image and generating a video highlight file by video recording within a preset recording duration, The video recording function is configured in the controller of the display device;

A processor connected to the controller in the display device, a designated application program is configured in the processor, and the processor is configured to:

receiving a video recording function call-up instruction generated when the designated application is triggered;

In response to the video recording function invocation instruction, presenting a terminal user interface in the display with a video recording initiation entry;

Receive a video recording start command generated by triggering the video recording start entry, and send the video recording start command to the controller, where the video recording start command is used to instruct the controller to call the camera in the display device to record in a preset setting During the duration, the moving image material of the moving target is collected according to the preset collection frequency, and a specified number of the moving image material is spliced and synthesized to generate a video collection file recording the moving target within the preset recording duration.

Description of drawings

FIG. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to one or more embodiments of the present application;

FIG. 2 is a block diagram of a hardware configuration of a display device 200 according to one or more embodiments of the present application;

FIG. 3 is a block diagram of the hardware configuration of the control device 100 according to one or more embodiments of the present application;

FIG. 4 is a schematic diagram of software configuration in a display device 200 according to one or more embodiments of the present application;

FIG. 5 is a schematic diagram showing an icon control interface of an application in a display device 200 according to one or more embodiments of the present application;

6 is a schematic diagram of a user interface according to one or more embodiments of the present application;

7 is a schematic interface diagram of a function effect display interface according to one or more embodiments of the present application;

8 is a schematic interface diagram of a video recording function startup page according to one or more embodiments of the present application;

FIG. 9 is a schematic diagram of displaying a watermark for enabling broadcasting according to one or more embodiments of the present application;

10 is a schematic diagram of an interactive interface for executing a function of sharing to a circle of relatives and friends according to one or more embodiments of the present application;

11 is a schematic diagram of an interface for displaying push notifications according to one or more embodiments of the present application;

12 is a schematic diagram of a video highlight file of a display device according to one or more embodiments of the present application;

13 is a schematic interface diagram of a terminal user interface according to one or more embodiments of the present application;

14 is a schematic interface diagram of a video list interface according to one or more embodiments of the present application;

15 is a schematic diagram of a watermark for playing a video highlight file according to one or more embodiments of the present application;

16 is a schematic diagram of a watermark for playing a video highlight file according to one or more embodiments of the present application;

17 is a schematic diagram of a watermark for playing a video highlight file according to one or more embodiments of the present application;

18 is a schematic diagram of a watermark for playing a video highlight file according to one or more embodiments of the present application;

FIG. 19 is a schematic diagram of a watermark for playing a video highlight file according to one or more embodiments of the present application.

detailed description

In order to make the objectives, implementations and advantages of the present application clearer, the exemplary embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings in the exemplary embodiments of the present application. Obviously, the exemplary embodiments described It is only a part of the embodiments of the present application, but not all of the embodiments.

Based on the exemplary embodiments described in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the appended claims of this application. Furthermore, although the disclosures in this application have been presented in terms of illustrative example or instances, it should be understood that various aspects of this disclosure may also constitute a complete embodiment in isolation. It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the embodiments described below, rather than intended to limit the embodiments of the present application. Unless otherwise specified, these terms are to be understood according to their ordinary and ordinary meanings.

FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device according to one or more embodiments of the present application. As shown in FIG. 1 , a user can operate the display device 200 through a mobile terminal 300 and the control device 100 . The control apparatus 100 may be a remote control, and the communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and wireless or other wired ways to control the display device 200 . The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like. In some embodiments, mobile terminals, tablet computers, computers, notebook computers, and other smart devices may also be used to control the display device 200 .

In some embodiments, the mobile terminal 300 may install a software application with the display device 200 to implement connection communication through a network communication protocol, so as to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 may also be transmitted to the display device 200 to realize a synchronous display function. The display device 200 also performs data communication with the server 400 through various communication methods. The display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200 . The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The display device 200 may additionally provide an intelligent network television function that provides a computer-supported function in addition to the function of broadcasting and receiving television.

FIG. 2 exemplarily shows a configuration block diagram of the control apparatus 100 according to an exemplary embodiment. As shown in FIG. 2 , the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply. The control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 . The communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key or an alternative module.

FIG. 3 is a block diagram showing a hardware configuration of the display apparatus 200 according to an exemplary embodiment. As shown in FIG. 3, the display device 200 includes a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280. at least one. The controller includes a central processing unit, a video processing unit, an audio processing unit, a graphics processing unit, a RAM, a ROM, and a first interface to an nth interface for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner-demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals. The detector 230 is used to collect external environment or external interaction signals. The controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the controller 250, through various software control programs stored on the memory, controls the operation of the display device and responds to user operations. The controller 250 controls the overall operation of the display apparatus 200 . A user may input a user command on a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

In some embodiments, a "user interface" is a medium interface for interaction and information exchange between an application program or an operating system and a user, which enables conversion between an internal form of information and a form acceptable to the user. The commonly used form of user interface is Graphical User Interface (GUI), which refers to a user interface related to computer operations displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display screen of the electronic device, wherein the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc. at least one of the visual interface elements.

FIG. 4 is a schematic diagram of software configuration in the display device 200 according to one or more embodiments of the present application. As shown in FIG. 4 , the system is divided into four layers. Layer"), the Application Framework layer (referred to as the "framework layer"), the Android runtime (Android runtime) and the system library layer (referred to as the "system runtime layer"), and the kernel layer. The kernel layer contains at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive etc.

FIG. 5 is a schematic diagram showing an icon control interface of an application in a display device 200 according to one or more embodiments of the present application. As shown in FIG. 5 , the application layer includes at least one application that can display a corresponding icon control on the display. , such as: live TV application icon control, video on demand application icon control, media center application icon control, application center icon control, game application icon control, etc. Live TV app that can provide live TV from different sources. Video-on-demand application that can provide video from different storage sources. Unlike live TV applications, video-on-demand provides a display of video from certain storage sources. A media center application that can provide a variety of multimedia content playback applications. The application center can provide storage of various applications. <Video Highlights>

In some embodiments, the display device adopts the usage scenario of the camera, for example, to record the daily life of the pet by means of video recording. Since the display device in the related art records the video of the pet, it is usually necessary for the user to operate the display device in real time to call the camera to realize image acquisition, and then the video file can be obtained. Therefore, in order for the user to be away from home during the day, the display device can still call the camera to record the wonderful life of the pet, and the video recording function can be configured in the display device to improve the richness of the usage scenarios of the display device using the camera. After the video recording function in the display device is activated, the display device can call the camera in real time to collect moving image material of the pet. The process of invoking the camera to collect images by the display device in real time does not require real-time operation by the user. As long as the display device is powered on and connected to the Internet, the display device can automatically realize the process. Finally, the display device can also generate a video highlight file based on multiple moving image materials collected by the camera in one day, and push it to the user, so as to prevent the user from missing the wonderful life of pets after leaving home during the day.

In addition to recording the wonderful life of pets, the video recording function can also record other sports targets, such as the user's baby at home. When the video recording function is activated on the display device, as long as moving objects such as pets or babies appear in the shooting area of the camera, the camera will collect moving image materials, and finally generate a video collection file from multiple moving image materials collected in one day. Pushed to the user for viewing the next time the user turns on the display device. The user can know the daily life of the pet or baby at home according to the video collection file, which will bring the user a good experience.

Some embodiments of the present application provide a display device 200 including a display 275 , a camera 232 and a controller 250 . The display is configured to present a user interface that displays a video recording start entry, and the video recording start entry is used to start a function of recording a specific target through video recording within a preset recording duration and generating a video highlight file; wherein the specific target includes motion Target. The camera is configured to collect image material of a specific target according to a preset collection frequency. A specific target is a target whose image needs to be recorded by video recording within a preset recording duration to generate a video highlight file. The controller is respectively connected with the camera and the display. The controller is used to start the video recording function configured in the display device, and call the camera to collect image materials of a specific target, and finally generate a video collection file. In order to facilitate the user to operate more quickly and conveniently when interacting with the display device, an interactive method for generating a video collection file is provided, which can instruct the user how to start the video recording function and how to perform an interactive operation on the video collection file.

In order to realize the video recording function, a target application program is configured in the display device, specifically, the target application program is configured in the controller, and the target application program is displayed on the system home page interface of the display device. The target application is used to provide the entry to start the video recording function. In order to present the user interface with the video recording startup entry in the display, the controller is further configured to: Step 011, in response to the device startup instruction generated when the user starts the display device, present the system home page interface in the display, the system home page interface. The target application is displayed on the . Step 012 , in response to the triggering instruction generated when the target application is triggered, present a user interface on the display, and the user interface is displayed with a video recording startup entry. When the user turns on the display device, a device startup instruction is generated. The controller can call up the system home page interface according to the device startup instruction, and display it on the display, and the target application program is displayed on the system home page interface. The user triggers the target application program through the remote control or voice to generate a call-up command, and the controller calls up the user interface according to the call-up command and displays it on the display. At this time, the content displayed on the display is switched from the home page interface of the display system to the user interface, and the user interface is the home page of the target application program. When the user interface is called up, the video recording startup entry is displayed in the user interface. The user clicks the video recording startup entry through the remote control or voice to enable the video recording function of the display device, that is, the recording of the specific target image material starts. Capture, and generate, video highlight files.

FIG. 6 is a schematic diagram of a user interface according to one or more embodiments of the present application. Referring to Figure 6, if the target application is "A application", the user interface displayed after triggering "A application" displays a video recording startup entry, such as the "Video Highlights sub-application" displayed in the upper right corner of the user interface, triggering " Video Collection sub-application” to turn on the video recording function of the display device. In some embodiments, a video recording startup entry can also be added to the system home page interface in the form of a shortcut, so that after turning on the display device, the user can quickly turn on the display device through the video recording startup entry on the system home page interface. Video recording function.

The user triggers the video recording start entry on the user interface or the system home page interface to generate a video recording start instruction, so that the controller enables the video recording function of the display device, that is, the camera is called to start capturing images. Specifically, the controller generates a video recording startup instruction when executing the triggering video recording startup entry, and is further configured as: Step 021, in response to the startup instruction generated when triggering the video recording startup entry, present a function effect display interface on the display, and the function On the effect display interface, a confirmation startup entry is displayed. Step 022: In response to triggering the confirmation command generated by the confirmation start entry, cancel the display of the function effect display interface on the display, and generate a video recording start command. In order to facilitate the user to clearly understand the realization effect of the video recording function when using the video recording function for the first time, a function effect display interface can be displayed on the display when the video recording startup entry is triggered. The content displayed on the function effect display interface includes the function introduction and the effect display that can be obtained.

FIG. 7 is a schematic interface diagram of a function effect display interface according to one or more embodiments of the present application. The pages shown in FIG. 7(a) and FIG. 7(b) are exemplary display interfaces of the function effect display interface, and the user can have a certain understanding of the video recording function according to the content displayed on the function effect display interface. The user triggers the video recording start entry on the user interface or the system homepage interface through the remote control, and a start command will be generated. The controller can call up the function effect display interface shown in FIG. 7 and display it on the display according to the start instruction. At this time, the content displayed on the display is switched from the display user interface to the function effect display interface. In order to facilitate the user to quickly start the video recording function, a confirmation start entry may be displayed on the last interface of the function effect display interface, such as the "enable" control shown in (b) in FIG. 7 . The user triggers the confirmation start entry through the remote control, and a confirmation instruction will be generated, indicating that the user wants to start the video recording function. At this time, the controller cancels the display of the function effect display interface on the display according to the confirmation instruction, and generates a video recording start instruction to enable the video recording function of the display device.

In some embodiments, if the user activates the video recording function of the display device for the second or subsequent times (the user activates the video recording function for the first time and then turns it off), when the user triggers the video recording start entry on the user interface, the user can no longer Display the function effect display interface, but directly display the video recording function start interface. FIG. 8 is a schematic interface diagram of a video recording function startup page according to one or more embodiments of the present application. Referring to Fig. 8, the user triggers the video recording startup entry in the user interface, generates a startup instruction, and the controller calls up the video recording function startup interface according to the startup instruction and displays it on the display. At this time, the video recording function startup interface is displayed in the display. On the video recording function startup interface, a confirmation startup entry is displayed, such as the "enable" control shown in FIG. 8 . When the user triggers the confirmation start entry, a confirmation command will be generated. At this time, the controller cancels the display of the video recording function startup interface on the display according to the confirmation instruction, and generates a video recording startup instruction to enable the video recording function of the display device.

After the video recording function of the display device is turned on, an image material list interface is displayed on the display, that is, after the controller responds to the confirmation instruction, it calls up the image material list interface and displays it on the display. The image material list interface is used to display image materials and Video Highlights file. In some embodiments, if the user starts the video recording function of the display device for the first time, it means that the camera has not captured any image material, and thus no video highlight file has been generated. Therefore, nothing is displayed in the image material list interface. In some embodiments, if the user starts the video recording function of the display device for the second or subsequent times instead of starting it for the first time, it means that the camera has collected image materials, and may also generate video highlight files. At this time, the image materials The list interface will display the image material collected by the camera and the video collection file generated by the controller.

In some embodiments, when executing the interactive method for generating a video highlight file, the controller thereof is configured to perform the following steps: S11. Receive a video recording start instruction generated when a video recording start entry is triggered, and the video recording start instruction is used for Instructs the camera to collect image material of a specific target at the preset collection frequency within the preset recording duration. The user triggers the video recording start entry on the user interface or the system homepage interface to generate a video recording start command, and the controller can start the video recording function of the display device according to the video recording start command, that is, call the camera to start collecting the data of a specific target. The image material, the specific target includes a moving target, and the image material includes a moving picture or a moving video. For example, a specific target could be a pet or a baby. Since the separation time between the user and the pet or the baby is usually during the day, that is to say, the display device only needs to record the living conditions of the pet or the baby during the day, so the preset recording duration can be set. The preset recording duration is the time period during which the controller automatically calls the camera to collect the specific target image material. In some embodiments, the preset recording duration may be set to 6:00-18:00, that is, the controller invokes the camera to capture the moving image material within the time period of 6:00-18:00. When the camera collects image material of a specific target, if the specific target always maintains a posture and does not move within the shooting range of the camera, the image material collected by the camera has the same content. Then, in order to prevent the camera from collecting the same material for a long time and occupying too much storage space, in some embodiments, the camera may be controlled to collect image material according to a preset collection frequency.

In some embodiments, when the camera collects image material of a specific target according to a preset collection frequency, the controller executes: S111: Receive a camera call instruction generated when the controller responds to a video recording start instruction. After the controller receives the video recording start instruction, it can call the camera for image acquisition. To this end, after the controller receives the video recording start command, it generates a camera call command and sends it to the camera, and the camera can start and start collecting image materials according to the camera call command. However, since the camera may be called by other applications, at this time, the controller cannot call the camera to collect image materials. To this end, the controller needs to first determine that the camera can be called, and if it can be called, send a camera calling instruction to the camera.

In some embodiments, before the controller sends the camera call instruction to the camera, that is, when executing the start instruction in response to the video recording, the controller generates the camera call instruction. Operating status. Step 1112 , if the current operating state of the camera is not called, generate a camera calling instruction, and the camera calling instruction is used to call the camera to collect image materials. The controller obtains the current operating state of the camera according to the video recording start instruction to determine whether the camera can be called. And when it is judged that the camera is not called, it means that at this moment, the camera can be called to execute the collection of moving image material of the moving target. At this point, the controller generates a camera call instruction and sends it to the camera to start the camera and call the camera to collect image materials. After the video recording function is activated, as long as the camera is not occupied by other applications, the controller calls the camera to continuously capture image materials. When the controller detects and determines that the camera is called by other applications, it stops acquiring video clips, or suspends acquiring video clips. For example, when the camera is used for a video call, the Video Highlights application pauses, or stops capturing video clips. If the video highlight function of the display device is in an off state, even if the camera is not occupied, the controller will not control the camera to record video clips, and the controller will stop the camera from performing monitoring activities.

S112. In response to the camera calling instruction, from the initial moment of the preset recording duration, collect image materials according to the preset collection frequency.

S113. When the end time of the preset recording duration is reached, the collection of the image material is ended. After the camera receives the camera call command sent by the controller, the camera will execute the command every day to collect image materials. Therefore, the moment when the image material of the camera starts to be collected is the initial moment of the preset recording duration. The camera collects image materials according to the preset collection frequency every day from the initial moment of the preset recording duration until the end time of the preset recording duration is reached. For example, the camera starts to collect moving image material of the moving target at 6:00 every day, and ends the collection at 18:00. When the end time of the preset recording duration is reached, the controller generates a camera stop calling instruction and sends it to the camera to control the camera to end the collection of image materials.

In some embodiments, when a specific target is within the monitoring range of the display device, the controller receives a video clip collected from a camera, which specifically includes: when the specific target is within the monitoring range of the display device, the controller controls the The camera performs face detection; based on the face detection, it is determined whether the user is younger than a preset age, and if the specific target is smaller than the preset age, the controller receives the video clip collected from the camera; otherwise, the controller Control the camera to continue to perform face detection.

In some embodiments, after the A application service is started, it is first detected whether it is set to start at startup, and if the display device is set to start at startup, a delay task for a preset time is started, for example, a 5-second delay task is started; if the display device does not If it is set to boot, it will detect whether there is a NAS in the hardware device; if there is no NAS, the A service will be automatically terminated; if there is a NAS, it will detect whether there is a video segment to be synthesized. Whether the highlight function switch is on, and whether the camera is set to keep rising (that is, whether the camera is activated).

After the camera is called, it does not always collect images, but starts to collect image materials after the moving target appears within the shooting range of the camera, so as to prevent the camera from collecting useless image materials and causing waste of resources. In some embodiments, in order to accurately determine that the camera can capture the moving image material including the specific target, the controller collects the moving image material of the specific target according to the preset collection frequency from the initial moment when the camera performs the preset recording duration, It is further configured to perform the following steps: Step 1121 , from the initial moment of the preset recording duration, acquire the preview image captured by the camera. Step 1122: Perform image recognition on the preview image to determine whether there is a moving object in the preview image. Step 1123: If there is a moving object in the preview image, call the camera to collect the moving image material of the moving object according to the preset collection frequency. After the camera is called, from the initial moment of the preset recording duration, the camera will capture the preview image in real time. Since the preview image indicates that no video recording is performed, the problem of occupying storage space will not occur. The controller performs image recognition on the preview image collected by the camera in real time, and determines whether the moving target appears in the shooting area of the camera according to the image recognition result. Only when the moving target appears in the shooting area of the camera, will the camera be called to collect the moving image material of the moving target. After the controller determines that there is a moving target in the preview screen, it can send a control command to the camera. At this time, the camera receives the control command and can collect the moving image material of the moving target according to the preset collection frequency.

In some embodiments, in order to avoid the situation that the camera continuously collects the moving object that has not changed its motion state in a short period of time, the collection process may be performed only once when the moving object appears in the shooting area of the camera. The preset collection frequency collects the moving image material of the moving object, and is further configured to: when there is a moving object in the preview screen, call the camera to perform a process of collecting the moving image material of the moving object. When the controller judges that there is a moving target in the camera shooting area through image recognition, it only calls the camera to collect a piece of moving image material of the moving target. If the moving target enters the camera shooting area after leaving the camera shooting area, it calls the camera again A moving image footage of a moving target. For example, if the moving target enters the shooting area of the camera at 9:00, the camera is called to collect the first moving image material, and the moving target leaves the camera shooting area at 9:10; When it enters the shooting area of the camera again, the camera is called again to collect the second piece of moving image material, and the moving target exits the shooting area of the camera at 10:40. It can be seen that between 9:00 and 9:10, the camera only collects a piece of moving image material, and between 10:23 and 10:40, the camera also collects only one piece of moving image material. The acquisition process of the camera is analogous and will not be repeated here.

In some embodiments, the preset collection frequency includes a preset collection duration and a preset collection interval duration; then, the camera is further configured to: Step 11231, From the moment when it is determined that there is a moving object in the preview screen, the first piece of moving image material of the moving object is collected according to the preset collection time period. Step 11232 : After the preset collection interval has elapsed, collect the second piece of moving image material of the moving target according to the preset collection time. From the moment when it is determined that there is a moving object in the preview screen, that is, after receiving the control command sent by the controller, the first piece of moving image material of the moving object starts to be collected, and the duration of the first piece of moving image material is the preset collection time. . In order to avoid the situation that the camera collects the moving target that has not changed its motion state in a short time, it is necessary to control the camera to wait for a period of time after completing the collection of a piece of moving image material, and then collect the next piece of moving image material. That is, after collecting the first piece of moving image material, the camera waits for the preset collection interval, and then collects the second piece of moving image material of the moving target again, and the duration of the second piece of moving image material is the preset collection time.

If the moving object walks out of the shooting area of the camera again, the controller performs image recognition on the image captured by the camera again. If it is recognized that there is no moving object in the shooting area of the camera, the camera is controlled to stop collecting moving images. That is to say, in the process of capturing the moving image material of the moving target by the camera, image recognition is performed on the captured image of the camera in real time. Once it is recognized that the motion does not appear in the captured image, a stop control command is immediately sent to the camera, so that the camera Stop collecting. Within the preset recording time, the moving target may appear in the shooting area of the camera for many times, and there will be various motion states in the shooting area of the camera, so the camera may collect multiple moving images according to the preset collection frequency material.

S12. When the end time of the preset recording duration is reached, acquire several moving image materials of the moving target captured by the camera within the preset recording duration.

After the display device starts the video recording function, as long as the camera is not occupied by other applications, it will always be in the state of collecting image materials. The time when the camera stops collecting the moving image material of the moving target is the end time when the preset recording duration is reached. For example, when the current 18:00 is reached, the controller generates a stop control command and sends it to the camera to control the camera to stop collecting motion. Targeted moving image footage. At this time, within the preset recording duration, the camera may collect several moving image materials, and the controller may acquire several moving image materials to synthesize the video highlight file.

S13, splicing and synthesizing a specified number of moving image materials to generate a video collection file for recording the moving target within a preset recording duration. In order to ensure that the synthesized video collection file meets the requirements of short videos, when synthesizing multiple moving image materials into a video collection file, it is necessary to synthesize a specified number of video collection files. Each moving image material includes the movement of the moving object, and the video collection file is to record the movement of the moving object within the preset recording duration. When viewing a video collection file, users can watch the wonderful life of a moving target, such as a pet or a baby, within a preset recording time. In some embodiments, the controller generates a video highlight file based on a plurality of the acquired video clips, wherein the video highlight file includes the earliest video clip and the latest video clip within the preset time period. For example, when the controller generates a video highlight file, it detects whether there is a valid video segment in the memory; wherein, the valid video segment refers to a video segment that has been normally recorded. When there are video clips to be synthesized in the memory and the space capacity is sufficient, the controller classifies all valid video clips by day, arranges the video clips of each day in ascending order by time, and selects a preset number of video clips for synthesis. It is worth noting that in this application, the video clip and the image material are substantially the same.

In some embodiments, the process of the controller generating the video highlight file based on the video clips may be implemented as follows: the controller reads each frame of video stream data from the video clips, and writes them into the video track of the target file; One frame is written after the last frame of the previous video to form the video continuous frame data of the video collection. The controller accumulates and calculates the video duration of the generated video highlight file when synthesizing the video stream data. After the video stream data is synthesized, the controller reads the data of each frame of the audio file and writes it into the audio track of the target file. If the duration of the read audio track data is greater than the duration of the video, stop reading the audio data, and the video synthesis is completed; after the video synthesis, delete the video segment to be synthesized to release the occupied space. <Number of composite files>

In some embodiments, in order to quickly and accurately generate a video collection file that meets the short video requirements, the controller performs splicing and synthesis of a specified number of moving image materials to generate a video collection that records the moving object within a preset recording duration. file, which is further configured to perform the following steps: S131 , acquiring the total number of moving image materials collected by the camera within the preset recording time period. S132. If the total number of materials is less than or equal to the specified number, splicing and synthesizing the moving image materials of the total number of materials in chronological order. S133. If the total number of materials is greater than the specified number, select a specified number of target moving image materials in the moving image material set. S134 , splicing and synthesizing a specified number of target moving image materials in a chronological order, and generating a video highlight file for recording the moving target within a preset recording duration. Every time a piece of moving image material is collected by the camera, it will be sent to the controller. Within the preset recording time, the controller can count the total number of moving image materials collected by the camera.

In some embodiments, the total duration of the synthesized video collection file is about 30s, which meets the duration requirement of short videos. That is to say, a maximum of 6 moving image materials are required for synthesis. If the total number of materials exceeds 6, the From the total number of materials, 6 suitable moving image materials are selected for synthesis. Compare the total number of moving image materials collected by the camera with the specified number. If the total number of materials is less than or equal to the specified number, it means that the duration requirements for synthesizing short videos are met. Time sequence for splicing synthesis.

If the total number of materials is greater than the specified number, it means that if the moving image materials of the total number of materials are combined into a video collection file, the total length of the video collection file will exceed the duration of the short video, and the video collection file does not meet the requirements. Therefore, in order to ensure the smooth synthesis of the video highlight file, the controller may select a specified number of target moving image materials in the moving image material set corresponding to the total number of materials. The specified number of target moving image materials are then spliced and synthesized in time sequence to generate a video highlight file that records the moving target within the preset recording duration. For example, if the specified number is set to 6 segments, and the total number of moving image materials is 5 segments, then the 5 segments of moving image materials can be directly spliced and synthesized to obtain a video collection file; and if the total number of moving image materials is 5 segments 10 segments, then it is necessary to select a suitable target moving image material from the 10 segments of moving image materials, and then splicing and synthesizing the 6 segments of the target moving image material to obtain a video highlight file.

In some embodiments, when the total number of materials exceeds a specified number, and a specified number of target moving image materials are selected from the moving image material set corresponding to the total number of materials, the time span between the selected target moving image materials may be large according to the Some. For example, if the camera captures moving image materials in the first, middle, and last time periods of the preset recording duration, then when selecting the target moving image material, it is necessary to ensure that there are moving materials in the first, middle, and last time periods. was selected to ensure a richer life situation for moving objects contained in composite video highlight files.

To this end, when the controller executes step 133, that is, if the total number of materials is greater than the specified number, select a specified number of target moving image materials in the moving image material set, and is further configured to perform the following steps: Step 1331, obtain each The start time of acquisition of a piece of moving image material. Step 1332 : Divide the start collection time corresponding to each piece of moving image material into a plurality of material collection periods according to the period of the start collection time, and each material collection period includes a plurality of motion image materials. Step 1333: Select a target number of moving image materials in each material collection period as the target moving image material, and the sum of the selected target numbers in each material collection period is equal to the specified number.

When the camera is collecting moving image material, it will use the start time to mark the time of each moving image material. Therefore, the time period when each moving image material is collected can be determined, that is, before, in the middle or after the preset recording time. period of time. For example, if the preset recording duration is 6:00-18:00, the former period may refer to the morning period, the middle period may refer to the noon period, and the latter period may refer to the afternoon period. According to different settings of the preset recording duration, the division of the time period will also be different, and the number of divisions of the time period may also be determined according to the actual situation. After each piece of moving image material is marked with the time period to which it belongs, it can be divided into multiple material collection periods according to the start time of collection, for example, the material collection periods are morning period, noon period and afternoon period. Each material collection period will include at least one piece of moving image material.

In order to ensure that the time span of multiple moving image materials of the composite video collection file is large, a certain number of moving image materials may be selected respectively in each material collection period. For example, n1 moving image materials are selected in the morning period, n2 moving image materials are selected in the noon period, and n3 moving image materials are selected in the afternoon period. Among them, it is necessary to ensure that n1+n2+n3=the specified number. Finally, the selected n1 moving image materials located in the morning period, n2 moving image materials located in the noon period, and n3 moving image materials located in the afternoon period are spliced and synthesized according to the chronological order of the starting time of acquisition, to obtain Video Highlights file.

In some embodiments, the above-mentioned video clip selection rule may be implemented as follows: if the number of video clips is less than or equal to the above-mentioned preset number, for example, the number is less than or equal to 5, then all video clips are synthesized; if the number of multiple video clips is greater than or equal to When the above preset number, for example, when the number is greater than 5, select the first and earliest video clip, the last video clip is the last and latest video clip of the video collection file, and the remaining 3 video clips are from the remaining video clips. Select evenly across clips.

In some embodiments, in order to improve the viewing effect of the video collection file, background music may be automatically superimposed when synthesizing the video collection file, and a start-up watermark may be added to the video collection file. In order to improve the viewing effect of the video highlight file, the controller performs splicing and synthesis of a specified number of moving image materials to generate a video highlight file that records the moving target within the preset recording duration, and is further configured as: S141. The moving image material is spliced and synthesized to obtain a video file that records the moving target within the preset recording time. S142: Acquire a preset audio file and a broadcast start watermark, where the start broadcast watermark is used to identify product information of the display device. S143, superimpose the audio file, the start-up watermark and the video file to generate a video highlight file for recording the moving target within the preset recording duration. First, splicing and synthesizing a specified number of moving image materials, which can be pictures or videos, to obtain a video file. There are multiple audio files preset in the controller, and one of the audio files is randomly selected to be synthesized with the video file. At the same time, obtain the start-up watermark and add it to the screen of the video file. In order to avoid blocking the video content, the start-up watermark can be added in the lower right corner of the screen, and the actual addition position can be set according to the user's preference. The start-up watermark is used to identify the product information of the display device.

FIG. 9 is a schematic diagram of displaying a watermark for enabling playback according to one or more embodiments of the present application. The start-up watermark can include title watermark and product watermark, see (a) in Figure 9, when the video file starts to play, the title watermark "My Family Diary, April 30, 2020" is displayed, and the title watermark is displayed a few seconds later disappear; see (b) in Figure 9, add the product watermark "XX Social TV, see you now, get together on one screen" in the lower right corner of the video file screen, the product watermark is always displayed on the video file screen. By superimposing the audio file, the start-up watermark and the video file, a video highlight file that records the moving target within the preset recording duration can be generated. In order to provide users with more operation requirements, the moving image material collected by the camera can be stored and displayed on the display. Users can perform functions such as deletion and editing according to the displayed moving image material.

In some embodiments, in order to facilitate the user to operate several moving image materials, the controller is further configured to: when the camera starts to collect the moving image material of the moving object in response to the video recording start instruction, acquire each piece of moving image captured by the camera material; generate an image material list interface in the user interface, and display each piece of moving image material in the image material list interface in chronological order. The user interface displays a video recording startup entry, and after the user triggers the video recording startup entry, an image material list interface can be presented on the display. The image material list interface is used to display moving image material and video collection files. Each piece of moving image material collected by the camera will be displayed in the image material list interface. In some embodiments, the image material list interface is displayed sequentially according to the time sequence of the start time of acquisition of each piece of moving image material. The user can operate the moving image material displayed in the image material list interface to realize different functions, such as sharing to the circle of friends, deleting the selected record, clearing the record and closing the video recording function, etc. The upper right corner of the image material list interface presents the operation prompt item "Press the menu button to disable the function or share and delete the video", and the user can perform the operation indicated by the operation prompt item to realize the above-mentioned interactive function.

In some embodiments, in order to facilitate the user to perform corresponding operations on the moving image material displayed in the image material list interface, the controller is further configured to perform the following steps: Step 151 : Receive the corresponding operation generated when the user performs the corresponding operation according to the operation prompt item. The interactive function calls up the command. Step 152: In response to the interactive function activating instruction, present a functional interactive floating layer in the image material list interface, where the functional interactive floating layer includes a plurality of function controls. Step 153: Execute the target operation corresponding to the target function control in response to the target control instruction generated when the target function control is triggered. When the image material list interface displays content normally, the interactive function entry is not displayed. If the user wants to realize an interactive function, he needs to call up the interactive function entrance first, that is, the user can call up the interactive function entrance by triggering the menu key through the remote control according to the content of the operation prompt item. When the user performs a corresponding operation according to the operation prompt item, an interactive function invocation instruction is generated, and the controller invokes the interactive function invocation instruction according to the interactive function invocation instruction, and calls out the functional interactive floating layer as the interactive function entrance, and displays it on the display. The function interaction floating layer is covered at the bottom of the image material list interface in the form of a floating layer. When the function interaction floating layer is displayed, the image material list interface does not disappear.

In some embodiments, FIG. 15 is a schematic diagram of a watermark for playing a video highlight file according to one or more embodiments of the present application. Referring to FIG. 15 , in response to the detected target user, the controller receives the video clip collected from the camera; based on The video clip generates a video highlight file containing the first watermark and the second watermark. Wherein, the first watermark is no longer displayed after the user interface plays the first display time length of the video highlight file, and the second watermark is displayed along with the video clip when the user interface is playing. System time update, as shown in FIG. 16 , FIG. 16 is a schematic diagram of a watermark for playing a video highlight file according to one or more embodiments of the present application. For example, video collection 1 includes a first watermark and a second watermark, and the first display time length can be configured to be 3 seconds. When video collection 1 is played on the user interface of the display device, the playback screen within 3 seconds includes the first watermark. Watermark, second watermark; after 3 seconds, the playback interface of Video Collection 1 does not display the first watermark, but only the second watermark, and the second watermark is displayed as the system time when the video clip was recorded, such as the first watermark. The second watermark can be displayed as the system time of the video highlight 1 playback picture when recording, so that the user can know the date and time when the playback progress of the current highlight file 1 occurs.

In some embodiments, the controller receives the video clip collected from the camera in response to the detected target user, which specifically includes adding a first watermark and a second watermark to all the video clips when the controller determines that the video clip is the first one of the day. the video clip; otherwise, the controller adds a second watermark to the video clip. For example, after the controller of the display device recognizes the target user and starts to record the video, and determines that the currently recorded video clip is the first video clip of the day, the controller adds the first watermark and the second watermark to the currently recorded video clip, so The first watermark can be implemented, for example, to include a cover image and a system date; the second watermark can be implemented, for example, to include timestamp information, that is, the system date and system time, and the system time is the system time of the currently recorded video clip, so The second watermark can be dynamically displayed along with the user interface refresh; when the controller judges that the currently recorded video clip is not the first video clip of the day, the controller only adds the second watermark to the currently recorded video clip, the For example, the second watermark can be implemented to include time stamp information, namely the system date and the system time, the system time being the system time of the currently recorded video clip, and the second watermark can be dynamically displayed as the user interface is refreshed.

FIG. 17 is a schematic diagram of a watermark for playing a video highlight file according to one or more embodiments of the present application. In some embodiments, the video collection file generated by the display device of the present application further includes a third watermark, and the controller receives the video clips collected from the camera in response to the detected target user, which specifically includes the controller determining that the video clips are On the first day of the day, the controller adds the first watermark, the second watermark, and the third watermark to the video clip; otherwise, the controller adds the second watermark and the third watermark to the video clip. For example, after the controller of the display device recognizes the target user and starts to record the video, and determines that the currently recorded video clip is the first video clip of the day, the controller adds the first watermark, the second watermark and the third watermark to the currently recorded video clip. For video clips, the first watermark can be implemented, for example, to include a cover image and a system date; the second watermark can be implemented, for example, to include timestamp information, that is, the system date and system time, and the system time is the date of the currently recorded video clip. System time, the second watermark can be dynamically displayed as the user interface is refreshed; the third watermark can be implemented, for example, to include brand LOGO information, as shown in FIG. 19 , which shows one or more implementations according to the present application. A schematic diagram of the watermark for the playback of the video highlight file of the example.

When the controller judges that the video clip currently recorded is not the first video clip of the day, the controller only adds a second watermark and a third watermark to the video clip currently recorded, and the second watermark can be implemented to include timestamp information, for example, That is, the system date and the system time, the system time is the system time of the currently recorded video clip, the second watermark can be dynamically displayed along with the user interface refresh; the third watermark can be implemented to include brand LOGO information, for example, As shown in FIG. 18 , FIG. 18 is a schematic diagram of a watermark for playing a video highlight file according to one or more embodiments of the present application.

<Share>

The function interaction floating layer includes multiple function controls, for example, including the "Share to friends and relatives" control, the "Delete selected record" control, the "Clear all records" control, the "Close this function" control and so on. If the user wants to perform a certain interactive function on the moving image material, he can trigger the corresponding function control through the remote control. The "Share to Friends and Family" control is used to perform the sharing operation, the "Delete Selected Record" control is used to perform the operation of deleting a moving image material or video collection file, and the "Clear All Records" control is used to perform the clearing of the image material list interface. For all display operations, the "Turn this off" control is used to perform operations that turn off the video recording function of the display device.

FIG. 10 is a schematic diagram of an interactive interface for executing a function of sharing to a circle of relatives and friends according to one or more embodiments of the present application. Referring to (a) in Figure 10, if the user wants to share a certain moving image material or video collection file to the circle of friends, after selecting the file to be shared, select the "Share to circle of relatives and friends" control as the target function through the remote control controls. The user clicks the target function control "Share to the circle of relatives and friends" through the remote controller again, and the display interface on the display jumps to the sharing interface at this time, and the sharing interface is shown in (b) of Figure 10 . In the sharing interface, you can share a certain moving image material or video collection file to the circle of friends. If the user wants to delete a certain moving image material or video collection file, after selecting the file to be shared, select the "delete selected record" control as the target function control through the remote control. The user clicks the target function control "Delete Selected Record" through the remote controller again, and the display interface on the monitor jumps to the delete interface. In the delete interface, a certain moving image material or video collection file can be deleted. The user can execute the delete operation by triggering the "Delete" control based on the delete interface, and the prompt "Deleted" is displayed in the delete interface.

In some embodiments, if the user wants to clear all the moving image material collected by the camera or the generated video collection file, the "clear all records" control can be selected as the target function control through the remote control. The user clicks the target function control "Clear All Records" again through the remote control, then the display interface in the monitor jumps to the clear interface. In the clear interface, the moving image material or video displayed in the image material list interface can be realized. All collection files are cleared. The user can perform the clearing operation by triggering the "clearing" control based on the clearing interface, and a prompt "all housekeeping records have been cleared" is displayed on the clearing interface.

In some embodiments, if the user wants to turn off the video recording function of the display device, the "turn off this function" control can be selected as the target function control through the remote control. The user clicks the target function control "close this function" again through the remote control, and the display interface in the display jumps to the close interface at this time, and in the close interface, the video recording function of the display device can be closed. The user can perform the closing operation by triggering the "close" control based on the closing interface, and the prompt "closed" is displayed in the closing interface. After the user turns off the video recording function of the display device, the user can also click the sharing link to view the video previously shared by the user. If the user wants to enable this function again, he can continue to view the moving image material and the generated video highlight file of the previous camera.

In some embodiments, to facilitate the user to view each moving image material based on the image material list interface, a time watermark may be added to each moving image material when the moving image material is displayed in the image material list interface. Therefore, the controller is further configured to perform the following steps when performing the chronological display of each piece of moving image material in the image material list interface: Step 161 , acquiring the start time of capturing each piece of moving image material. Step 162: Generate a time watermark including the start time of acquisition, and the time watermark is in one-to-one correspondence with the moving image material. Step 163: Display each piece of moving image material and the corresponding time watermark in the image material list interface according to the time sequence of the start of collection, and display the time watermark at the bottom or top of the corresponding moving image material.

In order to identify each piece of moving image material, a time watermark can be used to mark it. The time watermark is a watermark generated according to the start time of each piece of moving image material, and each piece of moving image material has an independent corresponding time watermark. Each piece of moving image material is displayed in the image material list interface in the chronological order of the starting time of collection. Similarly, each time watermark is also displayed in the image material list interface in the chronological order of the starting time of collection, so that the time watermark is consistent with the moving image material. One-to-one correspondence. The time sequence may be in the order from the nearest to the farthest from the current time, so that the newly collected moving image material is displayed in the front row of the image material list interface. The display position of the time watermark can be determined according to the actual usage, for example, it can be displayed on the bottom, top, left or right of the corresponding moving image material.

In some embodiments, since the moving image material collected by the camera and the video collection file synthesized by the controller are displayed in the image material list interface, in order to identify the video collection file, a time watermark can also be added to the video collection file. . To this end, when adding a time watermark to the video highlight file, the controller is further configured to perform the following steps: Step 171: Obtain the generation time of each video highlight file. Step 172: Create a generation time watermark including the generation time. Step 173: Display each video collection file and the corresponding generation time watermark in the image material list interface according to the time sequence of generation time, and display the generation time watermark at the bottom or top of the corresponding video collection file. Step 174: Delete the moving image material used to generate the video collection file. In order to identify each video collection file, it can be marked by generating a time watermark. The generation time watermark is a watermark generated according to the generation time of each video collection file, and each video collection file has an independent corresponding generation time watermark.

Each video collection file is displayed in the image material list interface in the chronological order of the generation time. Similarly, each generation time watermark is also displayed in the image material list interface in the chronological order of the generation time, so that the generation time watermark and the video collection file are One-to-one correspondence. The time sequence may be in order from the current time to the farthest, so that the newly generated video collection file is displayed in the front row of the image material list interface, and the video collection file is displayed before the moving image material.

In some embodiments, the video highlight file may add background music, and the camera records the video clip without recording audio data. After the preset time period, that is, after 22:00 every day, if the display device is still turned on, or the next day after the display device is turned on, the recorded video clips will be automatically synthesized into a video collection file with background music added. When recording video clips, only image data needs to be recorded, not audio data.

In order to remind the user to be able to timely view the video collection file that the controller automatically calls the camera to collect and synthesize when the user is not at home, the video collection file synthesized on the day needs to be pushed to the user.

To this end, when the video highlight file is pushed to the user, the controller is further configured to perform the following steps: generate a push notification according to the video highlight file, the push notification includes push content and operation prompts; when the display device is started, on the display Push notifications are displayed on the rendered system home page interface. Since the video collection file is generated from moving image material collected from a moving target within the preset recording duration of the day, the user may not activate the display device within the preset recording duration. Therefore, when the user starts the display device for the first time after the video highlight file is generated, the video highlight file can be pushed to the user. That is, when the user starts the display device for the first time, a push notification is generated according to the video highlight file and displayed on the system home page interface presented on the display.

FIG. 11 is a schematic diagram of an interface for displaying a push notification according to one or more embodiments of the present application. Referring to Figure 11, the push notification includes push content and operation prompts, such as "your cute pet exclusive Vlog has been generated, come and have a look", and operation prompts such as "press the menu button to view the details". Users can view the pushed video collection files by triggering the menu button on the remote control. In some embodiments, the video collection file is pushed only once, and is pushed when the user starts the display device for the first time after the generation of the video collection file. For example, if the preset recording time is 6:00-18:00, when it reaches 18:00, the controller controls the camera to stop collecting moving image materials, and at the same time, splicing and synthesizing the specified number of moving image materials to obtain a video collection document. After 18:00, if the user starts the display for the first time at 19:00, the video collection file will be displayed on the system home page interface in the form of a push notification to prompt the user to view and record the wonderful moments of the pet or baby's day.

It can be seen that, in a display device provided by an embodiment of the present application, the display is configured to present a user interface that displays a video recording start entry, and the video recording start entry is used to start a video recording function of the display device. The controller receives the video recording start instruction generated when the video recording start entry is triggered, so as to instruct the camera to collect the moving image material of the moving target according to the preset collection frequency within the preset recording duration; when the end time of the preset recording duration is reached, The specified number of moving image materials are spliced and synthesized to generate a video collection file that records the moving target within the preset recording time. It can be seen that in the display device provided by the embodiment of the present application, after the user starts the video recording function, the controller can actively call the camera in real time to collect the moving image material of the moving target without real-time operation by the user, and synthesize the video collection file after the image collection is completed. , the user can know the movement of the moving target within the preset recording duration according to the video collection file, which will bring a good experience to the user.

In some embodiments, FIG. 12 is a schematic diagram of a display device video highlight file according to one or more embodiments of the present application. Referring to FIG. 12 , the user interface includes a plurality of video highlight poster controls, and the lower side of the video highlight poster controls further includes prompt text indicating the generation date. For example, the video collection can be implemented as multiple video collections in one day, that is, the video collections are generated on the same day, but the content of the video collections is different; in other embodiments, the video collections can also be implemented as different Collections of dates, i.e. each collection has a different generation date.

In some embodiments, the controller of the display device controls the camera to record video clips, and generates a video highlight file based on a plurality of the acquired video clips, which specifically includes the controller recording within a preset time period no longer than a first preset time length After the preset time period, or after the first power on the day after the preset time period, the controller generates a video highlight file based on the plurality of acquired video clips. For example, within a preset time period of the display device, such as 00:00-22:00 every day, the controller detects that the video highlight switch is on and the camera is on, that is, the camera is in a raised state, and the controller of the display device Automatically detect the cute baby in front of the display device, and automatically record a video clip with a duration not longer than the first preset time length, such as 6s after each detected cute baby; after the preset time period, that is, after 22:00 every day If the display device is still powered on, or the next day after the display device is powered on, the recorded video clips will be automatically synthesized into a video highlight file, and the file will be stored in the specified directory of the NAS (Network Attached Storage), and pushed through a notification. For users, users can click to view, and can also view the collection of target users who downloaded the NAS disk storage through the mobile phone.

In some embodiments, after the display device controller is turned on for the first time on the day after the preset time period, the display device controller generates a video highlight file based on the acquired multiple video clips, which specifically includes the first power on the day after the preset time period. After two preset time lengths, the display device controller generates a video highlight file based on the acquired multiple video clips. For example, the target user detection service of the display device can be configured to include startup and timing automatic startup; if it is configured to start the target user detection service at startup, it can be set to start the target user video clip after a preset second length of time, for example, 5 minutes later For the task of synthesizing video collection files, by detecting and synthesizing after 5 minutes, it can avoid that the application starts to preempt system resources and causes the system to freeze and slow down.

In some embodiments, if the TV display device is not connected to the NAS, a specific button in the login interface of the A application will be grayed out, which means that the video highlight switch is off, and a prompt message will be displayed on the user interface. In some embodiments, the video collection file generated by the display device can be stored in the NAS, and the display device, or the mobile terminal, or the home private cloud can play the video collection file by accessing the NAS. The video collection files generated by the display device are stored on the NAS. The video collection files can be browsed and played through the A application, browsed and viewed through the home shared directory in the home private cloud space, and can also be viewed through the mobile phone application to view the TV display device Generated video highlight files stored on the NAS. In some embodiments, the controller controls the video collection file stored in the NAS to be pushed to a display device, a mobile terminal, or a private home cloud, and the user can download and play the video collection file.

In some embodiments, the A application architecture includes: a camera detection module, a whole machine setting module, a switch module, a recording and synthesis service module, a NAS module, and an application program module. The recording and synthesis service module includes a face detection module, a video recording module and a video synthesis module. The face detection module is used to detect whether there is a target user in the preview frame, for example, there is a cute baby; the video recording module is used to record video when the cute baby is detected; the video synthesis module is used to synthesize the Video clips, synthesizing the video source to generate a collection of cute babies, that is, a video collection file. The NAS module is used for file storage, and stores the content output by the recording and synthesis service module. For example, save the video recording file, save the synthesized video highlight file to the relevant directory of the NAS. The application module includes a collection browsing interface module and a menu module, the collection browsing interface module is used to display the video collection files stored in the NAS module, and the video collection files can be shared to the circle of relatives and friends, or deleted through the menu module in the collection browsing interface , or other operations. The camera detection module is used to detect the occupancy status of the camera and output the detection result to the recording synthesis service module; the whole machine setting module is used to set the camera and output it to the recording synthesis service module; the switch module is used to control A The application switch is output to the recording and synthesis service module, and it can also determine whether to enable the face detection function for target user identification, that is, target user identification; the switch module is also used for the entrance of the A application, for example, the cute baby detection switch is turned on Only then can cute baby detection be performed, and video clips of cute baby can be captured; in some embodiments, the video playback video collection file can be played by starting the media center.

The implementation process of starting the video recording function of the display device provided in some of the above-mentioned embodiments is implemented by the controller in the display device, and in other embodiments, the video recording function that can start the display device may also be a device connected to the display device. Intelligent Terminal. On the smart terminal side, it supports the activation of the video recording function of the display device, the browsing and editing of moving image materials, and the viewing and sharing of video collection files.

In order to realize the process of enabling the video recording function of the display device by the smart terminal, a smart terminal 300 provided by some embodiments of the present application includes: a display 320 and a processor 310 that are connected to each other. The display 320 is configured to present a terminal user interface displaying a video recording start entry for starting a video recording function for recording a moving image and generating a video highlight file by video recording within a preset recording duration, and the video recording The function is configured in the controller of the display device. The processor 310 is connected to the controller 250 in the display device, and a designated application program is configured in the processor, and the designated application program is used to call up the terminal user interface to be displayed on the display 320 . The processor receives the video recording start command generated when the user operates the smart terminal, and sends the video recording start command to the controller in the display device, so that the controller starts the video recording function of the display device, that is, actively calls the camera to capture in real time. Moving image material of moving objects and composite video collection files.

In some embodiments, when executing the interactive method for generating a video highlight file, the processor thereof is configured to perform the following steps: S21. Receive a video recording function invocation instruction generated when a specified application is triggered. In order to start the video recording function of the display device on the intelligent terminal side, a designated application program needs to be configured in the processor of the intelligent terminal, and the designated application program is displayed on the terminal homepage. Specifies that the application provides the entry point for starting the video recording function. The user manually triggers the designated application program to generate a video recording function activating instruction, and the processor can call up the entry for starting the video recording function according to the video recording function activating instruction. S22. In response to the video recording function activating instruction, present in the display a terminal user interface displaying a video recording startup entry. After receiving the instruction to activate the video recording function, the processor presents the terminal user interface on the display 320 of the smart terminal, and displays the video recording start entry on the terminal user interface. In some embodiments, FIG. 13 is a schematic interface diagram of a terminal user interface according to one or more embodiments of the present application. After the user triggers the designated application, a terminal user interface is displayed on the display, and a video recording start entry, such as "A Day of a Cute Pet", is displayed in the terminal user interface. The user clicks "A Day of the Cute Pet" to generate the video recording function startup interface. The page displays the "Enable" control, and the user triggers the "Enable" control to enable the video recording function.

S23. Receive the video recording start instruction generated by triggering the video recording start entry, and send the video recording start instruction to the controller, where the video recording start instruction is used to instruct the controller to call the camera in the display device within the preset recording duration according to the preset The collection frequency collects the moving image material of the moving object, and splices and synthesizes a specified number of moving image materials to generate a video collection file that records the moving object within the preset recording duration.

The user can generate a video recording start instruction based on the video recording startup entry displayed on the user interface of the terminal, and triggering the entry, that is, the "open" control. Then, the processor sends the video recording start instruction to the controller in the display device. After the controller receives the video recording start instruction, it can turn on the video recording function of the display device, that is, execute calling the camera in the display device to record the preset record. During the duration, the moving image materials of the moving target are collected according to the preset collection frequency, and the specified number of moving image materials are spliced and synthesized to generate a video collection file that records the moving target within the preset recording duration. The relevant steps for the controller to perform the video recording function may refer to the content of the display device-based part of the foregoing embodiment, which will not be repeated here.

In some embodiments, after the smart terminal side starts the video recording function of the display device, a video list interface will be presented on the display of the smart terminal. When presenting the video list interface, the processor is further configured to perform the following steps: Step 241, in response to the video recording start instruction, present the video list interface on the display. Step 242: Acquire the moving image material and the video collection file stored in the controller, and display the moving image material and the video collection file in the video list interface. After the processor receives the video recording start command generated when the user triggers the video recording start entry, it sends the video recording start command to the controller to start the video recording function of the display device, and switches the display of the smart terminal according to the video recording start command. The display content, that is, the terminal user interface displayed on the display of the intelligent terminal is switched to display the video list interface. The video list interface is similar to the image material list interface in the display device, and both are used to display moving image materials and video collection files. The moving image material and the synthesized video collection file collected by the camera will be stored in the controller. The controller will display the moving image material and the synthesized video collection file on the image material list interface and send it to the processor of the intelligent terminal, and the processor will send it to the processor of the intelligent terminal. Displays moving image material and composite video collection files on the video list interface. That is to say, the content displayed on the video list interface is the same as that displayed on the image material list interface.

In some embodiments, if the user activates the video recording function of the display device for the first time, it means that the camera has not captured any moving image material, and thus no video highlight file has been generated. Therefore, nothing is displayed in the video list interface. FIG. 14 is a schematic interface diagram of a video list interface according to one or more embodiments of the present application. When the user starts the video recording function for the first time, the content displayed in the video list interface is as shown in (a) of FIG. 14 . At this time, the prompt content "No pet has been found" is displayed in the video list interface. In some embodiments, if the user starts the video recording function of the display device for the second or subsequent times instead of starting it for the first time, it means that the camera has collected moving image material, and may also have generated a video highlight file. At this time, the video In the list interface, the moving image material collected by the camera and the video collection file generated by the controller history will be displayed, as shown in the video list interface in (b) of Figure 14. The display order of moving image materials and video collection files in the video list interface can be the same as that in the image material list interface, and will not be repeated here.

In some embodiments, the user can perform personalized operations on the moving image material and video highlight files displayed in the video list interface to realize different functions, such as sharing and downloading. To this end, when the user performs the personalization operation based on the video list interface, the processor is further configured to perform the following steps: Step 251 , display the personalization at the bottom of each moving image material and video highlight file displayed in the video list interface Action controls. Step 252: In response to triggering the personalized operation instruction generated by the target personalized operation control, execute the target personalized operation corresponding to the target personalized operation control. In the video list interface, personalized operation controls are displayed at the bottom of each moving image material and each video highlight file. In some embodiments, the personalized operation controls include a "share" control and a "download" control, and the "share" control can be used. Execute the operation of sharing a certain moving image material or video collection file to other platforms, and the "Download" control is used to perform the operation of downloading a certain moving image material or video collection file to the local. When a user triggers a personalized operation control, a personalized operation instruction can be generated, and the processor can perform a corresponding personalized operation according to the personalized operation instruction, such as sharing to other platforms, or downloading locally.

In some embodiments, in order for family members to perform personalized operations on the moving image material and video collection files displayed in the video list interface through the intelligent terminal, the intelligent terminal may authorize other intelligent terminals to operate the video list interface. When the intelligent terminal authorizes other intelligent terminals to perform personalized operation on the video list interface, the processor is further configured to perform the following steps: Step 261: Receive the device sharing instruction generated when the device sharing control is triggered, and the device sharing instruction is used to communicate with the peer The terminal intelligent terminal establishes an association relationship. Step 262: Send the device sharing instruction to at least one peer intelligent terminal to establish an association relationship between the local intelligent terminal and at least one peer intelligent terminal, and the device sharing instruction is used to instruct the peer intelligent terminal to execute the video collection file according to the association relationship. personalized operation. A "setting" entry is displayed in the terminal user interface, and when the user triggers the "setting" entry, the terminal setting interface can be presented on the display of the smart terminal, and the terminal setting interface is configured with device sharing controls. When the user triggers the device sharing control in the terminal setting interface, the device sharing instruction can be generated. The processor of the local smart terminal sends the device sharing instruction to the peer smart terminal that needs to perform personalized operation on the video list interface. After receiving the device sharing instruction, the opposite end intelligent terminal can establish an association relationship with the local end intelligent terminal, so that the opposite end intelligent terminal can operate the video list interface.

The operation steps of the peer user operating the peer smart terminal and the local user operating the local smart terminal and the page displayed by the corresponding display are the same. The only difference is that the peer user cannot operate the video recording function of the display device on the peer smart terminal. Perform on and off operations. If the local user does not enable the video recording function of the display device, nothing is displayed in the video list interface. At this time, if the peer user triggers the video recording startup entry on the terminal user interface of the peer smart terminal, a prompt will be displayed on the terminal user interface. For example, the prompt content can be "The administrator needs to enable this function to view." , the administrator refers to the local user. That is, after the local user enables the video recording function of the display device based on the local smart terminal, the peer user can perform personalized operations on the moving image material and video collection files on the peer smart terminal.

It can be seen that, in a smart terminal provided by some embodiments of the present application, the display is configured to present a terminal user interface displaying a video recording start entry, and the video recording start entry is used to start the video recording function of the display device. The processor is connected to the controller in the display device, and the processor is configured to: receive a video recording function activating instruction generated when a specified application is triggered, and present a terminal user interface with a video recording startup entry in the display; receive the trigger video The video recording start command generated by the recording start entry is sent to the controller. The video recording start command is used to instruct the controller to call the camera in the display device to collect the moving image material of the moving target according to the preset collection frequency within the preset recording time. , and splicing and synthesizing a specified number of moving image materials to generate a video collection file that records the moving target within a preset recording time period. It can be seen that in the smart terminal provided by the embodiment of the present application, the user enables the video recording function of the display device through the smart terminal, and the display device can realize the function of collecting the moving image material of the moving target and synthesizing the video collection file without the user operating the display device in real time. The user can know the movement situation of the moving target within the preset recording duration according to the video collection file, which will bring a good experience to the user.

Some embodiments of the present application also provide an interactive method for generating a video collection file, which is applied to a display device. The method includes: S11. Receive a video recording start instruction generated when the video recording start entry is triggered, and the video recording The start instruction is used to instruct the camera to collect the moving image material of the moving target according to the preset collection frequency within the preset recording time, and the video recording start entry is used to start the video recording to record the moving image and record the moving image within the preset recording time. The function of generating a video collection file, and the moving target refers to the target that needs to record a moving image by video recording within a preset recording duration to generate a video highlighting file; S12, when reaching the end moment of the preset recording duration, obtain The camera collects several moving image materials of the moving target within the preset recording duration; S13, splicing and synthesizing a specified number of the moving image materials to generate a recording of the moving target within the preset recording duration Video Highlights file.

Some embodiments of the present application further provide an interactive method for generating a video collection file, which is applied to a smart terminal, the method includes: S21, receiving a video recording function activating instruction generated when the designated application is triggered; S22, responding In response to the video recording function activating instruction, a terminal user interface displaying a video recording startup entry is presented in the display, and the video recording startup entry is used to initiate the recording of moving images through video recording within a preset recording duration. And generate the video recording function of the video collection file, and the video recording function is configured in the controller of the display device; S23, receive the video recording startup instruction generated by triggering the video recording startup entry, and send the video recording startup instruction to The controller, the video recording start instruction is used to instruct the controller to call the camera in the display device to collect the moving image material of the moving target according to the preset collection frequency within the preset recording duration, and to transfer the specified number of the The moving image material is spliced and synthesized to generate a video highlight file that records the moving object within a preset recording time period.

For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion in some embodiments is not intended to be exhaustive or to limit implementations to the specific forms disclosed above. Numerous modifications and variations are possible in light of the above teachings. The above embodiments have been chosen and described to better explain the principles and practical applications, so as to enable those skilled in the art to better utilize the embodiments and various modified embodiments suitable for specific use considerations.

Claims

A display device comprising:

a display for displaying the user interface;

Controller, configured as:

When the target user is within the monitoring range of the display device, receive the video clip collected by the camera;

A video collection file is generated based on the acquired multiple video clips, wherein after the video collection file receives a confirmation operation, the controller controls the user interface to play the video collection file.
The display device according to claim 1, wherein the controller is further configured to, before the controller receives the video clip collected from the camera, further comprising the controller determining that the video highlight switch of the display device and the camera are in On state.
The display device of claim 1, the controller configured to:

The controller records a video clip not greater than a first preset time length within a preset time period;

After the preset time period, or after the first power on the day after the preset time period, the controller generates a video highlight file based on the plurality of acquired video clips.
The display device of claim 3, the controller configured to:

After the second preset time length of first booting on the day after the preset time period, the controller generates a video highlight file based on the plurality of acquired video clips.
The display device of claim 3, the controller configured to:

The controller generates a video highlight file based on a plurality of the acquired video clips, wherein the video highlight file includes the earliest video clip and the latest video clip within the preset time period.
The display device of claim 1, the controller configured to:

When the user is within the monitoring range of the display device, the controller controls the camera to perform face detection;

Based on the face detection, it is determined whether the user is younger than the preset age. If the user is younger than the preset age, it is determined as the target user, and the controller receives the video clip collected from the camera; otherwise, the controller controls the The camera continues with face detection.
The display device of claim 1, further comprising network attached storage,

The controller is configured to:

The video collection file is stored in network attached storage.
The display device of claim 1, the controller configured to:

Background music is added to the video collection file, and the camera does not record audio data when recording the video clip.
The display device of claim 1, the controller configured to:

From the initial moment of the preset recording duration, obtain the preview image collected by the camera;

Perform image recognition on the preview image to determine whether the moving target exists in the preview image;

If the moving object exists in the preview screen, the camera is called to collect the moving image material of the moving object according to a preset collection frequency.
An intelligent terminal, comprising:

a display configured to present a terminal user interface displaying a video recording start entry, the video recording start entry being used to start a video recording function for recording a moving image and generating a video highlight file by video recording within a preset recording duration, The video recording function is configured in the controller of the display device;

A processor connected to the controller in the display device, a designated application program is configured in the processor, and the processor is configured to:

receiving a video recording function call-up instruction generated when the designated application is triggered;

In response to the video recording function invocation instruction, presenting a terminal user interface displaying a video recording start entry in the display;

Receive a video recording start command generated by triggering the video recording start entry, and send the video recording start command to the controller, where the video recording start command is used to instruct the controller to call the camera in the display device to record in a preset setting During the duration, the moving image material of the moving target is collected according to the preset collection frequency, and a specified number of the moving image material is spliced and synthesized to generate a video collection file recording the moving target within the preset recording duration.
The intelligent terminal of claim 10, the controller is further configured to:

presenting a video listing interface in the display in response to the video recording initiation instruction;

Acquire the moving image material and the video collection file stored in the controller, and display the moving image material and the video collection file in the video list interface.
The intelligent terminal of claim 11, the controller is further configured to:

Display personalized operation controls at the bottom of each moving image material and video highlight file displayed in the video list interface;

In response to triggering the personalized operation instruction generated by the target personalized operation control, the target personalized operation corresponding to the target personalized operation control is executed.
The smart terminal of claim 10, wherein a device sharing control is presented in the terminal user interface; and, the controller is further configured to:

receiving a device sharing instruction generated when the device sharing control is triggered, where the device sharing instruction is used to establish an association relationship with a peer intelligent terminal;

Send the device sharing instruction to at least one peer intelligent terminal, and establish an association relationship between the local intelligent terminal and at least one peer intelligent terminal, and the device sharing instruction is used to instruct the peer intelligent terminal to execute according to the association relationship. Personalized operations on video highlight files.
A method for generating a video collection file, comprising:

Record video clips when the target user is within the monitoring range;

A video highlight file is generated based on the acquired plurality of the video clips, wherein the video highlight file is played in the user interface after receiving the confirmation operation.
The method of claim 14, comprising:

Receive a video recording start instruction generated when the video recording start entry is triggered, where the video recording start instruction is used to instruct the camera to collect moving image material of a moving target according to a preset collection frequency within a preset recording duration, and the video recording The startup entry is used to start the function of recording moving images through video recording within a preset recording duration and generating a video highlight file, and the moving target refers to the need to record moving images through video recording within the preset recording duration to generate a video highlight. the target of the document;

When reaching the end time of the preset recording duration, acquiring several moving image materials of the moving target captured by the camera within the preset recording duration;

A specified number of the moving image materials are spliced and synthesized to generate a video collection file that records the moving object within a preset recording duration.