WO2022088344A1

WO2022088344A1 - Video recording method and system, terminal device, and computer-readable storage medium

Info

Publication number: WO2022088344A1
Application number: PCT/CN2020/132005
Authority: WO
Inventors: 李明沅; 梁启明
Original assignee: 深圳真伊科技有限公司
Priority date: 2020-10-28
Filing date: 2020-11-27
Publication date: 2022-05-05
Also published as: CN112788266A; CN112788266B

Abstract

A video recording method and system, a terminal device and a computer-readable storage medium. The method comprises: continuously collecting video data of a set range within a field of view of a video acquisition unit and/or audio data around an audio acquisition unit, and automatically and dynamically caching a first video and/or audio data of a first set duration or a first set storage capacity in a circulatory manner to a first storage unit so as to keep the first video and/or audio data updated in real time dynamically cached in the first storage unit; when receiving a first trigger signal, transferring all or part of the first video data and/or the first audio data cached at a time point in the first storage unit to a second storage unit; and at the same time, continuing to automatically and dynamically cache the video data and/or audio data in a circulatory manner collected after the time point in the first storage unit. The prompt recording or compensational recording of events is achieved, i.e. the recording of events will not be missed, and a large amount of useless video data will not be produced.

Description

A video recording method, system, terminal device and computer-readable storage medium

technical field

The present invention relates to the field of information technology, and in particular, to a method, a system, a terminal device and a computer-readable storage medium for video recording by a video capture unit.

Background technique

With the development of digital media technology and the wide application of smart devices such as smart phones, people are more and more accustomed to recording beautiful moments in life through smart devices. There are basically two situations in which people use smart devices to record their life, one is the situation that is not known in advance, and the other is the situation that is known in advance. For example, if there are children at home, parents want to record every bit of the child's growth, and do not want to miss every moving moment. However, wonderful moments are always fleeting. Often when the child is found to be showing his innocence, and the smart device is turned on and aimed at the child, the expression and scene just now have been missed. The situation cannot be recorded in time. In addition, when I participate in the interaction of the children, or when I make food and my hands need to be occupied, I often cannot find other people to help with the video and miss it; The effect is not good.

In the prior art, some IP Cameras with SD cards can record 7x24 hours of continuous video, so that every scene can be recorded, and the video content can be edited later. Such an operation is very troublesome, and the SD card needs to be pulled out for manual editing from time to time, and it is often necessary to search for the desired content in the long-term video files, which affects the user experience. For models without an SD card, recording of the desired scene cannot be achieved. In addition, the long-term erasing and writing operations of the SD card can easily cause bad blocks of the SD card and affect the life of the SD card. Moreover, the capacity of the SD card is limited. If you do not review it in time, all the target video clips will be lost after the SD card video content is overwritten in a loop.

Therefore, the prior art lacks an effective video recording method capable of recording and compensating for recording the beautiful moments in life in time.

The disclosure of the above background technology content is only used to assist the understanding of the concept and technical solution of the present invention, and it does not necessarily belong to the prior art of the present patent application. In this case, the above background art should not be used to evaluate the novelty and inventive step of the present application.

SUMMARY OF THE INVENTION

In order to solve the existing problems, the present invention provides a video recording method, system, terminal device and computer-readable storage medium.

In order to solve the above problems, the technical scheme adopted in the present invention is as follows:

A video recording method, comprising the following steps: S1: Continuously collect video data within a set range within the visual field of a video capture unit and/or audio data around the audio capture unit, and automatically and dynamically buffer a first set duration or a first set duration The first video data and/or the first audio data of the storage capacity are stored in the first storage unit, so as to keep the first storage unit dynamically buffered with real-time updating, the length of which is the first set duration or the storage capacity of the first storage unit. The first video data and/or the first audio data of the first set storage capacity; S2: when the first trigger signal is received, all or part of the buffered data in the first storage unit at this time point is stored. The first video data and/or the first audio data are dumped to the second storage unit; at the same time, the video data and/or audio data collected after the time point are automatically and dynamically buffered to the first storage unit.

Preferably, in step S2, while transferring the first video data and/or the first audio data to the second storage unit, continue to collect and store the second video data and/or the second audio data to the second storage unit.

Preferably, the first storage unit is a readable and writable storage medium, including a volatile storage medium, a non-volatile storage medium, and an external network storage medium; the first video stored in the first storage unit When the data and/or the first audio data have reached the first set duration or the first set storage capacity, the later recorded video data and/or audio data cyclically cover the first recorded video data and the first set storage capacity. /or audio data; the second storage unit is a local storage unit or a remote storage unit, configured to receive the dumped first video data and/or the first audio data, and/or directly store the first video data and/or the first audio data. two video data and/or the second audio data; or, for storing the processed first video data and/or the first audio data, the second video data and/or the second audio data; the processing includes synchronizing the first video data and the first audio data, synchronizing the second video data and the second audio data.

Preferably, the data of the second storage unit is stored and/or transmitted in a secure encrypted manner.

Preferably, the first trigger signal is a passive trigger signal or an active trigger signal; the passive trigger signal includes a first trigger signal output by receiving a trigger instruction from a user or a trigger instruction from an associated device; the active trigger signal Including continuous matching with preset trigger conditions, and if the matching is successful, then actively triggering as the first trigger signal; the trigger conditions include: preset target object list, preset expression type, preset action type, preset Set at least one of the sound types.

Preferably, the triggering instruction of the user includes pressing a button or remotely pressing a button on a remote control device to send an instruction, sending an instruction through an application program, sending an instruction through voice, and sending an instruction through somatosensory interaction; the preset target object list Including people, animals, objects.

Preferably, the target object is placed in the video frame by judging the movement of the target object to control the rotation of the video capture unit.

Preferably, the position of the target object in the video picture in the video data is adjusted through digital zoom.

Preferably, the video data is collected through a wide-angle panoramic lens; or, the first sub-video data is collected respectively through at least two video collection units, and the first sub-video data is spliced into a horizontal panoramic video picture as the video data.

Preferably, the second sub-video data is obtained by shooting from different angles through a distributed video capture system composed of at least two video capture units placed in different positions, and each of the second sub-video data is the For the video data collected by the video collection unit, the second sub-video data is spliced to complete multi-angle video data, and the video data is obtained from the multi-angle video data according to the collection time.

Preferably, the method further includes: performing time synchronization on the video capture unit; analyzing the second sub-video data of the video capture unit, and adjusting the angle of the video capture unit or the size of the video frame; The two sub-video data have date and time information, and the video data is obtained by splicing video data from different angles according to the time stamp.

Preferably, audio data is collected from different locations through a distributed audio collection system composed of at least two wireless audio collection units placed at different locations.

Preferably, time synchronization is performed on the wireless audio collection unit; or, the wireless audio collection unit forms a sound localization system, and the position of the target object is determined according to the sound of the target object.

Preferably, the method further includes: S3: After receiving a second trigger signal, stop storing the collected second video data and/or second audio data in the second storage unit, and continue to collect the first video data and/or the second audio data. /or the first audio data is automatically circularly buffered to the first storage unit.

Preferably, the second trigger signal is a passive trigger signal or an active trigger signal; the passive trigger signal includes a second trigger signal output by receiving a user's trigger instruction or receiving a trigger instruction from an associated device; the user's triggering The instructions include pressing a button or remotely pressing a button on a remote control device to send an instruction, sending an instruction through an application program, sending an instruction through voice, and sending an instruction through somatosensory interaction; the active trigger signal includes continuous matching with preset trigger conditions, If the matching fails continuously within the second set time period, the active trigger is used as the second trigger signal; the trigger conditions include: a preset target object list, a preset expression type, a preset action type, and a preset sound. at least one of the types; the preset target object list includes characters, animals, and objects.

The present invention also provides a video recording system, comprising: a video capture unit configured to continuously capture video data within a certain range of the video capture unit's field of view; an audio capture unit configured to capture audio around the audio capture unit data; a first storage unit configured to automatically and dynamically buffer the first video data and/or the first audio data of a first set duration or a first set storage capacity, so that the first storage unit In the dynamic cache there is real-time updated first video data and/or first audio data whose length is the first set duration or whose storage capacity is the first set storage capacity; the second storage unit is configured as When the processing unit receives the first trigger signal, the processing unit receives all or part of the first video data and/or the first audio data that are dumped by the first storage unit and buffered at this point in time; the A processing unit for executing any of the methods described above.

Preferably, the video data further includes second video data collected after the processing unit receives the first trigger signal; the audio data further includes second video data collected after the processing unit receives the first trigger signal the second audio data; the second storage unit is further configured to store the second video data and/or the second audio data.

The present invention further provides a video recording terminal device, which includes a memory, a processor, and a computer program stored in the memory and running on the processor. steps of the method described.

The present invention further provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, implements the steps of any of the above methods.

The beneficial effects of the present invention are as follows: a video recording method, system, terminal device and computer-readable storage medium are provided, and by setting the first storage unit and the second storage unit, according to the first trigger signal, The first video data and/or the first audio data are transferred to the second storage unit, so as to realize the timely recording or compensation recording of the event, that is, the occurrence of the recording event will not be missed, and a large amount of useless video data will not be generated.

Description of drawings

FIG. 1 is a schematic diagram of a first video recording method in an embodiment of the present invention.

FIG. 2 is a schematic diagram of a second video recording method in an embodiment of the present invention.

FIG. 3 is a schematic diagram of a third video recording method in an embodiment of the present invention.

FIG. 4 is a schematic diagram of a fourth video recording method in an embodiment of the present invention.

FIG. 5 is a schematic diagram of a first video recording system in an embodiment of the present invention.

Detailed ways

In order to make the technical problems, technical solutions and beneficial effects to be solved by the embodiments of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

It should be noted that when an element is referred to as being "fixed to" or "disposed on" another element, it can be directly on the other element or indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or indirectly connected to the other element. In addition, the connection can be used for both the fixing function and the circuit connection function.

It is to be understood that the terms "length", "width", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top" , "bottom", "inside", "outside", etc. indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, only for the convenience of describing the embodiments of the present invention and simplifying the description, rather than indicating or implying that The device or element referred to must have a particular orientation, be constructed and operate in a particular orientation, and therefore should not be construed as limiting the invention.

In addition, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature defined as "first", "second" may expressly or implicitly include one or more of that feature. In the description of the embodiments of the present invention, "plurality" means two or more, unless otherwise expressly and specifically defined.

As shown in Figure 1, the present invention provides a video recording method, comprising the following steps:

S1: Continuously collect video data within a set range of the video capture unit and/or audio data around the audio capture unit, and automatically and dynamically circularly buffer the first video data and/or the first set duration or first set storage capacity. Or the first audio data is sent to the first storage unit, so as to keep the first storage unit dynamically buffered with a real-time update, the length of which is the first set duration or the storage capacity of which is the first set storage capacity. a video data and/or first audio data;

S2: When the first trigger signal is received, transfer all or part of the first video data and/or the first audio data buffered in the first storage unit at the moment to the second storage unit At the same time, the video data and/or audio data collected after the time point are continuously automatically and dynamically buffered to the first storage unit.

In a specific embodiment, a camera is used to record and collect video data, and a sound recorder is used to collect audio data, the first storage unit is RAM, and the second storage unit is permanent storage. It can be understood that, for a part of the memory in the RAM in the first storage unit as the pre-allocated storage space, and the other part of the memory for other storage, the first video data and/or the first audio data are stored in the pre-allocated storage space. . Under normal circumstances, the camera and/or the recorder works normally to collect the first video data and the first audio data and store them in the RAM. The first set duration for the first audio and video data to be cached in the first storage unit can be preset. Or the first set storage capacity, that is, only the first video data and/or the first audio data of the first set duration are stored; or the first video data and/or the first audio data of the first set storage capacity are stored. When the video recording system receives the first trigger signal, it transfers the data of the first storage unit to the second storage unit. It can be understood that when the video recording system starts recording, the first storage unit may be in a state of zero storage, and the first video data and/or the first audio data of the first set duration are accumulated from nothing; A first video data and/or first audio data with a set storage capacity, and then dynamically circularly buffered.

In a specific embodiment, because of the first set duration or the first set storage capacity cached in the first storage unit, if the user finds that something worth recording has occurred in the past 3 minutes, the A trigger signal to transfer all the first video data and/or the first audio data in the first storage unit to the second storage unit, or transfer only the first video data and/or the first video data and/or the first video data related to the event to be recorded An audio data is dumped to the second storage unit. At this time, the cached video is stored as a permanent video to complete the timely recording or compensation recording of the event. It can be understood that the partial dumping in the present invention refers to dumping the first video data and/or the first audio data related to the event to be recorded to the second storage unit, and this part of the video or audio data may be the first video data and/or the first audio data. Set any period in the duration or the first set storage capacity.

In a specific embodiment, the parent is telling a story to the child, and suddenly the child says childish words, or suddenly lies on the back of the parent. It will be very regrettable; even if the child re-enacts it once, it will not restore the scene at that time. At this time, the user can use the method of the present invention to record in time what has just happened and is worth recording. The user can send a first trigger signal to transfer all the first video data and/or the first audio data in the first storage unit to the second storage unit.

In an embodiment of the present invention, it is assumed that the first set duration set by the video recording system is 5 minutes. When the system receives the first trigger signal, it dumps the first video data and/or audio data of the first set duration, that is, 5 minutes, to the second storage unit; and continues the video data and/or audio data collected after the moment Or the audio data is automatically and dynamically buffered to the first storage unit. After 3 minutes (less than 5 minutes of the first set duration), the first trigger signal is received again. At this time, it will be from the time when the first trigger signal was last received to the second time when the first trigger signal is received. 3 minutes of video and/or audio data between points are dumped to the second storage unit.

In another embodiment of the present invention, the video and/or audio data 2 minutes before the moment when the first trigger signal is received for the first time (this part of the data is also stored in the first storage unit because it is not overwritten) , the rest are dynamically cyclically covered by the new data collected after the first trigger signal is received), consisting of 3 minutes of video and/or audio data after the moment when the first trigger signal is first received 5 minutes of video and/or audio data are transferred to the second storage unit together.

In yet another embodiment of the present invention, the video data within a set range within the visual field of the video capture unit and/or the audio data around the audio capture unit are collected. For the set range, it can be understood that the default setting is the video capture unit The user can also set the saved video data to be a sub-picture in the field of view, and the sub-picture scope is the set range at this time. In a specific implementation, a sub-picture in the video field of view can be selected, and zoomed in by means of digital interpolation, etc., to realize a digital zoom function, and record the video content of the sub-picture at this time in an enlarged manner. As shown in FIG. 2, in a further embodiment, while transferring the first video data and/or the first audio data to the second storage unit, the collection of the second video data and/or the first audio data is continued. The second audio data is stored in the second storage unit, and the subsequent scene is recorded.

In another specific embodiment, if there is a conflict among the children at home, and the parents cannot judge the real situation of the matter, the first set duration or the first set duration cached in the first storage unit can be set by the first trigger signal. The storage capacity is transferred to the second storage unit for judging the real state of things. At this time, the supplementary recording of the event is realized by the method of the present invention.

In the present invention, the first storage unit and the second storage unit are arranged, and the first video data and/or the first audio data stored in the first storage unit are transferred to the second storage unit according to the first trigger signal, so as to realize the detection of the event Timely recording or compensating recording, that is, neither missing recording events nor generating a large amount of useless video data.

In another embodiment of the present invention, while transferring the first video data and/or the first audio data to the second storage unit, continue to collect the second video data and/or the second audio data and stored in the second storage unit.

It can be understood that the first video data and/or the first audio data need to be transferred to the second storage unit through the first storage unit, while the second video data and/or the second audio data are directly stored in the second storage unit. storage unit. Because the first video data and/or the first audio data stored in the first storage unit has reached the first set duration or the first set storage capacity, the later recorded video data and/or audio data cyclically cover the first Recorded video data and/or audio data. In one embodiment, when the first trigger signal is received, the event has already occurred, so the data of the complete event can be formed by splicing the first audio and video data and the second audio and video data at this time.

In an embodiment of the present invention, the first storage unit is a readable and writable storage medium, including a volatile storage medium, a non-volatile storage medium, and an external network storage medium. Volatile storage media, including RAM, SRAM, Cache, etc.; non-volatile storage media, including Flash, flash memory, SD card, hard disk, etc.; external network storage, including NAS storage systems, cloud storage systems, etc.; Flash includes Nor Flash , NAND Flash, etc.; hard drives include solid-state drives, magnetic hard drives, etc. In a specific embodiment, the first video data and/or audio data can be automatically and dynamically cached in the NAND Flash or SD card, and when the first trigger signal is received, all or part of the first video data and/or the audio data is dumped into the second storage unit. In another specific embodiment, if the first storage unit and the second storage unit are both cloud storages, the cloud storage dump instruction can be sent directly, and the cloud storage server performs the dump operation without transferring the data from the first storage unit. A storage unit is downloaded to the video recording system, and then transferred to the second storage, so that higher execution efficiency can be obtained. The second storage unit is a permanent storage medium, which can be an SD card, Flash, or hard disk integrated in the device, or a remote external storage, such as a NAS network storage at home, or a cloud storage service provided by an Internet service provider.

The audio and video data in the first storage unit is accumulated to the first video data and/or the first audio data of the first set duration; or the first video data and/or the first audio data of the first set storage capacity are stored After the data starts to cover the loop, keep a segment updated in real time, the length is the first set duration or the first set storage capacity; the second storage unit is a permanent storage unit, used for receiving the dumped first video data and/or or the first audio data, and/or directly store the second video data and/or the second audio data; or, store the processed first video data and/or the first audio data, the second video data and/or the second audio data audio data; in an embodiment of the present invention, the processing includes synchronizing the first video data and the first audio data, and synchronizing the second video data and the second audio data; the collection unit is always collecting, and the collected audio The video data is limited to the receipt of the first trigger signal, and can be divided into two parts: the first video data and/or the first audio data collected from the past to the moment when the first trigger signal is received; The second video data and/or the second audio data collected after the time of the trigger signal.

In an embodiment of the present invention, the video recording system includes an intelligent recognition unit, which can recognize the type, expression, action and/or sound of the target object, and then match the preset trigger condition, and if the match is successful, it will send out the first trigger signal.

In another embodiment of the present invention, the first trigger signal includes a passive trigger signal and an active trigger signal;

The passive trigger signal includes a first trigger signal output by receiving a user's trigger instruction or receiving a trigger instruction from an associated device;

The active trigger signal includes continuous matching with a preset trigger condition, and if the matching fails, the active trigger is used as the first trigger signal; the trigger condition includes: a preset target object list, a preset expression type, a preset at least one of the action type and the preset sound type.

For example, when the user already knows that he will tell stories with the child next, he can send a trigger instruction, and the video recording system outputs the first trigger signal after receiving the trigger instruction. Even if the user does not know what will happen next, for example, a child who can't walk suddenly walks independently, he can send a trigger command immediately when the event is discovered. Although there will be a delay, because the first video data is recorded in real time For a certain period of time, the cached first video data is transferred to the second storage unit, and the second audio and video data can be continuously collected, or a video of the completion event can be formed. In an embodiment of the present invention, the user's triggering instruction includes pressing a button or remotely pressing a button on a remote control device to send an instruction, sending an instruction through an application program, sending an instruction through voice, and sending an instruction through somatosensory interaction. For example, the user can press a button or remotely press the button on the remote control device to send the command, send the command through a pre-installed applet or APP on the smart terminal, or send the command by voice, or send the command directly through the somatosensory control.

In another embodiment, a trigger instruction from an associated device may also be received. It can be understood that the associated device is associated with the video recording system through some preset conditions, and when the associated device satisfies a certain condition, a trigger signal is sent to the video recording system. For example, the smart speaker at home is associated with the video recording system. After the smart speaker receives the command issued by the user through voice, it sends a trigger command to the video recording system, which becomes the first trigger command.

In a specific embodiment, both the video acquisition unit and the audio acquisition unit of the video recording system are provided with a wireless transceiver module, which can start to collect data in response to a user's instruction; the collected second video data and second audio data can also be obtained through The wireless transceiver module is transmitted to the second storage unit.

In another specific embodiment, the elder sister and younger sister play together in the game area in the living room, and the elder sister picks up the picture book to tell the story to the younger sister. This scene is very warm. When the parents come out of the living room from the room or the kitchen, they see the current warmth You can press the button on the remote control device without disturbing the children, and you can also record the warm scene that you just missed. If parents go to press the button on the video recording terminal device, they can also record, but they will also be recorded in the video recording, and video editing will not be so convenient and perfect in the future. The button on the remote control device can notify the recording terminal device to save the cached recording and start the real-time recording through Wi-Fi, Bluetooth or infrared signal.

Of course, for situations that the user cannot predict, it can also be triggered by an active trigger signal. At this time, the video recording system needs to be able to recognize through artificial intelligence (AI), and identify the preset target object list, the preset expression type, the preset action type, and the preset sound type. In a specific embodiment, a preset list of target objects can be preferentially identified, and it is determined whether there is a target object in the preset list of target objects, and the target objects include people, animals, and objects; for example, a family of three uses a baby as a The target object, and the pets at home can also be the target objects at the same time. There can be more than one target object to be tracked at the same time. For example, if there are two babies at home, the two babies can be used as one target object, that is, only the situation where the two babies appear at the same time can be tracked; As long as one of the babies is tracked, it is considered that the target object is matched.

After determining the target object, you can track the target object according to the collected audio and video data, identify the expression, action or sound of the target object, and continue to match with the preset expression type, preset action type, and preset sound type. If successful, the first trigger signal is issued.

In a specific embodiment, for example, taking at least one of the baby's expression: laugh, voice: laughter, and action: mouth opening as a trigger condition, the video recording system detects that the audio and video data has the above trigger condition, and sends out first trigger signal.

In another specific embodiment, children want to see the moment when the chick hatches from the egg shell, they will keep staring at the egg, but do not know when the chick will be born, which is time-consuming. If the method of the present invention is used to detect eggs, and the set trigger condition is that the video screen changes, then when the chick breaks out of the egg, the first trigger signal will be triggered, thereby automatically transferring the pre-recorded video the first video data, and start recording the second video data at the same time. That is, the method of the present invention is used to track the change event of the determined target object. Although the specific time of the event occurrence is uncertain, the method of the present invention can record or compensate the record in time.

In an embodiment of the present invention, the trigger condition can be updated regularly or irregularly. For example, with the change of the age of the person, especially the growth of the child, the behavior changes greatly, so the above trigger condition will be updated.

After receiving the first trigger signal, the video recording system transfers the collected first video data and/or first audio data of the first set duration to the second storage unit. At this point, the complete event may have been recorded. If the complete event is not recorded, the second video data and/or the second audio data will continue to be collected and stored in the second storage unit.

In some alternative embodiments, the end of the event is also judged. When the judgment event is over, the video recording system receives the second trigger signal, and the audio and video data collected at this time are no longer stored in the second storage unit, but only in the first storage unit. When a trigger signal occurs, the above steps are performed again.

As shown in Figure 3, the method of the present invention also includes:

S3: After receiving the second trigger signal, stop storing the collected second video data and/or second audio data in the second storage unit, and continue to collect the first video data and/or the first The audio data is automatically circularly buffered to the first storage unit.

In an embodiment of the present invention, the second trigger signal is a passive trigger signal or an active trigger signal;

The passive trigger signal includes a second trigger signal output by receiving a user's trigger instruction or receiving a trigger instruction from an associated device;

The active trigger signal includes continuously matching with a preset trigger condition, and if the matching fails continuously within the second set time period, the active trigger is used as the second trigger signal; the trigger condition includes: a preset target object list, At least one of a preset expression type, a preset action type, and a preset voice type.

In another specific embodiment, the preset trigger condition is the baby's laughter or smiling face, and when the child's smiling face image or laughter is detected, the first trigger signal is automatically triggered, and the cached video content is automatically saved to the video The SD card memory of the terminal, while continuing to collect the second audio and video data and directly storing it in the SD card memory of the video recording terminal. When the children leave the screen, the video terminal device starts timing, and continuously detects whether the children have returned to the screen. If they come back, the timing will end; when the timing exceeds the second set time and the children have not come back, it is considered that If the matching fails continuously within the second set time period, a second trigger signal will be triggered to stop storing the collected second video data and/or second audio data in the second storage unit, and continue to collect the first video The data and/or the first audio data are automatically and cyclically buffered to the first storage unit.

In an embodiment of the present invention, the second trigger signal can also be actively triggered after the third set duration, and the third set duration can be set according to the general time when the event occurs, for example, the baby laughing time will not exceed 5 minutes, the duration of collecting the second video data or the second audio data is determined according to the event type, so that invalid data can be further reduced.

In an embodiment of the present invention, the collection of the second video data and the second audio data may also be stopped according to the user's instruction. The user's triggering instruction includes pressing a button or remotely pressing a button on a remote control device to send an instruction, sending an instruction through an application program, sending an instruction through voice, and sending an instruction through somatosensory interaction. The pre-set target object list includes people, animals, and objects. As mentioned above, it will not be repeated here.

Likewise, in another embodiment, a trigger instruction from an associated device may also be received. It can be understood that the associated device is associated with the video recording system through some preset conditions, and when the associated device satisfies a certain condition, a second trigger signal is sent to the video recording system. For example, the smart speaker at home is associated with the video recording system. After the smart speaker receives the command sent by the user through voice, it sends a trigger command to the video recording system, which becomes the second trigger signal. In an embodiment of the present invention, regardless of whether the first trigger signal is an active trigger or a passive trigger, a notification to start recording the second video data or second audio data is sent to the user. The specific event determines whether to send the second trigger signal.

In an embodiment of the present invention, in order to obtain data more accurately, the target object in the second video data can be placed in a video frame by judging the movement of the target object to control the rotation of the video capture unit.

In a specific embodiment, the video recording system includes a rotating device, which can make the video capture unit rotate. The intelligent identification unit can discriminate the movement of the target shooting object, and control the rotating device to follow the movement of the target object to rotate, so that the target object is in the center of the video image captured by the video capture unit.

In another embodiment of the present invention, the first video data is captured by a wide-angle panoramic lens to realize 360° panoramic video capture, instead of the rotating device. At this time, the video acquisition unit further includes a video preprocessing unit, which performs distortion correction on the obtained image, and expands it into a horizontal 360° panoramic video image, which is convenient for the user to watch. When the intelligent recognition unit determines the movement of the target object, it tells the processing unit the coordinate position of the target object, and the processing unit can adjust the center position of the panoramic video, and intercept a video of a suitable size as the shooting video of the target object, and start the follow-up shooting function of the object. In yet another embodiment of the present invention, the first sub-video data is collected through at least two lenses and an image sensor, respectively, and spliced into a horizontal 360° panoramic video picture as the first video data or the second video data. Similarly, the video acquisition unit also includes a video preprocessing unit, which performs distortion correction on the obtained images, and stitches the videos from different lenses and image sensors into a horizontal 360° panoramic video picture, which is convenient for users to watch. Users can send instructions to control the recording master to select one of the sub-pictures of the 360° panoramic video picture for viewing and recording. When the intelligent recognition unit determines the movement of the target object, it tells the processing unit the coordinate position of the target object, and the processing unit can adjust the center position of the panoramic video, and intercept a video of a suitable size as the shooting video of the target object, and start the follow-up shooting function of the object.

In yet another embodiment of the present invention, the second sub-video data is obtained by shooting from different angles through a distributed video capture system composed of at least two video capture units placed in different positions. Each second sub-video data It is the video data collected by each of the video collection units, the second sub-video data is processed to obtain video data containing multiple angles, and the first video data and/or the second video are obtained from the multi-angle video data according to the collection time. data. Multiple video capture units can be combined to form a distributed video capture system. These video capture units are placed in different positions of the shooting scene, shoot the target object from different angles, and transmit the respective captured videos to audio and video. The processing center is automatically edited and edited by the audio and video processing center, and finally outputs a video clip containing multiple angles to the user. The video capture unit here may be an independent video capture unit and an audio capture unit, or may be a part of the video capture unit and the audio capture unit.

In a specific embodiment, by using a wide-angle panoramic lens or multi-lens stitching of panoramic images, a panoramic video can be obtained at the same time and artificial intelligence (AI) analysis can be performed to determine the orientation of the target object, thereby avoiding narrow-angle lenses and rotating devices. It is impossible to capture the occurrence of specific targets or specific expressions and actions in time; it is more conducive to record the occurrence of events in time. In some alternative embodiments, multiple video capture units configured as a distributed video capture system further include a time synchronization unit, which sends time synchronization information to each other, and ensures that the system clocks of these video capture units are kept synchronized through a time synchronization protocol. under 1 millisecond.

In a specific embodiment, for a situation where there is only one video capture unit, sometimes the target object will turn around, and a single video capture unit can only capture the side or back of the target object. In this case, multiple videos are deployed. The acquisition units are placed at different angles, and the facial expressions, smiles and other expressions of the target object can be photographed from multiple angles, and the videos from multiple video acquisition units can be edited into a multi-angle video through automatic video editing and splicing. , which makes up for the shortcoming that a single video cannot capture the front of the target object.

In another specific embodiment, by adopting distributed video capture systems placed in different positions, it is also possible to take care of the elderly at home in all directions and from all angles. For example, from the living room to the bathroom at home, you first turn 90 degrees through a corridor before entering the bathroom. At this time, the video capture unit installed in the living room cannot capture the situation on the other side of the corridor. If the old man falls from the living room to the bathroom, the video capture unit in the living room cannot capture the relevant video. At this time, if a second video capture unit is also installed in the corridor to form a distributed video capture system with the video capture unit in the living room, you can follow the process of filming the elderly walking from the living room to the bathroom. The first trigger signal is sent out in time to send the collected video data to the second storage unit, and further, the event notification can be sent to the family through the application program of the mobile terminal such as the mobile phone, so as to achieve timely notification and early treatment.

In some alternative embodiments, the time synchronization unit periodically performs synchronization to eliminate accumulated errors of system clocks between different video capture units.

In some alternative embodiments, when multiple video capture units jointly record videos, they will bring date and time information, such as a time stamp (Time Stamp), to identify the time of occurrence of each recorded video for the audio and video processing center to perform video recording. Synchronize video images during editing and editing.

In some alternative embodiments, when multiple video capture units jointly record videos, their respective intelligent identification units will analyze the video images of the video capture unit, find out the position and angle of the target object, and unify them through a coordination system. Coordinate, adjust the angle, picture size and other settings of the respective video capture units to obtain high-quality pictures that can be edited.

The video processing center arranges the videos from each video acquisition unit through the timeline synchronization, and according to a specific algorithm or some preset editing methods, clips clips from different angles, and then splices them into a continuous and complete video footage.

In another embodiment of the present invention, the position of the target object in the video picture in the second video data is adjusted through digital zooming. The video recording system can perform digital zooming. Since the video resolution of the video acquisition unit is relatively high (above 1920x1080 resolution), digital zooming can be performed by magnifying the image and interpolating. Optionally, the video capture unit further includes: a zoom lens, when the target object is far away and the proportion in the video picture is relatively small, it can be enlarged through optical zoom, so that the target object occupies a proper proportion of the entire video picture.

In an embodiment of the present invention, the video capture unit is connected to an external audio capture unit wirelessly (Bluetooth or Wi-Fi) to capture the sound of the surrounding environment or the conversation of the target object, so as to avoid the distance between the video capture unit and the target object. The longer the distance, the poorer the recording effect.

In another embodiment of the present invention, audio data is collected from different positions through a distributed audio collection system composed of at least two wireless audio collection units placed at different positions. Specifically, the video recording system includes: a distributed audio collection system to improve the audio collection quality. The distributed audio acquisition system is composed of a network of multiple external wireless audio acquisition units, and these external audio acquisition units are distributed and placed in different positions to collect audio.

In an embodiment of the present invention, the video camera is far away from the target object, and the effect of using one audio capture is not good; through distributed audio capture, it is possible to capture high-quality video while having sufficient video distance and field of view angle. audio data.

The above video and audio collected by the distributed video collection system and the distributed audio collection system are synchronized in the audio and video processing center, and the final audio and video recording files are output.

Optionally, multiple external wireless audio acquisition units configured as a distributed audio acquisition system also include a time synchronization unit, which sends time synchronization information to each other, and ensures that the system clocks of these external wireless audio acquisition units are kept synchronized through a time synchronization protocol. , the error is less than 1 millisecond.

Optionally, the time synchronization unit periodically performs synchronization to eliminate accumulated errors of system clocks between different external wireless audio collection devices.

Optionally, these external wireless audio acquisition units are combined to form a sound localization system, which locates the position of the target object according to the sound of the target object, thereby assisting the video acquisition unit to aim the lens of the video acquisition unit at the target object.

As shown in Figure 4, the method of the present invention also includes:

S4: After receiving the third trigger signal, stop collecting video data within a certain range of the video capture unit and/or audio data around the audio capture unit.

It can be understood that the third trigger signal includes receiving a trigger instruction from a user or receiving a trigger instruction from an associated device, and outputting the third trigger signal. The user's triggering instruction includes pressing a button or remotely pressing a button on a remote control device to send an instruction, sending an instruction through an application program, sending an instruction through voice, and sending an instruction through somatosensory interaction. Alternatively, the associated device is associated with the video recording system through some preset conditions, and when the associated device satisfies a certain condition, a third trigger signal is sent to the video recording system. For example, the smart speaker at home is associated with the video recording system. After the smart speaker receives the command sent by the user through voice, it sends a trigger command to the video recording system, which becomes the third trigger signal. For example, users need to change clothes or need to suspend the collection of audio and video data for other reasons to protect the privacy of users.

In an embodiment of the present invention, when the second trigger signal is not received, the third trigger signal may be directly received, and the collection of audio and video data may be suspended, so as to protect the privacy of the user.

In an embodiment of the present invention, the video capture unit optionally needs to receive a trigger signal before starting to work. For example: after the owner returns home, actively send a trigger signal to turn on the video capture unit or the video capture unit uses face recognition, or uses a mobile phone electronic fence, or checks whether the mobile phone and the video terminal equipment are under the same wireless local area network, and cooperate to judge The master's home and automatically turn on. This trigger signal can also be sent by an external device associated with the video capture system, such as a smart fingerprint door lock. After the owner unlocks the house with a fingerprint, the smart fingerprint door lock sends a trigger signal to the video capture system to start the video capture work.

Further, the second video data and/or the second audio data are stored and/or transmitted in a secure and encrypted manner.

As shown in Figure 5, the present invention also provides a video recording system, characterized in that it includes:

a video capture unit, configured to continuously capture video data within a certain range within the visual field of the video capture unit;

an audio collection unit configured to collect audio data around the audio collection unit;

The first storage unit is configured to automatically and dynamically buffer the first video data and/or the first audio data of the first set duration or the first set storage capacity, so that the dynamic cache the first video data and/or the first audio data updated in real time, the length is the first set duration or the storage capacity is the first set storage capacity;

The second storage unit is configured to, when the processing unit receives the first trigger signal, receive all or part of the first video data and/or all the first video data and/or all the buffered first video data and/or the stored data dumped by the first storage unit at this point in time. describe the first audio data;

A processing unit for executing any of the methods described above.

In an embodiment of the present invention, the video data further includes second video data collected after the processing unit receives the first trigger signal; the audio data further includes second audio data collected after the processing unit receives the first trigger signal ; a second storage unit, further configured to store the second video data and/or the second audio data.

Optionally, the video capture unit of the video recording system further includes: a privacy protection mode; by rotating the video capture unit up and down, the lens of the video capture unit is completely hidden inside the casing and covered by the casing, which physically ensures the user's privacy. The image will not enter the video capture unit lens, thus ensuring user privacy.

Optionally, the video recording system further includes: a privacy protection mode switching module, which controls the video recording system to switch from the video recording mode to the privacy mode, or from the privacy mode to the video recording mode. The user's triggering instruction includes pressing a button to send an instruction or remotely pressing a button on a remote control device, sending an instruction through an application program, sending an instruction through voice, and sending an instruction through somatosensory interaction.

Optionally, when video data is transmitted over the network, an internationally recognized security encryption method will be used for encrypted transmission to ensure that the video is not illegally intercepted during the transmission process.

Through the system and method of the present invention, predictable or unpredictable events in life can be recorded in a timely and complete manner, thereby improving user experience.

In an embodiment of the present invention, the second storage unit in the video recording system of the present invention is a cloud storage unit. Further, cloud server subscription and sharing can also be performed. Based on the user's permission, the data stored in the cloud server can be Share to other users to realize data sharing among family members or related members.

Optionally, the video data storage is stored in the second storage in a secure encryption manner to ensure that even if the storage (eg, SD card) is stolen, the recorded video in the storage cannot be decrypted.

In the present invention, the first storage unit has a certain capacity of storage space for buffering the first video data and the first audio data, and ensures that video images of several recent durations are recorded by means of cyclic video recording.

When the first trigger signal is received, the first video data and the first audio data are transferred to the second storage unit for permanent storage, and the second video data and the second audio data collected next are transferred to the second storage unit for permanent storage. Two storage units, which together form the audio and video data of the complete event.

Further, when collecting audio and video data, the video collecting unit can track the position change of the target object, and rotate the video collecting unit to track and shoot. The sound is collected through the built-in audio acquisition unit or an external audio acquisition unit and synchronized with the video data to obtain the best audio and video effects.

An embodiment of the present application further provides a control device, including a processor and a storage medium for storing a computer program; wherein the processor is configured to execute at least the above method when executing the computer program.

Embodiments of the present application further provide a storage medium for storing a computer program, and when the computer program is executed, at least the above method is performed.

An embodiment of the present application further provides a processor, where the processor executes a computer program, and at least executes the above method.

The storage medium may be implemented by any type of volatile or non-volatile storage device, or a combination thereof. Among them, the non-volatile memory can be a read-only memory (ROM, Read Only Memory), a programmable read-only memory (PROM, Programmable Read-Only Memory), an erasable programmable read-only memory (EPROM, Erasable Programmable Read-Only Memory) Memory), Electrically Erasable Programmable Read-Only Memory (EEPROM, Electrically Erasable Programmable Read-Only Memory), Magnetic Random Access Memory (FRAM, Ferromagnetic Random Access Memory), Flash Memory (Flash Memory), Magnetic Surface Memory, Optical Disc , or Compact Disc Read-Only Memory (CD-ROM, Compact Disc Read-Only Memory); magnetic surface storage can be disk storage or tape storage. Volatile memory may be Random Access Memory (RAM), which acts as an external cache. By way of example but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), SynchronousStatic Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM, Dynamic Random Access Memory), Synchronous Dynamic Random Access Memory (SDRAM, Synchronous Dynamic Random Access Memory), Double Data Rate Synchronous Dynamic Random Access Memory (DDR SDRAM, Double Data Rate Synchronous Dynamic Random Access Memory), Enhanced Synchronization Dynamic random access memory (ESDRAM, Enhanced Synchronous Dynamic Random Access Memory), synchronous connection dynamic random access memory (SLDRAM, SyncLink Dynamic Random Access Memory), direct memory bus random access memory (DRRAM, Direct Rambus Random Access Memory). The storage medium described in the embodiments of the present invention is intended to include, but not limited to, these and any other suitable types of memory.

In the several embodiments provided in this application, it should be understood that the disclosed system and method may be implemented in other manners. The device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored, or not implemented. In addition, the coupling, or direct coupling, or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be electrical, mechanical or other forms. of.

The unit described above as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place or distributed to multiple network units; Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present invention may all be integrated into one processing unit, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; the above-mentioned integration The unit can be implemented either in the form of hardware or in the form of hardware plus software functional units.

Those of ordinary skill in the art can understand that all or part of the steps of implementing the above method embodiments can be completed by program instructions related to hardware, the aforementioned program can be stored in a computer-readable storage medium, and when the program is executed, execute Including the steps of the above-mentioned method embodiment; and the aforementioned storage medium includes: a mobile storage device, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk and other various A medium on which program code can be stored.

Alternatively, if the above-mentioned integrated unit of the present invention is implemented in the form of a software function module and sold or used as an independent product, it may also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present invention may be embodied in the form of software products in essence or the parts that make contributions to the prior art. The computer software products are stored in a storage medium and include several instructions for A computer device (which may be a personal computer, a server, or a network device, etc.) is caused to execute all or part of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic disk or an optical disk and other mediums that can store program codes.

The methods disclosed in the several method embodiments provided in this application can be arbitrarily combined under the condition of no conflict to obtain new method embodiments.

The features disclosed in the several product embodiments provided in this application can be combined arbitrarily without conflict to obtain a new product embodiment.

The features disclosed in several method or device embodiments provided in this application can be combined arbitrarily without conflict to obtain new method embodiments or device embodiments.

The above content is a further detailed description of the present invention in conjunction with specific preferred embodiments, and it cannot be considered that the specific implementation of the present invention is limited to these descriptions. For those skilled in the art to which the present invention belongs, under the premise of not departing from the concept of the present invention, several equivalent substitutions or obvious modifications can be made, and the performance or use is the same, which should be regarded as belonging to the protection scope of the present invention.

Claims

A video recording method, comprising the steps of:

S1: Continuously collect video data within a set range of the video capture unit and/or audio data around the audio capture unit, and automatically and dynamically circularly buffer the first video data and/or the first set duration or first set storage capacity. Or the first audio data is sent to the first storage unit, so as to keep the first storage unit dynamically buffered with a real-time update, the length of which is the first set duration or the storage capacity of which is the first set storage capacity. a video data and/or first audio data;

S2: When the first trigger signal is received, transfer all or part of the first video data and/or the first audio data buffered in the first storage unit at the moment to the second storage unit At the same time, the video data and/or audio data collected after the time point are continuously automatically and dynamically buffered to the first storage unit.
The video recording method according to claim 1, wherein in step S2, while transferring the first video data and/or the first audio data to the second storage unit, continue to capture the second The video data and/or the second audio data are stored in the second storage unit.
The video recording method according to claim 2, wherein the first storage unit is a readable and writable storage medium, including a volatile storage medium, a non-volatile storage medium, and an external network storage medium; When the first video data and/or the first audio data stored in a storage unit has reached the first set duration or the first set storage capacity, the video data and/or the later recorded video data and/or Audio data loops over the first recorded video data and/or audio data;

The second storage unit is a local storage unit or a remote storage unit for receiving the dumped first video data and/or the first audio data, and/or directly storing the second video data and/or or the second audio data; or, for storing the processed first video data and/or the first audio data, the second video data and/or the second audio data;

The processing includes synchronizing the first video data and the first audio data, and synchronizing the second video data and the second audio data.
The video recording method according to claim 3, wherein the data of the second storage unit is stored and/or transmitted in a secure encryption manner.
The video recording method of claim 1, wherein the first trigger signal is a passive trigger signal or an active trigger signal;

The passive trigger signal includes a first trigger signal output by receiving a user's trigger instruction or receiving a trigger instruction from an associated device;

The active trigger signal includes continuous matching with a preset trigger condition, and if the match is successful, the active trigger is used as the first trigger signal; the trigger condition includes: a preset target object list, a preset expression type, a preset at least one of the action type and the preset sound type.
The video recording method according to claim 5, wherein the triggering instruction of the user comprises pressing a button or remotely pressing a button on a remote control device to send an instruction, sending an instruction through an application program, sending an instruction through a voice, and using a somatosensory interaction send instructions;

The preset target object list includes characters, animals, and objects.
6. The video recording method according to claim 6, wherein the target object is placed in the video frame by judging the movement of the target object to control the rotation of the video capture unit.
6. The video recording method according to claim 6, wherein the position of the target object in the video image in the video data is adjusted through digital zoom.
The video recording method according to any one of claims 1-8, wherein the video data is collected through a wide-angle panoramic lens;

Or, the first sub-video data is collected by at least two video collection units respectively, and the first sub-video data is spliced into a horizontal panoramic video picture as the video data.
The video recording method according to any one of claims 1 to 8, wherein the second sub-video data is obtained by shooting from different angles by a distributed video capture system jointly formed by at least two video capture units placed at different positions, Each of the second sub-video data is the video data collected by each of the video acquisition units. The second sub-video data is spliced to complete multi-angle video data. data to obtain the video data.
The video recording method according to claim 10, further comprising: performing time synchronization on the video capture unit;

Analyze the second sub-video data of the video capture unit, and adjust the angle of the video capture unit or the size of the video frame;

The second sub-video data carries date and time information, and the video data is obtained by splicing video data from different angles according to the time stamp.
The video recording method according to any one of claims 1 to 8, wherein the audio data is collected from different positions through a distributed audio collection system composed of at least two wireless audio collection units placed at different positions.
The video recording method of claim 12, wherein time synchronization is performed on the wireless audio acquisition unit;

Or, the wireless audio collection unit constitutes a sound localization system, and the position of the target object is determined according to the sound of the target object.
The video recording method according to any one of claims 2-3, further comprising:

S3: After receiving the second trigger signal, stop storing the collected second video data and/or second audio data in the second storage unit, and continue to collect the first video data and/or the first The audio data is automatically circularly buffered to the first storage unit.
The video recording method of claim 14, wherein the second trigger signal is a passive trigger signal or an active trigger signal;

The passive trigger signal includes a second trigger signal output by receiving a trigger instruction from a user or receiving a trigger instruction from an associated device; the user's trigger instruction includes pressing a button or remotely pressing a button on a remote control device to send an instruction, and sending an instruction through a remote control device. The application sends instructions, sends instructions through voice, and sends instructions through somatosensory interaction;

The active trigger signal includes continuously matching with a preset trigger condition, and if the matching fails continuously within the second set time period, the active trigger is used as the second trigger signal; the trigger condition includes: a preset target object list, at least one of a preset expression type, a preset action type, and a preset voice type;

The preset target object list includes characters, animals, and objects.
A video recording system, comprising:

a video capture unit, configured to continuously capture video data within a certain range within the visual field of the video capture unit;

an audio collection unit configured to collect audio data around the audio collection unit;

The first storage unit is configured to automatically and dynamically buffer the first video data and/or the first audio data of the first set duration or the first set storage capacity, so that the dynamic cache the first video data and/or the first audio data updated in real time, the length is the first set duration or the storage capacity is the first set storage capacity;

The second storage unit is configured to, when the processing unit receives the first trigger signal, receive all or part of the first video data and/or all the first video data and/or all the buffered first video data and/or the stored data dumped by the first storage unit at this point in time. describe the first audio data;

The processing unit is configured to execute the method according to any one of claims 1-15.
The video recording system according to claim 16, wherein the video data further comprises second video data collected after the processing unit receives the first trigger signal;

The audio data further includes second audio data collected after the processing unit receives the first trigger signal;

The second storage unit is further configured to store the second video data and/or the second audio data.
A video recording terminal device, comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that, when the processor executes the computer program, the computer program as claimed in claim 1 is realized. -15 the steps of any of the methods.
A computer-readable storage medium storing a computer program, characterized in that, when the computer program is executed by a processor, the steps of the method according to any one of claims 1-15 are implemented.