CN112367486B - Video processing method and device - Google Patents

Video processing method and device Download PDF

Info

Publication number
CN112367486B
CN112367486B CN202011197869.1A CN202011197869A CN112367486B CN 112367486 B CN112367486 B CN 112367486B CN 202011197869 A CN202011197869 A CN 202011197869A CN 112367486 B CN112367486 B CN 112367486B
Authority
CN
China
Prior art keywords
video
pixel
information
target video
pixel information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011197869.1A
Other languages
Chinese (zh)
Other versions
CN112367486A (en
Inventor
刘练
蒋敏叶
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN202011197869.1A priority Critical patent/CN112367486B/en
Publication of CN112367486A publication Critical patent/CN112367486A/en
Application granted granted Critical
Publication of CN112367486B publication Critical patent/CN112367486B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors

Abstract

The application discloses a video processing method and device, and belongs to the technical field of communication. The video processing method comprises the following steps: acquiring first pixel information recorded in a target video recording process; wherein the first pixel information is information recorded by a dynamic vision sensor; determining motion vector information of a moving object in the target video according to the first pixel information; and performing video compression processing on the target video based on the motion vector information. The technical scheme provided by the embodiment of the application can solve the problems of large data processing capacity and low compression speed in the prior art to a certain extent when video compression is carried out.

Description

Video processing method and device
Technical Field
The present application belongs to the field of communication technologies, and in particular, to a video processing method and apparatus.
Background
Conventional video images are collected in units of frames, for example, 60 frames per second, i.e., the frame rate is 60 frames/s; or 120 frames are acquired per second, namely the frame rate is 120 frames/s and the like. In the video generated in this way, because the image similarity between the continuous frames is high, a large amount of same image information exists between the adjacent frames.
In the process of processing video, in order to facilitate storage and transmission of video, it is often necessary to perform coding compression on original video to remove redundant information. In the prior art, when a video is compressed, a software algorithm is required to compare continuous multi-frame video images to refine effective information. Due to the fact that a large amount of identical image information exists between adjacent frames, data processing amount is large, processor pressure is increased, and video compression speed is affected.
Disclosure of Invention
The embodiment of the application aims to provide a video processing method and a video processing device, which can solve the problems of large data processing capacity and low compression speed in video compression in the prior art to a certain extent.
In order to solve the technical problem, the present application is implemented as follows:
in a first aspect, an embodiment of the present application provides a video processing method, where the video processing method includes:
acquiring first pixel information recorded in a target video recording process; wherein the first pixel information is information recorded by a dynamic vision sensor;
determining motion vector information of a moving object in the target video according to the first pixel information;
and performing video compression processing on the target video based on the motion vector information.
In a second aspect, an embodiment of the present application provides a video processing apparatus, including:
the acquisition module is used for acquiring first pixel information recorded in the target video recording process; wherein the first pixel information is information recorded by a dynamic vision sensor;
the determining module is used for determining the motion vector information of a moving object in the target video according to the first pixel information;
and the processing module is used for carrying out video compression processing on the target video based on the motion vector information.
In a third aspect, an embodiment of the present application provides an electronic device, including: a processor, a memory and a program or instructions stored on the memory and executable on the processor, which when executed by the processor, implement the steps in the video processing method according to the first aspect.
In a fourth aspect, the present application provides a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the video processing method according to the first aspect.
In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the video processing method according to the first aspect.
In the embodiment of the application, motion vector information of a moving object in a target video is obtained according to first pixel information recorded by a dynamic vision sensor in the target video recording process, and then video compression processing is performed on the target video according to the obtained motion vector information. Because the motion vector information is obtained by utilizing the pixel information recorded by the dynamic vision sensor, the motion vector information is obtained without comparing continuous multi-frame images through a software algorithm, the video data processing amount is greatly reduced, the operation pressure of a processor of the electronic equipment is reduced, and meanwhile, the video compression can be accelerated.
Drawings
Fig. 1 is a schematic flowchart of a video processing method provided in an embodiment of the present application;
FIG. 2 is one of the schematic diagrams of an example provided by an embodiment of the present application;
FIG. 3 is a second schematic diagram of an example provided by an embodiment of the present application;
fig. 4 is a schematic block diagram of a video processing apparatus provided in an embodiment of the present application;
FIG. 5 is a block diagram of an electronic device provided by an embodiment of the application;
fig. 6 is a second schematic block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in other sequences than those illustrated or otherwise described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense to distinguish one object from another, and not necessarily to limit the number of objects, e.g., the first object may be one or more. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
The video processing method provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings by using specific embodiments and application scenarios thereof.
Fig. 1 is a schematic flowchart of a video processing method provided in an embodiment of the present application, where the video processing method is applied to an electronic device equipped with a Dynamic Vision Sensor (DVS).
As shown in fig. 1, the video processing method may include:
step 101: acquiring first pixel information recorded in the target video recording process.
The first pixel information is information recorded by a dynamic visual sensor in the process of recording the target video.
The dynamic vision sensor works asynchronously, and only outputs the information related to the pixel with the changed brightness, for example, in the same scene, the character A moves from the position A to the position B in the scene, and the dynamic vision sensor records the information of the pixel with the changed brightness in the process when the light at the position of the scene changes due to the movement of the character A.
Step 102: and determining the motion vector information of the moving object in the target video according to the first pixel information.
In the embodiment of the application, the motion vector information of the moving object in the target video can be obtained through analysis according to the first pixel information recorded by the dynamic vision sensor. The motion vector information may include: the moving speed and the moving direction of the moving object, the position of the moving object in the video image and the like.
Step 103: and performing video compression processing on the target video based on the determined motion vector information.
After the motion vector information of the moving object in the target video is obtained, video compression processing, such as motion estimation, motion compensation and the like, may be performed on the target video based on the motion vector information, so as to perform encoding compression processing on the video.
In the embodiment of the application, the motion vector information is obtained by utilizing the pixel information recorded by the dynamic vision sensor, so that continuous multi-frame images do not need to be compared through a software algorithm to obtain the motion vector information, the video data processing amount is greatly reduced, the operation pressure of a processor of electronic equipment is reduced, and meanwhile, the video compression can be accelerated. In addition, the dynamic vision sensor records the pixel level information, and the motion vector obtained according to the pixel level information is more accurate, so that more image information can be reserved during video coding compression, and more image information can be obtained during video decoding, thereby improving the definition of video quality.
Optionally, in this embodiment of the present application, the first pixel information may include: the first pixel brightness variation information is used for calculating the first pixel brightness variation information. Wherein, the first pixel is a pixel with changed brightness, and the brightness change information includes: by light or dark.
For scenes taken by the dynamic vision sensor, the dynamic vision sensor can produce pixel-level outputs as long as there is light variation. The output information for a pixel point can be represented as (T, X, Y, P), where X and Y represent the two-dimensional coordinates of the pixel point, respectively; p represents the luminance change information of the pixel point, i.e., the pixel point is changed from dark to bright or from bright to dark, and may be represented by a number "0" and changed from dark to bright and dark by a number "1", and of course, other representation manners may be selected, which is not limited in this embodiment of the present application; and T represents the time stamp when the brightness of the pixel point changes. The dynamic vision sensor can output a series of (Ti, xi, yi, pi) information at the speed of millisecond or even nanosecond, thereby recording all the relevant information of the pixel points with the changed brightness.
As shown in fig. 2, assuming that a black dot 201 indicates a human nail moving from a position a to a position B in the scene, the dynamic vision sensor may record coordinate information of a pixel where the brightness changes during the entire movement of the human nail, brightness change information, and a time stamp when the brightness changes.
Optionally, when the target video is recorded, a shot picture of a camera which records the target video is the same as a shot picture of the dynamic visual sensor, that is, both the shot pictures are subjected to image acquisition for the same scene, so as to ensure the consistency of the shot pictures of the camera and the dynamic visual sensor. In addition, the pixels of the camera recording the target video and the pixels of the dynamic vision sensor may also be set to be the same, thereby omitting the operation of pixel conversion.
Optionally, the dynamic vision sensor may be disposed on the same side of the electronic device as the rear camera or the front camera of the electronic device, so that when a video is recorded by the rear camera or the front camera, the dynamic vision sensor may be started to cooperate with the corresponding camera. It can be understood that the dynamic vision sensor can be arranged to be a rotatable structure so as to be matched with the rear camera and the front camera for use. Of course, when the camera can be rotated for stretching out the electronic equipment shell and under the state of stretching out the electronic equipment shell, can set up dynamic vision sensor and this camera on same rotating-structure to dynamic vision sensor and camera rotate together, thereby the cooperation is used.
Optionally, step 102: determining motion vector information of a moving object in the target video according to the first pixel information may include:
determining a time stamp of each frame of video image in the target video according to the recording starting time and the frame rate of the target video; determining second pixel information corresponding to each frame of video image in the first pixel information according to the time stamp of each frame of video image and the time stamp in the first pixel information; and determining the motion vector of the moving object in the target video according to the second pixel information corresponding to the two adjacent frames of video images.
In this embodiment of the application, a timestamp of each frame of video image in the target video may be determined according to the recording start time and the frame rate of the target video, and then second pixel information corresponding to each frame of video image may be determined in the first pixel information according to the timestamp of each frame of video image and the timestamp in the first pixel information (that is, the first pixel information includes the second pixel information). Because the rate of information recorded by the dynamic vision sensor is greater than the frame rate of images acquired by the camera, second pixel information corresponding to each frame of video image needs to be determined in the first pixel information recorded by the dynamic vision sensor. And finally, determining the motion vector of the moving object in the target video according to the second pixel information corresponding to the two adjacent frames of video images.
Optionally, at step 101: before the first pixel information recorded in the target video recording process is obtained, the video processing method may further include:
and in the process of recording the target video, controlling the dynamic vision sensor to record the first pixel information in a first working mode or a second working mode.
In the embodiment of the application, in the first working mode, the dynamic vision sensor is always in a working state, and when brightness change in a shooting picture is detected, information of a pixel with changed brightness is recorded and output. In a second working mode, when a moving object is not detected in the video image, the dynamic vision sensor is in a dormant state; when a moving object is detected in a video image, the dynamic vision sensor is switched from a dormant state to a working state, and information of pixels with changed brightness is recorded and output; under the condition that the field Jing Liangdu does not change for the preset duration, the working state is switched to the dormant state, so that the power consumption is saved.
As shown in fig. 3, the "on" control is used to control the dynamic visual sensor to be in the first operating mode, and the "auto" control is used to control the dynamic video sensor to be in the second operating mode. Of course, the dynamic vision sensor may also be turned off without using it, such as by triggering the "off" control in fig. 3 to control the dynamic vision sensor to be in an off state.
In summary, in the embodiment of the present application, because the motion vector information is obtained by using the pixel information recorded by the dynamic vision sensor, it is not necessary to compare consecutive multi-frame images by using a software algorithm to obtain the motion vector information, which greatly reduces the processing amount of video data, reduces the operation pressure of a processor of an electronic device, and can also accelerate video compression.
It should be noted that, in the video processing method provided in the embodiment of the present application, the execution main body may be a video processing apparatus, or a control module used in the video processing apparatus to execute the video processing method. In the embodiment of the present application, a video processing apparatus executing a video processing method is taken as an example, and the video processing apparatus provided in the embodiment of the present application is described.
Fig. 4 is a schematic block diagram of a video processing apparatus according to an embodiment of the present application.
As shown in fig. 4, the video processing apparatus may include:
the obtaining module 401 is configured to obtain first pixel information recorded in a target video recording process.
Wherein the first pixel information is information recorded by a dynamic vision sensor.
A determining module 402, configured to determine motion vector information of a moving object in the target video according to the first pixel information.
A processing module 403, configured to perform video compression processing on the target video based on the motion vector information.
Optionally, the first pixel information includes: coordinate information of a first pixel, brightness change information of the first pixel and a timestamp when the brightness of the first pixel changes; wherein the first pixel is a pixel whose luminance changes, and the luminance change information includes: from light to dark or from dark to light.
Optionally, the determining module 402 may include:
the first determining unit is used for determining the time stamp of each frame of video image in the target video according to the recording starting time and the frame rate of the target video.
And the second determining unit is used for determining second pixel information corresponding to each frame of video image in the first pixel information according to the time stamp of each frame of video image and the time stamp in the first pixel information.
And the third determining unit is used for determining the motion vector of the moving object in the target video according to the second pixel information corresponding to the two adjacent frames of video images.
Optionally, the video processing apparatus may further include:
and the control module is used for controlling the dynamic vision sensor to record the first pixel information in a first working mode or a second working mode in the target video recording process.
Wherein, in the first working mode, the dynamic vision sensor is always in a working state; and under the second working mode, when a moving object is detected in the video image, the dynamic vision sensor enters a working state.
Optionally, when the target video is recorded, a shooting picture of a camera recording the target video is the same as a shooting picture of the dynamic visual sensor.
In the embodiment of the application, because the motion vector information is obtained by utilizing the pixel information recorded by the dynamic vision sensor, continuous multi-frame images do not need to be compared through a software algorithm to obtain the motion vector information, the video data processing amount is greatly reduced, the operation pressure of a processor of the electronic equipment is reduced, and meanwhile, the video compression can be accelerated.
The video processing apparatus in the embodiment of the present application may be an apparatus, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The video processing apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which is not specifically limited in the embodiment of the present application.
The video processing apparatus provided in the embodiment of the present application can implement each process implemented by the video processing method embodiment shown in fig. 1, and is not described here again to avoid repetition.
Optionally, as shown in fig. 5, an electronic device 500 is further provided in this embodiment of the present application, and includes a processor 501, a memory 502, and a program or an instruction stored in the memory 502 and executable on the processor 501, where the program or the instruction is executed by the processor 501 to implement each process of the above-mentioned video processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 6 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 600 includes, but is not limited to: a radio frequency unit 601, a network module 602, an audio output unit 603, an input unit 604, a sensor 605, a display unit 606, a user input unit 607, an interface unit 608, a memory 609, a processor 610, and the like.
Those skilled in the art will appreciate that the electronic device 600 may further comprise a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 610 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 6 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.
Wherein the processor 610 is configured to: acquiring first pixel information recorded in a target video recording process; determining motion vector information of a moving object in the target video according to the first pixel information; and performing video compression processing on the target video based on the motion vector information. Wherein the first pixel information is information recorded by a dynamic vision sensor.
Optionally, the processor 610 is further configured to: determining a time stamp of each frame of video image in the target video according to the recording starting time and the frame rate of the target video; determining second pixel information corresponding to each frame of video image in the first pixel information according to the time stamp of each frame of video image and the time stamp in the first pixel information; and determining the motion vector of the moving object in the target video according to the second pixel information corresponding to the two adjacent frames of video images. Wherein the first pixel information includes: coordinate information of a first pixel, brightness change information of the first pixel and a timestamp when the brightness of the first pixel changes; wherein the first pixel is a pixel whose luminance changes, and the luminance change information includes: by light or dark.
Optionally, the processor 610 is further configured to: and in the target video recording process, controlling the dynamic visual sensor to record the first pixel information in a first working mode or a second working mode. Wherein, in the first working mode, the dynamic vision sensor is always in a working state; and in the second working mode, when a moving object is detected to be included in the video image, the dynamic vision sensor enters a working state.
In the embodiment of the application, the motion vector information is obtained by utilizing the pixel information recorded by the dynamic vision sensor, so that continuous multi-frame images do not need to be compared through a software algorithm to obtain the motion vector information, the video data processing amount is greatly reduced, the operation pressure of a processor of electronic equipment is reduced, and meanwhile, the video compression can be accelerated.
It is to be understood that, in the embodiment of the present application, the input Unit 604 may include a Graphics Processing Unit (GPU) 6041 and a microphone 6042, and the Graphics Processing Unit 6041 processes image data of a still picture or a video obtained by an image capturing apparatus (such as a camera) in a video capture mode or an image capture mode. The display unit 606 may include a display panel 6061, and the display panel 6061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 607 includes a touch panel 6071 and other input devices 6072. A touch panel 6071, also referred to as a touch screen. The touch panel 6071 may include two parts of a touch detection device and a touch controller. Other input devices 6072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 609 may be used to store software programs as well as various data including, but not limited to, application programs and an operating system. The processor 610 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 610.
The embodiments of the present application further provide a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the video processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement each process of the above video processing method embodiment, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as a system-on-chip, or a system-on-chip.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (10)

1. A video processing method, comprising:
acquiring first pixel information recorded in a target video recording process; wherein the first pixel information is information recorded by a dynamic vision sensor;
determining motion vector information of a moving object in the target video according to the first pixel information;
performing video compression processing on the target video based on the motion vector information;
the determining motion vector information of the moving object in the target video according to the first pixel information includes:
determining a time stamp of each frame of video image in the target video according to the recording starting time and the frame rate of the target video;
determining second pixel information corresponding to each frame of video image in the first pixel information according to the time stamp of each frame of video image and the time stamp in the first pixel information;
and determining the motion vector of the moving object in the target video according to the second pixel information corresponding to the two adjacent frames of video images.
2. The video processing method of claim 1, wherein the first pixel information comprises: coordinate information of a first pixel, brightness change information of the first pixel and a timestamp when the brightness of the first pixel changes; wherein the first pixel is a pixel whose luminance changes, and the luminance change information includes: by light or dark.
3. The video processing method of claim 1, wherein prior to obtaining the first pixel information recorded during the recording of the target video, the video processing method further comprises:
in the target video recording process, controlling the dynamic visual sensor to record the first pixel information in a first working mode or a second working mode;
wherein, in the first working mode, the dynamic vision sensor is always in a working state; and under the second working mode, when a moving object is detected in the video image, the dynamic vision sensor enters a working state.
4. The video processing method according to claim 1, wherein, when recording the target video, a shot picture of a camera that records the target video is the same as a shot picture of the dynamic vision sensor.
5. A video processing apparatus, comprising:
the acquisition module is used for acquiring first pixel information recorded in the target video recording process; wherein the first pixel information is information recorded by a dynamic vision sensor;
the determining module is used for determining the motion vector information of a moving object in the target video according to the first pixel information;
the processing module is used for carrying out video compression processing on the target video based on the motion vector information;
the determining module comprises:
the first determining unit is used for determining a time stamp of each frame of video image in the target video according to the recording starting time and the frame rate of the target video;
a second determining unit, configured to determine, in the first pixel information, second pixel information corresponding to each frame of the video image according to a timestamp of each frame of the video image and a timestamp in the first pixel information;
and the third determining unit is used for determining the motion vector of the moving object in the target video according to the second pixel information corresponding to the two adjacent frames of video images.
6. The video processing device of claim 5, the first pixel information comprising: coordinate information of a first pixel, brightness change information of the first pixel and a timestamp when the brightness of the first pixel changes; wherein the first pixel is a pixel whose luminance changes, and the luminance change information includes: by light or dark.
7. The video processing device according to claim 5, wherein the video processing device further comprises:
the control module is used for controlling the dynamic visual sensor to record the first pixel information in a first working mode or a second working mode in the target video recording process;
wherein, in the first working mode, the dynamic vision sensor is always in a working state; and under the second working mode, when a moving object is detected in the video image, the dynamic vision sensor enters a working state.
8. The video processing apparatus according to claim 5, wherein when recording the target video, a shot of a camera that records the target video is the same as a shot of the dynamic vision sensor.
9. An electronic device, comprising: a processor, a memory and a program or instructions stored on the memory and executable on the processor, which when executed by the processor implements the steps in the video processing method of any of claims 1 to 4.
10. A readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps in the video processing method according to any one of claims 1 to 4.
CN202011197869.1A 2020-10-30 2020-10-30 Video processing method and device Active CN112367486B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011197869.1A CN112367486B (en) 2020-10-30 2020-10-30 Video processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011197869.1A CN112367486B (en) 2020-10-30 2020-10-30 Video processing method and device

Publications (2)

Publication Number Publication Date
CN112367486A CN112367486A (en) 2021-02-12
CN112367486B true CN112367486B (en) 2023-03-28

Family

ID=74513216

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011197869.1A Active CN112367486B (en) 2020-10-30 2020-10-30 Video processing method and device

Country Status (1)

Country Link
CN (1) CN112367486B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113115038B (en) * 2021-04-16 2022-03-29 维沃移动通信有限公司 Motion estimation method and device, electronic equipment and readable storage medium
CN113873100B (en) * 2021-09-29 2023-09-22 维沃移动通信有限公司 Video recording method, device, electronic equipment and storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4626158B2 (en) * 2004-03-01 2011-02-02 ソニー株式会社 Motion vector detection apparatus, motion vector detection method, and computer program
CN108886616A (en) * 2017-12-27 2018-11-23 深圳市大疆创新科技有限公司 The method, apparatus and computer system of Video coding
CN109785365B (en) * 2019-01-17 2021-05-04 西安电子科技大学 Real-time target tracking method of address event driven unstructured signal

Also Published As

Publication number Publication date
CN112367486A (en) 2021-02-12

Similar Documents

Publication Publication Date Title
CN113126862B (en) Screen capture method and device, electronic equipment and readable storage medium
CN112153301B (en) Shooting method and electronic equipment
CN112367486B (en) Video processing method and device
CN112333382B (en) Shooting method and device and electronic equipment
CN112954212B (en) Video generation method, device and equipment
CN112911147B (en) Display control method, display control device and electronic equipment
CN112422817B (en) Image processing method and device
CN112422798A (en) Photographing method and device, electronic equipment and storage medium
CN113489909B (en) Shooting parameter determining method and device and electronic equipment
CN113721876A (en) Screen projection processing method and related equipment
CN112738398B (en) Image anti-shake method and device and electronic equipment
CN112529766B (en) Image processing method and device and electronic equipment
CN113852756B (en) Image acquisition method, device, equipment and storage medium
CN112383708B (en) Shooting method and device, electronic equipment and readable storage medium
CN114466140A (en) Image shooting method and device
CN112511890A (en) Video image processing method and device and electronic equipment
CN113473012A (en) Virtualization processing method and device and electronic equipment
CN113709372B (en) Image generation method and electronic device
CN112367470B (en) Image processing method and device and electronic equipment
CN112333388B (en) Image display method and device and electronic equipment
CN113709375B (en) Image display method and device and electronic equipment
CN117640819A (en) Image display method and device, electronic equipment and readable storage medium
CN117274097A (en) Image processing method, device, electronic equipment and medium
CN117278687A (en) Image processing method and device
CN112543285A (en) Image processing method and device, electronic equipment and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant