CN110022452B - Video frame extraction method and system suitable for holographic display device - Google Patents
Video frame extraction method and system suitable for holographic display device Download PDFInfo
- Publication number
- CN110022452B CN110022452B CN201910411840.XA CN201910411840A CN110022452B CN 110022452 B CN110022452 B CN 110022452B CN 201910411840 A CN201910411840 A CN 201910411840A CN 110022452 B CN110022452 B CN 110022452B
- Authority
- CN
- China
- Prior art keywords
- frame
- video
- display device
- holographic display
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0127—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter
Abstract
The invention discloses a video frame extraction method and a system suitable for a holographic display device, which specifically comprise the following steps: s10, carrying out editing operation on the video to be frame-extracted to generate an editing matrix; s20, determining frame extraction key parameters; s30, zooming the frame to be extracted video according to the frame extracting key parameters and acquiring original frame data; s40, applying the editing matrix to the original frame data and intercepting the final frame data; s50, judging whether frame extraction is needed to be continued according to the frame extraction frame rate, if so, executing S40, and if not, executing S60; and S60, generating a final frame sequence to be displayed. The invention can carry out translation and zooming mirror image operation on the video to be frame-extracted; before the original frame data is acquired, the original frame data is scaled to the resolution, the frame extracting speed is adjusted in real time through the frame extracting frame rate, and then the original frame data is acquired, so that the frame rendering speed is improved, and the original frame data is acquired more quickly. The invention has the advantages of compatibility, stability, rapidness, high efficiency and universal availability.
Description
Technical Field
The invention relates to the technical field of video display, in particular to a video frame extracting method and system suitable for a holographic display device.
Background
A holographic (POV) display device is a display device that images based on the principle Of human eye Persistence Of Vision, and the arrangement Of the imaging elements LEDs is designed for a special rotating structure. When the holographic display device rotates, the patterns formed by the LEDs can form residual images on the retinas of human eyes at each position of each moment, and when the holographic display device rotates for a circle, a complete picture pattern can be displayed. At sufficiently high rotational speeds and imaging speeds, the displayed pattern will eventually result in smooth video content.
Currently, there are generally two video rendering (display) methods for a general holographic display device: one is that the display device stores the video original file, when needing to display the video, it is rendered in real time through the special hardware or general software of the device; one is that the rendered file after video preprocessing is stored in the device, and when the video needs to be displayed, the rendered file can be directly displayed, and no additional special hardware or general software is needed, so that offline rendering is realized.
The main flow of the offline rendering comprises the following steps: the frame rendering is usually a fixed mode, and the frame rendering is performed in many modes after the frame is extracted, but the efficiency is usually very low, so that the offline rendering efficiency is very low, which also results in that more devices in the market adopt a real-time rendering scheme. Common video frame extraction methods include: (1) through FFmpeg, appointing relevant parameters, setting frame number, quality, resolution, format and the like, wherein the FFmpeg can be used for recording and converting digital audio and video and can be converted into an open-source computer program of a stream; (2) the time parameter is specified by a system API (Application Programming Interface), such as Media Meta data Retriever, and the frame of the time can be acquired. The Media Meta data Retriever can parse the Media file, and obtain a system API of frames and metadata (information of titles, formats, artists, etc. contained in the video/audio) in the Media file; (3) and directly performing read-write operation on the display buffer area through the framg buffer to obtain the key frame, wherein the framg buffer drives a video display device from a memory buffer area containing complete frame data by using a video output device.
The frame is extracted through the FFmpeg, the method is flexible and convenient, and a plurality of setting parameters are supported; however, due to the open source characteristic, the support situation of each platform is different, when a certain platform implements frame extraction based on the FFmpeg, more work is to transplant the FFmpeg, and ensure the compatibility and stability of the FFmpeg, and meanwhile, the frame extraction efficiency of the FFmpeg is general. Frame extraction is carried out through a system API (application program interface) such as Media Meta data Retriever, the compatibility is high, but the frame extraction efficiency and the accuracy are low, the average time for extracting one frame is about 100ms, and only key frames can be extracted, so that the frame skipping problem is easy to generate. Frame extraction is carried out through frame buffers, a hidden API of a system is used for calling, special system permission is needed, and the method can be only applied to system-level application.
In summary, on the premise that a video frame extraction scheme which has compatibility, stability, rapidness, high efficiency and universal availability is needed, a video frame extraction method and a video frame extraction system for a holographic display device are provided.
Disclosure of Invention
The present invention is directed to a video frame extraction method and system for a holographic display device, which is suitable for solving the above-mentioned drawbacks of the prior art.
The technical scheme adopted by the invention for solving the technical problems is as follows: according to a first aspect of the present invention, there is provided a video frame extraction method suitable for a holographic display device, specifically comprising the steps of:
s10, carrying out editing operation on the video to be frame-extracted to generate an editing matrix; the edit matrix includes position coordinates, zoom size, start time T0, and deadline T1;
s20, determining frame extraction key parameters; the frame extraction key parameters comprise the display resolution, the frame time T, the frame number C and the frame extraction frame rate FPS of the holographic display device;
s30, zooming the frame to be extracted video according to the frame extracting key parameters and acquiring original frame data;
s40, applying the editing matrix to the original frame data and intercepting the final frame data;
s50, judging whether frame extraction is needed to be continued according to the frame extraction frame rate FPS, if so, executing S40, and if not, executing S60;
and S60, generating a final frame sequence to be displayed.
Preferably, S50, determining whether frame extraction needs to be continued according to the frame extraction frame rate FPS, specifically including:
s51, recording the time t0 after processing the final frame data;
s52, acquiring the current time T1 in real time, and calculating the frame time T through the frame extraction frame rate;
s53, judging that T1-T0 is greater than T, if yes, executing S40; if not, S60 is executed.
Preferably, the editing operation comprises a translation operation on the video to be frame-extracted; the translation operation includes:
acquiring initial position coordinates (x0, y0) of the last translation operation;
acquiring real-time position coordinates (x, y) of the current translation operation;
obtaining the position coordinate difference (x-x0, y-y0) of the translation operation;
the position coordinate difference (x-x0, y-y0) is used to update the edit matrix.
Preferably, the initial position coordinates (x0, y0) are reset immediately after the reference point of the translation operation is abruptly changed.
Preferably, the editing operation further comprises a zooming operation on the video to be frame-extracted; the zooming operation includes:
calculating the product of the scaling factor of the to-be-extracted frame video stored in the editing matrix and the current scaling operation factor to obtain an expected scaling factor;
setting the desired scaling factor to an upper bound threshold of a scaling boundary of the holographic display device if the desired scaling factor is greater than the upper bound threshold of the scaling boundary;
if the expected scaling factor is less than the lower bound threshold of the scaling boundary of the holographic display device, the expected scaling factor is set to the lower bound threshold of the scaling boundary.
Preferably, the editing operation further comprises performing mirror image operation on the video to be frame-extracted; the mirroring operation includes:
turning over an x or y coordinate of a position coordinate corresponding to a video to be frame-extracted in the editing matrix;
the x or y of the position coordinates stored in the edit matrix is translated back to the original coordinates.
Preferably, the frame time T is calculated by a decimated frame rate FPS, and the frame time T is 1000.0 ms/FPS; the number of frames C is calculated by the start time T0, the end time T1, and the frame time T, and the number of frames C is (T1-T0)/T.
The present invention also provides a computer-readable storage medium having stored thereon a computer program which, when executed, implements the above video framing method suitable for a holographic display device.
The invention also provides a video frame extracting device suitable for the holographic display device, which comprises a processor and a memory; wherein the memory is adapted to store a computer program and the processor is adapted to execute the computer program stored by the memory to cause the processor to perform the above video framing method suitable for a holographic display device.
The invention also provides a video frame extracting system suitable for the holographic display device, which comprises the holographic display device and a video frame extracting device suitable for the holographic display device;
the video frame extracting device suitable for the holographic display device comprises a processor and a memory; the memory is for storing a computer program and the processor is for executing the computer program stored by the memory to cause the processor to perform a video framing method as above suitable for a holographic display device.
The technical scheme of the video frame extracting method and the video frame extracting system which are suitable for the holographic display device has the following advantages or beneficial effects: the invention can carry out translation and zooming mirror image operation on the video to be frame-extracted; before the original frame data is obtained, the resolution ratio is reduced, and the frame extraction speed is increased; and adjusting the frame extracting speed in real time through the frame extracting frame rate, scaling the original frame data to the resolution ratio, and then acquiring the original frame data, so that the rendering speed of the frame is improved, and the original frame data is acquired more quickly. The invention has the advantages of compatibility, stability, rapidness, high efficiency and universal availability.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without inventive efforts, wherein:
FIG. 1 is a first flowchart of an embodiment of a video framing method for a holographic display device according to the present invention;
fig. 2 is a schematic diagram of a second flow chart of an embodiment of a video frame extraction method suitable for a holographic display device according to the present invention.
Detailed Description
In order that the objects, aspects and advantages of the present invention will become more apparent, various exemplary embodiments will be described below with reference to the accompanying drawings, which form a part hereof, and in which are shown by way of illustration various exemplary embodiments in which the invention may be practiced, and in which like numerals in different drawings represent the same or similar elements, unless otherwise specified. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. It is to be understood that they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims, and that other embodiments may be used, or structural and functional modifications may be made to the embodiments set forth herein, without departing from the scope and spirit of the present disclosure. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
In order to explain the technical means of the present invention, the following description will be given by way of specific examples.
The first embodiment is as follows:
fig. 1-2 are schematic diagrams provided by embodiments of the video framing method and system suitable for a holographic display device according to the present invention, and for convenience of illustration, only the parts related to the embodiments of the present invention are shown. The invention relates to a video frame extracting method suitable for a holographic display device, which comprises the following steps:
s10, carrying out editing operation on the video to be frame-extracted to generate an editing matrix; the edit matrix includes position coordinates, zoom size, start time T0, and deadline T1;
s20, determining frame extraction key parameters; the frame extraction key parameters comprise the display resolution, the frame time T, the frame number C and the frame extraction frame rate FPS of the holographic display device; specifically, the frame time T is calculated by a decimation frame rate FPS, and the frame time T is 1000.0 ms/FPS; the number of frames C is calculated by the start time T0, the end time T1, and the frame time T, and the number of frames C is (T1-T0)/T.
S30, zooming the frame to be extracted video according to the frame extracting key parameters and acquiring original frame data;
specifically, according to the display resolution of the holographic display device, the original frame data is scaled to the resolution and then acquired, so that the frame rendering speed is increased, and the original frame data is acquired more quickly. After the original frame data is obtained, the editing matrix is applied to the frame data, and then a part of the content required to be displayed on the holographic display device is intercepted to be used as final frame data.
S40, applying the editing matrix to the original frame data and intercepting the final frame data;
s50, judging whether frame extraction is needed to be continued according to the frame extraction frame rate FPS, if so, executing S40, and if not, executing S60;
and S60, generating a final frame sequence to be displayed.
In this embodiment, S50, determining whether frame extraction needs to be continued according to the frame extraction frame rate FPS, specifically includes the steps of:
s51, recording the time t0 after the final frame data is processed;
s52, acquiring the current time T1 in real time, and calculating the frame time T through the frame extraction frame rate;
s53, judging that T1-T0 is greater than T, if yes, executing S40; if not, S60 is executed.
Specifically, the above steps are repeatedly performed until the current time T1 reaches the end of the video to be frame-extracted and the extracted frame number reaches the expected frame number C, i.e., (T > T1 and the frame number C < C).
In this embodiment, the editing operation includes performing a panning operation on a video to be frame-extracted; the translation operation includes:
acquiring initial position coordinates (x0, y0) of the last translation operation;
acquiring real-time position coordinates (x, y) of the current translation operation;
obtaining the position coordinate difference (x-x0, y-y0) of the translation operation;
the position coordinate difference (x-x0, y-y0) is used to update the edit matrix.
Specifically, if the reference point of the translation operation is abruptly changed, the initial position coordinates (x0, y0) are reset immediately (i.e., at the first time when the change occurs); otherwise, the reference point of the translation operation changes suddenly, and the translation operation generates jitter. More specifically, the reset initial position coordinates (x0, y0) are the coordinates of the center point formed by the new reference point; if the point is a reference point, the central point is the coordinate of the point; if the two reference points are used, the central point is the central point of the two points; for example, the central point is the central point of three points.
In this embodiment, the editing operation further includes performing a scaling operation on the video to be frame-extracted; when a user performs a zoom operation, the zoom boundary is limited, and the zoom operation includes the steps of:
calculating the product of the scaling factor of the to-be-extracted frame video stored in the editing matrix and the current scaling operation factor to obtain an expected scaling factor; specifically, the original scaling factor, which is not fixed, is determined by its size at the time of initial loading. After the current zooming operation factor is zoomed, a specific behavior value of the operation can be obtained, wherein if the specific behavior value is larger than 1, the operation is zoomed in, and if the specific behavior value is smaller than 1, the operation is zoomed out.
Setting the desired scaling factor to an upper bound threshold of a scaling boundary of the holographic display device if the desired scaling factor is greater than the upper bound threshold of the scaling boundary;
if the expected scaling factor is less than the lower bound threshold of the scaling boundary of the holographic display device, the expected scaling factor is set to the lower bound threshold of the scaling boundary.
In this embodiment, the editing operation further includes performing a mirroring operation on the video to be frame-extracted; the mirroring operation includes the steps of:
turning over an x or y coordinate of a position coordinate corresponding to a video to be frame-extracted in the editing matrix;
and translating the x or y of the position coordinate stored in the editing matrix back to the original coordinate to ensure that the final mirroring operation is carried out according to the central point of the video to be frame-extracted. Specifically, the axis of symmetry of the mirror operation is not the central axis of itself, so that after x is directly inverted, the position of the video is shifted to-x, and then 2x is required to shift the video to the original position. Alternatively, after y is directly inverted, the position of the video may be moved to-y, and then it is moved to the original position by 2 y.
The invention can carry out translation and zooming mirror image operation on the video to be frame-extracted; before the original frame data is obtained, the resolution ratio is reduced, and the frame extraction speed is increased; and adjusting the frame extracting speed in real time through the frame extracting frame rate, scaling the original frame data to the resolution ratio, and then acquiring the original frame data, so that the rendering speed of the frame is improved, and the original frame data is acquired more quickly. The invention has the advantages of compatibility, stability, rapidness, high efficiency and universal availability. More specifically, compatibility: the frame extraction operation is completely carried out by a system-related method, and an additional class library and the like are not needed. Stability: the frame extraction stability depends on the rendering stability of the video in the view, and the rendering is very stable as the basic function of the view. Fast and efficient: the method is characterized in that the frame extraction method is used, the average time consumption is 2ms-4.5ms from the beginning of obtaining the original frame data to the final generation of the expected frame data, and the method is not influenced by the resolution of the original video; by using other frame extraction methods, the original resolution of the video can affect the frame extraction speed, and on the premise of the same video resolution, the frame extraction speed is 20-40 times slower than that by using the frame extraction method.
Compared with a real-time rendering display scheme of the holographic display device, the method has the advantages that the frames of the video are extracted, the processed rendered file is stored in the equipment, and the rendered file is displayed when the video needs to be displayed, so that extra special hardware or general software is not needed, and the hardware cost and the development cost are saved.
Example two:
it will be understood by those skilled in the art that all or part of the steps for implementing the above-described method embodiments may be performed by hardware associated with a computer program. The aforementioned computer program may be stored in a computer-readable storage medium, on which a computer program is stored, which, when executed (e.g., by a processor), performs the steps comprising the above-described embodiments of the video framing method for a holographic display device, and the aforementioned storage medium comprises: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Example three:
the invention also provides an embodiment of a video frame extracting device suitable for the holographic display device, which comprises a processor and a memory; wherein the memory is configured to store a computer program, and the processor is configured to execute the computer program stored by the memory, so as to cause the processor to perform the steps of the above-mentioned video framing method embodiment suitable for the holographic display device. Specifically, the video frame extracting device suitable for the holographic display device may be an intelligent terminal such as a computer, an intelligent tablet, a smart phone, and the like, and is not limited specifically herein.
Example four:
the invention also provides a video frame extracting system embodiment suitable for the holographic display device, which comprises the holographic display device and a video frame extracting device suitable for the holographic display device; specifically, the video frame extracting device suitable for the holographic display device comprises a processor and a memory; the memory is adapted to store a computer program and the processor is adapted to execute the computer program stored by the memory to cause the processor to perform the steps of the embodiments of the video framing method as described above for the holographic display device.
After reading the following description, it will be apparent to one skilled in the art that various features described herein can be implemented in a method, data processing system, or computer program product. Accordingly, these features may be embodied in less than hardware, in all software, or in a combination of hardware and software. Furthermore, the above-described features may also be embodied in the form of a computer program product stored on one or more computer-readable storage media having computer-readable program code segments or instructions embodied in the storage medium. The readable storage medium is configured to store various types of data to support operations at the device. The readable storage medium may be implemented by any type of volatile or non-volatile storage device, or combination thereof. Such as a static hard disk, a random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), an optical storage device, a magnetic storage device, a flash memory, a magnetic or optical disk, and/or combinations thereof.
While the invention has been described with reference to a preferred embodiment, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the spirit and scope of the invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the invention without departing from the essential scope thereof. Therefore, it is intended that the invention not be limited to the particular embodiment disclosed, but that the invention will include all embodiments falling within the scope of the appended claims.
Claims (8)
1. A video frame extraction method suitable for a holographic display device is characterized by specifically comprising the following steps:
s10, carrying out editing operation on the video to be frame-extracted to generate an editing matrix; the edit matrix includes position coordinates, zoom size, start time T0, and deadline T1;
s20, determining frame extraction key parameters; the frame extraction key parameters comprise the display resolution, the frame time T, the frame number C and the frame extraction frame rate FPS of the holographic display device; the frame time T is calculated by the frame extraction frame rate FPS, and the frame time T is 1000.0 ms/FPS; the frame number C is calculated by the start time T0, the end time T1, and a frame time T, and the frame number C is (T1-T0)/T;
s30, zooming the video to be frame-extracted according to the frame-extracting key parameters and acquiring original frame data; specifically, according to the display resolution of the holographic display device, the original frame data is scaled to the resolution and then acquired, so that the frame rendering speed is increased, and the original frame data is acquired more quickly;
s40, applying the editing matrix to the original frame data, and intercepting the final frame data;
s50, judging whether frame extraction is needed to be continued according to the frame extraction frame rate FPS, if so, executing S40, and if not, executing S60; the method specifically comprises the following steps:
s51, recording the time t0 after processing the final frame data;
s52, acquiring the current time T1 in real time, and calculating the frame time T according to the frame extraction frame rate;
s53, judging that the T1-T0 is greater than T, if yes, executing S40; if not, executing S60;
and S60, generating a final frame sequence to be displayed.
2. The video framing method for the holographic display device according to claim 1, wherein the editing operation comprises performing a panning operation on the video to be framed; the translation operation includes:
acquiring initial position coordinates (x0, y0) of the last translation operation;
acquiring the current real-time position coordinates (x, y) of the translation operation;
obtaining the position coordinate difference (x-x0, y-y0) of the translation operation;
the position coordinate difference (x-x0, y-y0) is used to update the edit matrix.
3. The video framing method for holographic display devices of claim 2, wherein the initial position coordinates (x0, y0) are reset immediately after a sudden change of the reference point of the panning operation.
4. The video framing method for the holographic display device according to claim 2, wherein the editing operation further comprises a zooming operation on the video to be framed; the scaling operation comprises:
calculating the product of the scaling factor of the video to be frame-extracted stored in the editing matrix and the current scaling operation factor to obtain an expected scaling factor;
setting the expected zoom factor to an upper bound threshold of a zoom boundary of the holographic display device if the expected zoom factor is greater than the upper bound threshold of the zoom boundary;
setting the expected scaling factor to a lower bound threshold of a scaling boundary of the holographic display device if the expected scaling factor is less than the lower bound threshold of the scaling boundary.
5. The video framing method suitable for the holographic display device according to claim 4, wherein the editing operation further comprises a mirroring operation on the video to be framed; the mirroring operation includes:
turning the x or y coordinate of the position coordinate corresponding to the video to be frame-extracted in the editing matrix;
translating the x or y of the position coordinates stored in the editing matrix back to the original coordinates.
6. A computer-readable storage medium, on which a computer program is stored, which, when executed, implements the video framing method for a holographic display device of any of claims 1-5.
7. A video frame extracting device suitable for a holographic display device is characterized by comprising a processor and a memory;
the memory is configured to store a computer program, and the processor is configured to execute the computer program stored by the memory to cause the processor to perform the video framing method for a holographic display device according to any of claims 1-5.
8. A video frame extracting system suitable for a holographic display device is characterized by comprising the holographic display device and a video frame extracting device suitable for the holographic display device;
the video frame extracting device suitable for the holographic display device comprises a processor and a memory; the memory is for storing a computer program and the processor is for executing the computer program stored by the memory to cause the processor to perform the video framing method for a holographic display device according to any of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910411840.XA CN110022452B (en) | 2019-05-16 | 2019-05-16 | Video frame extraction method and system suitable for holographic display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910411840.XA CN110022452B (en) | 2019-05-16 | 2019-05-16 | Video frame extraction method and system suitable for holographic display device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110022452A CN110022452A (en) | 2019-07-16 |
| CN110022452B true CN110022452B (en) | 2021-04-30 |
Family
ID=67193912
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910411840.XA Active CN110022452B (en) | 2019-05-16 | 2019-05-16 | Video frame extraction method and system suitable for holographic display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110022452B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113163260B (en) * | 2021-03-09 | 2023-03-24 | 北京百度网讯科技有限公司 | Video frame output control method and device and electronic equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101527134A (en) * | 2009-04-03 | 2009-09-09 | 华为技术有限公司 | Display method, display controller and display terminal |
| CN103220577A (en) * | 2012-01-18 | 2013-07-24 | 腾讯科技（深圳）有限公司 | Method, device and system for video displaying |
| CN104516255A (en) * | 2013-10-08 | 2015-04-15 | 江苏慧光电子科技有限公司 | Rapid hologram generating method |
| CN106060080A (en) * | 2016-07-12 | 2016-10-26 | 李巍 | Medical video signal collection and transcoding system |
| CN108038911A (en) * | 2017-11-27 | 2018-05-15 | 广西南宁聚象数字科技有限公司 | A kind of holographic imaging control method based on AR technologies |
| CN109391585A (en) * | 2017-08-03 | 2019-02-26 | 杭州海康威视数字技术股份有限公司 | Video data handling procedure, device, terminal and computer readable storage medium |
| CN109712224A (en) * | 2018-12-29 | 2019-05-03 | 青岛海信电器股份有限公司 | Rendering method, device and the smart machine of virtual scene |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI332205B (en) * | 2007-03-01 | 2010-10-21 | Lite On It Corp | Data modulation/encryption method used in holographic stotage system |
| CN105898267A (en) * | 2015-11-24 | 2016-08-24 | 徐州维林苑文化传媒有限公司 | Lens-free stereoscopic video processing method |
| CN105681777B (en) * | 2016-01-20 | 2017-09-05 | 深圳创维－Rgb电子有限公司 | A kind of bore hole 3D display methods and system |
| CN105933724A (en) * | 2016-05-23 | 2016-09-07 | 福建星网视易信息系统有限公司 | Video producing method, device and system |
-
2019
- 2019-05-16 CN CN201910411840.XA patent/CN110022452B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101527134A (en) * | 2009-04-03 | 2009-09-09 | 华为技术有限公司 | Display method, display controller and display terminal |
| CN103220577A (en) * | 2012-01-18 | 2013-07-24 | 腾讯科技（深圳）有限公司 | Method, device and system for video displaying |
| CN104516255A (en) * | 2013-10-08 | 2015-04-15 | 江苏慧光电子科技有限公司 | Rapid hologram generating method |
| CN106060080A (en) * | 2016-07-12 | 2016-10-26 | 李巍 | Medical video signal collection and transcoding system |
| CN109391585A (en) * | 2017-08-03 | 2019-02-26 | 杭州海康威视数字技术股份有限公司 | Video data handling procedure, device, terminal and computer readable storage medium |
| CN108038911A (en) * | 2017-11-27 | 2018-05-15 | 广西南宁聚象数字科技有限公司 | A kind of holographic imaging control method based on AR technologies |
| CN109712224A (en) * | 2018-12-29 | 2019-05-03 | 青岛海信电器股份有限公司 | Rendering method, device and the smart machine of virtual scene |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110022452A (en) | 2019-07-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7286684B2 (en) | Face-based special effects generation method, apparatus and electronics | |
| CN107015788B (en) | Method and device for displaying images on mobile device in animation mode | |
| CN112291627A (en) | Video editing method and device, mobile terminal and storage medium | |
| CN110636365B (en) | Video character adding method and device, electronic equipment and storage medium | |
| US20040075663A1 (en) | Processing scene objects | |
| AU2008299578B2 (en) | A system and method for capturing digital images | |
| JP6882992B2 (en) | How and devices to preview moving images, and how and devices to display representation packages | |
| CN113115095B (en) | Video processing method, video processing device, electronic equipment and storage medium | |
| CN110996150A (en) | Video fusion method, electronic device and storage medium | |
| CN112684966A (en) | Picture scaling method and device and electronic equipment | |
| CN109379631B (en) | Method for editing video captions through mobile terminal | |
| WO2022100162A1 (en) | Method and apparatus for producing dynamic shots in short video | |
| CN110572717A (en) | Video editing method and device | |
| CN110022452B (en) | Video frame extraction method and system suitable for holographic display device | |
| JP2003303333A (en) | Image display control device | |
| WO2023273114A1 (en) | Dynamic resolution rendering method and apparatus, device, program, and readable medium | |
| CN114157877A (en) | Playback data generation method and device, and playback method and device | |
| CN105635832A (en) | Video processing method and device | |
| CN115965519A (en) | Model processing method, device, equipment and medium | |
| CN114331808A (en) | Action posture storage method, device, medium and electronic equipment | |
| CN112333557A (en) | Method for adding watermark in video | |
| CN109729285B (en) | Fuse grid special effect generation method and device, electronic equipment and storage medium | |
| US20170091905A1 (en) | Information Handling System Defocus Tracking Video | |
| CN112311961A (en) | Method and device for setting lens in short video | |
| CN112991146A (en) | Automatic special effect generation system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220913 Address after: Room 609, Building B2, Hengjin Zhigu, Fengtang Avenue, Zhancheng Community, Fuhai Street, Baoan District, Shenzhen, Guangdong 518100 Patentee after: Shenzhen Holographic Times Media Technology Co.,Ltd. Address before: 518000 Longhua Street Fukang Community Pinus tabulaeformis Second Industrial Zone, Longhua District, Shenzhen City, Guangdong Province Patentee before: SHENZHEN XINDONG ELECTRONIC TECHNOLOGY Co.,Ltd. |