CN116886984A - Image processing method, apparatus, electronic device, and computer-readable storage medium - Google Patents

Image processing method, apparatus, electronic device, and computer-readable storage medium Download PDF

Info

Publication number
CN116886984A
CN116886984A CN202310647101.7A CN202310647101A CN116886984A CN 116886984 A CN116886984 A CN 116886984A CN 202310647101 A CN202310647101 A CN 202310647101A CN 116886984 A CN116886984 A CN 116886984A
Authority
CN
China
Prior art keywords
image frames
frame
image
transition
frames
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310647101.7A
Other languages
Chinese (zh)
Inventor
蒋亿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202310647101.7A priority Critical patent/CN116886984A/en
Publication of CN116886984A publication Critical patent/CN116886984A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4621—Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Television Systems (AREA)

Abstract

The present application relates to an image processing method, an apparatus, an electronic device, a storage medium, and a computer program product. The method comprises the following steps: acquiring at least two first image frames; performing frame interpolation processing on the at least two first image frames to obtain first transition frames; and transmitting the first transition frame and at least two first image frames to a target device, wherein the target device is used for displaying the first transition frame and the at least two first image frames. By adopting the method, the fluency of displaying the image frames by the target equipment can be improved.

Description

Image processing method, apparatus, electronic device, and computer-readable storage medium
Technical Field
The present application relates to the field of image technology, and in particular, to an image processing method, an image processing device, an electronic device, and a computer readable storage medium.
Background
With the development of the image technology field, a MEMC (Motion Estimation and Motion Compensation ) technology appears, when an electronic device plays a video in a screen, a plurality of compensation frame pictures generated by interpolation prediction can be aimed at between two frame pictures, so that the play frame rate can be improved, and better experience fluency is brought.
However, if the electronic device does not support the MEMC technology, frame interpolation cannot be performed when displaying the image frames of the video, and there is a problem that the image frames are not smoothly displayed.
Disclosure of Invention
The embodiment of the application provides an image processing method, an image processing device, electronic equipment, a computer readable storage medium and a computer program product, which can enable target equipment to display a first transition frame and at least two first image frames after frame insertion and improve the fluency of the target equipment in displaying the image frames.
In a first aspect, the present application provides an image processing method. The method comprises the following steps:
acquiring at least two first image frames;
performing frame interpolation processing on the at least two first image frames to obtain first transition frames;
and transmitting the first transition frame and at least two first image frames to a target device, wherein the target device is used for displaying the first transition frame and the at least two first image frames.
In a second aspect, the present application also provides an image processing apparatus. The device comprises:
the acquisition module is used for acquiring at least two first image frames;
the frame inserting module is used for carrying out frame inserting processing on the at least two first image frames to obtain first transition frames;
and the sending module is used for sending the first transition frame and the at least two first image frames to target equipment, and the target equipment is used for displaying the first transition frame and the at least two first image frames.
In a third aspect, the application further provides electronic equipment. The electronic device comprises a memory and a processor, the memory stores a computer program, and the processor executes the computer program to realize the following steps:
acquiring at least two first image frames;
performing frame interpolation processing on the at least two first image frames to obtain first transition frames;
and transmitting the first transition frame and at least two first image frames to a target device, wherein the target device is used for displaying the first transition frame and the at least two first image frames.
In a fourth aspect, the present application also provides a computer-readable storage medium. The computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of:
acquiring at least two first image frames;
performing frame interpolation processing on the at least two first image frames to obtain first transition frames;
and transmitting the first transition frame and at least two first image frames to a target device, wherein the target device is used for displaying the first transition frame and the at least two first image frames.
In a fifth aspect, the present application also provides a computer program product. The computer program product comprises a computer program which, when executed by a processor, implements the steps of:
acquiring at least two first image frames;
performing frame interpolation processing on the at least two first image frames to obtain first transition frames;
and transmitting the first transition frame and at least two first image frames to a target device, wherein the target device is used for displaying the first transition frame and the at least two first image frames.
According to the image processing method, the device, the electronic equipment, the computer readable storage medium and the computer program product, at least two first image frames are acquired, the at least two first image frames are subjected to frame inserting processing to obtain first transition frames, and the first transition frames and the at least two first image frames are sent to the target equipment, so that the target equipment can display the first transition frames and the at least two first image frames obtained after frame inserting even if the target equipment does not support the MEMC technology, and the smoothness of the display of the image frames of the target equipment which does not support the MEMC technology is improved.
Drawings
In order to more clearly illustrate the embodiments of the application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of an image processing method in one embodiment;
FIG. 2 is a schematic diagram of a conventional technique for receiving an image frame in one embodiment;
FIG. 3 is a schematic diagram of image processing in one embodiment;
FIG. 4 is a flowchart of an image processing method in another embodiment;
FIG. 5 is a block diagram showing the structure of an image processing apparatus in one embodiment;
fig. 6 is an internal structural diagram of an electronic device in one embodiment.
Detailed Description
The present application will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present application more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.
In one embodiment, as shown in fig. 1, an image processing method is provided, and this embodiment is illustrated by applying the method to an electronic device, which may be a terminal or a server; it will be appreciated that the method may also be applied to a system comprising a terminal and a server and implemented by interaction of the terminal and the server. The terminal can be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, internet of things equipment and portable wearable equipment, and the internet of things equipment can be smart speakers, smart televisions, smart air conditioners, smart vehicle-mounted equipment, smart automobiles and the like. The portable wearable device may be a smart watch, smart bracelet, headset, or the like. The server may be implemented as a stand-alone server or as a server cluster composed of a plurality of servers.
In this embodiment, the image processing method includes the steps of:
step S102, at least two first image frames are acquired.
Optionally, the electronic device acquires at least two first image frames obtained by shooting by the camera module.
Optionally, the electronic device includes a camera module and an image signal processing chip (ISP chip); shooting by a camera module to obtain at least two original image frames, and sending the at least two original image frames to an image signal processing chip; and carrying out image signal processing on each original image frame in sequence through an image signal processing chip to obtain at least two first image frames.
The image signal processing chip processes image signals of each original image frame in sequence, and may include Bayer, black level compensation (black level compensation), lens correction (lens shading correction), bad pixel correction (bad pixel correction), color interpolation (demosaic), bayer noise removal, white balance (AWB) correction, color correction (color correction), gamma correction, color space conversion (RGB conversion to YUV), color noise removal and edge enhancement, color and contrast enhancement in YUV color space, and automatic exposure control in the middle.
And step S104, performing frame interpolation processing on at least two first image frames to obtain first transition frames.
The first transition frame is an image frame obtained by interpolation processing.
Optionally, the electronic device performs frame interpolation processing on the two connected first image frames by using a frame interpolation technology through a frame interpolation chip to obtain a first transition frame. The frame inserting chip may be a MEMC chip, or other hardware chip, but is not limited thereto. Alternatively, the electronic device may perform frame interpolation processing on at least two first image frames by using other frame interpolation (frame interpolation) algorithms to obtain a first transition frame, which is not limited herein.
Optionally, the electronic device obtains a target frame rate; performing frame interpolation processing on at least two first image frames based on the target frame rate to obtain first transition frames; the frame rates of the at least two first transition frames and the at least two first image frames are target frame rates. The target frame rate may be set as needed, for example, 30 frames/second, 32 frames/second, or the like.
It will be appreciated that if the electronic device transmits the first transition frame and at least two first image frames of the target frame rate to the target device, both the target device and the electronic device may ensure that the presentation is performed at the same target frame rate.
Step S106, the first transition frame and at least two first image frames are sent to the target device, and the target device is configured to display the first transition frame and the at least two first image frames.
Optionally, the target device does not support MEMC techniques, i.e., the target device is unable to perform the frame insertion.
Optionally, the electronic device transmits the first transition frame and the at least two first image frames of the target frame rate to the target device, and the target device displays the first transition frame and the at least two first image frames at the target frame rate.
Optionally, the electronic device sends the first transition frame and the at least two first image frames to the application program, and then sends the first transition frame and the at least two first image frames to the target device through the application program.
Optionally, the electronic device may send the first transition frame and the at least two first image frames to the target device through a transmission medium such as a network, a usb disk, or the like.
According to the image processing method, at least two first image frames are obtained, the at least two first image frames are subjected to frame inserting processing to obtain the first transition frames, and the first transition frames and the at least two first image frames are sent to the target equipment, so that the target equipment can display the first transition frames and the at least two first image frames obtained after frame inserting even if the target equipment does not support the MEMC technology, the fluency of displaying the image frames of the target equipment which does not support the MEMC technology is improved, and the fluency of displaying videos is improved.
In one embodiment, performing frame interpolation processing on at least two first image frames to obtain a first transition frame, including: counting the receiving condition of the first image frame in each preset time period; and carrying out frame inserting processing on at least two first image frames based on the receiving condition of the first image frames in each preset duration to obtain first transition frames.
The preset duration may be set as needed, for example, the preset duration is 33 milliseconds.
The receiving of the first image frame in each preset time period may include receiving the first image frame in the preset time period, and not receiving the first image frame in the preset time period.
Optionally, based on the receiving condition of the first image frames in each preset duration, performing frame interpolation processing on at least two first image frames to obtain a first transition frame, including: if the receiving condition indicates that the first image frames are received in each preset time length, carrying out frame inserting processing on at least two first image frames to obtain first transition frames; if the receiving condition indicates that at least one first image frame is not received within the preset time length, generating at least two new first image frames based on the received first image frames, and performing frame inserting processing on the at least two new first image frames to obtain a first transition frame.
Optionally, the electronic device detects whether a first image frame is received in each preset duration, and if a first image frame is not received in the preset duration, the first image frame indicating the preset duration has a frame loss condition.
If the receiving condition indicates that the first image frames are received in each preset time period, and the electronic equipment receives all the first image frames, performing frame inserting processing on at least two first image frames to obtain first transition frames; if the receiving condition indicates that at least one first image frame is not received within a preset duration, and indicates that the electronic equipment has a frame loss condition in the process of receiving the first image frames, generating at least two new first image frames based on the received first image frames, and performing frame inserting processing on the at least two new first image frames to obtain first transition frames.
Optionally, if the receiving condition indicates that the number of the received first image frames reaches a preset number, performing frame inserting processing on at least two first image frames to obtain a first transition frame; if the receiving condition indicates that the number of the received first image frames is less than the preset number, generating at least two new first image frames based on the received first image frames, and performing frame inserting processing on the at least two new first image frames to obtain first transition frames.
In other embodiments, other receiving conditions may be set, so as to obtain the first transition frame.
It should be noted that, if the receiving situation indicates that the number of the received first image frames is less than the preset number, there is a frame loss in the process of sending the first image frames to the image signal processing chip, or there is a frame loss in the process of sending the first image frames to the frame inserting chip.
Optionally, generating new at least two first image frames based on the received first image frames, including: performing frame inserting processing on the received first image frame to obtain a second transition frame; based on the second transition frame and the first image frames, new at least two first image frames are obtained.
It can be understood that if the receiving condition indicates that the first image frame is not received within at least one preset duration, and indicates that the first image frame has a frame loss condition, determining at least two adjacent first image frames of the lost first image frame, and performing frame interpolation processing on the at least two adjacent first image frames to obtain a second transition frame; i.e. the lost first image frame is replaced with the second transition frame, whereby the second transition frame and the first image frame constitute a new at least two first image frames.
Optionally, the frame rate of the new at least two first image frames is the same as the original frame rate of the at least two first image frames, so that the target frame rate of the image frames obtained by final frame interpolation can be ensured to be the same. The original frame rate of the at least two first image frames is the frame rate of the first image frames received by the electronic device in each preset duration.
In this embodiment, the electronic device counts the receiving conditions of the first image frames in each preset duration, so that frame inserting processing can be accurately performed on at least two first image frames based on the receiving conditions of the first image frames in each preset duration, and a first transition frame is obtained. Further, the electronic device can obtain the first transition frame more accurately according to whether the frame is lost or not in the receiving condition; under the condition of frame loss, the electronic equipment carries out frame inserting processing on the received first image frames to obtain second transition frames, so that at least two new first image frames can be accurately obtained.
In the conventional technology, as shown in fig. 2, an electronic device receives an image frame every 33 ms, if the electronic device receives an n+1th image frame after receiving the N-th image frame, and then receives an n+2th image frame after receiving the 33 ms, it means that there is a frame loss between the N-th image frame and the n+1th image frame, which may cause inconsistent receiving time intervals of the front and rear image frames, and there is a problem that the pictures are not smooth when displaying each image frame.
In this embodiment, as shown in fig. 3, the electronic device is configured to receive a first image frame every time a preset time period (33 ms), and when an nth first image frame is received, the first image frame is not received within 33 ms, and then a second transition frame (M) is obtained by performing frame interpolation processing on the received first image frame, where an n+1th image frame and an n+2th image frame are received after 33 ms. It can be appreciated that, if the interval between each first image frame and each second transition frame is 33 ms, the electronic device or the target device can display each image frame more smoothly, so as to avoid the jamming of the picture.
In one embodiment, the method is applied to electronic equipment, and the electronic equipment comprises a camera module, an image signal processing chip and a frame inserting chip; acquiring at least two first image frames, comprising: shooting by a camera module to obtain at least two original image frames, and sending the at least two original image frames to an image signal processing chip; image signal processing is sequentially carried out on each original image frame through an image signal processing chip to obtain at least two first image frames, and the at least two first image frames are sent to a frame inserting chip; performing frame interpolation processing on at least two first image frames to obtain a first transition frame, wherein the frame interpolation processing comprises the following steps: and carrying out frame inserting processing on at least two first image frames through a frame inserting chip to obtain first transition frames.
Optionally, the electronic device shoots in real time through the camera module, sequentially obtains at least two original image frames, and sequentially sends the at least two original image frames to the image signal processing chip; the image signal processing chip sequentially carries out image signal processing on each original image frame to obtain at least two first image frames, and sends the at least two first image frames to the frame inserting chip; and the frame inserting chip sequentially carries out frame inserting processing on at least two first image frames to obtain first transition frames.
It can be understood that the image signal processing chip performs image signal processing on the original image frame, so that a first image frame with higher image quality can be obtained, and an image with higher image quality and clearer image can be displayed in the electronic device or the target device.
Optionally, the frame inserting chip performs frame inserting processing on at least two first image frames to obtain a first transition frame, and then the method further includes: and displaying the first transition frame and the at least two first image frames in sequence according to the arrangement sequence of the first transition frame and the at least two first image frames.
The electronic device further includes a display; the electronic equipment sequentially sends the first image frames or the first transition frames to the application program according to the arrangement sequence of the first image frames and the first transition frames, and sequentially sends the first image frames or the first transition frames to the display through the application program, and the first image frames or the first transition frames are sequentially displayed in the screen through the display, so that the image frames can be displayed in real time in the shooting process.
In this embodiment, the electronic device obtains at least two original image frames by shooting through the camera module, and can perform image signal processing on the at least two original image frames through the image signal processing chip, and then perform frame insertion on the at least two first image frames through the frame insertion chip, so as to perform display, that is, perform frame insertion processing on the image frames shot by the camera module in real time, so that the image frames with higher fluency are displayed.
In one embodiment, after performing frame interpolation processing on at least two first image frames to obtain a first transition frame, the method further includes: sequentially encoding the first transition frame and at least two first image frames through an encoder to obtain encoded image frames; transmitting the first transition frame and the at least two first image frames to a target device, the target device for displaying the first transition frame and the at least two first image frames, comprising: the encoded image frames are sequentially transmitted to a target device, which is configured to display the encoded image frames.
It can be understood that the electronic device performs encoding processing on the first transition frame and at least two first image frames in sequence, so that encoded image frames which occupy a lower memory space and are more suitable for transmission can be obtained, and then the encoded image frames are sequentially sent to the target device, so that the target device can avoid frame loss in the retransmission process, accurately receive all the encoded images, decode the encoded image frames by the target device, and obtain a first transition frame and at least two first image frames with a target frame rate, thereby sequentially displaying the first transition frame and at least two first image frames with the target frame rate.
It can be understood that each encoded image frame belongs to a video file, and after receiving the encoded image frame, the target device can decode to obtain a first transition frame and a first image frame, and sequentially display the first transition frame and the first image frame, and can display the video file.
In one embodiment, as shown in fig. 4, the electronic device obtains at least two original image frames by shooting through the camera module, and sends the at least two original image frames to the image signal processing chip; the at least two original image frames include an nth original image frame, an n+1th original image frame, and an n+2th original image frame; image signal processing is sequentially carried out on each original image frame through an image signal processing chip to obtain at least two first image frames, and the at least two first image frames are sent to a frame inserting chip; the at least two first image frames include an nth first image frame, an n+1th first image frame, and an n+2th first image frame; the frame inserting chip carries out frame inserting processing on at least two first image frames to obtain first transition frames, namely the frame inserting chip carries out frame inserting processing according to the N first image frames and the (n+1) th first image frames to obtain the (M) th transition frames, and carries out frame inserting processing according to the (n+1) th first image frames and the (n+2) th first image frames to obtain the (M+1) th transition frames; sequentially sending the sequences of N, M, N +1, M+1 and N+2 to an application program; the application program divides the image data into two paths, one path is transmitted to the display module, and the other path is transmitted to the coding module; transmitting the first transition frame and at least two first image frames to a display module through an application program, and sequentially displaying the first transition frame and the at least two first image frames; the first transition frame and the at least two first image frames are sent to the coding module through the application program, the coding module carries out coding processing on the first transition frame and the at least two first image frames to obtain coded image frames, and the coded image frames are sent to the target equipment, so that the equipment decodes the coded image frames to obtain the first transition frame and the at least two first image frames, the first transition frame and the at least two first image frames are displayed in the target equipment, and the fluency of displaying the image frames is improved.
In one embodiment, another image processing method is provided and applied to electronic equipment, wherein the electronic equipment comprises a camera module, an image signal processing chip and a frame inserting chip; the image processing method includes the steps of:
and A1, shooting by a camera module to obtain at least two original image frames, and sending the at least two original image frames to an image signal processing chip.
And A2, the image signal processing chip sequentially carries out image signal processing on each original image frame to obtain at least two first image frames, and the at least two first image frames are sent to the frame inserting chip.
Step A3, counting the receiving condition of the first image frame in each preset time period by the frame inserting chip; if the receiving condition indicates that the first image frame is received within each preset time period, executing the step A4; if the receiving condition indicates that there is at least one preset duration in which the first image frame is not received, step A5 is executed.
And A4, performing frame inserting processing on at least two first image frames by the frame inserting chip to obtain first transition frames.
Step A5, the frame inserting chip carries out frame inserting processing on the received first image frame to obtain a second transition frame; and obtaining at least two new first image frames based on the second transition frames and the first image frames, and performing frame interpolation processing on the at least two new first image frames to obtain the first transition frames.
The electronic device performs step A6 and/or step A7.
And step A6, the electronic equipment sequentially displays the first transition frame and the at least two first image frames according to the arrangement sequence of the first transition frame and the at least two first image frames.
Step A7, coding the first transition frame and at least two first image frames in sequence through an encoder to obtain coded image frames; the encoded image frames are sequentially transmitted to a target device for displaying the encoded image frames at a target frame rate.
It should be understood that, although the steps in the flowcharts related to the embodiments described above are sequentially shown as indicated by arrows, these steps are not necessarily sequentially performed in the order indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the flowcharts described in the above embodiments may include a plurality of steps or a plurality of stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of the steps or stages is not necessarily performed sequentially, but may be performed alternately or alternately with at least some of the other steps or stages.
Based on the same inventive concept, the embodiment of the application also provides an image processing device for realizing the above-mentioned image processing method. The implementation of the solution provided by the apparatus is similar to the implementation described in the above method, so the specific limitation of one or more embodiments of the image processing apparatus provided below may refer to the limitation of the image processing method hereinabove, and will not be repeated herein.
In one embodiment, as shown in fig. 5, there is provided an image processing apparatus including: an acquisition module 502, a frame insertion module 504, and a transmission module 506, wherein:
an acquisition module 502 is configured to acquire at least two first image frames.
And the frame inserting module 504 is configured to perform frame inserting processing on at least two first image frames to obtain first transition frames.
A transmitting module 506, configured to transmit the first transition frame and the at least two first image frames to a target device, where the target device is configured to display the first transition frame and the at least two first image frames.
According to the image processing device, at least two first image frames are obtained, the at least two first image frames are subjected to frame inserting processing to obtain the first transition frames, and the first transition frames and the at least two first image frames are sent to the target equipment, so that the target equipment can display the first transition frames and the at least two first image frames obtained after frame inserting even if the target equipment does not support the MEMC technology, and the smoothness of displaying the image frames of the target equipment which does not support the MEMC technology is improved.
In one embodiment, the frame inserting module 504 is further configured to count a receiving situation of the first image frame within each preset duration; and carrying out frame inserting processing on at least two first image frames based on the receiving condition of the first image frames in each preset duration to obtain first transition frames.
In one embodiment, the frame inserting module 504 is further configured to perform frame inserting processing on at least two first image frames to obtain a first transition frame if the receiving situation indicates that the first image frames are received within each preset duration; if the receiving condition indicates that at least one first image frame is not received within the preset time length, generating at least two new first image frames based on the received first image frames, and performing frame inserting processing on the at least two new first image frames to obtain a first transition frame.
In one embodiment, the frame inserting module 504 is further configured to perform frame inserting processing on the received first image frame to obtain a second transition frame; based on the second transition frame and the first image frames, new at least two first image frames are obtained.
In one embodiment, the method is applied to electronic equipment, and the electronic equipment comprises a camera module, an image signal processing chip and a frame inserting chip; the acquiring module 502 is further configured to acquire at least two original image frames by shooting with a camera module, and send the at least two original image frames to an image signal processing chip; image signal processing is sequentially carried out on each original image frame through an image signal processing chip to obtain at least two first image frames, and the at least two first image frames are sent to a frame inserting chip; the frame inserting module 504 is further configured to perform frame inserting processing on at least two first image frames through the frame inserting chip, so as to obtain a first transition frame.
In one embodiment, the apparatus further includes a display module, where the display module is configured to sequentially display the first transition frame and the at least two first image frames according to an arrangement order of the first transition frame and the at least two first image frames.
In one embodiment, the apparatus further includes an encoding module, where the encoding module is configured to sequentially encode the first transition frame and at least two first image frames by using an encoder to obtain an encoded image frame; the transmitting module 506 is further configured to sequentially transmit the encoded image frames to a target device, where the target device is configured to display the encoded image frames at the target frame rate.
The respective modules in the above-described image processing apparatus may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in hardware or independent of a processor in the electronic device, or may be stored in software in a memory in the electronic device, so that the processor may call and execute operations corresponding to the above modules.
In one embodiment, an electronic device is provided, which may be a terminal, and an internal structure diagram thereof may be as shown in fig. 6. The electronic device includes a processor, a memory, an input/output interface, a communication interface, a display unit, and an input device. The processor, the memory and the input/output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input/output interface. Wherein the processor of the electronic device is configured to provide computing and control capabilities. The memory of the electronic device includes a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The input/output interface of the electronic device is used to exchange information between the processor and the external device. The communication interface of the electronic device is used for conducting wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement an image processing method. The display unit of the electronic device is used for forming a visual picture, and can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the electronic equipment can be a touch layer covered on the display screen, can also be keys, a track ball or a touch pad arranged on the shell of the electronic equipment, and can also be an external keyboard, a touch pad or a mouse and the like.
It will be appreciated by those skilled in the art that the structure shown in fig. 6 is merely a block diagram of a portion of the structure associated with the present inventive arrangements and is not limiting of the electronic device to which the present inventive arrangements are applied, and that a particular electronic device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
The embodiment of the application also provides a computer readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform steps of an image processing method.
Embodiments of the present application also provide a computer program product comprising instructions which, when run on a computer, cause the computer to perform an image processing method.
It should be noted that, the user information (including but not limited to user equipment information, user personal information, etc.) and the data (including but not limited to data for analysis, stored data, presented data, etc.) related to the present application are information and data authorized by the user or sufficiently authorized by each party, and the collection, use and processing of the related data need to comply with the related laws and regulations and standards of the related country and region.
Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, database, or other medium used in embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high density embedded nonvolatile Memory, resistive random access Memory (ReRAM), magnetic random access Memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric Memory (Ferroelectric Random Access Memory, FRAM), phase change Memory (Phase Change Memory, PCM), graphene Memory, and the like. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, and the like. By way of illustration, and not limitation, RAM can be in the form of a variety of forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), and the like. The databases referred to in the embodiments provided herein may include at least one of a relational database and a non-relational database. The non-relational database may include, but is not limited to, a blockchain-based distributed database, and the like. The processor referred to in the embodiments provided in the present application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic unit, a data processing logic unit based on quantum computing, or the like, but is not limited thereto.
The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The foregoing examples illustrate only a few embodiments of the application and are described in detail herein without thereby limiting the scope of the application. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the application, which are all within the scope of the application. Accordingly, the scope of the application should be assessed as that of the appended claims.

Claims (10)

1. An image processing method, comprising:
acquiring at least two first image frames;
performing frame interpolation processing on the at least two first image frames to obtain first transition frames;
and transmitting the first transition frame and at least two first image frames to a target device, wherein the target device is used for displaying the first transition frame and the at least two first image frames.
2. The method according to claim 1, wherein the performing the frame interpolation process on the at least two first image frames to obtain a first transition frame includes:
counting the receiving condition of the first image frame in each preset duration;
and carrying out frame inserting processing on the at least two first image frames based on the receiving condition of the first image frames in each preset time length to obtain first transition frames.
3. The method according to claim 2, wherein the performing the frame interpolation process on the at least two first image frames based on the receiving condition of the first image frames in each preset duration to obtain a first transition frame includes:
if the receiving condition indicates that the first image frames are received in each preset time period, performing frame inserting processing on the at least two first image frames to obtain first transition frames;
if the receiving condition indicates that at least one first image frame is not received within a preset time period, generating at least two new first image frames based on the received first image frames, and performing frame inserting processing on the at least two new first image frames to obtain a first transition frame.
4. A method according to claim 3, wherein generating new at least two first image frames based on the received first image frames comprises:
performing frame inserting processing on the received first image frame to obtain a second transition frame;
and obtaining at least two new first image frames based on the second transition frame and the first image frames.
5. The method of claim 1, applied to an electronic device comprising a camera module, an image signal processing chip, and a frame insertion chip;
the acquiring at least two first image frames includes:
shooting by the camera module to obtain at least two original image frames, and sending the at least two original image frames to the image signal processing chip;
image signal processing is sequentially carried out on each original image frame through the image signal processing chip to obtain at least two first image frames, and the at least two first image frames are sent to the frame inserting chip;
the frame inserting processing is performed on the at least two first image frames to obtain first transition frames, including:
and carrying out frame inserting processing on the at least two first image frames through the frame inserting chip to obtain first transition frames.
6. The method of claim 5, wherein the method further comprises:
and displaying the first transition frame and the at least two first image frames in sequence according to the arrangement sequence of the first transition frame and the at least two first image frames.
7. The method according to claim 1, wherein after performing the frame interpolation processing on the at least two first image frames to obtain a first transition frame, the method further comprises:
the first transition frame and at least two first image frames are sequentially encoded through an encoder, so that encoded image frames are obtained;
the sending the first transition frame and the at least two first image frames to a target device, where the target device is configured to display the first transition frame and the at least two first image frames, including:
and sequentially transmitting the encoded image frames to target equipment, wherein the target equipment is used for displaying the encoded image frames.
8. An image processing apparatus, comprising:
the acquisition module is used for acquiring at least two first image frames;
the frame inserting module is used for carrying out frame inserting processing on the at least two first image frames to obtain first transition frames;
and the sending module is used for sending the first transition frame and the at least two first image frames to target equipment, and the target equipment is used for displaying the first transition frame and the at least two first image frames.
9. An electronic device comprising a memory and a processor, the memory having stored therein a computer program which, when executed by the processor, causes the processor to perform the steps of the image processing method according to any of claims 1 to 7.
10. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method according to any one of claims 1 to 7.
CN202310647101.7A 2023-06-01 2023-06-01 Image processing method, apparatus, electronic device, and computer-readable storage medium Pending CN116886984A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310647101.7A CN116886984A (en) 2023-06-01 2023-06-01 Image processing method, apparatus, electronic device, and computer-readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310647101.7A CN116886984A (en) 2023-06-01 2023-06-01 Image processing method, apparatus, electronic device, and computer-readable storage medium

Publications (1)

Publication Number Publication Date
CN116886984A true CN116886984A (en) 2023-10-13

Family

ID=88266916

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310647101.7A Pending CN116886984A (en) 2023-06-01 2023-06-01 Image processing method, apparatus, electronic device, and computer-readable storage medium

Country Status (1)

Country Link
CN (1) CN116886984A (en)

Similar Documents

Publication Publication Date Title
CN108391060B (en) Image processing method, image processing device and terminal
US10397612B2 (en) Three-dimensional video encoding method, three-dimensional video decoding method, and related apparatus
KR102617258B1 (en) Image processing method and apparatus
CN111401411A (en) Method and device for acquiring sample image set
CN111275653A (en) Image denoising method and device
US10812730B2 (en) Sensor auto-configuration
US20190141287A1 (en) Using low-resolution frames to increase frame rate of high-resolution frames
CN105589667B (en) Method and device for capturing display image of display equipment
CN114071223A (en) Optical flow-based video interpolation frame generation method, storage medium and terminal equipment
CN113259594A (en) Image processing method and device, computer readable storage medium and terminal
CN110049347B (en) Method, system, terminal and device for configuring images on live interface
CN111967397A (en) Face image processing method and device, storage medium and electronic equipment
US11233970B2 (en) Electronic apparatus and control method thereof
CN117768774A (en) Image processor, image processing method, photographing device and electronic device
CN115293994B (en) Image processing method, image processing device, computer equipment and storage medium
CN114466228B (en) Method, equipment and storage medium for improving smoothness of screen projection display
CN113228665A (en) Method, device, computer program and computer-readable medium for processing configuration data
CN116886984A (en) Image processing method, apparatus, electronic device, and computer-readable storage medium
CN108737877B (en) Image processing method and device and terminal equipment
CN115049572A (en) Image processing method, image processing device, electronic equipment and computer readable storage medium
CN113099237B (en) Video processing method and device
JP4888120B2 (en) Method and apparatus for processing image data
CN110941413B (en) Display screen generation method and related device
WO2017107605A1 (en) Image detail processing method, device, terminal and storage medium
CN113596583A (en) Video stream bullet time data processing method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination