WO2021027632A1 - Image special effect processing method, apparatus, electronic device, and computer-readable storage medium - Google Patents
Image special effect processing method, apparatus, electronic device, and computer-readable storage medium Download PDFInfo
- Publication number
- WO2021027632A1 WO2021027632A1 PCT/CN2020/106820 CN2020106820W WO2021027632A1 WO 2021027632 A1 WO2021027632 A1 WO 2021027632A1 CN 2020106820 W CN2020106820 W CN 2020106820W WO 2021027632 A1 WO2021027632 A1 WO 2021027632A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- layer
- special effect
- unit
- historical
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/71—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/448—Execution paradigms, e.g. implementations of programming paradigms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/448—Execution paradigms, e.g. implementations of programming paradigms
- G06F9/4482—Procedural
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
Definitions
- the present disclosure relates to the technical field of image special effect processing, and in particular to an image special effect processing method, device, electronic equipment, and computer-readable storage medium.
- the post-production method of the captured image is usually adopted to obtain images with special effects.
- this method is not real-time and cannot perform special effect processing on the input image in real time; or R&D personnel write programs for each special effect, but this is very inflexible. If multiple special effects are needed, multiple implementations are required. This will result in larger program size, more complicated implementation, and time-consuming and labor-intensive.
- the technical problem solved by the present disclosure is to provide an image special effect processing method, so as to at least partially solve the technical problem of the complicated and inflexible realization of image special effects in the prior art.
- an image special effect processing device an image special effect processing hardware device, a computer-readable storage medium, and an image special effect processing terminal are also provided.
- An image special effect processing method including:
- the combined image output is displayed on the terminal screen.
- An image special effect processing device including:
- Video acquisition module for acquiring video images
- the current image determining module is configured to determine the current image according to the current playback progress of the video image
- the historical image acquisition module is configured to acquire at least one historical image containing a preset action from the data storage layer through the image acquisition unit of the rendering layer;
- a combination processing module configured to perform a combination processing on the at least one historical image and the current image through the animation logic processing unit of the script layer and the special effect unit of the rendering layer;
- the image display module is used to output the combined image for display on the terminal screen.
- An electronic device including:
- Memory for storing non-transitory computer readable instructions
- the processor is configured to run the computer-readable instructions to enable the processor to implement any of the image special effects processing methods described above when executed.
- a computer-readable storage medium for storing non-transitory computer-readable instructions.
- the computer is caused to execute the image special effect processing method described in any one of the above .
- An image special effect processing terminal includes any image special effect processing device described above.
- At least one historical image containing preset actions is acquired from the data storage layer by the image acquisition unit of the rendering layer, and at least one historical image and the current image are processed by the animation logic processing unit of the script layer and the special effect unit of the rendering layer. Perform combination processing, and display the combined image output on the terminal screen, so that special effects can be achieved only by modifying the rendering layer, which is relatively simple and flexible to implement.
- FIG. 1 is a schematic flowchart of an image special effect processing method according to an embodiment of the present disclosure
- FIG. 2 is a schematic flowchart of an image special effect processing device according to an embodiment of the present disclosure
- Fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
- the image special effect processing method mainly includes the following steps S11 to S15.
- Step S11 Obtain a video image.
- the video image may be a real-time input video stream, for example, a live video in a short video application, or a video image pre-stored in the terminal.
- the terminal may be a mobile terminal, such as a smart phone, a tablet computer, or a fixed terminal, such as a desktop computer.
- Step S12 Determine the current image according to the current playback progress of the video image.
- the current image is the image played at the current moment.
- the current moment can be customized by the user.
- the video image is displayed on the terminal screen for playback.
- the current image can be acquired by triggering the corresponding button, such as taking a photo or capturing the terminal screen.
- Step S13 Obtain at least one historical image containing a preset action from the data storage layer through the image acquisition unit of the rendering layer.
- the data storage layer is used to store historical images.
- the data storage layer can be composed of a cache, and the historical images are stored in the cache so that they can be accessed quickly.
- the historical image may be one or more.
- Step S14 Combine the at least one historical image and the current image through the animation logic processing unit of the script layer and the special effect unit of the rendering layer.
- the script layer includes script programs and script files required for running the script programs. Control the rendering layer by setting the logic in the script.
- the animation logic processing unit is used to determine the zoom degree, size, rotation angle and position of at least one historical image and the current image.
- the special effect unit is used to draw at least one drawing history image and the current image on one image and perform combined rendering.
- Step S16 The combined image is output and displayed on the terminal screen.
- the image acquisition unit of the rendering layer acquires at least one historical image containing a preset action from the data storage layer, and the animation logic processing unit of the script layer and the special effect unit of the rendering layer perform at least one historical image and the current image.
- Combination processing the combined image output is displayed on the terminal screen, so that special effects can be realized only by modifying the rendering layer, which is relatively simple and flexible to implement.
- the method further includes:
- each frame of image is detected
- a partial image containing the predetermined action area is captured by the image capture unit of the rendering layer as the historical image and stored in the data storage layer.
- the preset action may be a preset gesture (for example, a scissors hand, an ok gesture, etc.), or an action such as blinking, or pouting.
- a preset gesture for example, a scissors hand, an ok gesture, etc.
- an action such as blinking, or pouting.
- step S14 specifically includes:
- Step S141 Use the current image as a background image
- Step S142 Determine the display attributes of each historical image and the position in the background image through the animation logic processing unit of the script layer;
- the display attributes are the zoom degree, size, rotation angle and position of the historical image.
- Step S143 Drawing a corresponding historical image at the position according to the display attribute by the special effect unit of the rendering layer to obtain an image.
- the current image as a background image
- set multiple blank areas above or below or on the left or right of the background image and place multiple historical images correspondingly.
- the method further includes:
- the counter of the script layer is triggered to start counting, and when the timer reaches a preset time, the operation of the animation logic processing unit is triggered.
- a partial image containing the predetermined action area is captured by the image capture unit of the rendering layer as the historical image and stored in the data storage layer, And trigger the counter of the script layer to start counting, and when the timer reaches a preset time, the animation logic processing unit is triggered to determine the display attributes of each historical image and the position in the background image.
- the method further includes:
- the script layer includes script programs and script files required for running the script programs.
- Control the rendering layer by setting the logic in the script. For example, by sending an image acquisition instruction to the image acquisition unit of the rendering layer, the image acquisition unit acquires the historical image of the video image from the data storage layer according to the image acquisition instruction.
- the method further includes:
- the script layer sends a control instruction to the special effect fetching unit of the rendering layer to trigger the operation of the special effect unit.
- control of the rendering layer is achieved by setting the logic in the script. For example, by controlling the special effect unit of the rendering layer to complete a special effect. That is, a control instruction is sent to the special effect fetching unit of the rendering layer, and the special effect unit superimposes the historical image with the current image according to the control instruction.
- the method further includes:
- control of the rendering layer is achieved by setting the logic in the script.
- the script layer sends an image capture instruction to the image capture unit of the rendering layer, and the image capture unit captures the image according to the capture instruction, and caches the captured image in the storage layer.
- the image capture instruction includes at least one of the following parameters: image identification, image coordinates, image width, image height, and resolution of the terminal screen.
- the image identifier is the number or name of the captured image, and the image identifier can be randomly generated each time an image is captured.
- the image coordinates are the start and end coordinates of the captured image, including x and y coordinates.
- it can be the coordinates of the upper left corner and the lower right corner of the terminal screen.
- the image coordinates may specifically be normalized coordinates.
- the actual coordinate needs to be calculated according to the resolution of the terminal screen.
- the product of the normalized coordinate and the resolution of the terminal screen is taken as the actual coordinate.
- the image width is the width of the captured image.
- the image height is the height of the captured image.
- the device embodiments of the present disclosure can be used to perform the steps implemented by the method embodiments of the present disclosure.
- the device can execute the steps in the image special effect processing method embodiment described in the first embodiment.
- the device mainly includes: a video acquisition module 21, a current image determination module 22, a historical image acquisition module 23, a combination processing module 24, and an image display module 25; among them,
- the video acquisition module 21 is used to acquire video images
- the current image determining module 22 is configured to determine the current image according to the current playback progress of the video image
- the historical image acquisition module 23 is configured to acquire at least one historical image containing a preset action from the data storage layer through the image acquisition unit of the rendering layer;
- the combination processing module 24 is configured to perform combination processing on the at least one historical image and the current image through the animation logic processing unit of the script layer and the special effect unit of the rendering layer;
- the image display module 25 is used to output the combined image for display on the terminal screen.
- the device further includes: an image storage module 26, wherein:
- the image storage module 26 is used to detect each frame of image during the playback of the video image; if an image containing the predetermined action is detected, the image capture unit of the rendering layer captures the image containing The partial image of the predetermined action area is stored in the data storage layer as the historical image.
- the combination processing module 24 is specifically configured to: use the current image as a background image; determine the display attributes of each historical image and its position in the background image through the animation logic processing unit of the script layer; The special effect unit of the rendering layer draws the corresponding historical image at the position according to the display attribute to obtain an image.
- the device further includes: a counter trigger module 27; wherein,
- the counter triggering module 27 is configured to trigger the counter of the script layer to start timing after the historical image is stored in the data storage layer by the image capture unit of the rendering layer, when the timer reaches a preset time , The operation of the animation logic processing unit is triggered.
- the device further includes: an acquisition instruction sending module 28; wherein,
- the acquisition instruction sending module 28 is configured to send an image acquisition instruction to the image acquisition unit of the rendering layer through the script layer to trigger the operation of the image acquisition unit.
- the device further includes: a control instruction sending module 29; wherein,
- the control instruction sending module 29 is configured to send a control instruction to the special effect fetching unit of the rendering layer through the script layer to trigger the operation of the special effect unit.
- the device further includes: a grabbing instruction sending module 210; wherein,
- the capture instruction sending module 210 is configured to send an image capture instruction to the image capture unit of the rendering layer through the script layer to trigger the operation of the image capture unit.
- the image capture instruction includes at least one of the following parameters: image identification, image coordinates, image width, image height, and resolution of the terminal screen.
- the terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals (e.g. Mobile terminals such as car navigation terminals) and fixed terminals such as digital TVs, desktop computers, etc.
- the electronic device shown in FIG. 3 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.
- the electronic device 300 may include a processing device (such as a central processing unit, a graphics processor, etc.) 301, which may be loaded into a random access device according to a program stored in a read-only memory (ROM) 302 or from a storage device 306.
- the program in the memory (RAM) 303 executes various appropriate actions and processing.
- various programs and data required for the operation of the electronic device 300 are also stored.
- the processing device 301, ROM 302, and RAM 303 are connected to each other through a bus 304.
- An input/output (I/O) interface 305 is also connected to the bus 304.
- the following devices can be connected to the I/O interface 305: including input devices 306 such as touch screens, touch pads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; including, for example, liquid crystal displays (LCD), speakers, vibration An output device 307 such as a device; a storage device 306 such as a magnetic tape and a hard disk; and a communication device 309.
- the communication device 309 may allow the electronic device 300 to perform wireless or wired communication with other devices to exchange data.
- FIG. 3 shows an electronic device 300 having various devices, it should be understood that it is not required to implement or have all the illustrated devices. It may alternatively be implemented or provided with more or fewer devices.
- an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer readable medium, and the computer program contains program code for executing the method shown in the flowchart.
- the computer program may be downloaded and installed from the network through the communication device 309, or installed from the storage device 306, or installed from the ROM 302.
- the processing device 301 When the computer program is executed by the processing device 301, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
- the aforementioned computer-readable medium in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any superposition of the two.
- the computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or a superposition of any of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable overlay of the above.
- a computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device.
- a computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier wave, and a computer-readable program code is carried therein. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable superposition of the foregoing.
- the computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium.
- the computer-readable signal medium may send, propagate, or transmit the program for use by or in combination with the instruction execution system, apparatus, or device .
- the program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wire, optical cable, RF (Radio Frequency), etc., or any suitable superposition of the above.
- the client and server can communicate with any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium.
- Communication e.g., communication network
- Examples of communication networks include local area networks (“LAN”), wide area networks (“WAN”), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future research and development network of.
- LAN local area networks
- WAN wide area networks
- the Internet e.g., the Internet
- end-to-end networks e.g., ad hoc end-to-end networks
- the above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or it may exist alone without being assembled into the electronic device.
- the above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device: acquires a video image; determines the current image according to the current playback progress of the video image; The image acquisition unit of the rendering layer acquires at least one historical image containing preset actions from the data storage layer; the animation logic processing unit of the script layer and the special effect unit of the rendering layer compare the at least one historical image and the The current image is combined and processed; the combined image is output and displayed on the terminal screen.
- the computer program code used to perform the operations of the present disclosure can be written in one or more programming languages or their superpositions.
- the above-mentioned programming languages include but are not limited to object-oriented programming languages such as Java, Smalltalk, C++, and Including conventional procedural programming languages-such as "C" language or similar programming languages.
- the program code can be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server.
- the remote computer can be connected to the user’s computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to pass Internet connection).
- LAN local area network
- WAN wide area network
- each block in the flowchart or block diagram can represent a module, program segment, or part of code, and the module, program segment, or part of code contains one or more for realizing the specified logical function Executable instructions.
- the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two blocks shown in succession can actually be executed substantially in parallel, or they can sometimes be executed in the reverse order, depending on the functions involved.
- each block in the block diagram and/or flowchart, and the superposition of the blocks in the block diagram and/or flowchart can be implemented by a dedicated hardware-based system that performs the specified functions or operations Or it can be realized by superimposing dedicated hardware and computer instructions.
- the units involved in the embodiments described in the present disclosure may be implemented in a software manner, or may be implemented in a hardware manner. Among them, the name of the unit does not constitute a limitation on the unit itself under certain circumstances.
- exemplary types of hardware logic components include: Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Product (ASSP), System on Chip (SOC), Complex Programmable Logical device (CPLD) and so on.
- FPGA Field Programmable Gate Array
- ASIC Application Specific Integrated Circuit
- ASSP Application Specific Standard Product
- SOC System on Chip
- CPLD Complex Programmable Logical device
- a machine-readable medium may be a tangible medium, which may contain or store a program for use by or in combination with the instruction execution system, apparatus, or device.
- the machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
- the machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or equipment, or any suitable superposition of the foregoing.
- machine-readable storage media would include electrical connections based on one or more wires, portable computer disks, hard drives, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable superposition of the foregoing.
- RAM random access memory
- ROM read-only memory
- EPROM or flash memory erasable programmable read-only memory
- CD-ROM compact disk read only memory
- magnetic storage device magnetic storage device, or any suitable superposition of the foregoing.
- an image special effect processing method including:
- the combined image output is displayed on the terminal screen.
- the method further includes:
- each frame of image is detected
- a partial image containing the predetermined action area is captured by the image capture unit of the rendering layer as the historical image and stored in the data storage layer.
- combination processing of the at least one historical image and the current image through the animation logic processing unit of the script layer and the special effect unit of the rendering layer includes:
- the special effect unit of the rendering layer draws a corresponding historical image at the position according to the display attribute to obtain an image.
- the method further includes:
- the counter of the script layer is triggered to start counting, and when the timer reaches a preset time, the operation of the animation logic processing unit is triggered.
- the method further includes:
- the method further includes:
- the script layer sends a control instruction to the special effect fetching unit of the rendering layer to trigger the operation of the special effect unit.
- the method further includes:
- the image capture instruction includes at least one of the following parameters: image identification, image coordinates, image width, image height, resolution of the terminal screen, and number of split screens.
- an image special effect processing apparatus including:
- Video acquisition module for acquiring video images
- the current image determining module is configured to determine the current image according to the current playback progress of the video image
- the historical image acquisition module is configured to acquire at least one historical image containing a preset action from the data storage layer through the image acquisition unit of the rendering layer;
- a combination processing module configured to perform a combination processing on the at least one historical image and the current image through the animation logic processing unit of the script layer and the special effect unit of the rendering layer;
- the image display module is used to output the combined image for display on the terminal screen.
- the device further includes:
- the image storage module is used to detect each frame of the image during the playback of the video image; if the image containing the predetermined action is detected, the image capture unit of the rendering layer captures the image containing all The partial image of the predetermined action area is stored in the data storage layer as the historical image.
- the combination processing module is specifically configured to: use the current image as a background image; determine the display attributes of each historical image and its position in the background image through the animation logic processing unit of the script layer; The special effect unit of the rendering layer draws the corresponding historical image at the position according to the display attribute to obtain an image.
- the device further includes:
- the counter trigger module is used to trigger the counter of the script layer to start counting after the historical image is stored in the data storage layer by the image capture unit of the rendering layer, when the timer reaches a preset time , The operation of the animation logic processing unit is triggered.
- the device further includes:
- the acquisition instruction sending module is configured to send an image acquisition instruction to the image acquisition unit of the rendering layer through the script layer to trigger the operation of the image acquisition unit.
- the device further includes:
- the control instruction sending module is used to send a control instruction to the special effect fetching unit of the rendering layer through the script layer to trigger the operation of the special effect unit.
- the device further includes:
- the grabbing instruction sending module is configured to send an image grabbing instruction to the image grabbing unit of the rendering layer through the script layer to trigger the operation of the image grabbing unit.
- the image capture instruction includes at least one of the following parameters: image identification, image coordinates, image width, image height, and resolution of the terminal screen.
- an electronic device including:
- Memory for storing non-transitory computer readable instructions
- the processor is configured to run the computer-readable instructions to enable the processor to implement the above-mentioned image special effect processing method when executed.
- a computer-readable storage medium for storing non-transitory computer-readable instructions.
- the non-transitory computer-readable instructions are executed by a computer, the The computer executes the above-mentioned image special effect processing method.
- the combined image output is displayed on the terminal screen, so that special effects can be realized only by modifying the rendering layer, which is relatively simple and flexible to implement.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims (11)
- 一种图像特效处理方法,其特征在于,包括:An image special effect processing method, characterized in that it comprises:获取视频图像;Obtain video images;根据所述视频图像的当前播放进度确定当前图像;Determining the current image according to the current playback progress of the video image;通过渲染层的图像获取单元从数据存储层获取包含预设动作的至少一张历史图像;Obtain at least one historical image containing a preset action from the data storage layer through the image acquisition unit of the rendering layer;通过脚本层的动画逻辑处理单元和所述述渲染层的特效单元对所述至少一张历史图像和所述当前图像进行组合处理;Performing combined processing on the at least one historical image and the current image through the animation logic processing unit of the script layer and the special effect unit of the rendering layer;将组合后的图像输出在终端屏幕上显示。The combined image output is displayed on the terminal screen.
- 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method of claim 1, wherein the method further comprises:在所述视频图像播放过程中,对每一帧图像进行检测;In the process of playing the video image, each frame of image is detected;若检测到含有所述预定动作的图像中,则通过所述渲染层的图像抓取单元抓取含有所述预定动作区域的部分图像作为所述历史图像存储在所述数据存储层。If the image containing the predetermined action is detected, a partial image containing the predetermined action area is captured by the image capture unit of the rendering layer as the historical image and stored in the data storage layer.
- 根据权利要求1所述的方法,其特征在于,所述通过脚本层的动画逻辑处理单元和所述述渲染层的特效单元对所述至少一张历史图像和所述当前图像进行组合处理,包括:The method according to claim 1, wherein the combination processing of the at least one historical image and the current image through the animation logic processing unit of the script layer and the special effect unit of the rendering layer includes :将所述当前图像作为背景图像;Use the current image as a background image;通过脚本层的动画逻辑处理单元确定每张历史图像的显示属性及在所述背景图像中的位置;Determine the display attributes of each historical image and its position in the background image through the animation logic processing unit of the script layer;通过所述述渲染层的特效单元根据所述显示属性在所述位置处绘制对应的历史图像,得到一幅图像。The special effect unit of the rendering layer draws a corresponding historical image at the position according to the display attribute to obtain an image.
- 根据权利要求2所述的方法,其特征在于,所述通过所述渲染层的图像 抓取单元将所述历史图像存储在所述数据存储层之后,所述方法还包括:The method according to claim 2, wherein after storing the historical image in the data storage layer by the image capture unit of the rendering layer, the method further comprises:触发所述脚本层的计数器开始计时,当所述计时器到达预设时间,则触发所述动画逻辑处理单元的操作。The counter of the script layer is triggered to start counting, and when the timer reaches a preset time, the operation of the animation logic processing unit is triggered.
- 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method of claim 1, wherein the method further comprises:通过所述脚本层向所述渲染层的图像获取单元发送图像获取指令,以触发所述图像获取单元的操作。Send an image acquisition instruction to the image acquisition unit of the rendering layer through the script layer to trigger the operation of the image acquisition unit.
- 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method of claim 1, wherein the method further comprises:通过所述脚本层向所述渲染层的特效取单元发送控制指令,以触发所述特效单元的操作。Send a control instruction to the special effect fetching unit of the rendering layer through the script layer to trigger the operation of the special effect unit.
- 根据权利要求2所述的方法,其特征在于,所述方法还包括:The method of claim 2, wherein the method further comprises:通过所述脚本层向所述渲染层的图像抓取单元发送图像抓取指令,以触发所述图像抓取单元的操作。The script layer sends an image capture instruction to the image capture unit of the rendering layer to trigger the operation of the image capture unit.
- 根据权利要求7所述的方法,其特征在于,所述图像抓取指令中包含以下至少一项参数:图像标识、图像坐标、图像宽度、图像高度、所述终端屏幕的分辨率。The method according to claim 7, wherein the image capture instruction includes at least one of the following parameters: image identification, image coordinates, image width, image height, and resolution of the terminal screen.
- 一种图像特效处理装置,其特征在于,包括:An image special effect processing device, characterized in that it comprises:视频获取模块,用于获取视频图像;Video acquisition module for acquiring video images;当前图像确定模块,用于根据所述视频图像的当前播放进度确定当前图像;The current image determining module is configured to determine the current image according to the current playback progress of the video image;历史图像获取模块,用于通过渲染层的图像获取单元从数据存储层获取包含预设动作的至少一张历史图像;The historical image acquisition module is configured to acquire at least one historical image containing a preset action from the data storage layer through the image acquisition unit of the rendering layer;组合处理模块,用于通过脚本层的动画逻辑处理单元和所述述渲染层的特效单元对所述至少一张历史图像和所述当前图像进行组合处理;A combination processing module, configured to perform a combination processing on the at least one historical image and the current image through the animation logic processing unit of the script layer and the special effect unit of the rendering layer;图像显示模块,用于将组合后的图像输出在终端屏幕上显示。The image display module is used to output the combined image for display on the terminal screen.
- 一种电子设备,包括:An electronic device including:存储器,用于存储非暂时性计算机可读指令;以及Memory for storing non-transitory computer readable instructions; and处理器,用于运行所述计算机可读指令,使得所述处理器执行时实现根据权利要求1-8任一项所述的图像特效处理方法。The processor is configured to run the computer-readable instructions so that the processor implements the image special effect processing method according to any one of claims 1-8 when executed.
- 一种计算机可读存储介质,用于存储非暂时性计算机可读指令,当所述非暂时性计算机可读指令由计算机执行时,使得所述计算机执行权利要求1-8任一项所述的图像特效处理方法。A computer-readable storage medium for storing non-transitory computer-readable instructions. When the non-transitory computer-readable instructions are executed by a computer, the computer can execute any one of claims 1-8. Image special effects processing method.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910734922.8 | 2019-08-09 | ||
CN201910734922.8A CN112347301B (en) | 2019-08-09 | 2019-08-09 | Image special effect processing method, device, electronic equipment and computer readable storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021027632A1 true WO2021027632A1 (en) | 2021-02-18 |
Family
ID=74367824
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/106820 WO2021027632A1 (en) | 2019-08-09 | 2020-08-04 | Image special effect processing method, apparatus, electronic device, and computer-readable storage medium |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN112347301B (en) |
WO (1) | WO2021027632A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113476837B (en) * | 2021-07-01 | 2024-06-04 | 网易(杭州)网络有限公司 | Image quality display method, device, equipment and storage medium |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100053342A1 (en) * | 2008-09-04 | 2010-03-04 | Samsung Electronics Co. Ltd. | Image edit method and apparatus for mobile terminal |
CN102917033A (en) * | 2012-09-29 | 2013-02-06 | 乐视网信息技术(北京)股份有限公司 | Picture intercepting and sharing method of video player |
CN105608715A (en) * | 2015-12-17 | 2016-05-25 | 广州华多网络科技有限公司 | Online group shot method and system |
CN108009473A (en) * | 2017-10-31 | 2018-05-08 | 深圳大学 | Based on goal behavior attribute video structural processing method, system and storage device |
CN108156520A (en) * | 2017-12-29 | 2018-06-12 | 珠海市君天电子科技有限公司 | Video broadcasting method, device, electronic equipment and storage medium |
CN109040837A (en) * | 2018-07-27 | 2018-12-18 | 北京市商汤科技开发有限公司 | Method for processing video frequency and device, electronic equipment and storage medium |
CN110070551A (en) * | 2019-04-29 | 2019-07-30 | 北京字节跳动网络技术有限公司 | Rendering method, device and the electronic equipment of video image |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8610724B2 (en) * | 2011-07-29 | 2013-12-17 | Qualcomm Innovation Center, Inc. | Systems and methods for webpage adaptive rendering |
CN103716548A (en) * | 2013-12-06 | 2014-04-09 | 乐视致新电子科技(天津)有限公司 | Video picture special effect processing method and device |
CN104766361B (en) * | 2015-04-29 | 2018-04-27 | 腾讯科技(深圳)有限公司 | A kind of implementation method of ghost effect, and device |
CN106303662B (en) * | 2016-08-29 | 2019-09-20 | 网易(杭州)网络有限公司 | Image processing method and device in net cast |
CN106385591B (en) * | 2016-10-17 | 2020-05-15 | 腾讯科技(上海)有限公司 | Video processing method and video processing device |
CN107015648B (en) * | 2017-03-28 | 2020-12-18 | 北京小米移动软件有限公司 | Picture processing method and device |
CN108198159A (en) * | 2017-12-28 | 2018-06-22 | 努比亚技术有限公司 | A kind of image processing method, mobile terminal and computer readable storage medium |
CN110070585A (en) * | 2019-01-31 | 2019-07-30 | 北京字节跳动网络技术有限公司 | Image generating method, device and computer readable storage medium |
CN110047122A (en) * | 2019-04-04 | 2019-07-23 | 北京字节跳动网络技术有限公司 | Render method, apparatus, electronic equipment and the computer readable storage medium of image |
CN110049371A (en) * | 2019-05-14 | 2019-07-23 | 北京比特星光科技有限公司 | Video Composition, broadcasting and amending method, image synthesizing system and equipment |
-
2019
- 2019-08-09 CN CN201910734922.8A patent/CN112347301B/en active Active
-
2020
- 2020-08-04 WO PCT/CN2020/106820 patent/WO2021027632A1/en active Application Filing
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100053342A1 (en) * | 2008-09-04 | 2010-03-04 | Samsung Electronics Co. Ltd. | Image edit method and apparatus for mobile terminal |
CN102917033A (en) * | 2012-09-29 | 2013-02-06 | 乐视网信息技术(北京)股份有限公司 | Picture intercepting and sharing method of video player |
CN105608715A (en) * | 2015-12-17 | 2016-05-25 | 广州华多网络科技有限公司 | Online group shot method and system |
CN108009473A (en) * | 2017-10-31 | 2018-05-08 | 深圳大学 | Based on goal behavior attribute video structural processing method, system and storage device |
CN108156520A (en) * | 2017-12-29 | 2018-06-12 | 珠海市君天电子科技有限公司 | Video broadcasting method, device, electronic equipment and storage medium |
CN109040837A (en) * | 2018-07-27 | 2018-12-18 | 北京市商汤科技开发有限公司 | Method for processing video frequency and device, electronic equipment and storage medium |
CN110070551A (en) * | 2019-04-29 | 2019-07-30 | 北京字节跳动网络技术有限公司 | Rendering method, device and the electronic equipment of video image |
Also Published As
Publication number | Publication date |
---|---|
CN112347301B (en) | 2024-07-23 |
CN112347301A (en) | 2021-02-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021027596A1 (en) | Image special effect processing method and apparatus, and electronic device and computer readable storage medium | |
WO2021027631A1 (en) | Image special effect processing method and apparatus, electronic device, and computer-readable storage medium | |
WO2021027547A1 (en) | Image special effect processing method, apparatus, and electronic device, and computer-readable storage medium | |
WO2023051185A1 (en) | Image processing method and apparatus, and electronic device and storage medium | |
WO2021170013A1 (en) | Image effect processing method and apparatus | |
WO2021031847A1 (en) | Image processing method and apparatus, electronic device and computer-readable storage medium | |
WO2018000619A1 (en) | Data display method, device, electronic device and virtual reality device | |
WO2021129385A1 (en) | Image processing method and apparatus | |
WO2020253453A1 (en) | Image switching method and apparatus, and electronic device and storage medium | |
WO2021135864A1 (en) | Image processing method and apparatus | |
WO2022007565A1 (en) | Image processing method and apparatus for augmented reality, electronic device and storage medium | |
WO2023169305A1 (en) | Special effect video generating method and apparatus, electronic device, and storage medium | |
JP2023536365A (en) | Video processing method and apparatus | |
CN111352560B (en) | Screen splitting method and device, electronic equipment and computer readable storage medium | |
WO2021227953A1 (en) | Image special effect configuration method, image recognition method, apparatuses, and electronic device | |
WO2021027632A1 (en) | Image special effect processing method, apparatus, electronic device, and computer-readable storage medium | |
WO2021027597A1 (en) | Image special effect processing method and apparatus, electronic device and computer-readable storage medium | |
US11880919B2 (en) | Sticker processing method and apparatus | |
WO2023098576A1 (en) | Image processing method and apparatus, device, and medium | |
CN114187169B (en) | Method, device, equipment and storage medium for generating video special effect package | |
WO2021190322A1 (en) | Special effect processing method and apparatus | |
WO2021073204A1 (en) | Object display method and apparatus, electronic device, and computer readable storage medium | |
CN113515329B (en) | Special effect attribute setting method and device | |
US20240163392A1 (en) | Image special effect processing method and apparatus, and electronic device and computer readable storage medium | |
WO2021004171A1 (en) | Method and apparatus for achieving water ripple image |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20852491 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20852491 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 25.08.2022) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20852491 Country of ref document: EP Kind code of ref document: A1 |