CN112423095A - Game video recording method and device, electronic equipment and storage medium - Google Patents

Game video recording method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN112423095A
CN112423095A CN202011206218.4A CN202011206218A CN112423095A CN 112423095 A CN112423095 A CN 112423095A CN 202011206218 A CN202011206218 A CN 202011206218A CN 112423095 A CN112423095 A CN 112423095A
Authority
CN
China
Prior art keywords
game
video
data
video data
audio data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011206218.4A
Other languages
Chinese (zh)
Inventor
何志强
陈健生
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Boguan Information Technology Co Ltd
Original Assignee
Guangzhou Boguan Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Boguan Information Technology Co Ltd filed Critical Guangzhou Boguan Information Technology Co Ltd
Priority to CN202011206218.4A priority Critical patent/CN112423095A/en
Publication of CN112423095A publication Critical patent/CN112423095A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334Recording operations
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/52Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/85Providing additional services to players
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • H04N21/4398Processing of audio elementary streams involving reformatting operations of audio signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781Games
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)

Abstract

The embodiment of the invention provides a game video recording method, a game video recording device, electronic equipment and a storage medium, wherein the game video recording method comprises the following steps: responding to a video recording request of a game, and creating a shared texture and a buffer area; acquiring game video data and game audio data; deleting the layer of the game video data to obtain target game video data; writing the target game video data into the shared texture and writing the game audio data into the buffer; reading the target game video data from the shared texture and the game audio data from the buffer; and obtaining game video according to the target game video data and the game audio data. According to the embodiment of the invention, the layer deleting processing can be carried out on the game video data, so that the game pictures displayed by the game video can be freely customized, the privacy disclosure is prevented, and the recording experience of players is improved.

Description

Game video recording method and device, electronic equipment and storage medium
Technical Field
The present invention relates to the field of video recording technologies, and in particular, to a game video recording method, a game video recording apparatus, an electronic device, and a storage medium.
Background
In the game process, the game scenes in different time periods need to be recorded, and the video files are obtained after processing, so that wonderful segments can be subsequently made based on the video files for the subsequent playback and watching of players. However, currently, the recorded game pictures cannot be controlled for recording the game video, so that some privacy contents of players are disclosed, and the recording experience of the players is not good.
Disclosure of Invention
In view of the above problems, embodiments of the present invention are proposed to provide a game video recording method and a corresponding game video recording apparatus, electronic device, storage medium that overcome or at least partially solve the above problems.
In order to solve the above problems, an embodiment of the present invention discloses a game video recording method, including:
responding to a video recording request of a game, and creating a shared texture and a buffer area;
acquiring game video data and game audio data;
deleting the layer of the game video data to obtain target game video data;
writing the target game video data into the shared texture and writing the game audio data into the buffer;
reading the target game video data from the shared texture and the game audio data from the buffer;
and obtaining game video according to the target game video data and the game audio data.
Optionally, the obtaining a game video according to the target game video data and the game audio data includes:
performing video processing on the target game video data to obtain game video data to be encoded, and performing audio processing on the game audio data to obtain game audio data to be encoded;
and respectively encoding the game video data to be encoded and the game audio data to be encoded and then packaging the encoded game video data and the encoded game audio data into a game video with a specified video format.
Optionally, the shared texture is created in a video memory, and the buffer is created in a memory.
Optionally, an image layer in the game video data has an image layer identifier, and the deleting image layer processing on the game video data includes:
determining an identifier of a layer to be deleted;
and deleting the layer with the layer identifier consistent with the layer identifier to be deleted in the game video data.
Optionally, the determining the identifier of the layer to be deleted includes:
acquiring a preset deleted layer identifier;
and taking the preset deleted layer mark as a layer mark to be deleted.
Optionally, the determining the identifier of the layer to be deleted includes:
when a deleting request aiming at a target layer in game video data is received, determining the layer identifier of the target layer as a layer identifier to be deleted.
Optionally, the shared texture has a shared video memory identifier, and writing the target game video data into the shared texture includes:
and determining the shared video memory identification, and writing the target game video data into the shared texture corresponding to the shared video memory identification.
Optionally, the reading the target game video data from the shared texture includes:
acquiring the shared video memory identification, and reading the target game video data from the shared texture corresponding to the shared video memory identification;
the video processing of the target game video data to obtain the game video data to be encoded includes:
responding to a video special effect adding request, and adding a video special effect to the target game video data; the video special effect comprises an animation special effect and a watermark;
and carrying out video coding on the target game video data added with the video special effect to obtain game video data to be coded.
Optionally, the buffer includes a write entry identifier, and the writing the game audio data into the buffer includes:
and writing the game audio data into the buffer area according to the writing entry identification.
Optionally, the buffer further includes a read entry identifier, and the reading the game audio data from the buffer includes:
reading the game audio data from the buffer area according to the read inlet identification;
carrying out audio processing on the game audio data to obtain game audio data to be encoded, wherein the game audio data to be encoded comprises the following steps:
responding to an audio data processing request, and processing the game audio data; the processing treatment at least comprises one of audio special effect superposition treatment, echo elimination treatment, sound mixing treatment and sound mixing overflow treatment;
and carrying out audio coding on the processed game audio data to obtain game audio data to be coded.
The embodiment of the invention also discloses a game video recording device, which comprises:
the request response module is used for responding to a video recording request of a game and creating a shared texture and a buffer area;
the game data acquisition module is used for acquiring game video data and game audio data;
the layer deleting processing module is used for deleting layers of the game video data to obtain target game video data;
a game data writing module, configured to write the target game video data into the shared texture, and write the game audio data into the buffer;
a game data reading module, configured to read the target game video data from the shared texture, and read the game audio data from the buffer;
and the game video obtaining module is used for obtaining game videos according to the target game video data and the game audio data.
Optionally, the shared texture is created in a video memory, and the buffer is created in a memory.
Optionally, the game video obtaining module is configured to:
performing video processing on the target game video data to obtain game video data to be encoded, and performing audio processing on the game audio data to obtain game audio data to be encoded;
and respectively encoding the game video data to be encoded and the game audio data to be encoded and then packaging the encoded game video data and the encoded game audio data into a game video with a specified video format.
Optionally, an image layer in the game video data has an image layer identifier, and the image layer deletion processing module 5 is configured to:
determining an identifier of a layer to be deleted;
and deleting the layer with the layer identifier consistent with the layer identifier to be deleted in the game video data.
Optionally, the layer deletion processing module is further configured to:
acquiring a preset deleted layer identifier;
and taking the preset deleted layer mark as a layer mark to be deleted.
Optionally, the layer deletion processing module is further configured to:
when a deleting request aiming at a target layer in game video data is received, determining the layer identifier of the target layer as a layer identifier to be deleted.
Optionally, the shared texture has a shared video memory identifier, and the game data writing module is configured to:
and determining the shared video memory identification, and writing the target game video data into the shared texture corresponding to the shared video memory identification.
Optionally, the game data reading module is configured to:
acquiring the shared video memory identification, and reading the target game video data from the shared texture corresponding to the shared video memory identification;
optionally, the game video obtaining module is configured to:
responding to a video special effect adding request, and adding a video special effect to the target game video data; the video special effect comprises an animation special effect and a watermark;
and carrying out video coding on the target game video data added with the video special effect to obtain game video data to be coded.
Optionally, the buffer includes a write entry identifier, and the game data writing module is configured to:
and writing the game audio data into the buffer area according to the writing entry identification.
Optionally, the buffer further includes a read entry identifier, and the game data reading module is configured to:
reading the game audio data from the buffer area according to the read inlet identification;
optionally, the game video obtaining module is configured to:
responding to an audio data processing request, and processing the game audio data; the processing treatment at least comprises one of audio special effect superposition treatment, echo elimination treatment, sound mixing treatment and sound mixing overflow treatment;
and carrying out audio coding on the processed game audio data to obtain game audio data to be coded.
The embodiment of the invention discloses electronic equipment, which comprises a processor, a memory and a computer program which is stored on the memory and can run on the processor, wherein the computer program realizes the steps of the game video recording method when being executed by the processor.
The embodiment of the invention discloses a computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and the computer program is used for realizing the steps of the game video recording method when being executed by a processor.
The embodiment of the invention has the following advantages:
in the embodiment of the invention, a shared texture and a buffer area are created in response to a video recording request of a game, game video data and game audio data are obtained, layer deleting processing is carried out on the game video data to obtain target game video data, then the target game video data are written into the shared texture and the game audio data are written into the buffer area, then the target game video data are read from the shared texture and the game audio data are read from the buffer area, and finally the game video is obtained according to the target game video data and the game audio data. According to the embodiment of the invention, the layer deleting processing can be carried out on the game video data, so that the game pictures displayed by the game video can be freely customized, the privacy disclosure is prevented, and the recording experience of players is improved.
Drawings
FIG. 1 is a flow chart of steps of a method for recording game video according to an embodiment of the present invention;
FIG. 2 is a flow chart of the steps for deleting layers from game video data in accordance with the present invention;
FIG. 3 is a flow chart of the steps of a game video generation of the present invention;
FIG. 4 is a schematic diagram of a ring buffer of the present invention;
fig. 5 is a block diagram of a game video recording apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
The current scheme for realizing game video recording comprises the following steps: scheme 1: recording game pictures of a game displayed on the whole screen by using a client screen intercepting interface to obtain game video data, acquiring game audio data of the game by using a microphone, and then combining the game video data and the game audio data into a game video; scheme 2: for the online game, the client intercepts game video from the server in an instruction mode.
However, the above recording schemes have a number of disadvantages, specifically, the disadvantages of the 2 schemes are:
disadvantages of scheme 1: (a) the game video has a lot of contents irrelevant to the game, because the screen capture mode can record some privacy data such as the system popup notice, the name of the player and the like; (b) part of layers which cannot be independently specified are recorded, so that the content of recorded game video is uncontrollable; (c) the game audio data is not clear enough, the microphone is used for recording the whole environmental sound, namely, the game audio data of the game also contains surrounding noise, and the sound effect of the game audio data is poor; (d) the screen recording permission request is tedious, and each time a player needs to record a game video, the request needs to be automatically triggered, so that the game experience of the player is seriously influenced. The disadvantage of scheme 2: (a) the server records the game video, but cannot perform custom recording on the game picture; (b) the game video recorded by the server is transmitted to the client, network resources need to be occupied, the requirement on a player network is high in the transmission process of the game video, and the game experience of the player is easily influenced.
In order to solve the above problems, the embodiment of the present invention performs data interaction with a game through the video stuffing interface and the audio stuffing interface, so that game video data and game audio data can be respectively stuffed based on the video stuffing interface and the audio stuffing interface in the game process. The video filling interface renders layers in video data needing to be played to the shared texture in a texture sharing mode, the audio filling interface passes through the buffer area, and the game fills the audio data of the game to the buffer area at regular time. In the specific implementation, when a game video is recorded in the game process, the game video data and the game audio data are collected from the shared texture and the buffer area according to a certain frame rate and a certain sampling rate, and then the game video data and the game audio data are packaged into a game video with a specified format and output after being encoded.
The game video recording method in one embodiment of the invention can be operated on a terminal device or a server. The terminal device may be a local terminal device. When the game video recording method is operated on a server, the game video recording method can be implemented and executed based on a cloud interactive system, wherein the cloud interactive system comprises the server and a client device.
In an optional embodiment, various cloud applications may be run under the cloud interaction system, for example: and (5) cloud games. Taking a cloud game as an example, a cloud game refers to a game mode based on cloud computing. In the cloud game operation mode, the game program operation main body and the game picture presentation main body are separated, the storage and the operation of the game video recording method are completed on the cloud game server, and the client device is used for receiving and sending data and presenting the game picture, for example, the client device can be a display device with a data transmission function close to a player side, such as a mobile terminal, a television, a computer, a palm computer and the like; however, the terminal device for performing the game video recording method is a cloud game server at the cloud end. When a game is played, a player operates the client device to send an operation instruction to the cloud game server, the cloud game server runs the game according to the operation instruction, data such as game pictures and the like are encoded and compressed, the data are returned to the client device through a network, and finally the data are decoded through the client device and the game pictures are output.
In an alternative embodiment, the terminal device may be a local terminal device. Taking a game as an example, the local terminal device stores a game program and is used for presenting a game screen. The local terminal device is used for interacting with the player through a graphical player interface, namely, a game program is downloaded and installed and operated through an electronic device conventionally. The manner in which the local terminal device provides the graphical player interface to the player may include a variety of ways, for example, it may be rendered for display on a display screen of the terminal or provided to the player through holographic projection. By way of example, the local terminal device may include a display screen for presenting a graphical player interface including a game screen and a processor for running the game, generating the graphical player interface, and controlling display of the graphical player interface on the display screen.
Referring to fig. 1, a flowchart illustrating steps of an embodiment of a game video recording method according to the present invention is shown, and the embodiment of the present invention may specifically include the following steps:
step 101, responding to a video recording request of a game, and creating a shared texture and a buffer area.
The game program is installed with a video SDK (Software Development Kit), the video SDK starts a video recording function if a video recording request is triggered in the process of monitoring a game of a player, the video SDK creates an OPENGL environment when the video recording function is started, the OPENGL environment shares an OPENGL context with a game rendering thread, and the video SDK creates a shared texture and a buffer area which can be used for reading and writing the video SDK.
Step 102, game video data and game audio data are acquired.
In the embodiment of the invention, the shared texture is created in the video memory and is specially used for caching the game video data of the game, and the buffer area is created in the memory and is specially used for caching the game audio data of the game. The shared texture is a buffer area in the video memory, the buffer area has a unique shared video memory Identifier (ID), and different threads can access (read/write) the shared texture simultaneously according to the shared video memory identifier.
And 103, performing layer deletion processing on the game video data to obtain target game video data.
In the embodiment of the invention, the game video data and the game audio data are directly obtained from the game program. Specifically, a video filling interface is arranged between the video SDK and the game program, so that the video SDK can directly acquire game video data generated by a player in the game process from the game program through the video filling interface, and an audio filling interface is arranged between the video SDK and the game program, so that the video SDK can directly acquire the game audio data from the game program through the audio filling interface.
Each video frame of the game video data may be composed of a plurality of layers, for example, a video frame may include a game picture layer and a player operation layer, and a game picture resulting from mixing the plurality of layers is finally displayed on the screen.
In practice, the game video data may include sensitive layers such as some special UI layers, password input layers, and the like, and players of these layers usually do not want to be recorded and retained in the game video.
It should be noted that, the game video data of the embodiment of the present invention is not the game picture displayed on the whole screen recorded by the screen acquisition interface, but the game video data generated by the game program itself is acquired by the video SDK, and the game video data includes a plurality of layers.
Step 104, writing the target game video data into the sharing texture, and writing the game audio data into the buffer area.
In an illustrative example, the video SDK will require layers in the game video data to be rendered to shared textures therein, and the video SDK writes the game audio data to a buffer. When the game video data has a plurality of layers, part of the layers can be selected and rendered to the shared texture, specifically, the game video data can be rendered to the shared texture after layer deletion processing, and the game picture content of the recorded game video can be guaranteed to be controllable through the method.
Wherein rendering may be understood as drawing, drawing the content of the game video data to a specified area. For example, the shared texture may be understood as a piece of canvas, and the layers in the game video data are respectively drawn on the canvas, and different layers are overlapped on the canvas, so that the overlapping of the layers is realized.
Step 105, reading the target game video data from the shared texture, and reading the game audio data from the buffer.
And 106, obtaining a game video according to the target game video data and the game audio data.
In the embodiment of the invention, the target game video data and the game audio data after the layer deleting process are packaged, so that the game video can be obtained, the game video can be stored at a local client, and prompt information for prompting the completion of the game video recording can be generated while the game video is successfully stored, so as to prompt the player that the game video recording is successful.
In the embodiment of the invention, a shared texture and a buffer area are created in response to a video recording request of a game, game video data and game audio data are obtained, layer deleting processing is carried out on the game video data to obtain target game video data, then the target game video data are written into the shared texture and the game audio data are written into the buffer area, then the target game video data are read from the shared texture and the game audio data are read from the buffer area, and finally the game video is obtained according to the target game video data and the game audio data. According to the embodiment of the invention, the layer deleting processing can be carried out on the game video data, so that the game pictures displayed by the game video can be freely customized, the privacy disclosure is prevented, and the recording experience of players is improved.
In an optional embodiment of the present invention, an image layer in the game video data has an image layer identifier, and referring to fig. 2, in step 102, performing image layer deletion processing on the game video data to obtain target game video data, includes:
step 201, determining an identifier of a layer to be deleted.
Step 202, deleting the layer with the layer identifier consistent with the layer identifier to be deleted in the game video data.
In the embodiment of the present invention, the layer identifier to be deleted refers to a layer identifier corresponding to a layer that needs to be subjected to layer deletion processing, and the layer identifier refers to a layer name or a layer number that can identify a content expressed by the layer. Specifically, the layer identifier to be deleted may be automatically determined by the video SDK according to a preset layer identifier, or may be selected by the user, and then the corresponding layer in the game video data may be deleted based on the layer identifier to be deleted.
In an optional embodiment of the present invention, in step 201, determining the identifier of the layer to be deleted includes: acquiring a preset deleted layer identifier; and taking the preset deleted layer mark as a layer mark to be deleted.
Specifically, a preset deletion layer identifier corresponding to a layer to be deleted may be preset in the video SDK, and then after the game video data is obtained, the preset deletion layer identifier is obtained as a layer identifier to be deleted, and then the video SDK may extract a map that is consistent with the layer identifier of the layer identifier to be deleted from the game video data according to the layer identifier to be deleted and perform deletion processing. The layer identification to be deleted is automatically determined through the video SDK and layer deletion processing is carried out on the game video data, so that the layer deletion processing in the recorded video is a game background behavior, any operation of a player is not needed, and the player does not feel the behavior.
In an optional embodiment of the present invention, in step 201, determining the identifier of the layer to be deleted includes: when a deleting request aiming at a target layer in game video data is received, determining the layer identifier of the target layer as a layer identifier to be deleted.
In an alternative embodiment, the method further comprises: and displaying the layer identification of the layer in the game video data.
Specifically, all or important layers in the game video data are identified in advance, so that a player can conveniently identify which layer is, such as a game scene layer, an interactive interface layer, a bullet screen layer and the like, and then the layer identification is displayed to the user, the player can select a target layer to be deleted according to the layer identification, correspondingly, the video SDK receives a deletion request for the target layer, so that the layer identification of the target layer is used as the layer identification to be deleted, and then the video SDK can extract a picture consistent with the layer identification of the layer identification to be deleted from the game video data according to the layer identification to be deleted for deletion processing.
In the above example, the layer to be deleted in the game video data may be automatically deleted by the video SDK in the background, or may be selected and deleted by the player according to the layer identifier, so that the player has more diversified playing methods and better recording experience.
In an alternative embodiment of the present invention, referring to fig. 3, said step 106 of obtaining game video according to said target game video data and said game audio data comprises:
step 301, performing video processing on the target game video data to obtain game video data to be encoded, and performing audio processing on the game audio data to obtain game audio data to be encoded;
step 302, respectively encoding the game video data to be encoded and the game audio data to be encoded, and then packaging the encoded game video data and the encoded game audio data into a game video with a specified video format.
Specifically, when the video SDK writes the game video data in the shared texture, the video SDK can read the game video data from the shared texture for video processing, so as to enrich the content of the game video data and obtain the game video data to be encoded. Similarly, when the game audio data are written into the buffer area by the video SDK, the game audio data can be read from the buffer area by the video SDK for audio processing, so that the audio quality is optimized, and the game audio data to be encoded are obtained.
It should be noted that, the processing mode of the game video data or the game audio data may be preset according to actual needs, or may be set during recording according to the needs of the player, which is not limited in the embodiment of the present invention.
Specifically, after video processing on game video data in the shared texture is completed, game video data to be encoded is obtained, and after audio processing on game audio data in the buffer area is completed, game audio data to be encoded is obtained, the game video data to be encoded and the game audio data to be encoded can be packaged into a game video in a specified video format, and then the game video data and the game audio data to be encoded are stored in the local client.
In an optional embodiment of the present invention, the shared texture has a shared video memory identifier, and the step 104 of writing the target game video data into the shared texture includes: and determining the shared video memory identification, and writing the target game video data into the shared texture corresponding to the shared video memory identification.
The shared texture is located in a buffer area in a Graphics Processing Unit (GPU) memory, has a unique shared memory identifier, and performs write operation and read operation simultaneously by multiple users sharing different threads of the texture. Based on the shared texture, the game video data is stored in a buffer area of the video memory, so that the resources of a Central Processing Unit (CPU) can not be consumed when the game video data is processed in the video memory.
In an optional embodiment of the present invention, the step 105 of reading the target game video data from the shared texture includes: and acquiring the shared video memory identification, and reading the target game video data from the shared texture corresponding to the shared video memory identification.
Specifically, the video SDK may retrieve the shared presence identifier and then read the target game video data from the corresponding shared texture based on the shared presence identifier.
In the above example, the target game video data is written and read according to the shared video memory identifier, so that copy and exchange of the target game video data between the video memory and the memory can be avoided, and performance consumption is reduced.
In an optional embodiment of the present invention, in step 301, performing video processing on the target game video data to obtain game video data to be encoded, includes:
responding to a video special effect adding request, and adding a video special effect to the target game video data; the video special effect comprises an animation special effect and a watermark;
and carrying out video coding on the target game video data added with the video special effect to obtain game video data to be coded.
Specifically, the video SDK reads target game video data in the shared texture according to a predetermined frame rate, performs video processing on the read target game video data, for example, for a video special effect addition request, obtains video special effects, such as an animation special effect and a watermark, in response to the video special effect addition request, adds the video special effects to a video frame of the game video data, and performs video encoding on the game video data to which the video special effects are added, thereby obtaining game video data to be encoded, to which the video special effects are added. In the above example, by performing video processing on the target game video, game video data with richer contents can be obtained.
In an optional embodiment of the present invention, the step 104 of writing the game audio data into the buffer includes: and writing the game audio data into the buffer area according to the writing entry identification.
In the embodiment of the invention, the buffer area is a memory area with a fixed size applied in the memory, and the program realizes the annular read-write logic. Specifically, the buffer includes a write entry identifier by which game audio data can be written from a memory start location.
In an optional embodiment of the present invention, the step 105 of reading the game audio data from the buffer includes: and reading the audio data from the ring buffer according to the read inlet identification.
Specifically, the buffer further comprises a read port identifier, and game audio data can be read from the initial position of the memory through the read port identifier.
As a specific embodiment, the buffer may be a ring buffer. Specifically, referring to fig. 4, while the game audio data is played, the game audio data may be acquired, the game audio data of the game is written into the ring buffer through the write port identifier, and then when audio processing is required to be performed on the game audio data, the ring buffer is read through the read port identifier to perform processing on the game audio data.
In the embodiment of the invention, the video SDK reads the game audio data from the buffer according to a certain sampling rate, and when the game audio data in the buffer is inconsistent with the appointed game audio data format (such as sampling rate, bit depth and channel number) for recording the game video, the game audio data needs to be resampled, and the game audio data of the game is converted into the game audio data format required by recording the game video.
Therefore, the time stamp of the game audio data according to the embodiment of the present invention may be calculated according to the amount of the collected audio data, for example, in the case of the sampling rate 44100, the time stamp of the game audio data is 10 × 1000 milliseconds after the recording SDK has read 44100 × 10 sampling points, that is, the embodiment of the present invention may not completely depend on the system time.
In a conventional game video recording scheme, in the process of playing an audio in a client side of a game picture, because a game card is not written into game audio data in time and empty game audio data needs to be supplemented in time, the problem is caused that the client side plays the game audio data in a card-pause manner.
By applying the embodiment of the invention, as the game video data and the game audio data are read and written in real time, the buffer area does not have too much game audio data, and better audio and video synchronization effect can be ensured.
In an optional embodiment of the present invention, in step 301, performing audio processing on the game audio data to obtain game audio data to be encoded includes: responding to an audio data processing request, and processing the game audio data; the processing treatment at least comprises one of audio special effect superposition treatment, echo elimination treatment, sound mixing treatment and sound mixing overflow treatment; and carrying out audio coding on the processed game audio data to obtain game audio data to be coded.
The video SDK of the embodiment of the invention provides different audio processing aiming at game audio data according to different product requirements or player requirements. Specifically, the audio processing process may include, but is not limited to, the following processes:
and audio special effect superposition processing: when a specific scene is recognized, a specific sound effect is superimposed on the game audio data, for example, when a big boss appears in a game or a big boss is killed in a player game, an exciting sound effect is superimposed on the game audio data.
Echo eliminating process, if the sound signal of the speaking of the player collected by the microphone needs to be mixed in the game audio data, the echo eliminating process can be carried out on the sound signal.
And (3) sound mixing treatment: audio sources from multiple sources (e.g., sound signals and game audio data) are integrated into a stereo or monophonic audio track. Because the sound energy levels of different audio sources are different, one audio source is generally selected as a standard audio source when mixing, and the rest audio sources are scaled to the same level as the standard audio source. For example, when there is a sound signal of a microphone, the sound energy of the game audio data of a general game is large, and the sound energy of the sound signal of the microphone is small, so that the sound signal of the microphone can be used as a standard audio source, and the game audio data can be reduced to achieve a better sound mixing effect.
And (3) mixed sound overflow processing: the sampling point data of one game audio data is 16 bits and takes a value of-32768-32767, when a plurality of audios are linearly mixed, overflow is possible to generate, for upward overflow, the maximum positive value (32767) is taken, and for downward overflow, the minimum negative value (-32768) is adopted.
In the above example, the game audio data with the optimized audio quality can be obtained by performing audio processing on the game audio data.
In summary, the embodiments of the present invention can have at least the following advantages: (1) the game pictures can be freely customized, the picture layer deletion processing is carried out on the game video data, and pictures which are not desired to be recorded and stored by the player are not reserved; (2) the game audio data is controllable, the game can send the game audio data of the game to the video SDK, the collected game audio data is clear and completely consistent with the sound effect in the game process, and the game process scene is completely restored; (3) the game video data and the game audio data are generated by the game, and do not relate to the permission request, and the player does not feel during the recording process.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 5, a block diagram of a game video recording apparatus according to an embodiment of the present invention is shown, where the game video recording apparatus according to the embodiment of the present invention specifically includes the following modules:
a request response module 501, configured to respond to a video recording request of a game, and create a shared texture and a buffer area;
a game data obtaining module 502, configured to obtain game video data and game audio data;
the layer deleting module 503 is configured to delete a layer of the game video data to obtain target game video data;
a game data writing module 504, configured to write the target game video data into the shared texture, and write the game audio data into the buffer;
a game data reading module 505, configured to read the target game video data from the shared texture, and read the game audio data from the buffer;
a game video obtaining module 506, configured to obtain a game video according to the target game video data and the game audio data.
In an optional embodiment of the present invention, the shared texture is created in a video memory, and the buffer is created in a memory.
In an optional embodiment of the present invention, the game video obtaining module 506 is configured to:
performing video processing on the target game video data to obtain game video data to be encoded, and performing audio processing on the game audio data to obtain game audio data to be encoded;
and respectively encoding the game video data to be encoded and the game audio data to be encoded and then packaging the encoded game video data and the encoded game audio data into a game video with a specified video format.
In an optional embodiment of the present invention, an image layer in the game video data has an image layer identifier, and the image layer deletion processing module 503 is configured to:
determining an identifier of a layer to be deleted;
and deleting the layer with the layer identifier consistent with the layer identifier to be deleted in the game video data.
In an optional embodiment of the present invention, the layer deletion processing module 503 is further configured to:
acquiring a preset deleted layer identifier;
and taking the preset deleted layer mark as a layer mark to be deleted.
In an optional embodiment of the present invention, the layer deletion processing module 503 is further configured to:
when a deleting request aiming at a target layer in game video data is received, determining the layer identifier of the target layer as a layer identifier to be deleted.
In an optional embodiment of the present invention, the shared texture has a shared video memory identifier, and the game data writing module 504 is configured to:
and determining the shared video memory identification, and writing the target game video data into the shared texture corresponding to the shared video memory identification.
In an optional embodiment of the present invention, the game data reading module 505 is configured to:
acquiring the shared video memory identification, and reading the target game video data from the shared texture corresponding to the shared video memory identification;
the game video obtaining module 506 is configured to:
responding to a video special effect adding request, and adding a video special effect to the target game video data; the video special effect comprises an animation special effect and a watermark;
and carrying out video coding on the target game video data added with the video special effect to obtain game video data to be coded.
In an optional embodiment of the invention, the buffer comprises a write entry identifier, and the game data writing module 504 is configured to:
and writing the game audio data into the buffer area according to the writing entry identification.
In an optional embodiment of the present invention, the buffer further comprises a read entry identifier, and the game data reading module 505 is configured to:
reading the game audio data from the buffer area according to the read inlet identification;
the game video obtaining module 506 is configured to:
responding to an audio data processing request, and processing the game audio data; the processing treatment at least comprises one of audio special effect superposition treatment, echo elimination treatment, sound mixing treatment and sound mixing overflow treatment;
and carrying out audio coding on the processed game audio data to obtain game audio data to be coded.
To sum up, in the embodiment of the present invention, a shared texture and a buffer area are created in response to a video recording request of a game, game video data and game audio data are obtained, layer deletion processing is performed on the game video data to obtain target game video data, the target game video data is written into the shared texture and the game audio data is written into the buffer area, the target game video data is read from the shared texture and the game audio data is read from the buffer area, and finally, a game video is obtained according to the target game video data and the game audio data. According to the embodiment of the invention, the layer deleting processing can be carried out on the game video data, so that the game pictures displayed by the game video can be freely customized, the privacy disclosure is prevented, and the recording experience of players is improved.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiment of the invention discloses electronic equipment, which comprises a processor, a memory and a computer program which is stored on the memory and can run on the processor, wherein the computer program realizes the steps of the game video recording method embodiment when being executed by the processor.
The embodiment of the invention discloses a computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and the computer program is executed by a processor to realize the steps of the game video recording method embodiment.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The game video recording method, the game video recording device, the electronic device and the storage medium provided by the invention are described in detail, specific examples are applied in the text to explain the principle and the implementation mode of the invention, and the description of the above embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (13)

1. A method for game video recording, the method comprising:
responding to a video recording request of a game, and creating a shared texture and a buffer area;
acquiring game video data and game audio data;
deleting the layer of the game video data to obtain target game video data;
writing the target game video data into the shared texture and writing the game audio data into the buffer;
reading the target game video data from the shared texture and the game audio data from the buffer;
and obtaining game video according to the target game video data and the game audio data.
2. The method of claim 1, wherein deriving game video from the target game video data and the game audio data comprises:
performing video processing on the target game video data to obtain game video data to be encoded, and performing audio processing on the game audio data to obtain game audio data to be encoded;
and respectively encoding the game video data to be encoded and the game audio data to be encoded and then packaging the encoded game video data and the encoded game audio data into a game video with a specified video format.
3. The method of claim 1, wherein the shared texture is created in video memory and the buffer is created in memory.
4. The method according to claim 1, wherein the layer in the game video data has a layer identifier, and the performing layer deletion processing on the game video data includes:
determining an identifier of a layer to be deleted;
and deleting the layer with the layer identifier consistent with the layer identifier to be deleted in the game video data.
5. The method according to claim 4, wherein the determining the layer identifier to be deleted includes:
acquiring a preset deleted layer identifier;
and taking the preset deleted layer mark as a layer mark to be deleted.
6. The method according to claim 4, wherein the determining the layer identifier to be deleted includes:
when a deleting request aiming at a target layer in game video data is received, determining the layer identifier of the target layer as a layer identifier to be deleted.
7. The method of claim 1, wherein the shared texture has a shared video memory identifier, and wherein writing the target game video data into the shared texture comprises:
and determining the shared video memory identification, and writing the target game video data into the shared texture corresponding to the shared video memory identification.
8. The method of claim 7, wherein reading the target game video data from the shared texture comprises:
acquiring the shared video memory identification, and reading the target game video data from the shared texture corresponding to the shared video memory identification;
the video processing of the target game video data to obtain the game video data to be encoded includes:
responding to a video special effect adding request, and adding a video special effect to the target game video data; the video special effect comprises an animation special effect and a watermark;
and carrying out video coding on the target game video data added with the video special effect to obtain game video data to be coded.
9. The method of claim 1, wherein the buffer includes a write entry identifier, and wherein writing the game audio data into the buffer comprises:
and writing the game audio data into the buffer area according to the writing entry identification.
10. The method of claim 9, wherein the buffer further comprises a read port identification, and wherein reading the game audio data from the buffer comprises:
reading the game audio data from the buffer area according to the read inlet identification;
carrying out audio processing on the game audio data to obtain game audio data to be encoded, wherein the game audio data to be encoded comprises the following steps:
responding to an audio data processing request, and processing the game audio data; the processing treatment at least comprises one of audio special effect superposition treatment, echo elimination treatment, sound mixing treatment and sound mixing overflow treatment;
and carrying out audio coding on the processed game audio data to obtain game audio data to be coded.
11. A game video recording apparatus, the apparatus comprising:
the request response module is used for responding to a video recording request of a game and creating a shared texture and a buffer area;
the game data acquisition module is used for acquiring game video data and game audio data;
the layer deleting processing module is used for deleting layers of the game video data to obtain target game video data;
a game data writing module, configured to write the target game video data into the shared texture, and write the game audio data into the buffer;
a game data reading module, configured to read the target game video data from the shared texture, and read the game audio data from the buffer;
and the game video obtaining module is used for obtaining game videos according to the target game video data and the game audio data.
12. An electronic device comprising a processor, a memory and a computer program stored on the memory and capable of running on the processor, the computer program when executed by the processor implementing the steps of a game video recording method as claimed in any one of claims 1 to 10.
13. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of a game video recording method according to any one of claims 1 to 10.
CN202011206218.4A 2020-11-02 2020-11-02 Game video recording method and device, electronic equipment and storage medium Pending CN112423095A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011206218.4A CN112423095A (en) 2020-11-02 2020-11-02 Game video recording method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011206218.4A CN112423095A (en) 2020-11-02 2020-11-02 Game video recording method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN112423095A true CN112423095A (en) 2021-02-26

Family

ID=74828101

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011206218.4A Pending CN112423095A (en) 2020-11-02 2020-11-02 Game video recording method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN112423095A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112714352A (en) * 2021-03-25 2021-04-27 统信软件技术有限公司 Screen recording method and device, computing equipment and readable storage medium
CN113423018A (en) * 2021-08-24 2021-09-21 腾讯科技(深圳)有限公司 Game data processing method, device and storage medium
CN113438412A (en) * 2021-05-26 2021-09-24 维沃移动通信有限公司 Image processing method and electronic device
CN113577760A (en) * 2021-08-17 2021-11-02 网易(杭州)网络有限公司 Game operation guiding method and device, electronic equipment and storage medium
CN116233520A (en) * 2023-05-06 2023-06-06 海马云(天津)信息技术有限公司 Method and device for transmitting and acquiring video data, server device and storage medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090088247A1 (en) * 2007-09-28 2009-04-02 Oberg Gregory Keith Handheld device wireless music streaming for gameplay
CN104023192A (en) * 2014-06-27 2014-09-03 深圳市中兴移动通信有限公司 Method and device for recording video
CN105302580A (en) * 2015-11-28 2016-02-03 武汉斗鱼网络科技有限公司 Method and system for rapidly acquiring game graphics through GPU (Graphics Processing Unit) texture sharing
CN105979187A (en) * 2015-07-24 2016-09-28 乐视致新电子科技(天津)有限公司 Data recording method and device
CN106127673A (en) * 2016-07-19 2016-11-16 腾讯科技(深圳)有限公司 A kind of method for processing video frequency, device and computer equipment
CN109040419A (en) * 2018-06-11 2018-12-18 Oppo(重庆)智能科技有限公司 Record screen method, apparatus, mobile terminal and storage medium
CN109582410A (en) * 2018-10-17 2019-04-05 广州视源电子科技股份有限公司 Screenshot method, screenshot device, screenshot equipment and computer-readable storage medium
CN109640105A (en) * 2018-12-05 2019-04-16 网易(杭州)网络有限公司 Game live broadcasting method, device, storage medium and electronic device
US20190208230A1 (en) * 2016-11-29 2019-07-04 Tencent Technology (Shenzhen) Company Limited Live video broadcast method, live broadcast device and storage medium
CN111346378A (en) * 2020-02-26 2020-06-30 腾讯科技(深圳)有限公司 Game picture transmission method, device, storage medium and equipment

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090088247A1 (en) * 2007-09-28 2009-04-02 Oberg Gregory Keith Handheld device wireless music streaming for gameplay
CN104023192A (en) * 2014-06-27 2014-09-03 深圳市中兴移动通信有限公司 Method and device for recording video
CN105979187A (en) * 2015-07-24 2016-09-28 乐视致新电子科技(天津)有限公司 Data recording method and device
CN105302580A (en) * 2015-11-28 2016-02-03 武汉斗鱼网络科技有限公司 Method and system for rapidly acquiring game graphics through GPU (Graphics Processing Unit) texture sharing
CN106127673A (en) * 2016-07-19 2016-11-16 腾讯科技(深圳)有限公司 A kind of method for processing video frequency, device and computer equipment
US20190208230A1 (en) * 2016-11-29 2019-07-04 Tencent Technology (Shenzhen) Company Limited Live video broadcast method, live broadcast device and storage medium
CN109040419A (en) * 2018-06-11 2018-12-18 Oppo(重庆)智能科技有限公司 Record screen method, apparatus, mobile terminal and storage medium
CN109582410A (en) * 2018-10-17 2019-04-05 广州视源电子科技股份有限公司 Screenshot method, screenshot device, screenshot equipment and computer-readable storage medium
CN109640105A (en) * 2018-12-05 2019-04-16 网易(杭州)网络有限公司 Game live broadcasting method, device, storage medium and electronic device
CN111346378A (en) * 2020-02-26 2020-06-30 腾讯科技(深圳)有限公司 Game picture transmission method, device, storage medium and equipment

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112714352A (en) * 2021-03-25 2021-04-27 统信软件技术有限公司 Screen recording method and device, computing equipment and readable storage medium
CN113438412A (en) * 2021-05-26 2021-09-24 维沃移动通信有限公司 Image processing method and electronic device
CN113577760A (en) * 2021-08-17 2021-11-02 网易(杭州)网络有限公司 Game operation guiding method and device, electronic equipment and storage medium
CN113423018A (en) * 2021-08-24 2021-09-21 腾讯科技(深圳)有限公司 Game data processing method, device and storage medium
CN113423018B (en) * 2021-08-24 2021-11-02 腾讯科技(深圳)有限公司 Game data processing method, device and storage medium
CN116233520A (en) * 2023-05-06 2023-06-06 海马云(天津)信息技术有限公司 Method and device for transmitting and acquiring video data, server device and storage medium
CN116233520B (en) * 2023-05-06 2023-07-25 海马云(天津)信息技术有限公司 Method and device for transmitting and acquiring video data, server device and storage medium

Similar Documents

Publication Publication Date Title
CN112423095A (en) Game video recording method and device, electronic equipment and storage medium
US10939069B2 (en) Video recording method, electronic device and storage medium
US20120100910A1 (en) High quality video game replay
US10798363B2 (en) Video file processing method and apparatus
US20070006064A1 (en) Aspects of media content rendering
US20080109727A1 (en) Timing aspects of media content rendering
CN111625214B (en) Audio control method, device, equipment and storage medium
EP1899968A2 (en) Synchronization aspects of interactive multimedia presentation management
JP6379107B2 (en) Information processing apparatus, control method therefor, and program
WO2007005271A2 (en) Synchronization aspects of interactive multimedia presentation management
CN111800668A (en) Bullet screen processing method, device, equipment and storage medium
CN111800661A (en) Live broadcast room display control method, electronic device and storage medium
CN112533058A (en) Video processing method, device, equipment and computer readable storage medium
CN105096989A (en) Method and apparatus for processing background music
CN106792219B (en) It is a kind of that the method and device reviewed is broadcast live
CN116437153A (en) Previewing method and device of virtual model, electronic equipment and storage medium
CN102577413B (en) Method for adding voice content to video content and device for implementing said method
CN111726701B (en) Information implantation method, video playing method, device and computer equipment
CN114339308A (en) Video stream loading method, electronic equipment and storage medium
KR100554374B1 (en) A Method for manufacuturing and displaying a real type 2D video information program including a video, a audio, a caption and a message information, and a memory devices recorded a program for displaying thereof
CN111818357A (en) Network live broadcast control method and device
CN114513682B (en) Multimedia resource display method, sending method, device, equipment and medium
CN112734940B (en) VR content playing modification method, device, computer equipment and storage medium
CN113992878B (en) Remote desktop operation auditing method, device and equipment
CN115643462B (en) Interactive animation display method and device, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210226