CN112653859A - Online transaction video recording method and device - Google Patents

Online transaction video recording method and device Download PDF

Info

Publication number
CN112653859A
CN112653859A CN202011340213.0A CN202011340213A CN112653859A CN 112653859 A CN112653859 A CN 112653859A CN 202011340213 A CN202011340213 A CN 202011340213A CN 112653859 A CN112653859 A CN 112653859A
Authority
CN
China
Prior art keywords
recording
client
video
task
live broadcast
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011340213.0A
Other languages
Chinese (zh)
Other versions
CN112653859B (en
Inventor
张满
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beike Technology Co Ltd
Original Assignee
Beike Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beike Technology Co Ltd filed Critical Beike Technology Co Ltd
Priority to CN202011340213.0A priority Critical patent/CN112653859B/en
Publication of CN112653859A publication Critical patent/CN112653859A/en
Application granted granted Critical
Publication of CN112653859B publication Critical patent/CN112653859B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334Recording operations
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The invention provides an online transaction video recording method and device, wherein the method comprises the following steps: monitoring information of a client entering and exiting a live broadcast room, and starting a whole-course recording task if the fact that a first client enters the live broadcast room is known; continuously monitoring information of other clients entering and exiting the live broadcast room, and displaying the information on display windows at corresponding positions; and when the client logs out of the live broadcast room, the corresponding display window is reserved, and when the client logs on the live broadcast room again, the corresponding video picture is still displayed on the display window. According to the online transaction video recording method provided by the invention, after the whole-process recording task is started, the corresponding video pictures are displayed on the display windows on the canvas by each client according to the entering sequence and the preset layout, so that multi-angle recording is realized, and the information of the first entering sequence of the user is reserved.

Description

Online transaction video recording method and device
Technical Field
The invention relates to the technical field of computers and communication, in particular to an online transaction video recording method and device.
Background
Under the large background of gradual online traditional industry, the past time-consuming and labor-consuming transaction process is gradually changed into a quick and convenient online business. Taking the house property transaction as an example, the link which most attracts eyes in the house property transaction on line is 'on-line surface signing', and a buyer, a seller, a bank and a broker can sign a contract on line based on the live broadcast technology without going to an off-line signing center for a long distance. In the online countersigning process, a bank needs to record a video for evidence preservation, and because the signing process cannot be repeated and the bank is involved, a highly available video implementation scheme is urgently needed.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides an online transaction video recording method and device.
The invention provides an online transaction video recording method, which comprises the following steps: monitoring information of a client entering and exiting a live broadcast room, starting a whole-process recording task if a first client entering the live broadcast room is known, and displaying a video picture of the first client on a display window at a corresponding position on a canvas; continuously monitoring information of other clients entering and exiting the live broadcast room, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients entering the live broadcast room are known; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, the corresponding display window is reserved when the client exits the live broadcast room, and the corresponding video pictures are still displayed on the display window when the client is on-line again.
According to the online transaction video recording method provided by the invention, the room number of the live broadcast room corresponds to the task ID of the whole-course recording task one by one; the method further comprises the following steps: after generating a video clip, inquiring whether a task which is being spliced exists at present according to the task ID, and if so, pushing the video clip into a task queue to be processed corresponding to the task ID; if not, judging whether the video waiting for splicing exists in the task queue to be processed, if so, splicing the video segments and the video waiting for splicing to obtain a new summary video and storing the new summary video.
According to the online transaction video recording method provided by the invention, the method further comprises the following steps: receiving an instant recording request sent by a first client, wherein the instant recording request comprises a client ID to be recorded; the first client side has instant recording authority; generating an instant recording task according to the instant recording request, wherein the instant recording task is used for recording the video of the client corresponding to the client ID; and generating a serial number corresponding to the instant recording task, and sending the serial number to the first client.
According to the online transaction video recording method provided by the invention, the method further comprises the following steps: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is failure, sending information of failure in starting recording to the first client.
According to the online transaction video recording method provided by the invention, the method further comprises the following steps: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is recording, sending information of starting recording to the first client.
According to the online transaction video recording method provided by the invention, after the receiving of the instant recording request sent by the first client, the method further comprises the following steps: and if the number of the client IDs is multiple, mixing the audio and video streams of the clients corresponding to the multiple client IDs and then sending the mixed streams to the first client.
According to the online transaction video recording method provided by the invention, after the receiving of the instant recording request sent by the first client, the method further comprises the following steps: and acquiring a video signal and screen information of the client corresponding to the client ID, and sending the video signal and the screen information to the first client.
According to the online transaction video recording method provided by the invention, the method further comprises the following steps: receiving recording ending request information sent by the first client, wherein the recording ending request information comprises the serial number; and acquiring the recording task state according to the serial number, and if the recording is finished, returning recording finishing success information to the first client.
According to the online transaction video recording method provided by the invention, the method further comprises the following steps: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is an abnormal state, acquiring that the abnormal state belongs to recording failure or recording overtime, and sending the information of the abnormal state to the first client.
The invention also provides an online transaction video recording device, which comprises: a task initiation module to: monitoring information of a client entering and exiting a live broadcast room, starting a whole-process recording task if a first client entering the live broadcast room is known, and displaying a video picture of the first client on a display window at a corresponding position on a canvas; a video display module to: continuously monitoring information of other clients entering and exiting the live broadcast room, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients entering the live broadcast room are known; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, the corresponding display window is reserved when the client exits the live broadcast room, and the corresponding video pictures are still displayed on the display window when the client is on-line again.
According to the online transaction video recording device provided by the invention, the room number of the live broadcast room corresponds to the task ID of the whole-course recording task one by one; the apparatus further comprises a splicing module configured to: after generating a video clip, inquiring whether a task which is being spliced exists at present according to the task ID, and if so, pushing the video clip into a task queue to be processed corresponding to the task ID; if not, judging whether the video waiting for splicing exists in the task queue to be processed, if so, splicing the video segments and the video waiting for splicing to obtain a new summary video and storing the new summary video.
According to the online transaction video recording device provided by the invention, the device further comprises an instant recording module, wherein the instant recording module is used for: receiving an instant recording request sent by a first client, wherein the instant recording request comprises a client ID to be recorded; the first client side has instant recording authority; generating an instant recording task according to the instant recording request, wherein the instant recording task is used for recording the video of the client corresponding to the client ID; and generating a serial number corresponding to the instant recording task, and sending the serial number to the first client.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is failure, sending information of failure in starting recording to the first client.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is recording, sending information of starting recording to the first client.
According to the online transaction video recording device provided by the invention, after the instant recording module is used for receiving the instant recording request sent by the first client, the instant recording module is further used for: and if the number of the client IDs is multiple, mixing the audio and video streams of the clients corresponding to the multiple client IDs and then sending the mixed streams to the first client.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: and acquiring a video signal and screen information of the client corresponding to the client ID, and sending the video signal and the screen information to the first client.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving recording ending request information sent by the first client, wherein the recording ending request information comprises the serial number; and acquiring the recording task state according to the serial number, and if the recording is finished, returning recording finishing success information to the first client.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is an abnormal state, acquiring that the abnormal state belongs to recording failure or recording overtime, and sending the information of the abnormal state to the first client.
The invention also provides an electronic device, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the steps of the online transaction video recording method.
The present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the online transaction recording method as any one of the above.
According to the online transaction video recording method and device, after the whole-process recording task is started, the corresponding video pictures are displayed on the display windows on the canvas by the client sides according to the entering sequence and the preset layout, so that multi-angle recording is achieved, and information of the first entering sequence of a user is reserved.
Drawings
In order to more clearly illustrate the technical solutions of the present invention or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
FIG. 1 is a flow chart of an online transaction recording method according to the present invention;
FIG. 2 is a schematic diagram illustrating multi-angle recording display in the online transaction video recording method according to the present invention;
FIG. 3 is a schematic flow chart of video splicing in the online transaction video recording method according to the present invention;
FIG. 4 is a schematic diagram illustrating signaling interaction for starting recording in the online transaction video recording method according to the present invention;
FIG. 5 is a schematic diagram illustrating signaling interaction for recording failure in the online transaction recording method according to the present invention;
FIG. 6 is a schematic diagram illustrating signaling interaction for successful recording in the online transaction recording method according to the present invention;
FIG. 7 is a schematic diagram illustrating signaling interaction for recording termination in the online transaction video recording method according to the present invention;
FIG. 8 is a schematic diagram illustrating an interaction of a signaling message for recording an abnormal event in the online transaction recording method according to the present invention;
FIG. 9 is a flowchart illustrating callback processing logic in the online transaction video recording method according to the present invention;
FIG. 10 is a schematic flow chart illustrating the recording failure starting process in the online transaction recording method according to the present invention;
FIG. 11 is a schematic flow chart illustrating successful start of recording in the online transaction recording method according to the present invention;
FIG. 12 is a schematic architecture diagram of an online transaction imaging method provided by the present invention;
FIG. 13 is a schematic diagram of an online transaction recording apparatus according to the present invention;
fig. 14 is a schematic structural diagram of an electronic device provided by the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The online transaction video recording method and apparatus provided by the present invention are described below with reference to fig. 1-14.
FIG. 1 is a flow chart of an online transaction recording method according to the present invention. As shown in fig. 1, the method includes:
step 101, monitoring information of a client entering and exiting a live broadcast room, starting a whole-process recording task if a first client entering the live broadcast room is known, and displaying a video picture of the first client on a display window at a corresponding position on a canvas.
The online transaction video recording method provided by the invention can be applied to a live broadcast server, and the live broadcast server can be called a live broadcast middling station. The online transaction audio and video recording scheme is based on the audio and video capability, the audio and video capability can be realized based on the audio and video cloud, the audio and video basic capability can be improved in a self-building mode, and the audio and video cloud is not necessarily relied on. If the audio and video cloud is relied on, the live broadcast server needs to interact with the audio and video cloud server to acquire audio and video data.
And the live broadcasting middling station monitors information of the client entering and exiting the live broadcasting room, and starts a whole-course recording task after monitoring that the first client enters the live broadcasting room. And displaying the video picture of the first client on a display window at a corresponding position on a preset canvas.
Step 102, continuously monitoring information of other clients entering and exiting the live broadcast room, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients entering the live broadcast room are known; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, the corresponding display window is reserved when the client exits the live broadcast room, and the corresponding video pictures are still displayed on the display window when the client is on-line again.
And the live broadcasting middle station continuously monitors information of other clients entering and exiting the live broadcasting room, and displays video pictures of other clients on display windows at corresponding positions on the canvas when knowing that other clients enter the live broadcasting room. And when the video pictures of the clients are displayed, displaying the corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout. For example, the display is performed in sequence and in rows according to the entering sequence. And when the client exits from the live broadcast room, the corresponding display window is reserved, and the reservation means that the display window still belongs to the exiting client and is not distributed to other clients, and the display style of the display window is not required to be limited, such as graying and the like. The video of a plurality of clients is recorded, and multi-angle recording is also realized.
FIG. 2 is a schematic diagram illustrating multi-angle recording display in the online transaction recording method according to the present invention. As shown in fig. 2, taking online sign as an example, when a first user enters an online sign room (which can be understood as a live broadcast room), recording in the whole process starts, as "recorded video" in fig. 2, since the recording is performed in multiple angles, mixed flow is performed here, video pictures of different users are sequentially arranged on a large canvas (here, taking a black canvas as an example), and the layout of the user pictures can be designed according to the requirements of a demand party, and is flexible and variable. When a user goes down or drops off, the window is not deleted, but is kept, and when the user goes up again, the window still appears (for example, the 1 st window on the left side still appears after the user 1 goes off and goes back on), and the information of the first entering sequence of the user is kept.
According to the online transaction video recording method provided by the invention, after the whole-process recording task is started, the corresponding video pictures are displayed on the display windows on the canvas by each client according to the entering sequence and the preset layout, so that multi-angle recording is realized, and the information of the first entering sequence of the user is reserved.
The online transaction video recording method is characterized in that the room number of the live broadcast room corresponds to the task ID of the whole-course recording task one by one; the method further comprises the following steps: after generating a video clip, inquiring whether a task which is being spliced exists at present according to the task ID, and if so, pushing the video clip into a task queue to be processed corresponding to the task ID; if not, judging whether the video waiting for splicing exists in the task queue to be processed, if so, splicing the video segments and the video waiting for splicing to obtain a new summary video and storing the new summary video.
Since a transaction process may not be completed for a short time, if not, it may involve continuing recording of the last transaction, i.e., multiple video clips corresponding to the same online transaction may occur. Or, due to equipment failure during recording, etc., there may be multiple video segments corresponding to the same online transaction. At this time, the video segments formed by the recordings need to be spliced to obtain a complete video corresponding to a certain online transaction. One transaction process corresponds to one task ID, and related videos are conveniently integrated and spliced according to the task ID. And after the video recording is interrupted and the last recording is continued, the same live broadcast room is still accessed for recording. Live rooms can be distinguished by room number. Therefore, the room number of the live broadcast room and the task ID of the whole-course recording task are in one-to-one correspondence, and video splicing can be performed according to the task ID.
When splicing, splicing tasks of different task IDs can be performed in parallel. For the video with a certain task ID, after a certain video segment is generated, whether a task which is being spliced exists at present is inquired according to the task ID, wherein the task which is being spliced exists at present means that the video segment with the same task ID is executing a splicing task. If yes, pushing the video clip into a task queue to be processed corresponding to the task ID; if the task which is being spliced does not exist, judging whether a video to be spliced exists in the task queue to be processed or not, if so, splicing the video clip and the video to be spliced to obtain a new summarized video and storing the new summarized video.
FIG. 3 is a schematic flow chart of video splicing in the online transaction video recording method according to the present invention. As shown in fig. 3, taking online transaction video recording based on audio and video cloud as an example, the video splicing algorithm is as follows:
(1) and receiving a video call-back of the audio and video cloud server, wherein the video call-back comprises a video file url, a service ID (task ID) and the like.
(2) And (4) inquiring whether the task which is spliced currently exists or not according to the service id, and entering the step (3) if the task which is spliced currently exists. There is no entry to step (4).
(3) And pushing the video into a task queue to be processed corresponding to the service id.
(4) And inquiring the corresponding queue details according to the service id.
(5) And (4) judging whether the video waiting for splicing exists in the queue, wherein the step (6) is carried out, and the step (7) is not carried out.
(6) And (5) starting to execute the splicing task, summarizing the video to be processed and the previous splicing result to obtain a new summarized video, and entering the step (4).
(7) And (6) ending.
Because the transaction process can not last too long and can be completed in one day, the finally obtained summary video of the task queue to be processed can be downloaded according to the actual situation of the online transaction, and the complete video of the corresponding online transaction can be obtained.
According to the online transaction video recording method, the task queue to be processed corresponding to the task ID is set, and the video to be spliced in the task queue to be processed and the newly generated video segment are spliced according to the task ID to obtain the new summary video, so that the splicing of the video segments is realized, the complete video is favorably obtained, and the video watching requirement is met.
According to the online transaction video recording method provided by the invention, the method further comprises the following steps: receiving an instant recording request sent by a first client, wherein the instant recording request comprises a client ID to be recorded; the first client side has instant recording authority; generating an instant recording task according to the instant recording request, wherein the instant recording task is used for recording the video of the client corresponding to the client ID; and generating a serial number corresponding to the instant recording task, and sending the serial number to the first client.
The instant recording is mainly aimed at important signing links, such as recording before and after signing. The first client has instant recording authority, such as a client held by a broker. The live broadcasting center station receives an instant recording request sent by a first client, the instant recording request comprises a client ID to be recorded, an instant recording task is generated according to the instant recording request, and the instant recording task is used for recording a video of the client corresponding to the client ID.
After receiving an instant recording request sent by a first client, generating a serial number corresponding to the instant recording request, and sending the serial number to the first client. The serial number corresponds to the instant recording task one by one.
Fig. 4 is a schematic diagram of signaling interaction for starting recording in the online transaction video recording method provided by the present invention. As shown in fig. 4, after a service party (a first client) clicks to start recording (e.g., clicks a recording button), a live broadcast middle station performs audio/video stream validity detection, power detection (avoiding generating the same task), writes mysql, generates a serial number, records power key (power related information) in a redis (processing speed is faster than mysql), sets expiration time of the serial number and a task state, and if the serial number is set to expire 5s (mysql is still recorded) in the redis, the task state expires for 7 days, and the like. And returns the serial number to the first client. The above can be realized by adopting an asynchronous task mode.
In order to start the recording process, the user only needs to care about the serial number of the recording task.
According to the online transaction video recording method provided by the invention, the instant recording task is generated after the instant recording request is received, the serial number corresponding to the instant recording task is generated, and the serial number is sent to the first client, so that the first client can conveniently inquire the task state according to the serial number.
According to the online transaction video recording method provided by the invention, the method further comprises the following steps: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is failure, sending information of failure in starting recording to the first client.
Fig. 5 is a schematic diagram of signaling interaction for recording failure in the online transaction recording method provided by the present invention. As shown in fig. 5, a service party obtains a recording task state through serial numbers, a live broadcast station queries the task state through redis, and returns a state of "in preparation" to the service party, for example, processes such as idempotent detection are in preparation; and then receiving information of a recording task state obtained by the first client through the serial number, querying the task state through redis, and if the state is 'recording failure', sending information of starting recording failure to the first client to prompt a user of recording failure.
The recording task failure can be sensed through the serial number in the process design for starting the recording failure.
The online transaction video recording method provided by the invention obtains the information of the failure of the recording task through the serial number, and realizes the feedback of the task state.
According to the online transaction video recording method provided by the invention, the method further comprises the following steps: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is recording, sending information of starting recording to the first client.
Fig. 6 is a schematic diagram of signaling interaction for successful recording start in the online transaction recording method provided by the present invention. As shown in fig. 6, the service side obtains the recording task state through serial number, the live broadcast center station queries the task state through redis, and returns the state to the service side as "recording", thereby prompting the user that recording has started.
The recording task can be sensed to be started normally through the serial number in the process design for starting the recording successfully.
The online transaction video recording method provided by the invention obtains the information that the recording task starts to be successfully recorded through the serial number, and further realizes the feedback of the task state.
According to the online transaction video recording method provided by the invention, the method further comprises the following steps: receiving recording ending request information sent by the first client, wherein the recording ending request information comprises the serial number; and acquiring the recording task state according to the serial number, and if the recording is finished, returning recording finishing success information to the first client.
Fig. 7 is a schematic diagram of signaling interaction for recording end in the online transaction video recording method provided by the present invention. As shown in fig. 7, the service party clicks the "end recording" button, so as to send an end recording request message to the live broadcasting middling station, where the end recording request message includes a serial number; and after receiving the recording ending request information of the service party, the live broadcasting middle station inquires redis to detect the state of the recording task according to the serial number, deletes the key with the power and the like if the recording is finished, ends the recording, updates the mysql task state to be the recording finished, and returns recording ending success information to the service party.
Here, the flow design is used for the user to actively finish the recording.
The online transaction video recording method provided by the invention obtains the recording task state through the serial number after receiving the recording ending request information of the first client, updates the task state when the recording is finished and returns the information of successful recording ending, thereby further realizing the feedback of the task state.
According to the online transaction video recording method provided by the invention, the method further comprises the following steps: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is an abnormal state, acquiring that the abnormal state belongs to recording failure or recording overtime, and sending the information of the abnormal state to the first client.
FIG. 8 is a schematic diagram of signaling interaction for recording an abnormal event in the online transaction video recording method according to the present invention. Fig. 8 is an example of signaling interaction for recording anomalies when audio-video capabilities are provided using an audio-video cloud. As shown in fig. 8, the service side sends a recording task state query request to the live broadcast middlebox, where the recording task state query request includes a serial number; and the live broadcast center feeds back the task state of the first client to be recorded (at the moment, the task state is also in the normal recording process), if the audio and video cloud recording is abnormal, the video is called back to the live broadcast center, and the live broadcast center executes the call-back processing logic. And receiving the query task state of the service party again, and feeding back information of recording failure or recording overtime to the service party if the abnormal state and type are judged at the moment.
FIG. 9 is a flowchart illustrating callback processing logic in the online transaction video recording method according to the present invention. As shown in fig. 9, callback preprocessing is performed, and according to the task id (taskid), the library is searched, and if the search is normally finished, mysql is updated; if not, judging whether the recording fails or is overtime, updating the task state, deleting keys such as power, recycling resources and the like according to the judgment result, and then updating mysql.
The processing flow of the abnormal condition is an important guarantee that the recording scheme is highly available. Here, the audio/video cloud is taken as an example, and a self-built audio/video cluster may also be used instead. Any interruption caused by abnormality in the recording process can be quickly sensed, and the polling state of a service party can be sensed. The scheme is mainly used for real-time recording at the PC end, and for the screen recording at the APP end, the active polling of the service party is only required to be changed into broadcast notification.
The online transaction video recording method provided by the invention obtains the recording task state through the serial number after receiving the recording task state query request of the first client, and feeds back the abnormal state when the abnormal state occurs, thereby further realizing the feedback of the task state.
According to the online transaction video recording method provided by the invention, after the receiving of the instant recording request sent by the first client, the method further comprises the following steps: and if the number of the client IDs is multiple, mixing the audio and video streams of the clients corresponding to the multiple client IDs and then sending the mixed streams to the first client.
Mixed flow refers to the gathering together of multiple video streams. In the whole-course recording task, videos of different clients are displayed on the canvas and are mixed flow. If the instant recording request sent by the first client includes a plurality of client IDs in the instant recording task, it indicates that the first client needs to record videos of a plurality of clients, and this is that videos of clients corresponding to the plurality of client IDs can be mixed and then sent to the first client. The audio and video stream correspondingly received by the first client can be watched and downloaded.
FIG. 10 is a flowchart illustrating a recording failure starting process in the online transaction recording method according to the present invention. As shown in fig. 10, for the case of multiple streams, mixed stream processing is performed, if the mixed stream processing is successful, cloud recording is called, and if the cloud recording is not successfully called, the DB task state is updated to recording failure, and resource recovery is performed. And if the mixed flow is unsuccessful, directly updating the DB task state to be recording failure, and recovering resources.
Fig. 11 is a schematic flow chart illustrating successful recording starting in the online transaction recording method provided by the present invention. And performing mixed flow processing aiming at the condition of multi-path flow, calling cloud recording if the mixed flow is successful, and updating the DB task state into recording and storing taskId if the cloud recording is successfully called.
The online transaction video recording method provided by the invention is convenient for centralized display of the multi-channel video stream by mixing the multi-channel stream.
According to the online transaction video recording method provided by the invention, after the receiving of the instant recording request sent by the first client, the method further comprises the following steps: and acquiring a video signal and screen information of the client corresponding to the client ID, and sending the video signal and the screen information to the first client.
In online transactions, besides the video information of the participants, the operation information of the participants on the equipment is also important information to be recorded. Therefore, after receiving the instant recording request sent by the first client, the live broadcast center station acquires the video signal and the screen information of the client corresponding to the client ID, and sends the video signal and the screen information to the first client. The screen information can be collected in a screen sharing mode.
The online transaction video recording method provided by the invention can record equipment information besides videos of participants, thereby improving comprehensiveness of information retention.
Fig. 12 is a schematic architecture diagram of an online transaction recording method provided by the present invention. As shown in fig. 12, the online transaction audio/video recording scheme is based on audio/video capability, here, taking audio/video cloud capability as an example, actually, a self-built method may also be adopted to improve the audio/video basic capability, and it is not necessarily dependent on some cloud. The core capability of the scheme is 'instant recording' and 'whole-course recording', wherein the instant recording mainly aims at important signing links, such as recording signing nodes; and the whole recording records the whole signing process and the activity of each participant. The two functions of 'state keeping' (including that the first client receives feedback information of a live broadcasting middling station in time) and 'flexible layout' are exposed to the outside, and the recording service which is concise and highly available can be exposed to a user with the assistance of the automatic splicing capability.
The invention provides an online transaction video recording method, which solves the technical problems that:
1. the whole signing process is recorded, various abnormal conditions are subjected to fault tolerance, and the accurate in-out sequence of each user is ensured through layout design.
2. The recording task state is maintained, the accuracy is ensured, and meanwhile the change of the recording task can be fed back quickly.
3. Recording and splicing ensure correct splicing sequence, correct splicing quantity, maximum splicing efficiency, multi-task combination and the like.
The online transaction video recording method provided by the invention has the technical effects that:
1. and (4) recording pictures of all subscribers in multiple angles, including the participation and exit sequences of the subscribers, and simultaneously recording the operation pictures of the subscribers and the equipment pictures of the subscribers in each subscription process to ensure sufficient information.
2. The recording task has a state, and the state is fed back to the user immediately after being changed.
3. And the recording tasks are automatically spliced, and under the condition of poor network conditions, the recording tasks are integrated by recording for many times, and finally only the summarized videos are exposed. The user using the video recording scheme is more friendly and simpler, the recording effect is more humanized, and a large amount of video recording fragments can not be generated.
The online transaction video recording device provided by the present invention is described below, and the online transaction video recording device described below and the online transaction video recording method described above may be referred to in correspondence.
FIG. 13 is a schematic diagram of an online transaction recording apparatus according to the present invention. As shown in fig. 13, the apparatus includes a task starting module 10 and a video display module 20, wherein: the task starting module 10 is configured to: monitoring information of a client entering and exiting a live broadcast room, starting a whole-process recording task if a first client entering the live broadcast room is known, and displaying a video picture of the first client on a display window at a corresponding position on a canvas; the video display module 20 is configured to: continuously monitoring information of other clients entering and exiting the live broadcast room, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients entering the live broadcast room are known; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, the corresponding display window is reserved when the client exits the live broadcast room, and the corresponding video pictures are still displayed on the display window when the client is on-line again.
According to the online transaction video recording device, after the whole-process recording task is started, the corresponding video pictures are displayed on the display windows on the canvas according to the entering sequence and the preset layout by each client, so that multi-angle recording is realized, and the information of the first entering sequence of a user is reserved.
According to the online transaction video recording device provided by the invention, the room number of the live broadcast room corresponds to the task ID of the whole-course recording task one by one; the apparatus further comprises a splicing module configured to: after generating a video clip, inquiring whether a task which is being spliced exists at present according to the task ID, and if so, pushing the video clip into a task queue to be processed corresponding to the task ID; if not, judging whether the video waiting for splicing exists in the task queue to be processed, if so, splicing the video segments and the video waiting for splicing to obtain a new summary video and storing the new summary video.
According to the online transaction video recording device, the task queue to be processed corresponding to the task ID is set, and the video to be spliced in the task queue to be processed and the newly produced video segment are spliced according to the task ID to obtain the new summary video, so that the splicing of the video segments is realized, the complete video is favorably obtained, and the video watching requirement is met.
According to the online transaction video recording device provided by the invention, the device further comprises an instant recording module, wherein the instant recording module is used for: receiving an instant recording request sent by a first client, wherein the instant recording request comprises a client ID to be recorded; the first client side has instant recording authority; generating an instant recording task according to the instant recording request, wherein the instant recording task is used for recording the video of the client corresponding to the client ID; and generating a serial number corresponding to the instant recording task, and sending the serial number to the first client.
According to the online transaction video recording device, the instant recording task is generated after the instant recording request is received, the serial number corresponding to the instant recording task is generated, and the serial number is sent to the first client, so that the first client can conveniently inquire the task state according to the serial number.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is failure, sending information of failure in starting recording to the first client.
The online transaction video recording device provided by the invention acquires the information of the failure of the recording task through the serial number, thereby realizing the feedback of the task state.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is recording, sending information of starting recording to the first client.
The online transaction video recording device provided by the invention acquires the information that the recording task starts to be successfully recorded through the serial number, and further realizes the feedback of the task state.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving recording ending request information sent by the first client, wherein the recording ending request information comprises the serial number; and acquiring the recording task state according to the serial number, and if the recording is finished, returning recording finishing success information to the first client.
The online transaction video recording device provided by the invention obtains the recording task state through the serial number after receiving the recording ending request information of the first client, updates the task state when the recording is finished and returns the information of successful recording ending, thereby further realizing the feedback of the task state.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is an abnormal state, acquiring that the abnormal state belongs to recording failure or recording overtime, and sending the information of the abnormal state to the first client.
The online transaction video recording device provided by the invention obtains the recording task state through the serial number after receiving the recording task state query request of the first client, and feeds back the abnormal state when the abnormal state occurs, thereby further realizing the feedback of the task state.
According to the online transaction video recording device provided by the invention, after the instant recording module is used for receiving the instant recording request sent by the first client, the instant recording module is further used for: and if the number of the client IDs is multiple, mixing the audio and video streams of the clients corresponding to the multiple client IDs and then sending the mixed streams to the first client.
The online transaction video recording device provided by the invention is convenient for centralized display of the multi-channel video stream by mixing the multi-channel stream.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: and acquiring a video signal and screen information of the client corresponding to the client ID, and sending the video signal and the screen information to the first client.
The online transaction video recording device provided by the invention can record equipment information besides videos of participants, thereby improving comprehensiveness of information retention.
Fig. 14 is a schematic structural diagram of an electronic device provided in the present invention, and as shown in fig. 14, the electronic device may include: a processor (processor)1410, a communication Interface (Communications Interface)1420, a memory (memory)1430 and a communication bus 1440, wherein the processor 1410, the communication Interface 1420 and the memory 1430 communicate with each other via the communication bus 1440. Processor 1410 may invoke logic instructions in memory 1430 to perform an online transaction video recording method comprising: monitoring information of a client entering and exiting a live broadcast room, starting a whole-process recording task if a first client entering the live broadcast room is known, and displaying a video picture of the first client on a display window at a corresponding position on a canvas; continuously monitoring information of other clients entering and exiting the live broadcast room, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients entering the live broadcast room are known; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, the corresponding display window is reserved when the client exits the live broadcast room, and the corresponding video pictures are still displayed on the display window when the client is on-line again.
In addition, the logic instructions in the memory 1430 may be implemented in software functional units and stored in a computer readable storage medium when sold or used as a stand-alone product. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In another aspect, the present invention also provides a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, enable the computer to perform the online transaction video recording method provided by the above methods, the method comprising: monitoring information of a client entering and exiting a live broadcast room, starting a whole-process recording task if a first client entering the live broadcast room is known, and displaying a video picture of the first client on a display window at a corresponding position on a canvas; continuously monitoring information of other clients entering and exiting the live broadcast room, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients entering the live broadcast room are known; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, the corresponding display window is reserved when the client exits the live broadcast room, and the corresponding video pictures are still displayed on the display window when the client is on-line again.
In yet another aspect, the present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program, which when executed by a processor is implemented to perform the online transaction video recording method provided above, the method comprising: monitoring information of a client entering and exiting a live broadcast room, starting a whole-process recording task if a first client entering the live broadcast room is known, and displaying a video picture of the first client on a display window at a corresponding position on a canvas; continuously monitoring information of other clients entering and exiting the live broadcast room, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients entering the live broadcast room are known; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, the corresponding display window is reserved when the client exits the live broadcast room, and the corresponding video pictures are still displayed on the display window when the client is on-line again.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. An online transaction video recording method, comprising:
monitoring information of a client entering and exiting a live broadcast room, starting a whole-process recording task if a first client entering the live broadcast room is known, and displaying a video picture of the first client on a display window at a corresponding position on a canvas;
continuously monitoring information of other clients entering and exiting the live broadcast room, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients entering the live broadcast room are known; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, the corresponding display window is reserved when the client exits the live broadcast room, and the corresponding video pictures are still displayed on the display window when the client is on-line again.
2. The method of claim 1, wherein a room number of the live broadcast room corresponds to a task ID of the global recording task one-to-one; the method further comprises the following steps:
after generating a video clip, inquiring whether a task which is being spliced exists at present according to the task ID, and if so, pushing the video clip into a task queue to be processed corresponding to the task ID; if not, judging whether the video waiting for splicing exists in the task queue to be processed, if so, splicing the video segments and the video waiting for splicing to obtain a new summary video and storing the new summary video.
3. The method of claim 1, further comprising:
receiving an instant recording request sent by a first client, wherein the instant recording request comprises a client ID to be recorded; the first client side has instant recording authority;
generating an instant recording task according to the instant recording request, wherein the instant recording task is used for recording the video of the client corresponding to the client ID;
and generating a serial number corresponding to the instant recording task, and sending the serial number to the first client.
4. The method of claim 3, further comprising:
receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number;
acquiring a recording task state according to the serial number; and if the recording task state is failure, sending information of failure in starting recording to the first client.
5. The method of claim 3, further comprising:
receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number;
acquiring a recording task state according to the serial number; and if the recording task state is recording, sending information of starting recording to the first client.
6. The method of claim 3, wherein after receiving the request for immediate recording from the first client, the method further comprises:
and if the number of the client IDs is multiple, mixing the audio and video streams of the clients corresponding to the multiple client IDs and then sending the mixed streams to the first client.
7. The method of claim 3, wherein after receiving the request for immediate recording from the first client, the method further comprises:
and acquiring a video signal and screen information of the client corresponding to the client ID, and sending the video signal and the screen information to the first client.
8. An online transaction video recording device, comprising:
a task initiation module to: monitoring information of a client entering and exiting a live broadcast room, starting a whole-process recording task if a first client entering the live broadcast room is known, and displaying a video picture of the first client on a display window at a corresponding position on a canvas;
a video display module to: continuously monitoring information of other clients entering and exiting the live broadcast room, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients entering the live broadcast room are known; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, the corresponding display window is reserved when the client exits the live broadcast room, and the corresponding video pictures are still displayed on the display window when the client is on-line again.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the online transaction recording method according to any one of claims 1 to 7 are implemented when the program is executed by the processor.
10. A non-transitory computer readable storage medium having stored thereon a computer program, wherein the computer program when executed by a processor implements the steps of the online transaction recording method according to any one of claims 1 to 7.
CN202011340213.0A 2020-11-25 2020-11-25 Online transaction video recording method and device Active CN112653859B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011340213.0A CN112653859B (en) 2020-11-25 2020-11-25 Online transaction video recording method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011340213.0A CN112653859B (en) 2020-11-25 2020-11-25 Online transaction video recording method and device

Publications (2)

Publication Number Publication Date
CN112653859A true CN112653859A (en) 2021-04-13
CN112653859B CN112653859B (en) 2023-06-09

Family

ID=75349432

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011340213.0A Active CN112653859B (en) 2020-11-25 2020-11-25 Online transaction video recording method and device

Country Status (1)

Country Link
CN (1) CN112653859B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114390239A (en) * 2021-12-23 2022-04-22 北京百度网讯科技有限公司 Communication method, device, system, electronic device, and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090009601A1 (en) * 2006-03-27 2009-01-08 Ke Li Logistics monitoring and tracking method and system
CN105872581A (en) * 2016-05-31 2016-08-17 深圳市佑嘉互动科技有限公司 System and method for providing video direct broadcasting room services
CN108460560A (en) * 2018-04-03 2018-08-28 孙利嫚 A kind of the commodity online trading system and its online transaction method of internet identification
CN110996037A (en) * 2019-11-14 2020-04-10 苏州中车建设工程有限公司 Multipoint video conference picture display system and control method thereof
CN111698451A (en) * 2020-06-17 2020-09-22 北京天威诚信电子商务服务有限公司 Video conference-based electronic contract signing method, platform and system
CN111898977A (en) * 2020-07-22 2020-11-06 北京厚泽人力资源有限公司 Electronic signing system and method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090009601A1 (en) * 2006-03-27 2009-01-08 Ke Li Logistics monitoring and tracking method and system
CN105872581A (en) * 2016-05-31 2016-08-17 深圳市佑嘉互动科技有限公司 System and method for providing video direct broadcasting room services
CN108460560A (en) * 2018-04-03 2018-08-28 孙利嫚 A kind of the commodity online trading system and its online transaction method of internet identification
CN110996037A (en) * 2019-11-14 2020-04-10 苏州中车建设工程有限公司 Multipoint video conference picture display system and control method thereof
CN111698451A (en) * 2020-06-17 2020-09-22 北京天威诚信电子商务服务有限公司 Video conference-based electronic contract signing method, platform and system
CN111898977A (en) * 2020-07-22 2020-11-06 北京厚泽人力资源有限公司 Electronic signing system and method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114390239A (en) * 2021-12-23 2022-04-22 北京百度网讯科技有限公司 Communication method, device, system, electronic device, and storage medium
CN114390239B (en) * 2021-12-23 2022-11-25 北京百度网讯科技有限公司 Communication method, device, system, electronic device, and storage medium

Also Published As

Publication number Publication date
CN112653859B (en) 2023-06-09

Similar Documents

Publication Publication Date Title
US9621958B2 (en) Deferred, on-demand loading of user presence within a real-time collaborative service
US9723242B1 (en) Video conferencing system and method
US10305841B2 (en) System and method of enterprise mobile message
CN105933375B (en) Method and device for monitoring microphone connection session and server
WO2014183427A1 (en) Method and apparatus for displaying webcast rooms
CN112351288B (en) Live broadcast information processing method, device, server, terminal and storage medium
CN113518247A (en) Video playing method, related equipment and computer readable storage medium
CN105871800A (en) Pull stream control method, device and system
CN111246238A (en) Live broadcast method, device, storage medium and live broadcast system
CN111818383B (en) Video data generation method, system, device, electronic equipment and storage medium
CN103401854A (en) Social network service-based television content sharing method
CN110996180B (en) Network live broadcast chatting method, system and server
CN111726641A (en) Live video playing processing method and device and server
CN112423140A (en) Video playing method and device, electronic equipment and storage medium
CN111586042A (en) Multi-screen interaction method, terminal and storage medium
CN112291502A (en) Information interaction method, device and system and electronic equipment
CN114928758A (en) Live broadcast abnormity detection processing method and device
CN112653859A (en) Online transaction video recording method and device
CN111866544A (en) Data processing method, device, equipment and computer readable storage medium
CN109348298B (en) Method and equipment for pushing and playing multimedia data stream
CN113271474B (en) Method, device, equipment and storage medium for testing streaming media server
CN113099247B (en) Virtual resource processing method, device, server, storage medium and program product
CN113346973B (en) Event prompting method and device, electronic equipment and computer readable storage medium
US11838338B2 (en) Method and device for conference control and conference participation, server, terminal, and storage medium
CN115396626A (en) Video conference method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant