CN112653859B - Online transaction video recording method and device - Google Patents

Online transaction video recording method and device Download PDF

Info

Publication number
CN112653859B
CN112653859B CN202011340213.0A CN202011340213A CN112653859B CN 112653859 B CN112653859 B CN 112653859B CN 202011340213 A CN202011340213 A CN 202011340213A CN 112653859 B CN112653859 B CN 112653859B
Authority
CN
China
Prior art keywords
recording
client
video
task
online transaction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011340213.0A
Other languages
Chinese (zh)
Other versions
CN112653859A (en
Inventor
张满
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beike Technology Co Ltd
Original Assignee
Beike Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beike Technology Co Ltd filed Critical Beike Technology Co Ltd
Priority to CN202011340213.0A priority Critical patent/CN112653859B/en
Publication of CN112653859A publication Critical patent/CN112653859A/en
Application granted granted Critical
Publication of CN112653859B publication Critical patent/CN112653859B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334Recording operations
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The invention provides an online transaction video recording method and device, wherein the method comprises the following steps: monitoring information of a client entering and exiting a live broadcasting room, and starting a whole-process recording task if the first client is known to enter the live broadcasting room; monitoring information of other clients entering and exiting the live broadcasting room continuously, and displaying on display windows at corresponding positions; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, and when the client exits from the live broadcasting room, the corresponding display window is reserved, and when the client is on line again, the corresponding video pictures are still displayed on the display window. According to the online transaction video recording method provided by the invention, after the whole recording task is started, each client side displays the corresponding video picture on the display window on the canvas according to the entering sequence and the preset layout, so that multi-angle recording is realized, and the information of the first entering sequence of a user is reserved.

Description

Online transaction video recording method and device
Technical Field
The invention relates to the technical field of computers and communication, in particular to an online transaction video recording method and device.
Background
Under the great background of gradual online in the online-down traditional industry, the past time-consuming and labor-consuming transaction flow is gradually changed into a quick and convenient online service. Taking a house property transaction as an example, the link of the most attractive eyeball in the online house property transaction is an online surface sign, and based on a live broadcast technology, buyers, sellers, banks and brokers can sign online without long-distance travel to an offline signing center. In the online face-tagging process, the bank needs to record video as evidence, and because the signing process is not repeatable and involves the bank, a highly available video implementation scheme is needed.
Disclosure of Invention
Aiming at the problems existing in the prior art, the invention provides an online transaction video recording method and device.
The invention provides an online transaction video recording method, which comprises the following steps: monitoring information of a client entering and exiting a live broadcasting room, if the client is known to enter the live broadcasting room, starting a whole-process recording task, and displaying a video picture of the first client on a display window at a corresponding position on a canvas; monitoring information of other clients entering and exiting the live broadcasting room continuously, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients enter the live broadcasting room; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, and when the client exits from the live broadcasting room, the corresponding display window is reserved, and when the client is online again, the corresponding video picture is still displayed on the display window.
According to the online transaction video recording method provided by the invention, the room number of the live broadcasting room corresponds to the task ID of the whole-process recording task one by one; the method further comprises the steps of: after generating a video clip, inquiring whether a task which is being spliced exists currently or not according to the task ID, if so, pushing the video clip into a task queue to be processed corresponding to the task ID; if not, judging whether the task queue to be processed has videos to be spliced or not, if so, splicing the video clips and the videos to be spliced to obtain a new summarized video and storing the new summarized video.
The invention provides an online transaction video recording method, which further comprises the following steps: receiving an instant recording request sent by a first client, wherein the instant recording request comprises a client ID to be recorded; wherein, the first client side has instant recording authority; generating an instant recording task according to the instant recording request, wherein the instant recording task is used for recording the video of the client corresponding to the client ID; and generating a serial number corresponding to the instant recording task, and sending the serial number to the first client.
The invention provides an online transaction video recording method, which further comprises the following steps: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is failure, sending information of recording failure starting to the first client.
The invention provides an online transaction video recording method, which further comprises the following steps: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is recording, sending information that recording is started to the first client.
According to the online transaction video recording method provided by the invention, after the instant recording request sent by the first client is received, the method further comprises the following steps: and if the number of the client IDs is multiple, the audio and video streams of the clients corresponding to the multiple client IDs are mixed and then sent to the first client.
According to the online transaction video recording method provided by the invention, after the instant recording request sent by the first client is received, the method further comprises the following steps: and acquiring video signals and screen information of the client corresponding to the client ID, and transmitting the video signals and the screen information to the first client.
The invention provides an online transaction video recording method, which further comprises the following steps: receiving recording ending request information sent by the first client, wherein the recording ending request information comprises the serial number; and acquiring the recording task state according to the serial number, and returning recording success ending information to the first client if recording is completed.
The invention provides an online transaction video recording method, which further comprises the following steps: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; if the recording task state is an abnormal state, acquiring that the abnormal state belongs to recording failure or recording overtime, and sending the information of the abnormal state to the first client.
The invention also provides an online transaction video device, which comprises: the task starting module is used for: monitoring information of a client entering and exiting a live broadcasting room, if the client is known to enter the live broadcasting room, starting a whole-process recording task, and displaying a video picture of the first client on a display window at a corresponding position on a canvas; a video display module for: monitoring information of other clients entering and exiting the live broadcasting room continuously, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients enter the live broadcasting room; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, and when the client exits from the live broadcasting room, the corresponding display window is reserved, and when the client is online again, the corresponding video picture is still displayed on the display window.
According to the online transaction video recording device provided by the invention, the room number of the live broadcasting room corresponds to the task ID of the whole-process recording task one by one; the device also comprises a splicing module, wherein the splicing module is used for: after generating a video clip, inquiring whether a task which is being spliced exists currently or not according to the task ID, if so, pushing the video clip into a task queue to be processed corresponding to the task ID; if not, judging whether the task queue to be processed has videos to be spliced or not, if so, splicing the video clips and the videos to be spliced to obtain a new summarized video and storing the new summarized video.
According to the online transaction video recording device provided by the invention, the device further comprises an instant recording module, wherein the instant recording module is used for: receiving an instant recording request sent by a first client, wherein the instant recording request comprises a client ID to be recorded; wherein, the first client side has instant recording authority; generating an instant recording task according to the instant recording request, wherein the instant recording task is used for recording the video of the client corresponding to the client ID; and generating a serial number corresponding to the instant recording task, and sending the serial number to the first client.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is failure, sending information of recording failure starting to the first client.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is recording, sending information that recording is started to the first client.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for receiving the instant recording request sent by the first client, and then is further used for: and if the number of the client IDs is multiple, the audio and video streams of the clients corresponding to the multiple client IDs are mixed and then sent to the first client.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: and acquiring video signals and screen information of the client corresponding to the client ID, and transmitting the video signals and the screen information to the first client.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving recording ending request information sent by the first client, wherein the recording ending request information comprises the serial number; and acquiring the recording task state according to the serial number, and returning recording success ending information to the first client if recording is completed.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; if the recording task state is an abnormal state, acquiring that the abnormal state belongs to recording failure or recording overtime, and sending the information of the abnormal state to the first client.
The invention also provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the online transaction video recording method as described in any one of the above when executing the program.
The present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the online transaction video recording method as described in any of the above.
According to the online transaction video recording method and device, after the whole recording task is started, the clients are enabled to display the corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, so that multi-angle recording is realized, and the information of the first entering sequence of the user is reserved.
Drawings
In order to more clearly illustrate the invention or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic flow chart of an online transaction video recording method according to the present invention;
FIG. 2 is a schematic diagram of multi-angle recording and displaying in the online transaction video recording method provided by the invention;
FIG. 3 is a schematic diagram of a video splicing process in the online transaction video method provided by the invention;
FIG. 4 is a signaling interaction diagram for starting recording in the online transaction video recording method provided by the invention;
FIG. 5 is a signaling interaction diagram for recording failure in the online transaction video recording method provided by the invention;
FIG. 6 is a signaling interaction diagram of the recording success starting in the online transaction video recording method provided by the invention;
FIG. 7 is a signaling interaction diagram of recording end in the online transaction video recording method provided by the invention;
FIG. 8 is a signaling interaction schematic diagram of recording anomalies in the online transaction video recording method provided by the invention;
FIG. 9 is a schematic flow chart of callback processing logic in the online transaction video recording method provided by the invention;
FIG. 10 is a schematic diagram of a recording failure starting process in the online transaction recording method according to the present invention;
FIG. 11 is a schematic diagram of a process for starting recording success in the online transaction video recording method provided by the invention;
FIG. 12 is a schematic diagram of an online transaction video recording method according to the present invention;
FIG. 13 is a schematic diagram of an online transaction video recording device according to the present invention;
fig. 14 is a schematic structural diagram of an electronic device provided by the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The method and apparatus for recording online transactions provided by the present invention are described below with reference to fig. 1 to 14.
FIG. 1 is a schematic flow chart of an online transaction video recording method according to the present invention. As shown in fig. 1, the method includes:
and step 101, monitoring information of the client entering and exiting the live broadcasting room, if the first client is known to enter the live broadcasting room, starting a whole-course recording task, and displaying a video picture of the first client on a display window at a corresponding position on a canvas.
The online transaction video recording method provided by the invention can be applied to a live broadcast server, and the live broadcast server can be called a live broadcast middle station. The online transaction audio and video recording scheme is based on audio and video capability, the implementation of the audio and video capability can be based on audio and video cloud, and the audio and video basic capability can be improved in a self-built mode without depending on the audio and video cloud. If the audio/video cloud is supported, the live broadcast server needs to interact with the audio/video cloud server to acquire audio/video data.
And the live broadcast middle station monitors information of the client entering and exiting the live broadcast room, and starts a whole-course recording task after monitoring that the first client enters the live broadcast room. And displaying the video picture of the first client on a display window at a corresponding position on a preset canvas.
102, continuing to monitor information of other clients entering and exiting the live broadcasting room, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients enter the live broadcasting room; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, and when the client exits from the live broadcasting room, the corresponding display window is reserved, and when the client is online again, the corresponding video picture is still displayed on the display window.
The live broadcast middle station continues to monitor information of other clients entering and exiting the live broadcast room, and when knowing that the other clients enter the live broadcast room, video pictures of the other clients are displayed on display windows at corresponding positions on a canvas. When the video pictures of each client are displayed, the corresponding video pictures are displayed on the display window on the canvas according to the entering sequence and the preset layout. For example, in order of entry, in line. And, when the client exits the live broadcasting room, the corresponding display window is reserved, and the reservation means that the display window still belongs to the exiting client and is not distributed to other clients, and the display style of the display window is not limited, for example, gray setting can be performed. And recording videos of a plurality of clients, namely realizing multi-angle recording.
Fig. 2 is a schematic diagram of multi-angle recording and displaying in the online transaction video recording method provided by the invention. As shown in fig. 2, taking an on-line sign as an example, from the first user to enter an on-line sign room (which can be understood as a living broadcast room), the whole-process recording starts, such as "recorded video" in fig. 2, and because of multi-angle recording, mixed streaming is performed here, video pictures of different users are sequentially arranged on a large canvas (black canvas is taken as an example here), and the layout of the user pictures can be designed according to the requirements of the demander, so that the user pictures are flexible and changeable. When a certain user goes offline or drops, the window is not deleted, but remains, when he goes online again, the window still appears (for example, the 1 st window on the left side still appears after the user 1 goes offline and comes online again), and the information of the first entering sequence of the user is kept.
According to the online transaction video recording method provided by the invention, after the whole recording task is started, each client side displays the corresponding video picture on the display window on the canvas according to the entering sequence and the preset layout, so that multi-angle recording is realized, and the information of the first entering sequence of a user is reserved.
The online transaction video recording method is characterized in that the room number of the live broadcasting room corresponds to the task ID of the whole-process recording task one by one; the method further comprises the steps of: after generating a video clip, inquiring whether a task which is being spliced exists currently or not according to the task ID, if so, pushing the video clip into a task queue to be processed corresponding to the task ID; if not, judging whether the task queue to be processed has videos to be spliced or not, if so, splicing the video clips and the videos to be spliced to obtain a new summarized video and storing the new summarized video.
Since a transaction process is sometimes not necessarily completed in a short time, if it is not completed in a short time, it may involve the situation of continuing the recording of the last transaction, that is, a plurality of video clips corresponding to the same online transaction may occur. Or, due to equipment failure during recording, multiple video clips corresponding to the same online transaction may also be caused. At this time, the video clips formed by each recording need to be spliced to obtain a complete video corresponding to a certain online transaction. One transaction process corresponds to one task ID, so that the related videos can be integrated and spliced conveniently according to the task ID. After the video is interrupted and when the last recording is continued, the same live broadcasting room is still entered for recording. The living room may be distinguished by room number. Therefore, the room number of the live broadcasting room and the task ID of the whole recording task are in one-to-one correspondence, and video splicing can be performed according to the task ID.
When in splicing, the splicing tasks of different task IDs can be performed in parallel. For video of a certain task ID, after a certain video segment is generated, inquiring whether a task which is being spliced exists currently according to the task ID, wherein the task which is being spliced currently refers to that the video segment with the same task ID is executing the splicing task. If yes, pushing the video clip into a task queue to be processed corresponding to the task ID; if the task to be spliced does not exist, judging whether the task queue to be processed has the video to be spliced, if so, splicing the video segment and the video to be spliced to obtain a new summarized video and storing the new summarized video.
Fig. 3 is a schematic flow chart of video splicing in the online transaction video method provided by the invention. As shown in fig. 3, taking on-line transaction video based on an audio/video cloud as an example, a video stitching algorithm is as follows:
(1) And receiving a video callback of the audio and video cloud server, wherein the video callback comprises a video file url, a service ID (task ID) and the like.
(2) Inquiring whether a task which is being spliced exists currently according to the service id, and if so, entering the step (3). There is no entry into step (4).
(3) Pushing the video into a task queue to be processed corresponding to the service id.
(4) And inquiring the corresponding queue details according to the service id.
(5) Judging whether the video waiting for splicing exists in the queue, if yes, entering the step (6), and if not, entering the step (7).
(6) And (4) starting to execute a splicing task, summarizing the video to be processed and the previous splicing result to obtain a new summarized video, and entering the step (4).
(7) And (5) ending.
Because the transaction process can not last for a long time and can be completed in one day generally, the summary video obtained finally by the task queue to be processed can be downloaded according to the actual situation of the online transaction, and the complete video of the corresponding online transaction can be obtained.
According to the online transaction video recording method provided by the invention, the task queue to be processed corresponding to the task ID is set, and the video to be spliced in the task queue to be processed and the newly generated video segments are spliced according to the task ID to obtain the new summarized video, so that the splicing of the video segments is realized, the complete video is obtained, and the video watching requirement is met.
The invention provides an online transaction video recording method, which further comprises the following steps: receiving an instant recording request sent by a first client, wherein the instant recording request comprises a client ID to be recorded; wherein, the first client side has instant recording authority; generating an instant recording task according to the instant recording request, wherein the instant recording task is used for recording the video of the client corresponding to the client ID; and generating a serial number corresponding to the instant recording task, and sending the serial number to the first client.
The instant recording is mainly aimed at important signing links, such as recording before and after signing. The first client has instant recording authority, and the first client is a client held by a broker. The live broadcast middle station receives an instant recording request sent by a first client, the instant recording request comprises a client ID to be recorded, an instant recording task is generated according to the instant recording request, and the instant recording task is used for recording videos of clients corresponding to the client ID.
After receiving the instant recording request sent by the first client, generating a serial number corresponding to the instant recording request, and sending the serial number to the first client. The serial numbers correspond to the instant recording tasks one by one.
Fig. 4 is a signaling interaction diagram for starting recording in the online transaction video recording method provided by the invention. As shown in fig. 4, after the service side (the first client) clicks to start recording (e.g. clicks even a recording button), the live broadcast middle station performs audio and video stream validity detection, idempotent detection (avoids generating the same task), writes mysql, generates a serial number, records idempotent key (idempotent related information) in redis (processing speed is faster than mysql), sets expiration time of the serial number and task state, e.g. sets 5s of the serial number to expire in redis (mysql still records), and the task state to expire for 7 days. And returns the serial number to the first client. The above may be implemented in an asynchronous task manner.
In order to start the recording process, the user only needs to care about the serial number of the recording task.
According to the online transaction video recording method, after the instant recording request is received, the instant recording task is generated, the serial number corresponding to the instant recording task is generated, and the serial number is sent to the first client, so that the first client can conveniently inquire the task state according to the serial number.
The invention provides an online transaction video recording method, which further comprises the following steps: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is failure, sending information of recording failure starting to the first client.
Fig. 5 is a signaling interaction schematic diagram of recording failure starting in the online transaction video recording method provided by the invention. As shown in fig. 5, the service party obtains the recording task state through the serial number, and the live broadcast center station inquires the task state through redis, returns the state to the service party as "in preparation", for example, the process of idempotent detection and the like is in preparation; and then receiving information of the recording task state obtained by the first client through the serial number, inquiring the task state through redis, and if the state is recording failure, sending information of recording failure to the first client to prompt a user of recording failure.
Here, in order to start the process design of recording failure, the failure of the recording task can be perceived through the serial number.
According to the online transaction video recording method provided by the invention, the information of recording task failure is obtained through the serial number, so that the feedback of task state is realized.
The invention provides an online transaction video recording method, which further comprises the following steps: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is recording, sending information that recording is started to the first client.
Fig. 6 is a signaling interaction schematic diagram of recording success in the online transaction video recording method provided by the invention. As shown in fig. 6, the service party obtains the recording task state through the serial number, and the live broadcast center station inquires the task state through redis and returns the state to the service party as recording, thereby prompting the user that recording is started.
In this case, in order to start the successful recording process, the recording task can be perceived to have been started normally through the serial number.
According to the online transaction video recording method provided by the invention, the information that the recording task starts to be successfully recorded is obtained through the serial number, so that the feedback of the task state is further realized.
The invention provides an online transaction video recording method, which further comprises the following steps: receiving recording ending request information sent by the first client, wherein the recording ending request information comprises the serial number; and acquiring the recording task state according to the serial number, and returning recording success ending information to the first client if recording is completed.
Fig. 7 is a signaling interaction diagram of recording end in the online transaction video recording method provided by the invention. As shown in fig. 7, the service side clicks the "end recording" button, so as to send end recording request information to the live broadcast center, where the end recording request information includes a serial number; after receiving the recording ending request information of the service party, the live broadcast center station inquires rediss according to the serial numbers to detect the recording task state, if the recording is completed, the power key is deleted, the recording is ended, the mysql task state is updated to be the recording completion, and recording ending success information is returned to the service party.
Here, the process design of actively ending recording by the user is provided.
According to the online transaction video recording method, after receiving the recording ending request information of the first client, the recording task state is obtained through the serial number, the task state is updated when recording is completed, and the recording ending success information is returned, so that the task state feedback is further realized.
The invention provides an online transaction video recording method, which further comprises the following steps: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; if the recording task state is an abnormal state, acquiring that the abnormal state belongs to recording failure or recording overtime, and sending the information of the abnormal state to the first client.
Fig. 8 is a signaling interaction schematic diagram of recording abnormality in the online transaction video recording method provided by the invention. Fig. 8 is a signaling interaction example of recording anomalies when an audio-video cloud is employed to provide audio-video capabilities. As shown in fig. 8, the service direction live broadcast center sends a recording task state query request, where the recording task state query request includes a serial number; and the live broadcasting center feeds back the task state of the first client side as recording (at the moment, the recording process is still normal), if the recording of the audio and video cloud is abnormal, the video is recalled to the live broadcasting center, and the live broadcasting center executes callback processing logic. And receiving the inquiry task state of the service party again, and feeding back information of recording failure or recording overtime to the service party if the abnormal state and type are judged at the moment.
Fig. 9 is a schematic flow chart of callback processing logic in the online transaction video recording method provided by the invention. As shown in fig. 9, performing callback preprocessing, checking a library according to task ID (taskId), and if the task ID is normally ended, updating mysql; if the recording is not finished normally, judging whether the recording is failed or overtime, updating the task state, deleting the idempotent key, recovering resources and the like according to the judging result, and then updating mysql.
The abnormal situation processing flow is an important guarantee that the recording scheme is high in availability. Taking an audio/video cloud as an example, a self-built audio/video cluster can be used instead. Any abnormality in the recording process leads to interruption, so that the interruption can be perceived quickly, and the polling state of the business party can be perceived. The scheme is mainly used for the instant recording of the PC terminal, and for the recording of the APP terminal, only the active polling of the service party is changed into broadcasting notification.
According to the online transaction video recording method, after the recording task state query request of the first client is received, the recording task state is obtained through the serial number, and the abnormal state is fed back when the recording task state is abnormal, so that the task state feedback is further realized.
According to the online transaction video recording method provided by the invention, after the instant recording request sent by the first client is received, the method further comprises the following steps: and if the number of the client IDs is multiple, the audio and video streams of the clients corresponding to the multiple client IDs are mixed and then sent to the first client.
Mixed streaming refers to the concentration of multiple video streams together. In the whole recording task, the video of different clients displayed on the canvas is also mixed stream. If the instant recording request sent by the first client includes a plurality of client IDs in the instant recording task, it indicates that the first client needs to record videos of a plurality of clients, and the videos of the clients corresponding to the plurality of client IDs may be mixed and then sent to the first client. The first client can watch and download the received audio and video stream correspondingly.
Fig. 10 is a schematic flow chart of recording failure starting in the online transaction video recording method provided by the invention. As shown in fig. 10, for the case of multiple streams, mixed stream processing is performed, if successful, cloud recording is invoked, if unsuccessful, the DB task state is updated to be recording failure, and resource recovery is performed. If the mixed flow is unsuccessful, the DB task state is directly updated as recording failure, and resource recovery is carried out.
Fig. 11 is a schematic diagram of a process for starting recording success in the online transaction video recording method provided by the invention. And aiming at the condition of multi-path flow, mixed flow processing is carried out, if the mixed flow processing is successful, cloud recording is called, and if the cloud recording is successful, the DB task state is updated to be recorded, and the task Id is stored.
The online transaction video recording method provided by the invention is convenient for intensively displaying the multi-path video stream by mixing the multi-path stream.
According to the online transaction video recording method provided by the invention, after the instant recording request sent by the first client is received, the method further comprises the following steps: and acquiring video signals and screen information of the client corresponding to the client ID, and transmitting the video signals and the screen information to the first client.
In online transactions, in addition to the video information of the participants, the operational information of the participants on the device is also important information to be recorded. Therefore, after receiving the instant recording request sent by the first client, the live broadcast center station collects the video signal and screen information of the client corresponding to the client ID and sends the video signal and screen information to the first client. The screen information collection can be realized by a screen sharing mode.
The online transaction video recording method provided by the invention can record equipment information besides the video of the participant, thereby improving the comprehensiveness of the reserved information.
Fig. 12 is a schematic diagram of an online transaction video recording method according to the present invention. As shown in fig. 12, the online transaction audio and video recording scheme is based on audio and video capability, and takes audio and video cloud capability as an example, actually, a self-built manner can be adopted to improve audio and video basic capability, and a certain cloud is not necessarily required to be relied on. The key capabilities of the scheme are 'instant recording' and 'whole-course recording', wherein the instant recording mainly aims at important signing links, such as recording signature nodes; and the whole process of recording is to record the whole face-signature process and the activities of each participant. The two functions are externally exposed for 'state holding' (comprising that the first client timely receives feedback information of the live broadcast center) and 'flexible layout', and can expose compact and high-availability recording service to a user with the aid of automatic splicing capability.
The invention provides an online transaction video recording method, which solves the technical problems that:
1. the whole signing process is recorded, fault tolerance is realized for various abnormal conditions, and the accuracy of the entering and exiting sequence of each user is ensured through layout design.
2. The state of the recording task is maintained, the accuracy of the recording task is ensured, and meanwhile, the change of the recording task can be fed back quickly.
3. Recording and splicing, ensuring correct splicing sequence, correct splicing quantity, maximized splicing efficiency, multi-task merging and the like.
The online transaction video recording method provided by the invention has the following technical effects:
1. the multi-angle recording records the pictures of all subscribers, including the participation and withdrawal sequences, and each signing process records the operation picture of the subscriber and the picture of the equipment at the same time, so that the information is sufficient.
2. The recording task has a state, and the state is immediately fed back to the user after being changed.
3. And the recording tasks are automatically spliced, and the video is recorded for a plurality of times and integrated under the condition of poor network conditions, and finally only the summarized video is exposed. The method is more friendly to the user using the video recording scheme, simpler, more humanized in recording effect and free from generating a large number of video fragments.
The online transaction video recording device provided by the invention is described below, and the online transaction video recording device described below and the online transaction video recording method described above can be correspondingly referred to each other.
Fig. 13 is a schematic structural diagram of an online transaction video recording device provided by the invention. As shown in fig. 13, the apparatus includes a task initiation module 10 and a video display module 20, wherein: the task initiation module 10 is configured to: monitoring information of a client entering and exiting a live broadcasting room, if the client is known to enter the live broadcasting room, starting a whole-process recording task, and displaying a video picture of the first client on a display window at a corresponding position on a canvas; the video display module 20 is configured to: monitoring information of other clients entering and exiting the live broadcasting room continuously, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients enter the live broadcasting room; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, and when the client exits from the live broadcasting room, the corresponding display window is reserved, and when the client is online again, the corresponding video picture is still displayed on the display window.
According to the online transaction video recording device provided by the invention, after the whole-process recording task is started, each client side displays the corresponding video picture on the display window on the canvas according to the entering sequence and the preset layout, so that multi-angle recording is realized, and the information of the first entering sequence of a user is reserved.
According to the online transaction video recording device provided by the invention, the room number of the live broadcasting room corresponds to the task ID of the whole-process recording task one by one; the device also comprises a splicing module, wherein the splicing module is used for: after generating a video clip, inquiring whether a task which is being spliced exists currently or not according to the task ID, if so, pushing the video clip into a task queue to be processed corresponding to the task ID; if not, judging whether the task queue to be processed has videos to be spliced or not, if so, splicing the video clips and the videos to be spliced to obtain a new summarized video and storing the new summarized video.
According to the online transaction video recording device provided by the invention, the task queue to be processed corresponding to the task ID is set, and the video to be spliced in the task queue to be processed and the newly produced video segments are spliced according to the task ID to obtain the new summarized video, so that the splicing of the video segments is realized, the complete video is obtained, and the video watching requirement is met.
According to the online transaction video recording device provided by the invention, the device further comprises an instant recording module, wherein the instant recording module is used for: receiving an instant recording request sent by a first client, wherein the instant recording request comprises a client ID to be recorded; wherein, the first client side has instant recording authority; generating an instant recording task according to the instant recording request, wherein the instant recording task is used for recording the video of the client corresponding to the client ID; and generating a serial number corresponding to the instant recording task, and sending the serial number to the first client.
According to the online transaction video recording device, after the instant recording request is received, the instant recording task is generated, the serial number corresponding to the instant recording task is generated, and the serial number is sent to the first client, so that the first client can conveniently inquire the task state according to the serial number.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is failure, sending information of recording failure starting to the first client.
The online transaction video recording device provided by the invention realizes the feedback of the task state by acquiring the information of recording task failure through the serial number.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; and if the recording task state is recording, sending information that recording is started to the first client.
According to the online transaction video recording device provided by the invention, the successful recording information of the recording task is obtained through the serial number, so that the feedback of the task state is further realized.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving recording ending request information sent by the first client, wherein the recording ending request information comprises the serial number; and acquiring the recording task state according to the serial number, and returning recording success ending information to the first client if recording is completed.
According to the online transaction video recording device, after receiving the recording ending request information of the first client, the recording task state is obtained through the serial number, the task state is updated when recording is completed, and the information of successful recording ending is returned, so that the feedback of the task state is further realized.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number; acquiring a recording task state according to the serial number; if the recording task state is an abnormal state, acquiring that the abnormal state belongs to recording failure or recording overtime, and sending the information of the abnormal state to the first client.
According to the online transaction video recording device, after the recording task state query request of the first client is received, the recording task state is obtained through the serial number, and the abnormal state is fed back when the recording task state is abnormal, so that the task state feedback is further realized.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for receiving the instant recording request sent by the first client, and then is also used for: and if the number of the client IDs is multiple, the audio and video streams of the clients corresponding to the multiple client IDs are mixed and then sent to the first client.
The online transaction video recording device provided by the invention is convenient for intensively displaying the multiple paths of video streams by mixing the multiple paths of streams.
According to the online transaction video recording device provided by the invention, the instant recording module is further used for: and acquiring video signals and screen information of the client corresponding to the client ID, and transmitting the video signals and the screen information to the first client.
The online transaction video recording device provided by the invention can record equipment information besides the video of the participators, so that the comprehensiveness of information retention is improved.
Fig. 14 is a schematic structural diagram of an electronic device according to the present invention, and as shown in fig. 14, the electronic device may include: processor 1410, communication interface (Communications Interface) 1420, memory 1430 and communication bus 1440, wherein processor 1410, communication interface 1420 and memory 1430 communicate with each other via communication bus 1440. Processor 1410 may invoke logic instructions in memory 1430 to perform an online transaction video recording method comprising: monitoring information of a client entering and exiting a live broadcasting room, if the client is known to enter the live broadcasting room, starting a whole-process recording task, and displaying a video picture of the first client on a display window at a corresponding position on a canvas; monitoring information of other clients entering and exiting the live broadcasting room continuously, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients enter the live broadcasting room; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, and when the client exits from the live broadcasting room, the corresponding display window is reserved, and when the client is online again, the corresponding video picture is still displayed on the display window.
In addition, the logic instructions in the memory 1430 described above may be implemented in the form of software functional units and may be stored in a computer readable storage medium when sold or used as a stand alone product. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
In another aspect, the present invention also provides a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, enable the computer to perform the method of recording an online transaction provided by the methods described above, the method comprising: monitoring information of a client entering and exiting a live broadcasting room, if the client is known to enter the live broadcasting room, starting a whole-process recording task, and displaying a video picture of the first client on a display window at a corresponding position on a canvas; monitoring information of other clients entering and exiting the live broadcasting room continuously, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients enter the live broadcasting room; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, and when the client exits from the live broadcasting room, the corresponding display window is reserved, and when the client is online again, the corresponding video picture is still displayed on the display window.
In yet another aspect, the present invention provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, is implemented to perform the online transaction video recording methods provided above, the method comprising: monitoring information of a client entering and exiting a live broadcasting room, if the client is known to enter the live broadcasting room, starting a whole-process recording task, and displaying a video picture of the first client on a display window at a corresponding position on a canvas; monitoring information of other clients entering and exiting the live broadcasting room continuously, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients enter the live broadcasting room; and each client displays corresponding video pictures on the display window on the canvas according to the entering sequence and the preset layout, and when the client exits from the live broadcasting room, the corresponding display window is reserved, and when the client is online again, the corresponding video picture is still displayed on the display window.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. An online transaction video recording method, comprising:
monitoring information of a client entering and exiting a live broadcasting room, if the client is known to enter the live broadcasting room, starting a whole-process recording task, and displaying a video picture of the first client on a display window at a corresponding position on a canvas; the whole recording task is used for recording pictures of all subscribers;
monitoring information of other clients entering and exiting the live broadcasting room continuously, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients enter the live broadcasting room; each client displays corresponding video pictures on display windows on the canvas according to an entering sequence and a preset layout, and when the client exits from a living broadcast room, the corresponding display windows are reserved, wherein the reservation means that the display windows still belong to the exiting client and cannot be distributed to other clients, and when the client is online again, the corresponding video pictures are still displayed on the display windows;
receiving an instant recording request sent by a first client, wherein the instant recording request comprises a client ID to be recorded; wherein, the first client side has instant recording authority; and generating an instant recording task according to the instant recording request, wherein the instant recording task is used for recording the video of the client corresponding to the client ID.
2. The online transaction video recording method according to claim 1, wherein a room number of the live broadcasting room and a task ID of the whole-process recording task are in one-to-one correspondence; the method further comprises the steps of:
after generating a video clip, inquiring whether a task which is being spliced exists currently or not according to the task ID, if so, pushing the video clip into a task queue to be processed corresponding to the task ID; if not, judging whether the task queue to be processed has videos to be spliced or not, if so, splicing the video clips and the videos to be spliced to obtain a new summarized video and storing the new summarized video.
3. The online transaction video recording method according to claim 1, wherein the method further comprises:
and generating a serial number corresponding to the instant recording task, and sending the serial number to the first client.
4. The online transaction video recording method as recited in claim 3, further comprising:
receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number;
acquiring a recording task state according to the serial number; and if the recording task state is failure, sending information of recording failure starting to the first client.
5. The online transaction video recording method as recited in claim 3, further comprising:
receiving a recording task state query request of the first client, wherein the recording task state query request comprises the serial number;
acquiring a recording task state according to the serial number; and if the recording task state is recording, sending information that recording is started to the first client.
6. The online transaction video recording method according to claim 3, wherein after the receiving the instant recording request sent by the first client, the method further comprises:
and if the number of the client IDs is multiple, the audio and video streams of the clients corresponding to the multiple client IDs are mixed and then sent to the first client.
7. The online transaction video recording method according to claim 3, wherein after the receiving the instant recording request sent by the first client, the method further comprises:
and acquiring video signals and screen information of the client corresponding to the client ID, and transmitting the video signals and the screen information to the first client.
8. An online transaction video recording device, comprising:
The task starting module is used for: monitoring information of a client entering and exiting a live broadcasting room, if the client is known to enter the live broadcasting room, starting a whole-process recording task, and displaying a video picture of the first client on a display window at a corresponding position on a canvas; the whole recording task is used for recording pictures of all subscribers;
a video display module for: monitoring information of other clients entering and exiting the live broadcasting room continuously, and displaying video pictures of the other clients on display windows at corresponding positions on the canvas when the other clients enter the live broadcasting room; each client displays corresponding video pictures on display windows on the canvas according to an entering sequence and a preset layout, and when the client exits from a living broadcast room, the corresponding display windows are reserved, wherein the reservation means that the display windows still belong to the exiting client and cannot be distributed to other clients, and when the client is online again, the corresponding video pictures are still displayed on the display windows;
the instant recording module is used for: receiving an instant recording request sent by a first client, wherein the instant recording request comprises a client ID to be recorded; wherein, the first client side has instant recording authority; and generating an instant recording task according to the instant recording request, wherein the instant recording task is used for recording the video of the client corresponding to the client ID.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the online transaction video method of any one of claims 1 to 7 when the program is executed by the processor.
10. A non-transitory computer readable storage medium having stored thereon a computer program, which when executed by a processor performs the steps of the online transaction video recording method as claimed in any one of claims 1 to 7.
CN202011340213.0A 2020-11-25 2020-11-25 Online transaction video recording method and device Active CN112653859B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011340213.0A CN112653859B (en) 2020-11-25 2020-11-25 Online transaction video recording method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011340213.0A CN112653859B (en) 2020-11-25 2020-11-25 Online transaction video recording method and device

Publications (2)

Publication Number Publication Date
CN112653859A CN112653859A (en) 2021-04-13
CN112653859B true CN112653859B (en) 2023-06-09

Family

ID=75349432

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011340213.0A Active CN112653859B (en) 2020-11-25 2020-11-25 Online transaction video recording method and device

Country Status (1)

Country Link
CN (1) CN112653859B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114390239B (en) * 2021-12-23 2022-11-25 北京百度网讯科技有限公司 Communication method, device, system, electronic device, and storage medium

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100547604C (en) * 2006-03-27 2009-10-07 李克 The logistics enquiring system that has electronic tag video
CN105872581A (en) * 2016-05-31 2016-08-17 深圳市佑嘉互动科技有限公司 System and method for providing video direct broadcasting room services
CN108460560A (en) * 2018-04-03 2018-08-28 孙利嫚 A kind of the commodity online trading system and its online transaction method of internet identification
CN110996037A (en) * 2019-11-14 2020-04-10 苏州中车建设工程有限公司 Multipoint video conference picture display system and control method thereof
CN111698451B (en) * 2020-06-17 2022-07-08 北京天威诚信电子商务服务有限公司 Video conference-based electronic contract signing method, platform and system
CN111898977A (en) * 2020-07-22 2020-11-06 北京厚泽人力资源有限公司 Electronic signing system and method

Also Published As

Publication number Publication date
CN112653859A (en) 2021-04-13

Similar Documents

Publication Publication Date Title
US9621958B2 (en) Deferred, on-demand loading of user presence within a real-time collaborative service
US9723242B1 (en) Video conferencing system and method
CN110381326B (en) Video system, processing method, device and computer readable medium
CN111163330A (en) Live video rendering method, device, system, equipment and storage medium
CN111246238A (en) Live broadcast method, device, storage medium and live broadcast system
CN112653859B (en) Online transaction video recording method and device
KR20220090411A (en) Method, apparatus and device of live game broadcasting
CN111818383B (en) Video data generation method, system, device, electronic equipment and storage medium
CN112291502A (en) Information interaction method, device and system and electronic equipment
CN112911325B (en) Method and device for recovering inter-live-broadcast room connection
CN112511739B (en) Interactive information generation method and equipment
CN111327910A (en) Operation control method, device and equipment of application program and storage medium
CN114257572B (en) Data processing method, device, computer readable medium and electronic equipment
CN109348298B (en) Method and equipment for pushing and playing multimedia data stream
US11838338B2 (en) Method and device for conference control and conference participation, server, terminal, and storage medium
CN112165597B (en) Data approval method and device based on multiparty video
CN113099247B (en) Virtual resource processing method, device, server, storage medium and program product
CN113271474B (en) Method, device, equipment and storage medium for testing streaming media server
CN111885167B (en) Data synchronization method, device, electronic equipment and storage medium
CN110635993B (en) Method and apparatus for synthesizing multimedia information
CN112637618A (en) Live playback video generation method and device, electronic equipment and computer medium
CN113420133A (en) Session processing method, device, equipment and storage medium
CN108768830B (en) Method and equipment for pushing information and displaying information
CN114255021A (en) Resource transfer method, device, medium and electronic equipment
CN115086408B (en) Data processing method, system, device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant