CN107332830B - Video code conversion, video broadcasting method and device, computer equipment, storage medium - Google Patents
Video code conversion, video broadcasting method and device, computer equipment, storage medium Download PDFInfo
- Publication number
- CN107332830B CN107332830B CN201710466100.7A CN201710466100A CN107332830B CN 107332830 B CN107332830 B CN 107332830B CN 201710466100 A CN201710466100 A CN 201710466100A CN 107332830 B CN107332830 B CN 107332830B
- Authority
- CN
- China
- Prior art keywords
- video
- information
- image analysis
- video flowing
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 238000006243 chemical reaction Methods 0.000 title claims description 21
- 238000010191 image analysis Methods 0.000 claims abstract description 122
- 238000012545 processing Methods 0.000 claims abstract description 48
- 238000012544 monitoring process Methods 0.000 claims description 30
- 230000008569 process Effects 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 9
- 230000005540 biological transmission Effects 0.000 claims description 8
- 238000000605 extraction Methods 0.000 claims description 6
- 238000007781 pre-processing Methods 0.000 claims description 5
- 238000005538 encapsulation Methods 0.000 claims description 2
- 230000010365 information processing Effects 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 19
- 238000004458 analytical method Methods 0.000 description 12
- 238000004891 communication Methods 0.000 description 8
- 238000012163 sequencing technique Methods 0.000 description 2
- 238000012550 audit Methods 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000005641 tunneling Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/765—Media network packet handling intermediate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
A kind of video transcoding method and device, video broadcasting method and device, computer equipment and storage medium, the video transcoding method of one embodiment include: the first video flowing for receiving collection terminal and uploading；According to the first transport protocol message between the collection terminal and server, the first decapsulation processing is carried out to first video flowing, obtains the second video flowing；According to the second transport protocol message between server and playback terminal, second video flowing is packaged, obtains third video flowing, and the third video is flowed into playback terminal and is sent；Image analysis is carried out to second video flowing, obtains image analysis result, result is analyzed according to described image and sends image analysis information to the playback terminal.This embodiment scheme improves the picture quality of the video played out after transcoding, and helps to reduce the processing load of server.
Description
Technical field
The present invention relates to video technique fields, more particularly to a kind of video transcoding method, a kind of video code conversion device, one
Kind video broadcasting method, a kind of video play device, a kind of computer equipment and a kind of storage medium.
Background technique
In fields such as current intelligent monitoring, the live streaming of face stage property, intelligent picture recognitions, it will usually which it is right according to demand to need
Video flowing carries out transcoding processing.Traditional transcoding processing mode, is first decoded to original video stream, and it is new for then recompiling again
Video flowing.With the increase of intelligent use, after being decoded to original video stream, it is also necessary to carry out video point to video flowing
Analysis, and the result of video analysis is presented to user.For this demand of intelligent use, based on traditional video code conversion side
Formula is first to be decoded by server to video flowing, and do image analysis to decoded every frame image, then by image analysis result
Simultaneously re-compression and encoding is new video flowing to the decoded video flowing that is added to, and is sent to each terminal and is presented to the user.This
Kind video code conversion mode needs to carry out secondary coding, seriously reduces picture quality, while also increasing the burden of server.
Summary of the invention
Based on this, the embodiment of the present invention provides a kind of video transcoding method, a kind of video code conversion device, a kind of video playing
Method, a kind of video play device, a kind of computer equipment and a kind of storage medium, to improve the view played out after transcoding
The picture quality of frequency, and help to reduce the processing load of server.
A kind of video transcoding method is applied to server, comprising steps of
Receive the first video flowing that collection terminal uploads；
According to the first transport protocol message between the collection terminal and server, first is carried out to first video flowing
Decapsulation processing, obtains the second video flowing；
According to the second transport protocol message between server and playback terminal, second video flowing is packaged,
Third video flowing is obtained, and the third video is flowed into playback terminal and is sent；
To second video flowing carry out image analysis, obtain image analysis result, according to described image analyze result to
The playback terminal sends image analysis information.
A kind of video broadcasting method is applied to playback terminal, comprising steps of
The third video flowing that server is sent is received, and is believed according to the second transport protocol between server and playback terminal
Breath carries out the second decapsulation processing to third video flowing, obtains the second video flowing；
It is sending with the associated image analysis information of the second video flowing to receive the server；
It is played out after described image analysis information is added to second video flowing.
A kind of video code conversion device is applied to server, comprising:
First receiving module, for receiving the first video flowing of collection terminal upload；
First decapsulation module, for according to the first transport protocol message between the collection terminal and server, to institute
It states the first video flowing and carries out the first decapsulation processing, obtain the second video flowing；
Package module, for being regarded to described second according to the second transport protocol message between server and playback terminal
Frequency stream is packaged, and obtains third video flowing, and the third video is flowed to playback terminal and is sent；
Image analysis module obtains image analysis result for carrying out image analysis to second video flowing；
Information sending module is analyzed, sends image analysis letter to the playback terminal for analyzing result according to described image
Breath.
A kind of video play device is applied to playback terminal, comprising:
Second receiving module, for receiving the third video flowing of server transmission, and according to server and playback terminal it
Between the second transport protocol message, to third video flowing carry out the second decapsulation processing, obtain the second video flowing；
Information receiving module is analyzed, for receiving dividing with the associated image of the second video flowing for the server transmission
Analyse information；
It is superimposed playing module, for playing out after described image analysis information is added to second video flowing.
A kind of computer equipment, including memory, processor and be stored on the memory and can be in the processing
The computer program run on device, the processor realize method as described above when executing the computer program.
A kind of computer storage medium, is stored thereon with computer program, realizes when which is executed by processor as above
The method.
Based on the scheme of embodiment as described above, server is receiving the first video flowing of collection terminal upload and base
The first transport protocol message between collection terminal after the second video flowing, will directly regard the first decoding video stream to second
Frequency stream is encapsulated as sending playback terminal after third video flowing with the second transport protocol message between playback terminal, and server is another
One side carries out image analysis to above-mentioned second video flowing and obtains image analysis result, and whole to playing based on image analysis result
End sends image analysis information, and playback terminal receives third video flowing and image analysis information respectively, and to third video flowing solution
Code, which obtains image analysis information is added to the second video flowing after the second video flowing, to be played out, thus, server is being regarded
During frequency transcoding, although having carried out the processing of image analysis, it is not necessarily based on image analysis result and video is flowed into
Row secondary coding to reduce the processing load of server, and improves the efficiency of video code conversion, saves transcoding resource,
When playback terminal plays out, directly image analysis information is added in the second video flowing and is played out, improved and turn
The picture quality of the video played out after code.
Detailed description of the invention
Fig. 1 is the schematic diagram of the working environment of a this embodiment scheme；
Fig. 2 is the schematic diagram of the composed structure of the server of one embodiment；
Fig. 3 is the schematic diagram of the composed structure of the playback terminal of one embodiment；
Fig. 4 is the flow diagram of the video transcoding method of one embodiment；
Fig. 5 is the flow diagram of the video broadcasting method of one embodiment；
Fig. 6 is the schematic diagram of the interaction flow based on this embodiment scheme in a concrete application example；
Fig. 7 is one based on the process structure schematic diagram in an exemplary concrete application shown in Fig. 6；
Fig. 8 is the structural schematic diagram of the video code conversion device of one embodiment；
Fig. 9 is the structural schematic diagram of the video play device of one embodiment.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention more comprehensible, with reference to the accompanying drawings and embodiments, to this
Invention is described in further detail.It should be appreciated that the specific embodiments described herein are only used to explain the present invention,
And the scope of protection of the present invention is not limited.
Unless otherwise defined, all technical and scientific terms used herein and belong to technical field of the invention
The normally understood meaning of technical staff is identical.Term as used herein in the specification of the present invention is intended merely to description tool
The purpose of the embodiment of body, it is not intended that in the limitation present invention.Term as used herein " and/or " it include one or more phases
Any and all combinations of the listed item of pass.
Fig. 1 shows the working environment schematic diagram in one embodiment of the invention, as shown in Figure 1, its working environment is related to
Acquisition terminal 101, server 102 and playback terminal 103, acquisition terminal 101, playback terminal 103 and server 102 can lead to
Network is crossed to be communicated.After the video stream to server 102 that acquisition terminal 101 acquires, broadcasting is forwarded to by server 102
Terminal 103 plays out.Communication mode between acquisition terminal 101 and server 102, for example, by using communication protocol or number
According to tunneling, may be the same or different with the communication mode between playback terminal 103 and server 102.In difference
When, server 102 needs to carry out transcoding to the video flowing that acquisition terminal 101 is sent, and playback terminal 103 is correctly parsed
And it decodes correct video stream data and plays out.The acquisition terminal 101 can be and any can acquire video data and will adopt
Collect the video data obtained with video stream to the equipment of server, as shown in Figure 1, can be mobile terminal, such as mobile phone,
Tablet computer can also be personal computer, the equipment that can realize video monitoring with camera etc..
Fig. 2 is the composed structure schematic diagram of server 102 in one embodiment.As shown in Fig. 2, server includes passing through to be
Processor, power supply module, storage medium, memory and the communication interface of bus of uniting connection.Wherein, the processor is for providing calculating
And control ability, support the operation of entire server.The storage medium of server is stored with operating system, database and a kind of view
When the computer applied algorithm of the computer applied algorithm of frequency transcoding device, the video code conversion device is executed by processor, realize
A kind of video transcoding method.The operation that the video code conversion device in storage medium is saved as in server provides environment, communication
Interface is used to carry out network communication with collection terminal and playback terminal.It will be understood by those skilled in the art that knot shown in Figure 2
Structure, only the block diagram of part-structure relevant to example scheme, does not constitute and is applied thereon to this embodiment scheme
Server restriction, specific server may include than more or fewer components as shown in the figure, or the certain portions of combination
Part, or with different component layouts.
The structural schematic diagram of playback terminal 103 in one embodiment is as shown in Figure 3.The playback terminal 103 includes passing through
Processor, non-volatile memory medium, communication interface, power interface and the memory of system bus connection.Wherein, playback terminal
103 processor supports the operation of entire playback terminal 103 for providing calculating and control ability.Playback terminal 103 it is non-easily
The property lost storage medium is stored with operating system and a kind of computer applied algorithm of video play device, the video play device quilt
When processor executes, a kind of video broadcasting method is realized.The memory of playback terminal 103 is the view in non-volatile memory medium
The operation of frequency playing device provides environment, should.The network interface of playback terminal 103 is used to pass through network connection with server 102
And communication, for the power interface of playback terminal 103 for connecting with external power supply, external power supply is whole to playing by the power interface
103 power supply of end.Playback terminal 103 can be any equipment that can be realized video playing, such as personal computer, movement
Terminal, such as mobile phone, tablet computer etc.；It is also possible to other equipment with above structure.
The flow diagram of the video transcoding method in one embodiment is shown in Fig. 4, this method is applied to server
102, as shown in figure 4, the video transcoding method in the embodiment includes:
Step S401: the first video flowing that collection terminal uploads is received；
Step S402: according to the first transport protocol message between the collection terminal and server, to first video
Stream carries out the first decapsulation processing, obtains the second video flowing；
Step S403: according to the second transport protocol message between server and playback terminal, to second video flowing
It is packaged, obtains third video flowing, and the third video is flowed into playback terminal and is sent；
Step S404: image analysis is carried out to second video flowing, obtains image analysis result, according to described image point
It analyses result and sends image analysis information to the playback terminal.
It is appreciated that above-mentioned steps S404 and step S403 and does not have sequencing, obtain second in step S402
After video flowing, the process of step S403 and the process of step S404 can be with parallel processings.
Scheme based on the embodiment, server are not necessarily based on image point although having carried out image analysis processing
It analyses result and secondary coding is carried out to video flowing, facilitate the processing load for reducing server, improve the efficiency of video code conversion, take
Third video flowing and image analysis information are given to playback terminal by business device, thus when playback terminal plays out, directly by image
Analysis information, which is added in the second video flowing, to be played out, and the picture quality of the video played out after transcoding is improved.
Wherein, in above-mentioned image analysis information, the position to be shown in the video frame of second video flowing can be carried
The location information set.So that playback terminal after receiving image analysis information, can be based on the location information, by phase
It closes in the video frame for the corresponding position that information is added in the second video flowing and then plays out.
In one example, after above-mentioned acquisition image analysis result, image analysis letter is sent to the playback terminal
It, can be comprising steps of carrying out information categorization and/or calibration processing to described image analysis result before breath.At this point, above-mentioned figure
As analysis information includes the information categorization and/or calibration treated processing result.
Fig. 5 shows the flow diagram of the video broadcasting method in one embodiment, and this method is applied to playback terminal.
As shown in figure 5, the video broadcasting method in the embodiment includes:
Step S501: the third video flowing that server is sent is received, and according to second between server and playback terminal
Transport protocol message carries out the second decapsulation processing to third video flowing, obtains the second video flowing；
Step S502: it is sending with the associated image analysis information of the second video flowing to receive the server；
Step S503: it is played out after described image analysis information is added to second video flowing.
To, for playback terminal, be receive third video flowing and image analysis information respectively from server, and
Image information is added to and is played out to after third video flowing decapsulation treated the second video flowing, that is, it is from service
There is no superimposed images to analyze information for the received third video flowing of device, it is ensured that the image matter of the video played out after transcoding
Amount.
Wherein, in above-mentioned image analysis information, the position to be shown in the video frame of second video flowing can be carried
The location information set.So that playback terminal after receiving image analysis information, can be based on the location information, by phase
It closes in the video frame for the corresponding position that information is added in the second video flowing and then plays out.
Based on embodiment as described above, Fig. 6 shows the friendship based on this embodiment scheme in a concrete application example
The schematic diagram of mutual process comprising step S601 to step S608, the schematic diagram of the process structure of corresponding concrete application such as Fig. 7
It is shown.In shown in Fig. 6, Fig. 7, be with and meanwhile contain the video code conversion process of server and the video playing mistake of playback terminal
It is illustrated for journey.
In conjunction with shown in Fig. 6, Fig. 7, in step s 601, collection terminal is needing after collecting video data to server
When sending video flowing, the video data of acquisition is sent to server in a manner of video flowing.In order to which video flowing is transmitted
To server, collection terminal need based on it between server transport protocol (for convenient for server between playback terminal
Transport protocol distinguish, become the first transport protocol in this example), video flowing is packaged, the first transport protocol is obtained
Video flowing after encapsulation is known as the first video flowing in this example, then will be to the first video stream to server.Collection terminal can
With it is any may or need when be packaged into the first video flowing and be sent to server, specific limit is not done in the present embodiment
It is fixed.For example, when the collection terminal is video monitoring equipment, collection terminal can be every one for field of video monitoring
Collected video data is just sent to server in a manner of the first video flowing by the period, to embody the real-time of video monitoring
Property.For net cast field, collection terminal can be the terminal device being broadcast live, and can be and opening live streaming
Afterwards, then by the live video data of acquisition it is sent to server.Need to send the fields of video data in others, it can also be
The other desired moment sends video flowing.
After server receives the first video flowing of collection terminal upload, in step S602, according to server and acquisition
The information for holding the first transport protocol communicated carries out the first decapsulation processing to the first video flowing, obtains the first decapsulation
Video flowing after processing is known as the second video flowing in this example.It is appreciated that collection terminal takes to give video data transmission
Business device needs to be packaged the video data of acquisition using the first transport protocol between collection terminal and server, i.e., first
It include the related words about the first transport protocol being packaged based on the first transport protocol to video data in video flowing
Section.When carry out first is decapsulated and handled, by being parsed to these relevant fields, it is hereby achieved that actual complete
Video data, this not video data about the field of the first transport protocol, as above-mentioned second video flowing.
Server is after obtaining the second video flowing, on the one hand, in step S603, according between server and playback terminal
The second transport protocol message, second video flowing is packaged, third video flowing is obtained, and in step s 604 by institute
It states third video and flows to playback terminal transmission.As it can be seen that video data of the server into the third video flowing that playback terminal is sent,
It is original video data, is not superimposed other information, to helps to improve the play quality of video.
Server is after obtaining the second video flowing, and on the other hand, in step s 605, server is also to second video flowing
Image analysis is carried out, image analysis result is obtained.After obtaining image analysis result, image analysis result can also be carried out
Information categorization and/or calibration processing.
Specifically to the second video flowing carry out image analysis process, can by the way of any progress image analysis into
Row, as long as correspondence image analysis result can be obtained.The mode of specific image analysis, can have with applied field
It closes.
In one example, for applying in field of video monitoring, it can be and as shown in Figure 7 flow into the second video
After the decoding of row video is converted to a kind of YUV (also known as YCrCb, colour coding method) format, image preprocessing, figure are successively carried out
As feature extraction, characteristic value is determining and obtains the processing of intelligent recognition information, in other examples, can also use it
His mode carries out image analysis processing.At this point, the image analysis result of above-mentioned acquisition can be whether corresponding target prison
Control event as a result, for example, if there is target monitoring personage, target object whether occur, target emergency event whether occur
Deng.It specifically to the mode of image characteristics extraction, can be carried out using existing any possible mode, such as based on depth
Mode, the mode of cascade sort of habit.After whether acquisition has the result of corresponding target monitoring event, it can also be divided
, e.g. there is target monitoring personage and target emergency event still occur in class and calibration processing, know to obtain final intelligence
Other information, i.e., above-mentioned image analysis information.It is appreciated that the image analysis information may include whether target occur based on above-mentioned
Monitoring personage, analysis result target object whether occur, target emergency event whether occur etc. information, such as appearance
The specific markers (such as watermark, special efficacy, sound) of target monitoring personage, for there is specific markers (such as water of target emergency event
Print, special efficacy, sound), while further including the location information for having each information relative to the second video flowing, it is specific in order to navigate to
Video frame.
In one example, for being applied to net cast field, image analysis mode can be can with it is above-mentioned
It is handled for the similar mode of monitor video, for example whether target monitoring personage occur, target object whether occur, whether occur
The security audit to live video stream may be implemented in target emergency event etc. accordingly.In net cast field, there can also be it
His intellectual analysis processing, such as the gift in live video stream during addition advertisement, addition watermark, addition special efficacy, live streaming
The information of commodity etc. sold during object information, live streaming.The image analysis information finally obtained may include having based on upper
State the letter for analysis result target monitoring personage whether occur, target object whether occur, target emergency event whether occur etc.
Breath, for example, for the specific markers (such as watermark, special efficacy, sound) for target monitoring personage occur, for there is target emergency event
Specific markers (such as watermark, special efficacy, sound), while can also have advertisement, the watermark, spy added for second video flowing itself
The information of effect, present, commodity, while further including the position for having each information position to be shown in the video frame of the second video flowing
Information, in order to the position navigated in specific video frame and video frame.For needing the mistake in entire video render
The case where all being shown in journey, corresponding location information can be sky, indicate to need whole display with default, be also possible to
The needs that location information is set as setting are carried out to the mark information of whole display.It is appreciated that in other embodiments, it can also
To be that the mark information that the needs carry out whole display is arranged in the other positions of image analysis information.
In one example, for being applied to educational video field, the image obtained after image analysis point is carried out
Analysis is as a result, can be the relevant informations such as some labels of addition, watermark, special efficacy, while further including having each information relative to second
The location information of position in the video frame of video flowing, in order to the position navigated in specific video frame and frame.
As it can be seen that in the scheme of the present embodiment, the mode that service implement body is analyzed to obtain image analysis information can be with
It is carried out using various possible modes, the different modes for obtaining image analysis information can be applied to the video of the present embodiment
During transcoding, it is added to the image analysis played out on the second video flowing as long as can finally obtain convenient for playback terminal
Information.It is appreciated that the image analysis information carries location information, which can be vector position information.
After obtaining image analysis information, in step S606, which can be also sent to broadcasting by server
Terminal plays out convenient for playback terminal.
Playback terminal is after receiving third video flowing, in step S607, according between server and playback terminal
The second transport protocol message, to third video flowing carry out the second decapsulation processing, obtain the second video flowing.Playback terminal also connects
Receive server send with the associated image analysis information of the second video flowing.It is appreciated that playback terminal receives third video flowing
With the process of image analysis information, may and not have strict sequence as shown in FIG. 6, for example, receiving third view
During frequency flows, while image analysis information is received, as long as when carrying out intelligent connecting or to add image analysis information,
The video flowing and image analysis information of corresponding position have been received.In certain application scenarios, decapsulated above-mentioned
It can also be yuv format and then progress intelligent connecting processing by second decoding video stream to after the second video flowing.
Then, in step S608, playback terminal carries out intelligence to the image analysis information received and the second video flowing
Image analysis information, i.e., be added in the second video flowing, in order to which image analysis information can be based on the second video flowing by splicing
Broadcasting and play display.The specific mode for carrying out intelligent connecting can be carried out using any possible mode, such as based on
Corresponding information is added to the corresponding position of the second video flowing, specifically by the location information carried in image analysis information
Intelligent connecting or the mode of addition, the present embodiment are not specifically limited.
As it can be seen that the mode as described above based on the present embodiment, server does not carry out two to video in transcoding process
Secondary coding improves picture quality, and reduces the processing load of server, and improves the efficiency of video code conversion, Er Qiejie
Transcoding resource is saved；And playback terminal is to be added to the second video flowing after the image analysis information for receiving server transmission
In, so that playback terminal can flexibly be handled according to various demands, realize personalization.
Fig. 8 shows the structural schematic diagram of the video code conversion device in one embodiment, which is set to
Server.As shown in figure 8, the device in the embodiment includes:
First receiving module 801, for receiving the first video flowing of collection terminal upload；
First decapsulation module 802 is right for according to the first transport protocol message between the collection terminal and server
First video flowing carries out the first decapsulation processing, obtains the second video flowing；
Package module 803, for according to the second transport protocol message between server and playback terminal, to described second
Video flowing is packaged, and obtains third video flowing, and the third video is flowed to playback terminal and is sent；
Image analysis module 804 obtains image analysis result for carrying out image analysis to second video flowing；
Information sending module 805 is analyzed, sends image point to the playback terminal for analyzing result according to described image
Analyse information.
It is appreciated that the treatment process of above-mentioned package module 803 and image analysis module 804 and does not have sequencing,
After the first decapsulation module 802 obtains the second video flowing, package module 803 can be located parallel with image analysis module 804
Reason.
Scheme based on the embodiment, server are not necessarily based on image point although having carried out image analysis processing
It analyses result and secondary coding is carried out to video flowing, to reduce the processing load of server, and improve the efficiency of video code conversion,
Transcoding resource is saved, third video flowing and image analysis information are given to playback terminal by server, so that playback terminal carries out
When broadcasting, directly image analysis information is added in the second video flowing and is played out, played out after improving transcoding
Video picture quality.
Wherein, in above-mentioned image analysis information, the position to be shown in the video frame of second video flowing can be carried
The location information set.So that playback terminal after receiving image analysis information, can be based on the location information, by phase
It closes and is played out in the video frame for the corresponding position that information is added in the second video flowing.
In one example, as shown in figure 8, the video code conversion device in the embodiment can also include:
Processing module 806, for carrying out information categorization and/or calibration processing to described image analysis result.
At this point, above-mentioned image analysis information includes the information categorization and/or calibration treated processing result.
Fig. 9 shows the structural schematic diagram of the video play device in one embodiment, the video play device setting or
Applied to playback terminal.As shown in figure 9, the video play device in the embodiment includes:
Second receiving module 901, for receiving the third video flowing of server transmission, and according to server and playback terminal
Between the second transport protocol message, to third video flowing carry out the second decapsulation processing, obtain the second video flowing；
Information receiving module 902 is analyzed, it is sending with the associated figure of the second video flowing for receiving the server
As analysis information；
It is superimposed playing module 903, for playing out after described image analysis information is added to second video flowing.
To, for playback terminal, be receive third video flowing and image analysis information respectively from server, and
Image information is added to and is played out to after third video flowing decapsulation treated the second video flowing, that is, it is from service
There is no superimposed images to analyze information for the received third video flowing of device, it is ensured that the image matter of the video played out after transcoding
Amount.
Wherein, in above-mentioned image analysis information, the position to be shown in the video frame of second video flowing can be carried
The location information set.So that playback terminal after receiving image analysis information, can be based on the location information for phase
Information is closed to be added in the video frame of the corresponding position in the second video flowing.
It is appreciated that the specific implementation of video code conversion device, each module in video play device, can using with
Identical mode is handled in above method embodiment.
Based on example as described above, a kind of computer equipment is also provided in one embodiment, the computer equipment packet
The computer program that includes memory, processor and storage on a memory and can run on a processor, wherein processor executes
It realizes when described program such as the method in any one embodiment in the various embodiments described above.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, it is non-volatile computer-readable that the program can be stored in one
It takes in storage medium, in the embodiment of the present invention, which be can be stored in the storage medium of computer system, and by the calculating
At least one processor in machine system executes, and includes the process such as the embodiment of above-mentioned each method with realization.Wherein, described
Storage medium can be magnetic disk, CD, read-only memory (Read-Only Memory, ROM) or random access memory
(Random Access Memory, RAM) etc..
Accordingly, a kind of storage medium is also provided in one embodiment, is stored thereon with computer program, wherein the journey
It realizes when sequence is executed by processor such as the method in any one embodiment in the various embodiments described above.
Each technical characteristic of embodiment described above can be combined arbitrarily, for simplicity of description, not to above-mentioned reality
It applies all possible combination of each technical characteristic in example to be all described, as long as however, the combination of these technical characteristics is not deposited
In contradiction, all should be considered as described in this specification.
The embodiments described above only express several embodiments of the present invention, and the description thereof is more specific and detailed, but simultaneously
It cannot therefore be construed as limiting the scope of the patent.It should be pointed out that coming for those of ordinary skill in the art
It says, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to protection of the invention
Range.Therefore, the scope of protection of the patent of the invention shall be subject to the appended claims.
Claims (14)
1. a kind of video transcoding method is applied to server, which is characterized in that comprising steps of
The first video flowing that collection terminal uploads is received, first video flowing is to pass using first between collection terminal and server
Video flowing after the video data encapsulation that defeated agreement acquires collection terminal includes based on the first transport protocol in the first video flowing
The relevant field about the first transport protocol that video data is packaged；
According to the first transport protocol message between the collection terminal and server, the first deblocking is carried out to first video flowing
Dress processing, obtains the second video flowing；
According to the second transport protocol message between server and playback terminal, second video flowing is packaged, is obtained
Third video flowing, and the third video is flowed into playback terminal and is sent；
Image analysis is carried out to second video flowing, obtains image analysis result, result is analyzed to described according to described image
Playback terminal sends image analysis information；When the collection terminal is video monitoring equipment, described image analysis includes: by second
After video flowing progress video decoding is converted to yuv format, successively progress image preprocessing, image characteristics extraction, characteristic value are true
Determine and obtain the processing of intelligent recognition information；
It is applying in field of video monitoring, described image analysis result includes: whether target monitoring personage occur, if occurs
Target object, if target emergency event occur；
When being applied to net cast field, described image analysis result includes: whether target monitoring personage occur, if occurs
Target object, if target emergency event occur, the information of advertisement is added in live video stream, is added in live video stream
The information of watermark, adds the information of special efficacy in live video stream, and the present information during being broadcast live is sold during live streaming
The information of commodity.
2. video transcoding method according to claim 1, it is characterised in that:
It further comprises the steps of: and information categorization and/or calibration processing is carried out to described image analysis result；
Described image analysis information includes the information categorization and/or calibration treated processing result.
3. video transcoding method according to claim 1 or 2, it is characterised in that: described image analysis information is carried to aobvious
Show the location information of the position in the video frame of second video flowing.
4. video transcoding method according to claim 3, which is characterized in that needing the process in entire video render
In when all being shown, the location information is empty or is set as needing to carry out the mark information of whole display.
5. a kind of video broadcasting method is applied to playback terminal, which is characterized in that comprising steps of
The third video flowing that server is sent is received, and according to the second transport protocol message between server and playback terminal,
Second decapsulation processing is carried out to third video flowing, obtains the second video flowing；
It is sending with the associated image analysis information of the second video flowing to receive the server；Described image analyzes information
The server carries out image analysis to second video flowing, obtains image analysis result, analyzes result according to described image
It determines；When collection terminal is video monitoring equipment, described image analysis includes: that the second video flowing is carried out video decoding to be converted to
After yuv format, successively carries out image preprocessing, image characteristics extraction, characteristic value determination and obtain intelligent recognition information
Processing；
It is played out after described image analysis information is added to second video flowing；
It is applying in field of video monitoring, described image analysis result includes: whether target monitoring personage occur, if occurs
Target object, if target emergency event occur；
When being applied to net cast field, described image analysis result includes: whether target monitoring personage occur, if occurs
Target object, if target emergency event occur, the information of advertisement is added in live video stream, is added in live video stream
The information of watermark, adds the information of special efficacy in live video stream, and the present information during being broadcast live is sold during live streaming
The information of commodity.
6. video broadcasting method according to claim 5, which is characterized in that described image analyze information carry it is to be shown
The location information of position in the video frame of second video flowing.
7. video broadcasting method according to claim 6, which is characterized in that the location information be it is empty or be need into
When the mark information of the whole display of row, described image analysis information whole process during video render is shown.
8. a kind of video code conversion device is applied to server characterized by comprising
First receiving module, for receiving the first video flowing of collection terminal upload；
First decapsulation module, for according to the first transport protocol message between the collection terminal and server, to described
One video flowing carries out the first decapsulation processing, obtains the second video flowing；
Package module, for according to the second transport protocol message between server and playback terminal, to second video flowing
It is packaged, obtains third video flowing, and the third video is flowed into playback terminal and is sent；
Image analysis module obtains image analysis result for carrying out image analysis to second video flowing；In the acquisition
End be video monitoring equipment when, described image analysis include: by the second video flowing carry out video decoding be converted to yuv format it
Afterwards, image preprocessing, image characteristics extraction, characteristic value determination are successively carried out and obtains the processing of intelligent recognition information；
Information sending module is analyzed, sends image analysis information to the playback terminal for analyzing result according to described image；
It is applying in field of video monitoring, described image analysis result includes: whether target monitoring personage occur, if occurs
Target object, if target emergency event occur；
When being applied to net cast field, described image analysis result includes: whether target monitoring personage occur, if occurs
Target object, if target emergency event occur, the information of advertisement is added in live video stream, is added in live video stream
The information of watermark, adds the information of special efficacy in live video stream, and the present information during being broadcast live is sold during live streaming
The information of commodity.
9. video code conversion device according to claim 8, it is characterised in that:
Further include: processing module, for carrying out information categorization and/or calibration processing to described image analysis result；
Described image analysis information includes the information categorization and/or calibration treated processing result.
10. video code conversion device according to claim 8 or claim 9, it is characterised in that: described image analysis information is carried to aobvious
Show the location information of the position in the video frame of second video flowing.
11. a kind of video play device is applied to playback terminal characterized by comprising
Second receiving module, for receiving the third video flowing of server transmission, and according between server and playback terminal
Second transport protocol message carries out the second decapsulation processing to third video flowing, obtains the second video flowing；
Information receiving module is analyzed, for receiving believing with the associated image analysis of second video flowing for the server transmission
Breath；It is that the server carries out image analysis to second video flowing that described image, which analyzes information, obtains image analysis result,
Result is analyzed according to described image to determine；When collection terminal is video monitoring equipment, described image analysis includes: by the second video
Stream carry out video decoding be converted to yuv format after, successively carry out image preprocessing, image characteristics extraction, characteristic value determine with
And obtain the processing of intelligent recognition information；
It is superimposed playing module, for playing out after described image analysis information is added to second video flowing；
It is applying in field of video monitoring, described image analysis result includes: whether target monitoring personage occur, if occurs
Target object, if target emergency event occur；
When being applied to net cast field, described image analysis result includes: whether target monitoring personage occur, if occurs
Target object, if target emergency event occur, the information of advertisement is added in live video stream, is added in live video stream
The information of watermark, the present information in live video stream during the information of addition special efficacy, live streaming, sell during live streaming
The information of commodity.
12. video play device according to claim 11, which is characterized in that it is to be shown that described image analyzes information carrying
The location information of position in the video frame of second video flowing.
13. a kind of computer equipment, including memory, processor and it is stored on the memory and can be in the processor
The computer program of upper operation, which is characterized in that the processor realized when executing the computer program as claim 1 to
Method described in 7 any one.
14. a kind of computer storage medium, is stored thereon with computer program, which is characterized in that the program is executed by processor
Shi Shixian method as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710466100.7A CN107332830B (en) | 2017-06-19 | 2017-06-19 | Video code conversion, video broadcasting method and device, computer equipment, storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710466100.7A CN107332830B (en) | 2017-06-19 | 2017-06-19 | Video code conversion, video broadcasting method and device, computer equipment, storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107332830A CN107332830A (en) | 2017-11-07 |
| CN107332830B true CN107332830B (en) | 2019-02-12 |
Family
ID=60195485
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710466100.7A Active CN107332830B (en) | 2017-06-19 | 2017-06-19 | Video code conversion, video broadcasting method and device, computer equipment, storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107332830B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109376655A (en) * | 2018-10-25 | 2019-02-22 | 兰州工业学院 | A kind of analog platform of the pattern recognition method based on deep learning algorithm |
| CN110753243A (en) * | 2019-11-05 | 2020-02-04 | 深圳市巨潮科技股份有限公司 | Image processing method, image processing server and image processing system |
| CN112866786A (en) * | 2021-01-14 | 2021-05-28 | 视联动力信息技术股份有限公司 | Video data processing method and device, terminal equipment and storage medium |
| CN114007109B (en) * | 2021-10-28 | 2023-05-12 | 广州华多网络科技有限公司 | Mixed stream transcoding processing method and device, equipment, medium and product thereof |
| CN113992687B (en) * | 2021-12-28 | 2022-04-08 | 浙江宇视科技有限公司 | Intelligent service cluster scheduling method and device, electronic equipment and storage medium |
| CN118101987A (en) * | 2024-04-25 | 2024-05-28 | 广州开得联智能科技有限公司 | Data processing method, device, system and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101404767A (en) * | 2008-11-24 | 2009-04-08 | 崔天龙 | Parameter-variable automated video transcoding method based on image analysis and artificial intelligence |
| JP5100572B2 (en) * | 2008-08-25 | 2012-12-19 | キヤノン株式会社 | Encoder |
| CN103024445A (en) * | 2012-12-13 | 2013-04-03 | 北京百度网讯科技有限公司 | Cloud video transcode method and cloud server |
| CN103731631A (en) * | 2012-10-16 | 2014-04-16 | 华为软件技术有限公司 | Method, device and system for transmitting video image |
| CN106851332A (en) * | 2017-01-04 | 2017-06-13 | 北京百度网讯科技有限公司 | Video stream processing method, device and system |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101188756B (en) * | 2007-12-04 | 2010-06-09 | 武汉大学 | A code conversion method from MPEG-4 SP to AVX video |
| CN101640788B (en) * | 2008-07-29 | 2012-06-20 | 深圳市朗驰欣创科技有限公司 | Method and device for controlling monitoring and monitoring system |
| CN101583036B (en) * | 2009-06-22 | 2010-11-17 | 浙江大学 | Method for determining the relation between movement characteristics and high efficient coding mode in pixel-domain video transcoding |
| CN102014284B (en) * | 2010-12-10 | 2014-09-10 | 中兴通讯股份有限公司 | Method, system and device for acquiring parameter set value of video code stream in transcoding business |
| US20130101014A1 (en) * | 2011-10-25 | 2013-04-25 | Microsoft Corporation | Layered Screen Video Encoding |
| WO2015107672A1 (en) * | 2014-01-17 | 2015-07-23 | 富士通株式会社 | Image processing program, image processing method, and image processing device |
-
2017
- 2017-06-19 CN CN201710466100.7A patent/CN107332830B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5100572B2 (en) * | 2008-08-25 | 2012-12-19 | キヤノン株式会社 | Encoder |
| CN101404767A (en) * | 2008-11-24 | 2009-04-08 | 崔天龙 | Parameter-variable automated video transcoding method based on image analysis and artificial intelligence |
| CN103731631A (en) * | 2012-10-16 | 2014-04-16 | 华为软件技术有限公司 | Method, device and system for transmitting video image |
| CN103024445A (en) * | 2012-12-13 | 2013-04-03 | 北京百度网讯科技有限公司 | Cloud video transcode method and cloud server |
| CN106851332A (en) * | 2017-01-04 | 2017-06-13 | 北京百度网讯科技有限公司 | Video stream processing method, device and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107332830A (en) | 2017-11-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107332830B (en) | Video code conversion, video broadcasting method and device, computer equipment, storage medium | |
| US8798168B2 (en) | Video telecommunication system for synthesizing a separated object with a new background picture | |
| CN107343220B (en) | Data processing method and device and terminal equipment | |
| CN110475150A (en) | The rendering method and device of virtual present special efficacy, live broadcast system | |
| CN109040792B (en) | Processing method for video redirection, cloud terminal and cloud desktop server | |
| CN109660823A (en) | Video distribution method, apparatus, electronic equipment and storage medium | |
| CN111739027B (en) | Image processing method, device, equipment and readable storage medium | |
| CN100512274C (en) | Device and method for simulating communication system capable of easily controlling protocol message | |
| KR20160021146A (en) | Virtual video call method and terminal | |
| CN108010037A (en) | Image processing method, device and storage medium | |
| CN109547786A (en) | Video coding and the decoded method, apparatus of video | |
| CN108833938A (en) | Method and apparatus for selecting video cover | |
| US20140310097A1 (en) | Information processing system, information processing method, communications terminals and control method and control program thereof | |
| CN109754383A (en) | A kind of generation method and equipment of special efficacy video | |
| CN105847263A (en) | Live video streaming method, device and system | |
| CN112036262A (en) | Face recognition processing method and device | |
| CN103929640B (en) | The technology broadcast for managing video flowing | |
| CN115115968A (en) | Video quality evaluation method and device and computer readable storage medium | |
| CN112565887B (en) | Video processing method, device, terminal and storage medium | |
| CN107027044B (en) | A kind of unmanned boat monitor video live broadcasting method and system | |
| CN112468792A (en) | Image recognition method and device, electronic equipment and storage medium | |
| CN110392271A (en) | The method and apparatus that live video examines | |
| CN106507125A (en) | A kind of pair of terminal coordinates live method and device | |
| JP2015231125A (en) | Image transmission system, image processing device, image storage device, and control method of them | |
| CN103927341B (en) | A kind of method and device for obtaining scene information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240102 Address after: 518057 Tencent Building, No. 1 High-tech Zone, Nanshan District, Shenzhen City, Guangdong Province, 35 floors Patentee after: TENCENT TECHNOLOGY (SHENZHEN) Co.,Ltd. Patentee after: TENCENT CLOUD COMPUTING (BEIJING) Co.,Ltd. Address before: 518000 Tencent Building, No. 1 High-tech Zone, Nanshan District, Shenzhen City, Guangdong Province, 35 Floors Patentee before: TENCENT TECHNOLOGY (SHENZHEN) Co.,Ltd. |
|
| TR01 | Transfer of patent right |