CN106791973A - A kind of data processing method and device based on intelligent television - Google Patents
A kind of data processing method and device based on intelligent television Download PDFInfo
- Publication number
- CN106791973A CN106791973A CN201611166170.2A CN201611166170A CN106791973A CN 106791973 A CN106791973 A CN 106791973A CN 201611166170 A CN201611166170 A CN 201611166170A CN 106791973 A CN106791973 A CN 106791973A
- Authority
- CN
- China
- Prior art keywords
- client
- video
- server
- layer
- identifier
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
This application provides a kind of data processing method and device based on intelligent television.Wherein, in the method, communicated by customized communication identifier between client and server, realize the data processing of cross-platform interchange between intelligent television, network, and, in the present invention, when client sends video-mail, what is sent is only the html page after a packing, also, the present invention need not upload the annex of Large Copacity the user effort plenty of time, its upload can be completed in video record, improve mail transmitting efficiency, also can guarantee that addressee subsequently can using web page browsing video when while download while browse.
Description
The application is：December 27, Application No. in 2012：201210583823.2nd, invention and created name
For：A kind of divisional application of the data processing method and device based on intelligent television.
Technical field
The application is related to data processing technique, more particularly to a kind of data processing method and device based on intelligent television.
Background technology
Television set " Qinghua high ", " networking ", the trend of " intellectuality " are complied with, intelligent television is gradually popularized.Intelligent television
The various application services such as web search, Internet Protocol Television, BBTV netviews will be realized.
At present, continuing to develop with ntelligent television technolog, intelligent television is turning into the after computer, mobile phone
Three kinds of message reference terminals, for convenience user can utilize intelligent television access at any time oneself needs information, in existing skill
In art, the data processing of cross-platform interchange between intelligent television, network is realized, be current technical problem urgently to be resolved hurrily.
The content of the invention
This application provides a kind of data processing method and device based on intelligent television, to realize intelligent television, network
Between cross-platform interchange data processing.
The technical scheme that the application is provided includes：
A kind of data processing method based on intelligent television, including：
Intelligent TV set is communicated between server as client by customized communication identifier, to obtain
Take the network authorization of server；
The client logs on to clothes when needing to send video-mail using the network identity ID of the server mandate
Business device, obtains the html page that this client is embedded in by server after completing to log in；The html page at least includes：Receive
Hair column, toolbar and mail editing area；
The client at least adds addressee information, sender information, mail in the transmitting-receiving column of the html page
Title and post time；
The client chooses insertion the Video Option in the toolbar of the html page, so that the postal of the html page
Part editing area adds a video selection area；
The client writes Mail Contents in the mail editing area of the html page, and in video selection area's selection hair
When sending local video file, by local video files passe to server, when selection sends the video file recorded, adjustment is regarded
The size in frequency area, open recording arrangement and start recorded video file with video area size mapping video resolution ratio, and will record
Video file uploads onto the server；
The client after video file is uploaded onto the server, notify server send, with by server according to postal
The form that part generator understands carries out packing one video-mail of generation to the html page, and sends to addressee.
A kind of data processing method based on intelligent television, including：
Server carries out network authorization to the intelligent TV set as client；
The server receives the company with the customized identifier that mails that the client is sent by HTTP
Request is connect, recognizes whether the mail that the connection request is asked is out of date, if it is not, then return being collected with customized mandate
The response of mail piece identifier to client, if it is, return with customized refusal mail identifier response extremely
Client；
The server receives the playing request with broadcasting adjustment identifier that the client sends, and the broadcasting please
What Seeking Truth sent when the client is received with the response for authorizing the identifier that mails；
Parameter of the server in the playing request, control media stream is in client terminal playing.
A kind of data processing equipment based on intelligent television, the device is intelligent TV set, including：
Communication module, for being communicated by customized communication identifier between server, to obtain server
Network authorization；
Log-in module, for when described device needs to send video-mail, using the network mark of the server mandate
Know ID and log on to server, the html page that this client is embedded in by server is obtained after completing to log in；The HTML page
Face at least includes：Transmitting-receiving column, toolbar and mail editing area；
Page processing module, for performing following treatment to the html page：In the transmitting-receiving column of the html page
Addressee information, sender information, mail header and post time are at least added, by the html page
Toolbar chooses insertion the Video Option, so that the mail editing area of the html page adds a video selection area, Yi Ji
The mail editing area of the html page writes Mail Contents, and when video selection area's selection sends local video file, will
Local video files passe, when selection sends the video file recorded, adjusts the size of video area, with video area to server
Size mapping video resolution ratio opens recording arrangement and starts recorded video file, and the video file of recording is uploaded into service
Device；
Notification module, for after the page processing module completes to upload onto the server video file, notifying service
Device is sent, and packing one video postal of generation is carried out to the html page according to the form that mail generator understands with by server
Part, and send to addressee.
A kind of data processing equipment based on intelligent television, the device is server, including：
Network process module, for carrying out network authorization to the intelligent TV set as client；
Mail requests processing module, is mailed by what HTTP sent for receiving the client with customized
The connection request of identifier, recognizes whether the mail that the connection request is asked is out of date, if it is not, then returning with self-defined
Mandate mail identifier response to client, if it is, return being mailed mark with customized refusal
The response of symbol is to client；
Playing request processing module, please for receiving the broadcasting with broadcasting adjustment identifier that the client sends
Ask, according to the parameter in the playing request, control media stream is in client terminal playing；Wherein, the playing request is in institute
State client and receive what is sent during with the response for authorizing the identifier that mails.
As can be seen from the above technical solutions, in the present invention, intelligence is realized by the interaction between client and server
The data processing of cross-platform interchange between energy TV, network, also, in the present invention, when client sends video-mail, with biography
The transmission Email flow of system is compared, and the present invention need not upload the annex of Large Copacity, its upload the user effort plenty of time
Can be completed in video record, improve mail transmitting efficiency；
Further, in the present invention, what server sent is only the html page after a packing, that is to say, that addressee
People be receive a html page, this can guarantee that addressee subsequently can using web page browsing video when while download while browse.
Brief description of the drawings
Fig. 1 is method flow diagram provided in an embodiment of the present invention；
Fig. 2 is network authorization flow chart provided in an embodiment of the present invention；
Fig. 3 is recording authorization flow figure provided in an embodiment of the present invention；
Fig. 4 is server memory space dynamic allocation schematic diagram provided in an embodiment of the present invention；
Fig. 5 is recorded video document flowchart provided in an embodiment of the present invention；
Fig. 6 is sound provided in an embodiment of the present invention, video data complex flow figure；
Fig. 7 is that video-mail provided in an embodiment of the present invention notifies transmission flow figure；
Fig. 8 is the flow chart that server provided in an embodiment of the present invention sends video-mail to client；
Fig. 9 realizes flow chart for step 805 provided in an embodiment of the present invention；
Figure 10 is that server provided in an embodiment of the present invention selects the streamed schematic diagram of multimedia；
Figure 11 is structure drawing of device provided in an embodiment of the present invention；
Figure 12 is structure drawing of device provided in an embodiment of the present invention.
Specific embodiment
In order that the object, technical solutions and advantages of the present invention are clearer, below in conjunction with the accompanying drawings with specific embodiment pair
The present invention is described in detail.
The invention provides a kind of data processing method based on intelligent television, as shown in figure 1, the method includes Fig. 1 institutes
The flow shown：
Step 101, intelligent TV set is led to as between client, with server by customized communication identifier
Letter, to obtain the network authorization of server.
Here, this step 101 can specifically be realized by flow shown in Fig. 2：
Fig. 2 is network authorization flow chart provided in an embodiment of the present invention.As shown in Fig. 2 the flow is comprised the following steps：
Step 201, client is sent with customized application Access Identifier [CL_USER_ACCESS] by HTTP
Connection request.
Here, connection request carries following parameter：
CLIENT_ID：It is client id, will be encrypted by the private key of client during transmission, is used in server end
Public key is decrypted, and verifies client true identity, takes 11 bytes.
TIMESTAMP：To send the time of message, can be equally encrypted by private key, be used to verify that client is true
Identity, takes 11 bytes.
Step 202, server matches send the information of the client of the connection request, it is determined whether authorized client is visited
Ask.
Here, the client-side information of matching at least includes username and password.
Step 203, server sends and carries customized access mandate identifier [SR_ACCESS_ when authorizing
ACCEPT] response to client, conversely, when not authorizing, send and carry customized access reject identifier [SR_
ACCESS_REJECT] response to client.
Here, the response with [SR_ACCESS_ACCEPT] carries TIMESTAMP and SERVER_ID.Wherein,
SERVER_ID:It is server ID, server will send confirmation to client, comprising the clothes encrypted by privacy key
Business device ID, client is decrypted using public key, for authentication server end true identity, takes 11 bytes.
Step 204, client is sent by HTTP and carried when the response with [SR_ACCESS_ACCEPT] is received
The capability message of customized performance parameter identifier [CL_PROFILE].
Here, why sending performance message purpose is easy for the actual conditions of this client of notification server, with housecoat
Business device management.Wherein, the performance parameter that the capability message is carried at least includes：
The CPU frequency (CPU_FREQ) of client, takes 10 bytes.
The maximum memory size (MEM) that client player is supported, takes 5 bytes.
The ultimate resolution (RES) that client is supported, takes 5 bytes.
The network rate (RATE) of client, takes 6 bytes.
Step 205, the performance parameter in server record capability message is returned and carries customized confirming performance identifier
The response of [SR_PROFILE_DONE].
So far, the flow shown in Fig. 2 is completed.
Network authorization can be completed by flow shown in Fig. 2.
Step 102, the client need send video-mail when, using the network identity of the server mandate
(ID) server is logged on to, the html page that this client is embedded in by server is obtained after completing to log in.
Step 103, the client is processed the html page.
Preferably, in the present invention, html page is mainly made up of toolbar, mail editing area, transmitting-receiving column and video library.
Based on this, in this step 103, client is processed specially the html page：
In the toolbar section of html page, in addition to the option such as insert pictures or annex, present invention also adds insertion
The option that video and cancellation send.
1) for the option of insertion video, a video selection area, the selection area's meeting of this video can be added in mail editing area
The label of user's selection addition local video or recorded video is provided, is specifically described below.
2) for cancelling the option for sending, before server delivering mail, the option is optional, otherwise not optional.
In the mail editing area part of html page, the content of mail can be write, also, when user selects area in video
When selection sends local video file, by local video files passe to server, when selection sends the video file recorded,
The size of video area is adjusted, opening recording arrangement with video area size mapping video resolution ratio starts recorded video file, and will
The video file of recording uploads onto the server.
In the transmitting-receiving column part of html page, it is preferable that the transmitting-receiving column is made up of outbox column and addressee column, and user can be with root
Component is clicked on according to transmitting-receiving demand.
1) for outbox column, user can add address of the addressee, make a copy for people address and title content, and click on transmission and press
Button carries out the transmission of mail.
2) for addressee column, show that sender, addressee, the people that makes a copy for, title content and transmission time of the mail etc. believe
Breath.
In the video library part of html page, video council to be sent is in the form of thumbnail in video preview showing interface
Out, user can be by clicking to enter video preview interface, and by setting, triggering mode triggering is such as long to be arrived by insertion video
Mail editing area.
So far, by being described above, you can complete the treatment of html page.
Step 104, the client notifies that server sends, with by servicing after video file is uploaded onto the server
Device carries out packing one video-mail of generation to the html page according to the form that mail generator understands, and sends to addressee
People.
Here, server carries out packing life according to the form that mail generator understands to the html page in step 104
Specifically it is described below into a video-mail.
So far, the flow shown in Fig. 1 is completed.
During the flow for sending video-mail from the client shown in Fig. 1 can be seen that the present invention, user need not spend greatly
The amount time uploads the annex of Large Copacity, and its upload can be completed in video record, also, in the present invention, server sends only
It is the html page after a packing, that is to say, that addressee is to receive a html page, and this can guarantee that addressee is follow-up
Can using web page browsing video when while download while browse.
In flow shown in Fig. 1, in step 103, before client starts recorded video, in addition it is also necessary to by customized
Communication identifier is communicated with server, and whether recorded video is authorized with confirmed service device.
Wherein, the communication process mainly includes each step as shown in Figure 3：
Step 301, client is sent by HTTP and carries customized recorded video identifier [CL_A_NEW_VIDEO]
Connection request.
Step 302, after server receives request, dynamic distributes memory space for client.
Wherein, the memory space dynamic allocation can be：A L such as L value default first is 20,000,000 memory space and L
Such as L values are 20,000,000 buffer-stored, after recorded content exceedes default memory space, double increase memory space, but
The size holding L such as L values for being buffer-stored are 20,000,000 constant, namely the memory space mm_storage=M+20 for distributing,
(M=20,40,80 ..., 10x2n；N=1,2 ...), so that L values are 20,000,000 as an example, then the memory space for distributing is as shown in Figure 4.
By so distribution memory space, after ensure that recording is completed, memory space is the size of the video file recorded.
Whether step 303, server meets according to recording condition, sends and records identifier [SR_ with customized mandate
PVR_ACCEPT] or refuse to record the response of identifier [SR_PVR_REJECT] to client.
Step 304, when the response with [SR_PVR_ACCEPT] is received, recorded video file is being received client
When the response for carrying [SR_PVR_REJECT], close and record communication.
So far, flow shown in Fig. 3 is completed.
Preferably, in the present invention, the client recording video file in above-mentioned steps 103 mainly includes flow shown in Fig. 5：
Referring to Fig. 5, Fig. 5 is recorded video document flowchart provided in an embodiment of the present invention.As shown in figure 5, the flow can
Comprise the following steps：
Step 501, collection sound, video data.
Here, sound, video data can respectively be gathered by connection microphone on the client and camera.
Wherein, when sound, video data is gathered, can be according to the acquisition parameter of the input configuration audio frequency and video of user, for regarding
For frequency, its acquisition parameter may include：The configuration parameters such as resolution ratio, yuv format, brightness, colourity, saturation degree；For audio
Speech, its acquisition parameter may include：The parameters such as sample rate, bit depth.
It should be noted that in the present invention, sound, the acquisition parameter of video can according to the actual requirements be adjusted by user
It is whole.
In addition, also, it should be noted that in the present invention, it is preferable that the acquisition interval of Voice ＆ Video must be less than synchronously about
Interfascicular every.
Step 502, sound, video data to collection are encoded.
In this step 502, when to sound, video data encoding, can be according to the coding ginseng of the input configuration audio frequency and video of user
Number, for video, its coding parameter may include：Coded format, frame per second, GOP, code stream bit rate etc.；For audio,
Its coding parameter may include：Audio format, code stream bit rate etc.；It should be noted that in the present invention, sound, the coding ginseng of video
Number can be according to the actual requirements adjusted by user.
Step 503, is combined to the sound after coding, video.
In this step 503, in sound, video compound tense, the Container Type of video file can be configured according to the input of user, if
Video file duration or the limitation of total file size are put, the raw data packets packing to audio frequency and video.In order to ensure sound, Video coding
Synchronization, it should record the timestamp of audio frequency and video, and be added in audio frequency and video frame head.
In the present invention, because video data is than larger, and voice data is much smaller, and capturing and coding frame of video institute every time
The time of consumption is also incomplete same, there is no assurance that when a frame audio data collecting is completed, video data also can be adopted just
The complete number frame of collection, so in the present invention, using system time as reference clock, and select frame of video as a reference point, in collection
Processed good audio frame is cached in an audio buffer successively during coding one-frame video data, when a frame is regarded
After the completion of frequency is according to capturing and coding, it is added in video frame header as timestamp using System Clock Reference, and obtains Audio Buffer
All voice datas in area add same System Clock Reference as timestamp letter as an audio frame in frame head
Breath, idiographic flow is as shown in Figure 6.
So far, flow shown in Fig. 5 is completed.
In the present invention, in above-mentioned steps 104, client notification server sends video-mail can flow by shown in Fig. 7
Cheng Shixian：
Referring to Fig. 7, Fig. 7 is that video-mail provided in an embodiment of the present invention notifies transmission flow figure.As shown in fig. 7, the stream
Journey may include following steps：
Step 701, client end is sent with customized transmission mail piece identifier [CL_A_NEW_VE] by HTTP
Connection request.
Step 702, server determines whether to deliver video-mail to addressee according to the html page after step 102 treatment
Mailbox.
Step 703, server sends and sends mark with customized mandate when the determination result of step 702 is to be
The response of [SR_VE_ACCEPT] is accorded with to client, and when the determination result of step 702 is no, is sent and is refused with customized
The response of identifier [SR_VE_REJECT] is sent absolutely to client.
Step 704, client when the response with [SR_VE_ACCEPT] is received, the hair on clicking trigger html page
Send to be elected item, to notify that server sends video-mail.
So far, flow shown in Fig. 7 is completed.
In the present invention, in above-mentioned steps 104, server enters according to the form that mail generator understands to the html page
One video-mail of row packing generation is concretely：
Under mail generation device, e-mail messages file is defined, video file, script more new file and some are interim
File etc., after client completes to write mail and uploaded videos, video-mail generator obtains Mail Contents to mail automatically
In message file and video file, and video-mail generator script is updated, ultimately generate new mail, i.e.,：video_email_
id.html。
Wherein, e-mail messages document definition MailInfo.txt, obtains Mail Contents and is organized into video-mail generator
The file format of understanding, such as txt file form, mainly including sender, addressee, make a copy for people, title and content etc..
Video file defines MediaInfo.txt, obtains video path and video format information etc..
Script updates document definition VideoEmail.sh, the more content of new mail messages file and video file to new stamp
Part.
More new mail messages, defined variable FileC is responsible for inquiring about e-mail messages file, it is possible to use search the side of suffix name
The txt file existed under method inquiry mail directory, i.e.,：${FileC:- 4 }=" .txt ", and according to predefined variables L evel, should
Whether Level values are that NULL is defined by more new content, and Mail Contents are updated step by step, are embodied as follows：
Level1, sender information updates：Video_email_simple.html is updated to addFrom.html；
Level2, addressee information updates：AddFrom.html is updated to addTo.html；
Level3, people's information updating of making a copy for：AddTo.html is updated to addCc.html；
Level4, heading message updates：AddCc.html is updated to addSubject.html；
Level5, Mail Contents update：AddSubject.html is updated to addContent.html；
Video file information is updated, defined variable URL is responsible for video link, and variable MediaC is responsible for the content of video, after
It is continuous to update Mail Contents, it is embodied as follows：
Level6, video information updates：AddContent.html is updated to video_email_id.html.
When video-mail is generated, Mail Contents are updated due to defining all kinds of template contrals, so only needing filling necessary
Data, such as insert video in html page, it is only necessary to video tab attribute and be worth and send to Flash and broadcast in packing table 1
Device is put, it is specific as follows：
Table 1
So far, how the form understood according to mail generator carries out packing life to the html page to complete server
Into the description of a video-mail.
The method how client sends video-mail is described above, in the present invention, also describes server
How video-mail is sent to client, be described below：
Referring to Fig. 8, Fig. 8 is the flow chart that server provided in an embodiment of the present invention sends video-mail to client.Such as
Shown in Fig. 8, the flow may include following steps：
Step 801, server carries out network authorization to the intelligent TV set as client.
This step 801 is implemented and refers to flow shown in above-mentioned Fig. 2, is repeated no more here.
Step 802, server receive the client by HTTP send with the customized identifier that mails
The connection request of [CL_VE_PATH].
Step 803, server judges that whether expired the mail that connection request is asked is, is made by oneself if it is not, then returning and carrying
The mandate of justice mail identifier [SR_VE_PATH_ACCEPT] response to client, if it is, returning with making by oneself
The refusal of justice mail identifier [SR_VE_PATH_REJECT] response to client.
Step 804, server receives the broadcasting with broadcasting adjustment identifier [CL_ADJUST] that the client sends
Request, the playing request is sent when the client receives the response with [SR_VE_PATH_ACCEPT].
Step 805, parameter of the server in the playing request, control media stream is in client terminal playing.
This step is specifically included：Server parses the delay parameter FRAME_DELAY and network speed parameter RATE_ in the playing request
CHANGE, according to described FRAME_DELAY, RATE_CHANGE and the performance parameter of the client, many matchmakers of real-time adjustment
The code check of body streaming, with the media stream of controlling transmission in client smooth playing.
Here, FRAME_DELAY be client play when, the decoding delay time of generation, take 13 bytes.
And RATE_CHANGE is client actual network speed in playing process, 13 bytes are taken.
So far, the flow shown in Fig. 8 is completed.
It should be noted that in the present invention, between client and server all customized identifiers be by
The data segment addition in packet header, the user-defined identification identifier value occupies 16 bit widths, and the size of identifier is set according to bit wide value.
In the present invention, server be based on cloud storage pattern, in step 805, its according to the FRAME_DELAY,
The performance parameter of RATE_CHANGE and the client, the code check of real-time adjustment transmission of multimedia streams can be by shown in Fig. 9
Flow is realized：
Referring to Fig. 9, Fig. 9 realizes flow chart for step 805 provided in an embodiment of the present invention.As shown in figure 9, the flow can be wrapped
Include following steps：
Step 901, when the FRAME_DELAY is more than the maximum per frame decoding time, performs step 902, in institute
When stating FRAME_DELAY less than 1/2fps, step 903 is performed, in code checks of the RATE_CHANGE less than current layer, held
Row step 904.
In the present invention, server end supports that a space for possessing N layers on spatial domain and each space layer have in time domain
There are the not more than 3 scalable multimedia streams of time horizon, if the space layer of media stream is { L0,L1,L2,L3,…,LN-1,
If the subsidiary 3 times layering of each space layer, the maximum frame per second of note is fps, then time horizon deuterzooid is not under every kind of spatial level
Fps, fps/2, fps/4.
Wherein, each layer is determined by with making policy decision in media stream：
Note RXIt is X layers of code check, if L0To LN-1Spatial resolution is increasing, then L0To LN-1Code check be incremented by, if
Network speed is R, and equipment supports that ultimate resolution is res, and initial level number K will be as made decision.
When there is a layer k, its resolution ratio is closest with device resolution and code check is multiplied by λ less than current network speed, and λ is
One coefficient more than 1, λ value will ensure that the transmission of audio-frequency unit and the smooth playing under certain network speed surging condition.
If in the absence of such layer, choose code check less than λ R and with the immediate layers of λ R.
If λ R are less than the code check of basal layer, choose basal layer and time domain layering lowermost layer is used as initial layering.
Based on above-mentioned decision-making, then Figure 10 shows each interlayer structure figure in media stream.
In the present invention, if FRAME_DELAY is more than the maximum per frame decoding time, indicate the video in client
Smooth playing is will be unable to, server will adjust the media stream of transmission, be specifically shown in step 902；And work as FRAME_DELAY less than 1/
During 2fps, then mean that client CPU still there are a large amount of free times, can accordingly lift code stream quality, be specifically shown in step 903 and retouch
State.And work as code checks of the RATE_CHANGE less than current layer, then mean now to there is no need to adjust code stream, can continue according to original
Bit stream is carried out by mode.
Step 902, CPU_FREQ and Q in the client performance parameter for having recordedLow, the QLow, it is to work as
CPU frequency value required for front layer support smooth playing, if the former is less than the latter, selects relative to current layer, on spatial domain
Low one layer of media stream transmission, if the former is more than or equal to the latter, selects relative to current layer, low one layer many in time domain
Media stream.
Step 903, in the RATE_CHANGE more than R` and during more than R``, selects relative to current layer, high on spatial domain
One layer of media stream transmission, in the RATE_CHANGE more than R` and during less than R``, selects relative to current layer, in time domain
One layer high of media stream transmission；Wherein, the R` be relative to one layer high in current layer time domain of code check, R`` be relative to
Current layer, one layer high of code check on spatial domain.
Step 904, terminates adjustment.
So far, flow shown in Fig. 9 is completed.
Wherein, in flow shown in Fig. 9, server selection media stream transmission can be realized by following steps：
Selected media stream is read by document reader and is put into internal memory；
File demultiplexer is then used by separate the video data and voice data in media stream；
Only by video data be input into NAL bag selectors, with cause video data be input into NAL bag selectors be organized into it is many
Individual NAL unit；
The NAL unit that NAL bag Choosers are input into is chosen, the video counts for then completing voice data and treatment
According to group of networks bag device is respectively fed to, packing treatment is carried out, finally exported as network data flow.
Figure 10 shows that server selects the streamed schematic diagram of multimedia.
In the present invention, the number of plies is lower, shows that code check is smaller, and in decoding process, one layer high of decoding may rely on low
One layer of data, and low one layer of data never rely on one layer high of data, therefore, the NAL bags being input into NAL bag selectors
Chosen concretely：The specific code check specification that the media stream to be transmitted is made in decision-making before server is mapped as phase
The target dependency_id (being represented with U) and target temporal_id (being represented with V) for answering, are input into from NAL bag selectors
All NAL units in read the NAL unit of the values of NAL Type=first, here, the first value represents SVC extension head header's
NAL unit, its concretely 14, if the dependency_id≤U of the NAL unit of the reading, temporal_id≤V, then
Showing that all NAL units after the NAL unit are all needs to choose what is sent, otherwise skips all NAL bags thereafter.As again
NAL bags of the NAL Type equal to the first value is run into, judgement is re-started.
So far, the method description that the present invention is provided is completed.
The device that the present invention is provided is described below：
Referring to Figure 11, Figure 11 is structure drawing of device provided in an embodiment of the present invention.The device is intelligent TV set, is applied to
Flow shown in Fig. 1, it may include：
Communication module, for being communicated by customized communication identifier between server, to obtain server
Network authorization；
Log-in module, for when described device needs to send video-mail, using the network mark of the server mandate
Know ID and log on to server, the html page that this client is embedded in by server is obtained after completing to log in；The HTML page
Face at least includes：Transmitting-receiving column, toolbar and mail editing area；
Page processing module, for performing following treatment to the html page：In the transmitting-receiving column of the html page
Addressee information, sender information, mail header and post time are at least added, by the html page
Toolbar chooses insertion the Video Option, so that the mail editing area of the html page adds a video selection area, Yi Ji
The mail editing area of the html page writes Mail Contents, and when video selection area's selection sends local video file, will
Local video files passe, when selection sends the video file recorded, adjusts the size of video area, with video area to server
Size mapping video resolution ratio opens recording arrangement and starts recorded video file, and the video file of recording is uploaded into service
Device；
Notification module, for after the page processing module completes to upload onto the server video file, notifying service
Device is sent, and packing one video postal of generation is carried out to the html page according to the form that mail generator understands with by server
Part, and send to addressee.
Preferably, in the present invention, the page processing module passes through following steps recorded video file：
Collection sound, video data；
Sound, video data to collection are encoded；
System time selects frame of video as a reference point as reference clock, in capturing and coding one-frame video data
During processed good audio frame is cached in an audio buffer successively, when one-frame video data capturing and coding complete
Afterwards, it is added in video frame header as timestamp using present system time, and obtains all voice datas in audio buffer
As an audio frame, same system time is added in audio frame head as timestamp.
In addition, present invention also offers another kind based on intelligent television data processing equipment, as shown in figure 12, wherein,
The device is server, including：
Network process module, for carrying out network authorization to the intelligent TV set as client；
Mail requests processing module, is mailed by what HTTP sent for receiving the client with customized
The connection request of identifier, recognizes whether the mail that the connection request is asked is out of date, if it is not, then returning with self-defined
Mandate mail identifier response to client, if it is, return being mailed mark with customized refusal
The response of symbol is to client；
Playing request processing module, please for receiving the broadcasting with broadcasting adjustment identifier that the client sends
Ask, according to the parameter in the playing request, control media stream is in client terminal playing；Wherein, the playing request is in institute
State client and receive what is sent during with the response for authorizing the identifier that mails.
Parameter of the playing request processing module in the playing request, control media stream is broadcast in client
Put, specifically include：Parse the delay parameter FRAME_DELAY and network speed parameter RATE_CHANGE in the playing request, foundation
The performance parameter of described FRAME_DELAY, RATE_CHANGE and the client, the code of real-time adjustment transmission of multimedia streams
Rate, with the media stream of controlling transmission in client normal play.
In the present invention, the media stream possesses N layers of space on spatial domain, and each space layer has few in time domain
In three time horizons；
Based on this, the playing request processing module is according to FRAME_DELAY, RATE_CHANGE and the client
Performance parameter, real-time adjustment transmission code check include：
If the FRAME_DELAY is more than the maximum per frame decoding time,
CPU_FREQ and Q in the client performance parameter for having recordedLow, the QLow, it is that current layer is supported
CPU frequency value required for smooth playing, if the former is less than the latter, selects relative to current layer, low one layer on spatial domain
Media stream is transmitted, if the former is more than or equal to the latter, is selected relative to current layer, and low one layer of multimedia spreads in time domain
Send；
If the FRAME_DELAY is less than 1/2fps, in the RATE_CHANGE more than R` and during more than R``, choosing
Select relative to current layer, one layer high of media stream transmission on spatial domain, when the RATE_CHANGE is more than R` and less than R``,
Relative to current layer, one layer high of media stream is transmitted in time domain for selection；Wherein, the R` is high relative in current layer time domain
One layer of code check, R`` is one layer high of the code check on spatial domain relative to current layer.
The media stream includes audio stream and/or video flowing.
Especially, in an advantageous embodiment, the video flowing possesses N layers of space, each space layer on spatial domain
There are not more than three time horizons in time domain；
The playing request processing module is according to FRAME_DELAY, RATE_CHANGE and the performance of the client
Parameter, the code check of real-time adjustment transmission includes：
If the FRAME_DELAY is more than the maximum per frame decoding time,
CPU_FREQ and QLow in the client performance parameter for having recorded, the QLow is current layer branch
CPU frequency value required for holding smooth playing, if the former is less than the latter, selects relative to current layer, low one layer on spatial domain
Video stream, if the former be more than or equal to the latter, select relative to current layer, low one layer of video spreads in time domain
Send；The video flowing possesses N layers of space on spatial domain, and each space layer has not more than three time horizons in time domain；
If the FRAME_DELAY is less than 1/2fps, in the RATE_CHANGE more than R` and during more than R``, choosing
Select relative to current layer, one layer high of video stream on spatial domain, in the RATE_CHANGE more than R` and during less than R``, choosing
Select relative to current layer, one layer high of video stream in time domain；Wherein, the R` is high one layer relative in current layer time domain
Code check, R`` is one layer high of the code check on spatial domain relative to current layer.
So far, the device description that the present invention is provided is completed.
Presently preferred embodiments of the present invention is the foregoing is only, is not intended to limit the invention, it is all in essence of the invention
Within god and principle, any modification, equivalent substitution and improvements done etc. should be included within the scope of protection of the invention.
Claims (9)
1. a kind of data processing method based on intelligent television, it is characterised in that the method includes：
Server carries out network authorization to the intelligent TV set as client；
The server receives the client please by the connection with the customized identifier that mails that HTTP sends
Ask, recognize whether the mail that the connection request is asked is out of date, if it is not, then return being mailed with customized mandate
The response of identifier to client, if it is, return with customized refusal mail identifier response to client
End；
The server receives the playing request with broadcasting adjustment identifier that the client sends, and the playing request is
Sent when the client is received with the response for authorizing the identifier that mails；
Parameter of the server in the playing request, control media stream is in client terminal playing.
2. method according to claim 1, it is characterised in that parameter of the server in the playing request,
Control media stream is specifically included in client terminal playing：
The server parses the delay parameter FRAME_DELAY and network speed parameter RATE_CHANGE in the playing request, according to
According to described FRAME_DELAY, RATE_CHANGE and the performance parameter of the client, real-time adjustment transmission of multimedia streams
Code check, with the media stream of controlling transmission in client normal play.
3. method according to claim 1, it is characterised in that the performance parameter at least includes：CPU frequency CPU_
FREQ, maximum memory size MEM, ultimate resolution RES, the network of client of client support that client player is supported
Speed RATE；
The media stream possesses N layers of space on spatial domain, and each space layer has not more than three time horizons in time domain；
The performance parameter of described foundation FRAME_DELAY, RATE_CHANGE and the client, the code of real-time adjustment transmission
Rate includes：
If the FRAME_DELAY is more than the maximum per frame decoding time,
CPU_FREQ and Q in the client performance parameter for having recordedLow, the QLow, it is that current layer supports smooth
CPU frequency value required for playing, if the former is less than the latter, selects relative to current layer, low one layer of many matchmakers on spatial domain
Body streaming, if the former is more than or equal to the latter, selects relative to current layer, low one layer of media stream transmission in time domain；
If the FRAME_DELAY is less than 1/2fps, in the RATE_CHANGE more than R` and during more than R``, phase is selected
For current layer, one layer high of media stream transmission on spatial domain, when the RATE_CHANGE is more than R` and less than R``, selection
Relative to current layer, one layer high of media stream transmission in time domain；Wherein, the R` is high one layer relative in current layer time domain
Code check, R`` is one layer high of the code check on spatial domain relative to current layer.
4. method according to claim 3, it is characterised in that selection media stream transmission includes：
Selected media stream is read and is put into internal memory；
Video data in the media stream, voice data are made a distinction, decision-making treatment is carried out to video data, selected
Need the video data of transmission；
Video data and the voice data will be selected to carry out packing and processes and transmit.
5. method according to claim 4, it is characterised in that
Described to carry out decision-making treatment to video data, the video data for selecting needs transmission includes：
The video data is organized into multiple NAL units；
The code check of the media stream that will be selected is mapped as corresponding target dependency_id and target temporal_id；
Any NAL unit is read, if the property value of the NAL unit is the first value, first value represents SVC extension head
The NAL unit of header, then the NAL unit dependency_id less than or equal to target dependency_id and
When the temporal_id of the NAL unit is less than or equal to target temporal_id, all NAL after the NAL unit are selected
Unit needs transmission, otherwise, it determines all NAL units after the NAL unit need not be transmitted.
6. method according to claim 1, it is characterised in that the server enters to the intelligent TV set as client
Row network authorization includes：
The server receives the client please by the connection with customized application Access Identifier that HTTP sends
Ask；
The server matches send the information of the client of the connection request, if the match is successful, send with self-defined
Access mandate identifier response to client, if it fails to match, send carry customized access reject identifier
Response to client；
The server is received the client and is disappeared by the performance with customized performance parameter identifier that HTTP sends
Breath, the capability message is sent when client receives the response with access mandate identifier, and it is described that it is carried
The performance parameter of client；
The performance parameter that capability message described in the server record is carried, and return to confirming performance to client.
7. a kind of data processing equipment based on intelligent television, it is characterised in that the device is server, including：
Network process module, for carrying out network authorization to the intelligent TV set as client；
Mail requests processing module, for receive the client by HTTP send with the customized mark that mails
The connection request of symbol, recognizes whether the mail that the connection request is asked is out of date, if it is not, then return being awarded with customized
The response of the identifier that mails is weighed to client, if it is, return refusing the identifier that mails with customized
Response is to client；
Playing request processing module, for receiving the playing request with broadcasting adjustment identifier that the client sends, root
According to the parameter in the playing request, control media stream is in client terminal playing；Wherein, the playing request is in the client
Termination receives what is sent during with the response for authorizing the identifier that mails.
8. device according to claim 7, it is characterised in that the playing request processing module is according to the playing request
In parameter, control media stream in client terminal playing, specifically include：Parse the delay parameter FRAME_ in the playing request
DELAY and network speed parameter RATE_CHANGE, according to described FRAME_DELAY, RATE_CHANGE and the property of the client
Can parameter, the code check of real-time adjustment transmission, to control the broadcasting of client smooth.
9. device according to claim 8, it is characterised in that
The performance parameter of described playing request processing module foundation FRAME_DELAY, RATE_CHANGE and the client,
The code check of real-time adjustment transmission includes：
If the FRAME_DELAY is more than the maximum per frame decoding time,
CPU_FREQ and Q in the client performance parameter for having recordedLow, the QLow, it is that current layer supports smooth
CPU frequency value required for playing, if the former is less than the latter, selects relative to current layer, low one layer of video on spatial domain
Streaming, if the former is more than or equal to the latter, selects relative to current layer, low one layer of video stream in time domain；It is described
Video flowing possesses N layers of space on spatial domain, and each space layer has not more than three time horizons in time domain；
If the FRAME_DELAY is less than 1/2fps, in the RATE_CHANGE more than R` and during more than R``, phase is selected
For current layer, one layer high of video stream on spatial domain, in the RATE_CHANGE more than R` and during less than R``, selects phase
For current layer, one layer high of video stream in time domain；Wherein, the R` is relative to one layer high in current layer time domain of code
Rate, R`` is one layer high of the code check on spatial domain relative to current layer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611166170.2A CN106791973B (en) | 2012-12-27 | 2012-12-27 | data processing method and device based on smart television |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611166170.2A CN106791973B (en) | 2012-12-27 | 2012-12-27 | data processing method and device based on smart television |
| CN201210583823.2A CN103905906B (en) | 2012-12-27 | 2012-12-27 | A kind of data processing method based on intelligent television and device |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210583823.2A Division CN103905906B (en) | 2012-12-27 | 2012-12-27 | A kind of data processing method based on intelligent television and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106791973A true CN106791973A (en) | 2017-05-31 |
| CN106791973B CN106791973B (en) | 2019-12-06 |
Family
ID=50997022
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210583823.2A Active CN103905906B (en) | 2012-12-27 | 2012-12-27 | A kind of data processing method based on intelligent television and device |
| CN201611166170.2A Active CN106791973B (en) | 2012-12-27 | 2012-12-27 | data processing method and device based on smart television |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210583823.2A Active CN103905906B (en) | 2012-12-27 | 2012-12-27 | A kind of data processing method based on intelligent television and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN103905906B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105763857A (en) * | 2016-04-27 | 2016-07-13 | 王正作 | Video transmission method for unmanned aerial vehicle |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105472339B (en) * | 2015-12-15 | 2019-03-19 | 浙江省公众信息产业有限公司 | For realizing the method for playing back videos, server and system |
| CN106028058A (en) * | 2016-05-12 | 2016-10-12 | 青岛海信移动通信技术股份有限公司 | Method and device for recording multimedia data |
| CN107484008A (en) * | 2017-09-07 | 2017-12-15 | 北京奇虎科技有限公司 | A kind of video editing and sharing method, device, electronic equipment and medium |
| CN107529086A (en) * | 2017-09-07 | 2017-12-29 | 北京奇虎科技有限公司 | A kind of method for processing video frequency, device, electronic equipment and medium |
| CN109787942A (en) * | 2017-11-14 | 2019-05-21 | 广州市动景计算机科技有限公司 | Multimedia file submission and dissemination method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1972250A (en) * | 2005-11-22 | 2007-05-30 | 腾讯科技（深圳）有限公司 | A transmission method and system for attachment of multimedia mail |
| US20090144379A1 (en) * | 2007-12-04 | 2009-06-04 | At&T Delaware Intellectual Property, Inc. | Systems, methods and computer program products for the delivery of email text messages and audio video attachments to an iptv display device |
| CN101867529A (en) * | 2010-02-24 | 2010-10-20 | 北京算通科技发展股份有限公司 | Realization mode for intercommunicating mails between digital television network and internet |
| CN101926123A (en) * | 2007-12-07 | 2010-12-22 | 威迪恩斯科技私人有限公司 | Method to display video in email |
| CN102149005A (en) * | 2011-04-29 | 2011-08-10 | 四川长虹电器股份有限公司 | Self-adaptive method for controlling network video quality |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1719896A (en) * | 2005-08-03 | 2006-01-11 | 张杉 | Method for transmitting TV news image between foreign lands by internet |
| CN101472159A (en) * | 2007-12-29 | 2009-07-01 | 东方有线网络有限公司 | System and method for implementing information service based on interactive television platform |
| US9451319B2 (en) * | 2010-12-17 | 2016-09-20 | Microsoft Technology Licensing, Llc | Streaming digital content with flexible remote playback |
| CN102779046B (en) * | 2012-07-04 | 2016-01-20 | 合一网络技术(北京)有限公司 | A kind of audio/video player system based on HTML5 exploitation and video broadcasting method thereof |
| CN102833593B (en) * | 2012-07-17 | 2015-12-16 | 晨星软件研发(深圳)有限公司 | Authorization method, system and intelligent television that a kind of intelligent television is applied |
-
2012
- 2012-12-27 CN CN201210583823.2A patent/CN103905906B/en active Active
- 2012-12-27 CN CN201611166170.2A patent/CN106791973B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1972250A (en) * | 2005-11-22 | 2007-05-30 | 腾讯科技（深圳）有限公司 | A transmission method and system for attachment of multimedia mail |
| US20090144379A1 (en) * | 2007-12-04 | 2009-06-04 | At&T Delaware Intellectual Property, Inc. | Systems, methods and computer program products for the delivery of email text messages and audio video attachments to an iptv display device |
| CN101926123A (en) * | 2007-12-07 | 2010-12-22 | 威迪恩斯科技私人有限公司 | Method to display video in email |
| CN101867529A (en) * | 2010-02-24 | 2010-10-20 | 北京算通科技发展股份有限公司 | Realization mode for intercommunicating mails between digital television network and internet |
| CN102149005A (en) * | 2011-04-29 | 2011-08-10 | 四川长虹电器股份有限公司 | Self-adaptive method for controlling network video quality |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105763857A (en) * | 2016-04-27 | 2016-07-13 | 王正作 | Video transmission method for unmanned aerial vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103905906B (en) | 2017-03-01 |
| CN103905906A (en) | 2014-07-02 |
| CN106791973B (en) | 2019-12-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103905906B (en) | A kind of data processing method based on intelligent television and device | |
| US8787366B2 (en) | Community driven program access system and method | |
| EP2278775B1 (en) | Multicasting method and apparatus | |
| EP2695355B1 (en) | Network streaming of video data using byte range requests | |
| US6763019B2 (en) | Method and system for authenticated fast channel change of media provided over a DSL connection | |
| US8259861B2 (en) | Methods and systems for providing bandwidth adjustment | |
| US8386465B2 (en) | System and method to manage and distribute media using a predictive media cache | |
| US20070274293A1 (en) | Archiving VoIP conversations | |
| US20090135849A1 (en) | RTP Payload Format | |
| EP2154888A1 (en) | Realization system, method and device for multimedia service | |
| CN109348171A (en) | A kind of view networking monitoring video acquiring method and device | |
| EP1451695A1 (en) | System, method, and data structure for multimedia communications | |
| JP2004505363A (en) | Video messaging | |
| CN104519307B (en) | Meeting management system, continuous presence equipment, branch's field device, video meeting implementing method and system | |
| KR101198542B1 (en) | Content sharing via mobile broadcast system and method | |
| US20080313275A1 (en) | Method and System For Implementing Ring Service of Instant Messaging | |
| CN106056368A (en) | Payment processing method adopting payment password addition | |
| CN100428675C (en) | Method for realizing on-line playing of audio-video file and its network system | |
| CN103313093B (en) | Carry out method and the directory system of distributed video on demand | |
| CN106210867A (en) | A kind of method and apparatus of data sharing | |
| Yang et al. | Research on cluster remote video surveillance system | |
| CN113965897A (en) | Strategy method for terminal self-adaptive display based on 5G message | |
| Ciubotaru et al. | Support for Communication-Based Services | |
| Ciubotaru et al. | Network communications protocols and services | |
| WO2003079560A2 (en) | Intelligent bandwidth management |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |