CN110139144A - One kind is based on TV sharing method in smart home - Google Patents

One kind is based on TV sharing method in smart home Download PDF

Info

Publication number
CN110139144A
CN110139144A CN201910252615.6A CN201910252615A CN110139144A CN 110139144 A CN110139144 A CN 110139144A CN 201910252615 A CN201910252615 A CN 201910252615A CN 110139144 A CN110139144 A CN 110139144A
Authority
CN
China
Prior art keywords
signal
user
audio
programme
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910252615.6A
Other languages
Chinese (zh)
Other versions
CN110139144B (en
Inventor
崔凡钦
于鸿洋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Electronic Science and Technology of China
Original Assignee
University of Electronic Science and Technology of China
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Electronic Science and Technology of China filed Critical University of Electronic Science and Technology of China
Publication of CN110139144A publication Critical patent/CN110139144A/en
Application granted granted Critical
Publication of CN110139144B publication Critical patent/CN110139144B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00Speaker identification or verification
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/55Push-based network services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H04N21/4668Learning process for intelligent management, e.g. learning user preferences for recommending movies for recommending content, e.g. movies

Abstract

The invention discloses one kind based on TV sharing method in smart home, belongs to smart home field.The present invention uses digital-to-analogue to capture the real time data of TV signal being played on or other useful signal sources first, audio-video signal after conversion is encoded, the TV program information of acquisition is recorded simultaneously, the habit that user watches TV programme is analyzed, pushes and is suitble in user's TV programme to terminal being played on;The voice messaging for acquiring user records the voice of user, realizes the conversion of user speech intelligent control TV program, volume adjustment etc.;Audio, video data after coding divides two-way to be output in terminal.It is packaged into TS packet according to MPEG-2 format all the way, and is forwarded on terminal device by wireless or cable network, the text information, picture and audio-video that the end APP is sent can be inserted on original audio, video data, circuit is output on TV by another way.

Description

One kind is based on TV sharing method in smart home
Technical field
The invention belongs to smart home fields, and in particular to TV signal acquisition, Video coding, TS stream is packaged and network turns The technologies such as hair and audio/video decoding.
Background technique
Smart home has developed for many years at home, and with the development of Internet of Things, the application demand of smart home is increasingly enhanced. In terms of development space, China's smart home industry potential market is huge.Main platform of the TV as home entertaining, Its important role is played in family life.TV is connected to the network with terminal device, realizes the broadcasting pictures of shared TV Can be transferred in mobile phone by network technology, user can carry out kitchen cook etc. operation when do not miss splendid moment, pole The big information for facilitating user is received and is obtained, and has established solid foundation for smart home development.
There are the methods of several typical reception terrestrial broadcasting DTVs or mobile digital TV program in China at present.Machine top Box can complete the humorous reception of terrestrial broadcasting digital television signal, obtain multiplexed program transport stream and decoded video and audio letter Number, it is output to the terminal devices such as liquid crystal display and carries out video and audio playback.But set-top box and display terminal are connected by cable It connects, not Portable belt;And intelligent terminal also can not receiving set up box demodulation video/audio signal.It is finally terrestrial broadcasting number Mobile television rod.Television rod completes the humorous reception of digital television signal, transport stream is transferred to computer, by the software on computer Realize video and audio demultiplexing, decoding.But since television rod only makees coprocessor, using receiving larger limitation;Due to TV Stick only makees coprocessor, and the signal of its demodulation can not be received by smart phone, and application is very limited.Currently, not A kind of portable equipment can be while freely receiving terrestrial broadcasting digital television signal, but also with record television programme information And user speech, more intelligentized functions are provided for user.
Summary of the invention
Goal of the invention of the invention is: in view of the above problems, realizing that the real-time broadcasting pictures of shared TV can To be transferred in terminal by network technology, oneself more highlights and user are intelligently suitble to for user's push Voice control TV, while interactive chat, great convenience user can be exchanged together between user.
One kind of the invention is based on smart home TV sharing method, comprising the following steps:
Step 1 captures TV programme signal being played in real time, and TV programme signal is converted to colour difference signal, It configures output data and uses different digital coffret standard;
Step 2 receives the text information and/or audio, video data that user terminal sends over simultaneously, and inserts it into In the TV programme signal of capture, circuit is output on TV;
The TV programme signal that step 3, storage acquire,
And it is sent to cloud, the history based on user watches record, matches to user terminal push and history viewing record TV programme signal being played on to user terminal;
Step 4, the sound for recording user, identify the sound of user, based on for acoustic control instruction control TV programme Regulation and/or volume adjustment.
Further, step 1 specifically:
Different TV signals is captured, and different resolution ratio is set for every kind of TV signal, and be converted to not apposition The digital signal of formula;And user can resolution ratio and signal format based on demand and application scenarios selection TV signal;
Further, in step 2, the text information and different-format text code mode of Chinese and English, Yong Hufa are supported Different format and bit rate can be set in the voice sent and other audio files.
In addition, TV sharing processing of the invention can also upgrade processing mode in such a way that distal end upgrades.
It further include being encrypted to image file in upgrading processing mode, terminal device is got from server end to be reflected As file needs be decrypted, check file it is whether intact, be then updated.User, which can choose, to be updated or not It is updated.
In conclusion by adopting the above-described technical solution, the beneficial effects of the present invention are: realizing user different The TV programme of family are watched in place, do not miss program splendid moment.Message, audio-video can be sent simultaneously, picture is inserted into The interaction between user is greatly facilitated in the program of live streaming.
Detailed description of the invention
Fig. 1 is sharing application scenarios schematic diagram of the invention in specific embodiment;
Fig. 2 is sharing treatment process schematic diagram of the invention in specific embodiment;
Wherein, OSD is a kind of screen display technology, i.e. On Screen Display;CVBS indicates Composite Video Baseband letter Number, HDMI indicates high-definition multimedia interface.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below with reference to embodiment and attached drawing, to this hair It is bright to be described in further detail.
Referring to Fig. 1, TV sharing method packet TV is shared box (TV Sharing), is connect in a kind of smart home of the invention Enter equipment and user terminal, it includes processor and trapping module that wherein TV, which shares box,;And trapping module is with wired connection mode Connect television set;
Referring to fig. 2, specifically share realization process specifically:
Step 1: the processor that TV shares box configures trapping module by two-wire bus mode.Believed according to home videos Number configuration input signal is carried out, while resolution ratio and frame per second, clock are set.Configuring trapping module output signal format is YUV, the data captured are serially transferred to processor using BT656 format.BT656 is 8 data transmission, does not need to synchronize Signal.
Step 2: insertion text information and audio-video during, first with terminal (mobile phone, notebook, the palm Upper computer etc.) TCP connection is established, wireless network card one is worked after powering under ap mode, and then terminal device is connected to the hot spot Under, then the router SSID (Service Set Identifier) of family is sent to password and is shared by terminal device Box shares the wireless network card that box removes connection family again, while the IP address of multicast oneself, after terminal receives the IP of multicast, With with share box and establish TCP connection.
After establishing connection, sending information information is encoded using GB2312.Voice coding uses AAC coded format.
After TV shares the text code information that box receives transmission, font file is opened, reads and corresponds to from font file Text dot matrix, be stored in caching, then the size and color of the size of display area, background color, font be set, finally More new font is shown on TV.
Step 3: configuration processor interface receives yuv format data, is saved in caching, uses property high inside processor It can hardware H264 coding.Coding parameter is set, H264 coding is carried out to audio-video signal.The channel for capturing vision signal is set It is 0, path 3, the resolution ratio of Video coding is 720*576, and the frame per second of video is 25, bit rate control method CBR, GOP It is 60, bit rate 2048, the quantity of B frame is 0, then carries out the video set capture attribute and Video coding attribute Binding is returned to binding number, finally library function is called to be applied using number.Audio setting process is similar with video process, Parameter is set are as follows: coding mode AAC, bit rate 32000, capture channel are consistent with video.
Then PES (Packet Elementary is packaged into ES (Elementary Stream) stream got Stream it) wraps.Wherein, 6 bytes of PES packet beginning are the packet header PES: 3 byte start-code prefix before packet header, for showing one The beginning of PES packet;4th byte is starting code mark, illustrates initial code type, shows to be video ES in domain, audio ES is still Data basic flow.Most latter two byte is packet length, illustrates below also how many byte, if length is 0, illustrates PES packet Length is greater than 64K byte.It is the optional packet header PES after 6 byte packet headers, is finally the payload data of practical transmission ES stream.One PES packet corresponds to a frame image, and PTS (Decoding Time corresponding with the picture frame should all be set in each PES packet Stamp the value of) value, DTS (Decoding Time Stamp) can be obtained by the value of PTS.Audio data is packaged into the setting of PES packet Content is identical.
Since PES pack arrangement is not suitable for transmission, be especially not suitable for the broadcasted application for there are multiple programs in a data flow. PES packet need to be divided into the smaller data packet of fixed size, i.e. TS (Transport Stream) packet of 188 bytes.TS packet It is the basic unit of MPEG-2 data stream transmitting.It is packet header and the Payload of 184 bytes of 4 bytes under normal circumstances payload.Due to containing adaptive field in the header, the packet header of TS packet is at least more than 4 bytes, passes through load list First start indicator can find the beginning of load.Based on TS packet structure, it is defined as follows in practice:
Sync byte is fixed as 0x47.
Transmission error code indicating bit 0x00.
Load cell origin identification position indicates TS packet payload initial position situation, when having for transport stream packet When effect load is PES packet data, marker is that 1 expression payload is started with the first character section of PES, and otherwise indicating should Payload is started with the first character section of PES.Therefore the position is set as 1.
Transmit priority bit 0x00.
PID is the mark of unique instruction TS data packet, and Packet Data is that content is exactly to be determined by PID.Program The PID of contingency table PAT is 0x0000, and the PID of PMT is 0xFFF, and the PID of H264 is 0x100, and the PID of AAC is 0x101. Transmission scrambling control field is set as 0x00, and expression does not scramble.
Whether adaptive field control field, 2bit, the field instruction packet header TS rear portion have adaptive field and effectively bear It carries.Being set as 0x03 indicates existing payload, and has adaptive field, and for empty Bao Eryan, which should be set to 0x01。
Field during connecting technique, 4bit, the field are incremented by with the TS data packet with identical pid value, are reaching most 0 is reset to after big value 15.So being carried out respectively according to different pid values incremental when handling the field.
Adaptive field is generally 8 bytes, behind be 8 flag bits, occupy 1 byte in total, Optional Field according to Whether the flag bit of front uses PCR (Program Clock Reference), OPCR etc. to be configured.In practical application It in test process, only carries out using PCR, is configured a PCR every a frame.In digital television broadcasting application, PCR's Time interval should be not more than 40ms.For PCR for restoring 27MHZ system clock, the interval PCR mistake will lead to the clock of receiving end Shake, influences picture display time.
TS stream in comprising the table closely related with program information come describe TS stream temporal structure.PAT and PMT belong to In PSI.The structural information of entire TS stream can be learnt by PAT and PMT, there was only a kind of pat table, PAT in generally all the way TS stream The PID of the TS packet of table is 0, and the PID of pmt table all in the transport stream of the road Liao Gai is paid in pat table, is found according to these PID PMT.It is all audio ESs of the program, the PID of video ES and other data ES stream, according to these bases in the load department of pmt table This stream pid value, the audio-video basic flow that decoding can find the programs are decoded broadcasting.In TS data flow, every 40 TS packets are inserted into one group of PAT and PMT.
During obtaining the parsing that TS packet carries out, first since finding pat table, there is the PID of PMT in PAT packet.PAT After reading with PMT, user determines two PID of a program, the PID of video to be decoded and audio signal to be decoded PID PID identical TS packet collection is respectively synthesized video PES packet and audio PES packet, is sent to video during demultiplexing Decoder.By test, by the way of frame-skipping, image sharpness is improved.Increase ARM-V7A simultaneously, adapts to and more whole End.
Step 4: realizing infrared bottom layer driving, terminal device sends study order, and bottom software calling interruption is gone to capture red External signal considers that the infrared signal that remote controler issues will cause signal rebound factor, and setting fixed size infrared data caches Area every time empties buffer area before capture.Ensure to capture acquisition every time is all new valid data, while terminal is answered It is bound with the key of setting study.Terminal sends control command infrared module, and bottom software will be caught before using timer The infrared signal data obtained, which simulates, to be come, and is sent by infrared sending tube.
Step 5: when user wants upgrading, downloading needs the firmware updated from server, sends a command to bottom application. When being downloaded, version can be first checked first, and whether version information is greater than current version, only when version information is greater than currently When version, it is then downloaded firmware.Then MD5 is calculated, is compared with the firmware MD5 on server, if MD5 is identical, then downloading is correct, carries out erasing flash, new firmware is written in Flash.Version information is updated simultaneously to arrive In the last one subregion of Flash.When wanting to update a firmware, new version information is write using update application program Enter in firmware.MD5sum is run, * .md5 is generated and is used as verification.
In the present invention, the coding of video is using high-performance H264 coding inside processor.Currently based on ASIC hardware H264 encoding scheme has been widely used, and the program not only can reduce encoding device volume, reduce power consumption, can also be mentioned High system stability.For example the MB86H50 of Fuji Tsu, this hardware coder have obvious in power consumption and volume Advantage, but this hardware coder it is maximum the disadvantage is that can not carry out upgrading and fault restoration, it is even more impossible to carry out function to open up Exhibition, if necessary to adjust, it is necessary to throw piece production again;Another encoder is this coding based on function of hardware acceleration Device generally uses double architecture designs of ARM and DSP, such as QL202B, GM8136 family chip, and this encoder generally can be with Performance boost or functions expanding, the advantage of such encoder are carried out by firmware upgrade or the hardware-accelerated middleware of change Clearly, that is, device power consumption and volume be ensure that, and can use the function of hardware acceleration of device to carry out H.264 Efficient video coding, it is most important that such device is generally provided for hardware-accelerated SDK development kit, utilizes corresponding API Function can be carried out flexible and efficient H.264 coding.
The above description is merely a specific embodiment, any feature disclosed in this specification, except non-specifically Narration, can be replaced by other alternative features that are equivalent or have similar purpose;Disclosed all features or all Method or in the process the step of, other than mutually exclusive feature and/or step, can be combined in any way.

Claims (4)

1. one kind is based on smart home TV sharing method, which comprises the following steps:
Step 1 captures TV programme signal being played in real time, and TV programme signal is converted to colour difference signal, configuration Output data uses different digital coffret standard;
Step 2 receives the text information and/or audio, video data that user terminal sends over simultaneously, and inserts it into capture TV programme signal in, circuit is output on TV;
The TV programme signal that step 3, storage acquire,
And it is sent to cloud, the history based on user watches record, matches just to user terminal push and history viewing record Broadcasting TV programme signal to user terminal;
Step 4, record user sound, identify the sound of user, based on for acoustic control instruction control TV programme regulation And/or volume adjustment.
2. the method as described in claim 1, which is characterized in that step 1 specifically:
Different TV signals is captured, and different resolution ratio is set for every kind of TV signal, and be converted to different-format Digital signal;And user can resolution ratio and signal format based on demand and application scenarios selection TV signal.
3. the method as described in claim 1, which is characterized in that in step 2, support the text information and not apposition of Chinese and English Different format and bit rate can be set in formula text code mode, the voice and other audio files that user sends.
4. the method as described in claim 1, which is characterized in that the specific processing based on smart home TV sharing method Mode upgrades processing mode in such a way that distal end upgrades.
CN201910252615.6A 2018-03-30 2019-03-29 Television sharing method based on intelligent home Expired - Fee Related CN110139144B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810275589 2018-03-30
CN2018102755894 2018-03-30

Publications (2)

Publication Number Publication Date
CN110139144A true CN110139144A (en) 2019-08-16
CN110139144B CN110139144B (en) 2020-10-23

Family

ID=67568851

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910252615.6A Expired - Fee Related CN110139144B (en) 2018-03-30 2019-03-29 Television sharing method based on intelligent home

Country Status (1)

Country Link
CN (1) CN110139144B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111131858A (en) * 2019-12-30 2020-05-08 杭州当虹科技股份有限公司 Method for fixing code rate based on TS video PID

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060045280A1 (en) * 2004-08-24 2006-03-02 International Business Machines Corporation System and method for hierarchical audio conflict control
CN102523401A (en) * 2011-12-29 2012-06-27 深圳Tcl新技术有限公司 Intelligent household television control system and method thereof
CN103763607A (en) * 2014-01-08 2014-04-30 深圳市创维电器科技有限公司 Television signal sharing method and device
CN105227979A (en) * 2015-09-14 2016-01-06 深圳Tcl数字技术有限公司 Based on audio frequency playing method and the device of intelligent television
CN106101749A (en) * 2016-07-29 2016-11-09 北京小米移动软件有限公司 TV programme sharing method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060045280A1 (en) * 2004-08-24 2006-03-02 International Business Machines Corporation System and method for hierarchical audio conflict control
CN102523401A (en) * 2011-12-29 2012-06-27 深圳Tcl新技术有限公司 Intelligent household television control system and method thereof
CN103763607A (en) * 2014-01-08 2014-04-30 深圳市创维电器科技有限公司 Television signal sharing method and device
CN105227979A (en) * 2015-09-14 2016-01-06 深圳Tcl数字技术有限公司 Based on audio frequency playing method and the device of intelligent television
CN106101749A (en) * 2016-07-29 2016-11-09 北京小米移动软件有限公司 TV programme sharing method and device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111131858A (en) * 2019-12-30 2020-05-08 杭州当虹科技股份有限公司 Method for fixing code rate based on TS video PID

Also Published As

Publication number Publication date
CN110139144B (en) 2020-10-23

Similar Documents

Publication Publication Date Title
US20230328305A1 (en) Method and device for adapting the video content decoded from elementary streams to the characteristics of a display
CN111343460B (en) Receiving device, display equipment and receiving method
KR101706956B1 (en) Non-realtime service processing method and broadcasting receiver
US7650626B2 (en) Service system of thumbnail image and transmitting/receiving method thereof
US20190007709A1 (en) Broadcast signal transmission apparatus, broadcast signal reception apparatus, broadcast signal transmission method and broadcast signal reception method
US9769518B2 (en) Method for transmitting a broadcast service, method for receiving a broadcast service, and apparatus for receiving a broadcast service
JP2008011404A (en) Content processing apparatus and method
US10536665B2 (en) Device for transmitting broadcast signal, device for receiving broadcast signal, method for transmitting broadcast signal, and method for receiving broadcast signal
TW200836557A (en) Method and apparatus for switching program streams usign a variable speed program stream buffer coupled to a variable speed decoder
US10283167B2 (en) Image decoding device, image decoding method, image encoding device, and image encoding method
CN105142003B (en) Television program playing method and device
KR101171389B1 (en) System and method for compressed video data transmission using sdi
US9584755B2 (en) Endoscope with high definition video recorder/player
CN110139144A (en) One kind is based on TV sharing method in smart home
US10306298B2 (en) Image processing apparatus and control method thereof
AU2016269886B2 (en) Transmission device, transmission method, media processing device, media processing method, and reception device
JP6958645B2 (en) Transmitter, transmitter, receiver and receiver
JP6658944B2 (en) Transmitting device, transmitting method, receiving device and receiving method
EP2357820A1 (en) System and method for signaling programs from different Transport Streams
Liu et al. An HD IPTV system based on scalable video coding
JP2021073761A (en) Transmitter, transmission method, receiver and receiving method
JP2020014246A (en) Transmitter, transmission method, receiver and receiving method
CN105491394A (en) Method and device for sending MMT packet and method for receiving MMT packet
KR20140061352A (en) Method for receiving media and device thereof
CN102595241A (en) Method for supporting flv video playing through set top box

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20201023