CN103517146A - Method and system for implementing virtual voice device in smart television set - Google Patents

Method and system for implementing virtual voice device in smart television set Download PDF

Info

Publication number
CN103517146A
CN103517146A CN201210334046.8A CN201210334046A CN103517146A CN 103517146 A CN103517146 A CN 103517146A CN 201210334046 A CN201210334046 A CN 201210334046A CN 103517146 A CN103517146 A CN 103517146A
Authority
CN
China
Prior art keywords
intelligent television
speech
mobile terminal
module
voice
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201210334046.8A
Other languages
Chinese (zh)
Other versions
CN103517146B (en
Inventor
吴成林
谭凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TCL Corp
Original Assignee
TCL Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TCL Corp filed Critical TCL Corp
Priority to CN201210334046.8A priority Critical patent/CN103517146B/en
Publication of CN103517146A publication Critical patent/CN103517146A/en
Application granted granted Critical
Publication of CN103517146B publication Critical patent/CN103517146B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses a method and system for implementing a virtual voice device in a smart television set. The method for implementing the virtual voice device in the smart television set comprises the steps that connection between a mobile terminal and the smart television set is established, the mobile terminal captures voice data of a voice input device of the mobile terminal, and transmits the voice data to the smart television set, and the smart television set receives the voice data, and virtualizes the voice data to form voice data of a local voice device through a hardware adapter module of the virtual voice device. According to the method and system for implementing the virtual voice device in the smart television set, the voice data of the mobile terminal can be directly transmitted to the smart television set, an upper layer application of the smart television set can directly use the voice data of the mobile terminal, and voice data input of the smart television set can be achieved without configuration of an additional voice input device.

Description

Intelligent television is realized the method and system of virtual speech equipment
Technical field
The present invention relates to intelligent television virtual speech technology, relate in particular to the method and system that Android system intelligence TV is realized virtual speech equipment.
Background technology
Along with the arrival in intelligent television epoch, the purposes of television set becomes more and more wider.Television set has been no longer simple display device, strides forward gradually to intelligent equipment.Like this, TV just need to support more peripheral hardware to adapt to its application.Such as the use of the application programs such as intelligent television voice recording, phonetic search all be unable to do without the support of voice-input device-microphone.
Present intelligent television Realization of Product phonetic entry is on the market mainly to complete by peripheral hardware microphone, such as the microphone of USB interface or the microphone of audio interface, when intelligent television user will use the voice input function of TV, need to buy separately microphone apparatus.Along with the development of multi-screen interactive application technology, the phonetic entry of intelligent television also can complete by mobile terminal, and then realizes the control to intelligent television.But, the realization of this technology is by catching the voice signal of mobile terminal and processing the control command that obtains textual form at mobile terminal by high in the clouds, then send the control command of textual form to intelligent television, intelligent television is carried out the operation relevant to its control command after receiving control command, realizes the control to intelligent television by mobile terminal sound.Yet in whole control procedure, intelligent television does not have the original voice data of mobile terminal receive, but receive the text control command transforming after process in mobile terminal high in the clouds, realize the control to TV, belong to a kind of indirectly voice and control.
Visible, user, when using the voice input function of intelligent television, need to plug microphone on the hardware interface of TV, uses and inconvenience.For multi-screen interactive voice control technology, although realized to a certain extent, utilize the control of the microphone of mobile terminal to TV, but still existence can only complete aforementioned specific voice control, most of voice application, the speech application of downloading from application shop as intelligent television can not directly be used the microphone of mobile terminal, because it is treated data that mobile terminal microphone is sent to the speech data of TV end, and nonprimitive voice data.
Therefore, prior art has yet to be improved and developed.
Summary of the invention
In view of above-mentioned the deficiencies in the prior art part, the present invention is for solving prior art defect and deficiency, a kind of directly method and system of the voice-input device using mobile terminal as intelligent television are proposed, expanded the phonetic function of mobile terminal, made the various application of intelligent television all can directly use the speech data of mobile terminal.
The technical scheme that technical solution problem of the present invention adopts is as follows:
Intelligent television is realized a method for virtual speech equipment, and described intelligent television comprises virtual speech device hardware adaptation module, and described method comprises the steps:
When intelligent television is enabled phonetic entry, intelligent television is initiated data connection request to mobile terminal, and intelligent television is set up data with mobile terminal and is connected;
Mobile terminal captures the speech data of equipment of itself voice-input device, and gives described intelligent television described voice data transmission;
Intelligent television receives described speech data, and described speech data is invented to the speech data of local voice equipment by described virtual speech device hardware adaptation module.
Further, described intelligent television also comprises application interface module and virtual speech driven management module, at described intelligent television, receive described speech data, and after described speech data being invented to the speech data step of local voice equipment by described virtual speech device hardware adaptation module, also comprise:
The described application interface module of intelligent television realizes the functional method of local voice equipment by described virtual speech device hardware adaptation module, described functional method comprises that equipment is opened, equipment starts, equipment stops, equipment discharges, for provide standard to drive interface to upper strata, call virtual speech driven management module downwards and carry out the transmission of speech data and obtain, upper level applications is realized and facilitate virtual speech equipment calls.
Further, described, when intelligent television is enabled phonetic entry, intelligent television is initiated data connection request to mobile terminal, and intelligent television and mobile terminal also comprise before setting up data Connection Step:
Mobile terminal initiates to intelligent television the pre-connection that order is controlled, and sets up control command connection;
Mobile terminal ready for sending information is to intelligent television;
Described intelligent television creates device file, for notifying the voice-input device of described intelligent television mobile terminal ready.
Further, after described mobile terminal ready for sending information is to intelligent television step, also comprise:
Intelligent television and mobile terminal are set up WAV audio data stream transmission channel, for passing through RTSP protocol transmission WAV speech data, in described mobile terminal, set up RTSP service end, described intelligent television is set up RTSP client, under RTSP agreement, can by RTSP service end by WAV voice data transmission to RTSP client.
Further, described intelligent television also comprises after receiving described speech data step:
Intelligent television is reduced into PCM audio data stream WAV audio data stream, to offer virtual speech device hardware adaptation module, described PCM audio data stream is invented to the speech data of local voice equipment.
Further, described when intelligent television is enabled phonetic entry, intelligent television is initiated data connection request to mobile terminal, and intelligent television and mobile terminal are set up data Connection Step, specifically comprise:
When user moves intelligent television speech application, will open device command and send to mobile terminal;
Mobile terminal is passed to intelligent television by the speech data address of service of startup, and intelligent television is initiated speech data connection request according to this address to mobile terminal, and sets up data connection.
The system that the present invention also provides a kind of intelligent television to realize virtual speech equipment, for the virtual speech input equipment using the voice-input device of mobile terminal as intelligent television, described system comprises mobile terminal and the intelligent television connecting, and
Described mobile terminal comprises voice handling module and voice sending module, and described voice handling module is used for capturing speech data, and described voice sending module is for sending to described intelligent television by speech data;
Described intelligent television comprises virtual speech device hardware adaptation module, virtual speech driven management module and phonetic incepting module, wherein said virtual speech device hardware adaptation module is for providing standard to drive interface to upper strata, call virtual speech driven management module downwards, described virtual speech driven management module is for passing through pipeline communication with phonetic incepting intermodule, transmission control command, obtain speech data, described phonetic incepting module, for connecting with the voice sending module of mobile terminal, receives speech data.
Further, described intelligent television also comprises:
Application interface module, the standard that being used for calling described virtual speech device hardware adaptation module provides drives interface to obtain the speech data of described virtual speech device hardware adaptation module output, and operate and dock with upper level applications, the functional method of voice-input device is provided to upper level applications, described functional method comprises that equipment is opened, equipment starts, equipment stops, equipment discharges, and upper level applications is realized and facilitate virtual speech equipment calls.
Further, described application interface module is also for after receiving the ready information of mobile terminal transmission, and intelligent television creates device file, and the voice-input device of notice intelligent television mobile terminal is ready.
Further, between the phonetic incepting module of described intelligent television and the voice sending module of mobile terminal, set up WAV audio data stream transmission channel, for passing through RTSP protocol transmission WAV speech data.
Further, the phonetic incepting module of described intelligent television also comprises PCM data conversion module, for WAV audio data stream is reduced into PCM audio data stream, to offer virtual speech device hardware adaptation module, described PCM audio data stream is invented to the speech data of local voice equipment.
Compared with prior art, the present invention has realized mobile terminal, as smart mobile phone is virtual, is the voice-input device of intelligent television.
Mobile terminal captures speech data, and speech data is sent to intelligent television, intelligent television provides standard to drive interface on the virtual speech data ,Bing Dui upper strata for local voice equipment of described speech data again, reaches the speech ciphering equipment object that upper layer application can directly be used mobile terminal.
In the human-computer interaction technology of multi-screen interactive, user can utilize the voice-input device of mobile terminal, as the microphone of mobile phone, realizes the speech voice input function to intelligent television, for example, realize voice and control.Intelligent television can be equipped with external specially, realizes the typing of speech data such as USB microphone, the speech voice input function providing users with the convenient.
Accompanying drawing explanation
Fig. 1 is the functional module structure figure that intelligent television of the present invention is realized system one embodiment of virtual speech equipment.
Fig. 2 is the functional module frame construction drawing of Android system voice part in Fig. 1.
Fig. 3 is the workflow diagram that intelligent television of the present invention is realized method one embodiment of virtual speech equipment.
Embodiment
For making object of the present invention, technical scheme and advantage clearer, clear and definite, referring to accompanying drawing, developing simultaneously, the present invention is described in more detail for embodiment.Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.
The invention provides a kind of intelligent television and realize the method for virtual speech equipment, intelligent television adopts Android system, for by the voice-input device of mobile terminal virtual be the voice-input device of intelligent television upper layer application.
Mentality of designing of the present invention is at the intelligent television based on Android platform, to set up the virtual speech device hardware adaptation module of a bottom, described virtual speech device hardware adaptation module is also the virtual device driver of hardware adaptation layer, for by the voice-input device of mobile terminal virtual be the voice-input device of intelligent television upper layer application.Further, the present invention, at the bottom of intelligent television, provides standard to drive interface for upper strata application call, and local voice equipment is the same with using, and reaches the object that upper level applications can realize phonetic entry fast.
The voice-input device of corresponding mobile terminal, the mobile terminal in the inventive method preferably adopts mobile phone, certainly, and other mobile terminals, the mobile terminal that such as panel computer PAD, PDA etc. has microphone voice-input device can complete corresponding function equally.For convenience of explanation, described mobile terminal is similarly Android system platform.
Intelligent television, by mobile terminal, is the voice-input device of intelligent television as smart mobile phone is virtual.Intelligent television mainly comprises virtual speech device hardware adaptation module and virtual speech driven management module, and wherein virtual speech driven management module realizes the transmission of command information, and realizes the control to far-end (being mobile phone or panel computer) microphone; Described virtual speech device hardware adaptation module, for provide standard to drive interface to upper strata, is called virtual speech driven management module downwards and is obtained and transmitting audio data.On intelligent television upper strata, for needing the application program (being upper layer application) of phonetic entry all can directly drive interface to reach the object that realizes phonetic entry by the far-end microphone of mobile terminal by described standard.
In the Android of intelligent television system, realize a hardware adaptation (HAL) layer (being virtual speech device hardware adaptation module), this HAL layer and local voice input equipment belong to the equipment of same level, HAL layer is completed transmission and is obtained the speech data of mobile microphone by virtual speech driven management module, and controls alternately with mobile terminal.
Shown in Fig. 1, be the functional module structure figure that Android system intelligence TV of the present invention is realized virtual speech device systems; As shown in the figure, intelligent television 100 has application interface module 101, this application interface module is directly called for upper level applications, this application interface module 101 comprises the common function method interface (being API handle) that calls speech ciphering equipment, by described functional method interface, can conveniently be realized by remote speech equipment and be obtained speech data.In addition, whether described this application interface module 101 also exists for the device file by tactical management service-seeking intelligent television, be whether intelligent television connects local voice input equipment or virtual speech input equipment, inquire after device file existence, can serve shielding local voice input equipment by tactical management; Intelligent television 100 also comprises virtual speech device hardware adaptation module 102, virtual speech driven management module 103, phonetic incepting module 104, and the function of virtual speech device hardware adaptation module 102 is to realize the interface of Android system standard application programming interfaces and bottom speech data; Phonetic incepting module 104 comprises RTSP client 1041 and command transfer module 1042; Virtual speech driven management module 103 is as background service, pass through pipeline communication with phonetic incepting module 104, specifically the RTSP client 1041 in phonetic incepting module 104 completes with the WAV speech data of external voice input equipment and receives, command transfer module 1042 completes with the control command of external voice input equipment and sends, receives, and the transmission of control command adopts Transmission Control Protocol to transmit.
In addition, described virtual speech device hardware adaptation module comprises that system standard drives interface sub-module, and this submodule is used for providing voice-input device system standard to drive interface, and this interface offers the application interface module 101 of intelligent television and calls.Application interface module 101 drives interface to realize the speech data of local voice equipment by the standard of calling described virtual speech device hardware adaptation module and providing, and operate and dock with upper level applications, the functional method of voice-input device is provided to upper level applications, functional method comprises that equipment is opened, equipment starts, equipment stops and discharging with equipment, for provide standard to drive interface to upper strata, call virtual speech driven management module downwards and carry out the transmission of speech data and obtain, upper level applications is realized and facilitate virtual speech equipment calls.
Mobile terminal 200 comprises voice handling module 201 and voice sending module 202, wherein voice sending module 202 also comprises RTSP service end 2021 and command transfer module 2022, command transfer module 2022 herein belongs to the command transfer module 1042 in intelligent television phonetic incepting module 104 module that realizes command interactive function, transmission control command between intelligent television 100 and mobile terminal 200 realizes by command transfer module separately, and control command adopts Transmission Control Protocol to complete.Mobile terminal captures the speech data of equipment of itself voice-input device by voice handling module 201, be voice handling module 201 for opening voice-input device---microphone, capture speech data and generate WAV audio data stream, realize the input of speech data, WAV speech data Liu who captures sends to the phonetic incepting module 104 of intelligent television 100 by voice sending module 202.Intelligent television 100 receives WAV audio data stream and is reduced into PCM audio data stream, to offer virtual speech device hardware adaptation module, PCM audio data stream is invented to the speech data of local voice equipment.
System based on above-mentioned Android system intelligence TV and mobile terminal, the method basic handling step that Android system intelligence TV provided by the invention is realized virtual speech equipment is as follows:
When intelligent television is enabled phonetic entry, intelligent television 100 is initiated data connection request to mobile terminal 200, intelligent television 100 is set up data with mobile terminal 200 and is connected, mobile terminal 200 is passed to intelligent television by the speech data address of service of building, and intelligent television is initiated speech data connection request according to this address of service to mobile terminal.Mobile terminal captures the speech data of equipment of itself voice-input device, and give intelligent television voice data transmission, intelligent television receives after speech data, by virtual speech device hardware adaptation module, speech data is invented to the speech data of local voice equipment.
Before intelligent television is enabled phonetic entry, mobile terminal and intelligent television also have a pre-connection process, mobile terminal is initiated pre-connection request that order controls, is set up control command and connect to intelligent television, and ready for sending information is to intelligent television 100, intelligent television creates device file, for notifying the voice-input device of described intelligent television mobile terminal ready.
The virtual speech driven management module 103 of intelligent television 100 will be opened voice-input device order and send to described voice sending module 202 through phonetic incepting module 104, described voice sending module 202 is set up speech data with phonetic incepting module 104 and is connected, be specially intelligent television and mobile terminal and set up WAV data stream transmitting channel transfer WAV speech data, in mobile terminal, start RTSP service end, in intelligent television system, start RTSP client, under RTSP agreement, by RTSP service end, WAV speech data is streaming to RTSP client.Intelligent television is reduced into PCM audio data stream after receiving WAV audio data stream, to offer virtual speech device hardware adaptation module, described PCM audio data stream is invented to the speech data of local voice equipment.
Described voice handling module 201 captures the speech data of mobile terminal 200 voice-input devices, and speech data is sent to described phonetic incepting module 104; Described voice sending module 202 sends to described phonetic incepting module 104 to transmit realization by Transmission Control Protocol transmission command.
At above-mentioned voice sending module 202, set up in voice data transmission passage process with described phonetic incepting module 104, concrete steps adopt: the voice sending module 202 of described mobile terminal 200 starts RTSP service end, correspondingly, the virtual speech driven management module 103 of described intelligent television starts RTSP clients, by between RTSP service end and RTSP client by RTP(RTP) realize the transmission of speech data.Audio data stream and the form thereof of transmission have been described in detail in said system, do not repeat herein.
After the speech data of described phonetic incepting module 104 mobile terminal receives 200, the speech data that described virtual speech driven management module 103 receives phonetic incepting module 104 is uploaded to virtual speech device hardware adaptation module 102;
Described virtual speech device hardware adaptation module 102 offers voice data transmission the speech application use of intelligent television to the application interface module 101 of intelligent television 100, upper layer application is used.
In order to make the realization of virtual process clearer, below respectively the workflow of the functional modules such as virtual speech driven management module 103, phonetic incepting module 104, voice sending module 202 and mobile device voice handling module 201 is elaborated.
First the structure of virtual speech device hardware adaptation module 102 in Android system, as shown in Figure 2, the lower module of intelligent television Android system voice application 301 is JAVA speech API 302, JAVA speech API 302 lower floors are Android JNI303, Android JNI303 comprises two service modules, respectively the service 304 of Android audio frequency apparatus and Android audio frequency policy service 305, wherein Android audio frequency policy service 305 lower modules are audio frequency strategy HAL308, it is far-end audio equipment or local audio devices that this audio frequency strategy HAL308 is used for selecting Android audio service, Android audio frequency apparatus is served 304 lower floors and is comprised local audio devices HAL306 and virtual audio device HAL307, and local audio devices HAL306 lower floor comprises Linux audio device drive 309, and this driving layer is used for driving local audio devices 310.In order to realize the audio frequency apparatus of far-end, connect, and remote speech equipment virtual be local speech ciphering equipment, as shown in Figure 2, Android audio frequency apparatus is served 304 lower modules and is provided with virtual audio device HAL307, this HAL lower module is virtual audio device administration module 311, be used for driving far-end, i.e. the audio frequency apparatus 312 of mobile terminal.
Being intelligent television provided by the invention and mobile terminal below realizes method one embodiment of virtual speech equipment as smart mobile phone, as shown in Figure 3, smart mobile phone microphone is as the implementation method step of the virtual speech equipment of the far-end virtual speech equipment of Android system intelligence TV.The functional module that wherein intelligent television, smart mobile phone comprise, and between intelligent television, smart mobile phone, the transmission of data all be take said system as benchmark, does not repeat herein.
S100: smart mobile phone initiates to intelligent television the pre-connection request that order is controlled, sets up control command and connects, and send microphone state information to intelligent television;
S200: the virtual speech driven management module of intelligent television is received information and processes;
S300: judge that whether mobile phone terminal microphone ready? if not then thread, Android system is returned to step S100 and is again waited for that mobile phone sends microphone state information; If ready, sequentially perform step S400;
S400: intelligent television virtual speech driven management module creation device file, inform that intelligent television system has microphone to use;
S500: user moves intelligent television voice application, intelligent television system finds that there is available microphone apparatus (virtual audio device), calls the virtual speech equipment of intelligent television.
S600: intelligent television virtual speech EM equipment module will be opened device command by virtual speech driven management module and send to mobile phone terminal;
S700: mobile phone terminal is received and opened microphone order, starts RTSP service, and sends to intelligent television virtual speech driven management module to connect speech data address of service, then starts to capture microphone data transmitting audio data;
S800: intelligent television virtual speech driven management module sends data connection request according to the speech data address of service receiving;
S900: intelligent television virtual speech EM equipment module receives mobile microphone speech data;
S901: user's closing television end voice application, intelligent television virtual speech EM equipment module stops receiving data, and concurrent losing one's life makes closing hand phone microphone data capture service.
Mobile terminal, as the virtual speech equipment of smart mobile phone as intelligent television, at intelligent television, virtual speech functions of the equipments have been realized, the mobile microphone of far-end also can be identified by intelligent television as local voice input equipment, and key is to have increased in the Android audio frequency apparatus service in intelligent television virtual audio device module and virtual speech device hardware adaptation module.By virtual speech driven management module, the mobile microphone speech data of far-end is managed, speech data is uploaded to the voice application of intelligent television, makes the speech application of intelligent television can as using local voice input equipment, use the speech ciphering equipment of far-end.
Under RTSP agreement, what between mobile terminal and intelligent television, transmit is original WAV speech data, like this, receives after the speech data of mobile phone at intelligent television, WAV speech data can be converted to PCM speech data, meet the audio standard of Android system voice equipment.
The present invention can be applied in multi-screen interactive technology, realize and utilize the audio input device of mobile terminal to substitute local audio input equipment, improved on the one hand the utilance of equipment, user uses mobile terminal with respect to microphone, obtain and use conveniently on the other hand, has promoted user's experience.
Should be understood that; the foregoing is only preferred embodiment of the present invention; be not sufficient to limit technical scheme of the present invention; for those of ordinary skills; within the spirit and principles in the present invention; can be increased and decreased according to the above description, replaced, converted or be improved, and all these increases and decreases, replace, conversion or improve after technical scheme, all should belong to the protection range of claims of the present invention.

Claims (11)

1. intelligent television is realized a method for virtual speech equipment, it is characterized in that, described intelligent television comprises virtual speech device hardware adaptation module, and described method comprises the steps:
When intelligent television is enabled phonetic entry, intelligent television is initiated data connection request to mobile terminal, and intelligent television is set up data with mobile terminal and is connected;
Mobile terminal captures the speech data of equipment of itself voice-input device, and gives described intelligent television described voice data transmission;
Intelligent television receives described speech data, and described speech data is invented to the speech data of local voice equipment by described virtual speech device hardware adaptation module.
2. method according to claim 1, it is characterized in that, described intelligent television also comprises application interface module and virtual speech driven management module, at described intelligent television, receive described speech data, and after described speech data being invented to the speech data step of local voice equipment by described virtual speech device hardware adaptation module, also comprise:
The described application interface module of intelligent television realizes the functional method of local voice equipment by described virtual speech device hardware adaptation module, described functional method comprises that equipment is opened, equipment starts, equipment stops, equipment discharges, for provide standard to drive interface to upper strata, call virtual speech driven management module downwards and carry out the transmission of speech data and obtain, upper level applications is realized and facilitate virtual speech equipment calls.
3. method according to claim 1, is characterized in that, described when intelligent television is enabled phonetic entry, and intelligent television is initiated data connection request to mobile terminal, and intelligent television and mobile terminal also comprise before setting up data Connection Step:
Mobile terminal initiates control command pre-connection request and sets up control command to connect to intelligent television;
Mobile terminal ready for sending information is to intelligent television;
Described intelligent television creates device file, for notifying the voice-input device of described intelligent television mobile terminal ready.
4. method according to claim 3, is characterized in that, described mobile terminal ready for sending information, to after intelligent television step, also comprises:
Intelligent television and mobile terminal are set up WAV audio data stream transmission channel, for passing through RTSP protocol transmission WAV speech data, in described mobile terminal, set up RTSP service end, described intelligent television is set up RTSP client, under RTSP agreement, can by RTSP service end by WAV voice data transmission to RTSP client.
5. method according to claim 4, is characterized in that, described intelligent television also comprises after receiving described speech data step:
Intelligent television is reduced into PCM audio data stream WAV audio data stream, to offer virtual speech device hardware adaptation module, described PCM audio data stream is invented to the speech data of local voice equipment.
6. method according to claim 1, is characterized in that, described when intelligent television is enabled phonetic entry, and intelligent television is initiated data connection request to mobile terminal, and intelligent television and mobile terminal are set up data Connection Step, specifically comprise:
When user moves intelligent television speech application, will open device command and send to mobile terminal;
Mobile terminal is passed to intelligent television by the speech data address of service of startup, and intelligent television is initiated speech data connection request according to this address to mobile terminal, and sets up data connection.
7. intelligent television is realized a system for virtual speech equipment, and the virtual speech input equipment for using the voice-input device of mobile terminal as intelligent television, is characterized in that:
Described system comprises mobile terminal and the intelligent television connecting, and
Described mobile terminal comprises voice handling module and voice sending module, and described voice handling module is used for capturing speech data, and described voice sending module is for sending to described intelligent television by speech data;
Described intelligent television comprises virtual speech device hardware adaptation module, virtual speech driven management module and phonetic incepting module, wherein said virtual speech device hardware adaptation module is for providing standard to drive interface to upper strata, call virtual speech driven management module downwards, described virtual speech driven management module is for passing through pipeline communication with phonetic incepting intermodule, transmission control command, obtain speech data, described phonetic incepting module, for connecting with the voice sending module of mobile terminal, receives speech data.
8. system according to claim 7, is characterized in that, described intelligent television also comprises:
Application interface module, the standard that being used for calling described virtual speech device hardware adaptation module provides drives interface to obtain the speech data of described virtual speech device hardware adaptation module output, and operate and dock with upper level applications, the functional method of voice-input device is provided to upper level applications, described functional method comprises that equipment is opened, equipment starts, equipment stops, equipment discharges, and upper level applications is realized and facilitate virtual speech equipment calls.
9. system according to claim 8, is characterized in that, described application interface module is also for after receiving the ready information of mobile terminal transmission, and intelligent television creates device file, and the voice-input device of notice intelligent television mobile terminal is ready.
10. system according to claim 8, is characterized in that, between the phonetic incepting module of described intelligent television and the voice sending module of mobile terminal, sets up WAV audio data stream transmission channel, for passing through RTSP protocol transmission WAV speech data.
11. systems according to claim 8, it is characterized in that, the phonetic incepting module of described intelligent television also comprises PCM data conversion module, for WAV audio data stream is reduced into PCM audio data stream, to offer virtual speech device hardware adaptation module, described PCM audio data stream is invented to the speech data of local voice equipment.
CN201210334046.8A 2012-09-11 2012-09-11 Intelligent television realizes the method and system of virtual speech equipment Expired - Fee Related CN103517146B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210334046.8A CN103517146B (en) 2012-09-11 2012-09-11 Intelligent television realizes the method and system of virtual speech equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210334046.8A CN103517146B (en) 2012-09-11 2012-09-11 Intelligent television realizes the method and system of virtual speech equipment

Publications (2)

Publication Number Publication Date
CN103517146A true CN103517146A (en) 2014-01-15
CN103517146B CN103517146B (en) 2016-08-31

Family

ID=49899048

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210334046.8A Expired - Fee Related CN103517146B (en) 2012-09-11 2012-09-11 Intelligent television realizes the method and system of virtual speech equipment

Country Status (1)

Country Link
CN (1) CN103517146B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104050109A (en) * 2014-06-09 2014-09-17 青岛海信移动通信技术股份有限公司 Method, equipment and system for expanding peripherals
CN104536717A (en) * 2014-12-15 2015-04-22 深圳市金立通信设备有限公司 Voice input method
CN104536644A (en) * 2014-12-15 2015-04-22 深圳市金立通信设备有限公司 Terminal
CN107483993A (en) * 2017-07-14 2017-12-15 深圳Tcl新技术有限公司 Pronunciation inputting method, TV and the computer-readable recording medium of TV
CN109471667A (en) * 2018-11-16 2019-03-15 郑州大学 Computer and mobile phones integrated intelligent interactive method
CN111385624A (en) * 2018-12-29 2020-07-07 深圳Tcl新技术有限公司 Voice-based data transmission control method, smart television and storage medium
CN111739532A (en) * 2020-07-16 2020-10-02 展讯通信(上海)有限公司 Voice control method and device, storage medium, intelligent terminal and voice control system
CN111796794A (en) * 2020-07-09 2020-10-20 西安万像电子科技有限公司 Voice data processing method and system and virtual machine
CN112449224A (en) * 2019-09-05 2021-03-05 深圳Tcl新技术有限公司 Method, system and storage medium for controlling smart television by voice
CN112749022A (en) * 2019-10-29 2021-05-04 阿里巴巴集团控股有限公司 Camera resource access method, operating system, terminal and virtual camera

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101998077A (en) * 2009-08-21 2011-03-30 联咏科技股份有限公司 Voice control device, voice control method and relevant display device
WO2012074643A1 (en) * 2010-12-03 2012-06-07 Siemens Enterprise Communications, Inc. Method and apparatus for controlling sessions from one or more devices
CN102625171A (en) * 2012-03-16 2012-08-01 晨星软件研发(深圳)有限公司 Remote control method, system and corresponding equipment for smart television
CN103517123A (en) * 2012-06-29 2014-01-15 深圳市快播科技有限公司 Smart television playing device, terminal, method for achieving microphone function and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101998077A (en) * 2009-08-21 2011-03-30 联咏科技股份有限公司 Voice control device, voice control method and relevant display device
WO2012074643A1 (en) * 2010-12-03 2012-06-07 Siemens Enterprise Communications, Inc. Method and apparatus for controlling sessions from one or more devices
CN102625171A (en) * 2012-03-16 2012-08-01 晨星软件研发(深圳)有限公司 Remote control method, system and corresponding equipment for smart television
CN103517123A (en) * 2012-06-29 2014-01-15 深圳市快播科技有限公司 Smart television playing device, terminal, method for achieving microphone function and system

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104050109A (en) * 2014-06-09 2014-09-17 青岛海信移动通信技术股份有限公司 Method, equipment and system for expanding peripherals
CN104536717A (en) * 2014-12-15 2015-04-22 深圳市金立通信设备有限公司 Voice input method
CN104536644A (en) * 2014-12-15 2015-04-22 深圳市金立通信设备有限公司 Terminal
CN107483993B (en) * 2017-07-14 2021-04-09 深圳Tcl新技术有限公司 Voice input method of television, television and computer readable storage medium
CN107483993A (en) * 2017-07-14 2017-12-15 深圳Tcl新技术有限公司 Pronunciation inputting method, TV and the computer-readable recording medium of TV
CN109471667A (en) * 2018-11-16 2019-03-15 郑州大学 Computer and mobile phones integrated intelligent interactive method
CN111385624A (en) * 2018-12-29 2020-07-07 深圳Tcl新技术有限公司 Voice-based data transmission control method, smart television and storage medium
CN111385624B (en) * 2018-12-29 2021-10-01 深圳Tcl新技术有限公司 Voice-based data transmission control method, smart television and storage medium
CN112449224A (en) * 2019-09-05 2021-03-05 深圳Tcl新技术有限公司 Method, system and storage medium for controlling smart television by voice
CN112449224B (en) * 2019-09-05 2023-02-17 深圳Tcl新技术有限公司 Method, system and storage medium for controlling smart television by voice
CN112749022A (en) * 2019-10-29 2021-05-04 阿里巴巴集团控股有限公司 Camera resource access method, operating system, terminal and virtual camera
CN111796794A (en) * 2020-07-09 2020-10-20 西安万像电子科技有限公司 Voice data processing method and system and virtual machine
CN111796794B (en) * 2020-07-09 2023-12-22 西安万像电子科技有限公司 Voice data processing method, system and virtual machine
CN111739532A (en) * 2020-07-16 2020-10-02 展讯通信(上海)有限公司 Voice control method and device, storage medium, intelligent terminal and voice control system

Also Published As

Publication number Publication date
CN103517146B (en) 2016-08-31

Similar Documents

Publication Publication Date Title
CN103517146A (en) Method and system for implementing virtual voice device in smart television set
JP5039024B2 (en) Method and apparatus for multi-mode voice and web services
CN109348167B (en) Wireless auxiliary stream data transmission method and system based on video conference system
CN103942044B (en) remote assistance method and system in mobile terminal application
KR20080053688A (en) Apparatus and method for remote control in portable terminal
CN102307294A (en) Method for participation of intelligent mobile terminal in video conference, terminal and system
US20180014063A1 (en) Method and Apparatus for Accessing a Terminal Device Camera to a Target Device
CN110475126A (en) A kind of interface adaptation method for media content sharing process
EP4099690A1 (en) Enhanced video call method and system, and electronic device
US20150288735A1 (en) Virtual Audio Device System for Unified Communications Applications
EP1766953A2 (en) Audio session management system and method for a mobile communication device
CN104853135A (en) Method and system for video switching during voice communication process
CN105743862B (en) Bidirectional mirroring system for sound data
CN102799409A (en) Method, device and terminal for voice input
CN112770078A (en) Video conference terminal fusion method and device and readable storage medium
CN104837126B (en) Method and communication terminal for sharing call between communication terminal
CN103414867A (en) Method, terminal and system for controlling multimedia communication
CN106791992A (en) Signal source method for pushing and system
CN104394254A (en) IP (Internet Protocol) technology-based four-channel voice commanding communication terminal
CN101867766A (en) Method and device for switching auxiliary video sources of video conference terminal
KR102399457B1 (en) System for voice call service using distal assistance device, method thereof and non-transitory computer readable medium having computer program recorded thereon
JP2014149644A (en) Electronic meeting system
CN101132568A (en) Mobile communication terminal and computer interactively integrated application system
CN110912577B (en) Three-in-one digital interphone
CN112104649A (en) Multimedia interaction method and device, electronic equipment, server and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20160831

CF01 Termination of patent right due to non-payment of annual fee