CN107948663A - A kind of way of recording, client and terminal device - Google Patents
A kind of way of recording, client and terminal device Download PDFInfo
- Publication number
- CN107948663A CN107948663A CN201711156861.9A CN201711156861A CN107948663A CN 107948663 A CN107948663 A CN 107948663A CN 201711156861 A CN201711156861 A CN 201711156861A CN 107948663 A CN107948663 A CN 107948663A
- Authority
- CN
- China
- Prior art keywords
- audio
- terminal device
- internal
- frequency data
- audio frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 claims abstract description 75
- 230000008569 process Effects 0.000 claims abstract description 58
- 230000007613 environmental effect Effects 0.000 claims abstract description 40
- 230000004044 response Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 5
- 230000003321 amplification Effects 0.000 description 4
- 238000003199 nucleic acid amplification method Methods 0.000 description 4
- 230000000052 comparative effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000011946 reduction process Methods 0.000 description 3
- 241001269238 Data Species 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 230000004308 accommodation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000037452 priming Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4392—Processing of audio elementary streams involving audio buffer management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
- H04N21/4431—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB characterized by the use of Application Program Interface [API] libraries
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8106—Monomedia components thereof involving special audio data, e.g. different tracks for different languages
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Library & Information Science (AREA)
- Software Systems (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
An embodiment of the present invention provides a kind of way of recording, client and terminal device, wherein method includes：Live client is established with the multimedia service process throws the shared connection of screen, when receiving the internal audio frequency data for the terminal device that the multimedia service process is sent, by calling audio service interface by current audio service pattern switching to Video chat pattern, by calling the audio service interface by the output channel of the internal audio frequency data by throwing the audio output apparatus for shielding sharing channel and being switched to the terminal device, and by calling the audio service interface, the environmental audio data outside the internal audio frequency data and the terminal device are recorded using the audio input device of the terminal device.The recording of terminal device internal sound and outside environmental sounds can convenient, be efficiently completed by the embodiment of the present invention, and system robustness is high.
Description
Technical field
The present invention relates to Internet technical field, more particularly to a kind of way of recording, client and terminal device.
Background technology
With the fast development of development of Mobile Internet technology, on the mobile terminal device such as smart mobile phone, tablet computer
Playing, live broadcast service is very popular, and spectator hears game sound, can also listen except that can watch real-time game picture
To game explain sound, player sound etc., game sound is considered as internal sound, sound will be explained, player's sound regards
For outside environmental sounds.
, on the one hand can be by individual calculus at present for the recording of internal sound in game process and outside environmental sounds
The software at machine (Personal Computer, PC) end is realized, it is necessary to use the microphone records internal sound and external rings on PC
Border sound, which, which needs PC to coordinate, could complete the live task of game, realize complex；On the other hand can be straight by game
The code broadcast is embedded into game to realize, that is, live function of playing can be regarded as a part for game, but embedded game is live
Code will increase the code cubage of game, the most of user for the direct broadcast function that causes to play but has downloaded and will not use
Function code, and system stability is poor.
The content of the invention
An embodiment of the present invention provides a kind of way of recording, client and terminal device, can convenient, efficiently complete eventually
The recording of end equipment internal sound and outside environmental sounds, and system robustness is high.
First aspect of the embodiment of the present invention provides a kind of way of recording, applied to terminal device, the terminal device fortune
Row has live client and multimedia service process, the described method includes：
The live client is established with the multimedia service process throws the shared connection of screen；
The live client is receiving the internal audio frequency for the terminal device that the multimedia service process is sent
During data, by calling audio service interface by current audio service pattern switching to Video chat pattern；
The live client by call the audio service interface by the output channel of the internal audio frequency data by
Throw the audio output apparatus that screen sharing channel is switched to the terminal device；
The live client utilizes the audio input device of the terminal device by calling the audio service interface
Record the environmental audio data outside the internal audio frequency data and the terminal device.
Second aspect of the embodiment of the present invention provides a kind of client, including：
Module is established, the shared connection of screen is thrown for being established with multimedia service process；
Receiving module, the internal audio frequency data of the terminal device sent for receiving the multimedia service process；
Handover module, for when the receiving module receives the internal audio frequency data, by calling audio service
Interface is by current audio service pattern switching to Video chat pattern；
The handover module, is additionally operable to by calling the audio service interface to lead to the output of the internal audio frequency data
Road is switched to the audio output apparatus of the terminal device by throwing screen sharing channel；
Module is recorded, for by calling the audio service interface, utilizing the audio input device of the terminal device
Record the environmental audio data outside the internal audio frequency data and the terminal device.
In some feasible embodiments, the handover module, is specifically used for：
When the receiving module receives the internal audio frequency data, by calling audio service interface by current sound
The business pattern switching that is taken in small doses at short intervals is played to audio and recording mode；
After preset duration is waited, by calling the audio service interface to cut the current audio service pattern
Change to Video chat pattern.
In some feasible embodiments, the audio output apparatus is loudspeaker, and the client further includes：
Output module, for by calling the audio service interface, the internal audio frequency to be exported using the loudspeaker
Data.
In some feasible embodiments, the client further includes：
Processing module, for being amplified processing to the internal audio frequency data of recording, the inside sound after being handled
Frequency evidence, and the voice data that the internal audio frequency data after the processing and the environmental audio data are obtained as recording.
It is described to establish module in some feasible embodiments, it is specifically used for：
The shared Connection Service request of screen is thrown in issue；
When the throwing screen for receiving the multimedia service progress feedback shares the response of Connection Service request, with institute
State multimedia service process and establish to throw and shield shared connection；
Wherein, established described after module and the multimedia service process establish and throw the shared connection of screen, internal audio frequency
The output channel of data is switched to throwing screen sharing channel by audio output apparatus.
The third aspect of the embodiment of the present invention provides a kind of terminal device, including：Processor and storage device；
The storage device, instructs for storage program；
The processor, calls the programmed instruction stored in the storage device, for being established with multimedia service process
Throw the shared connection of screen；When receiving the internal audio frequency data for the terminal device that the multimedia service process is sent, lead to
Cross and call audio service interface by current audio service pattern switching to Video chat pattern；By calling the audio service
The audio output that the output channel of the internal audio frequency data is switched to the terminal device by interface by throwing screen sharing channel is set
It is standby；By calling the audio service interface, the internal audio frequency number is recorded using the audio input device of the terminal device
According to the environmental audio data outside the terminal device.
Fourth aspect of the embodiment of the present invention provides a kind of computer-readable storage medium, it is characterised in that the computer stores
Have program stored therein instruction in medium, which is performed, and is used for realization the method described in above-mentioned first aspect.
In the embodiment of the present invention, live client is established with multimedia service process throws the shared connection of screen, more receiving
During the internal audio frequency data for the terminal device that media services process is sent, by calling audio service interface to take current audio
Pattern switching of being engaged in is to Video chat pattern, by calling audio service interface by the output channel of internal audio frequency data by throwing screen altogether
Enjoy the audio output apparatus that passage is switched to terminal device so that internal audio frequency data can be exported normally, then by calling audio
Service interface, the ambient sound frequency outside internal audio frequency data and terminal device is recorded using the audio input device of terminal device
According to so as to recording that is convenient, efficiently completing terminal device internal sound and outside environmental sounds, it is not necessary to external tool
Auxiliary, and system robustness is high.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is attached drawing needed in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, without creative efforts, can be with
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is a kind of flow diagram of way of recording provided in an embodiment of the present invention；
Fig. 2 a are a kind of operation interface schematic diagrames of live client provided in an embodiment of the present invention；
Fig. 2 b are the operation interface schematic diagrames of the live client of another kind provided in an embodiment of the present invention；
Fig. 3 is the flow diagram of another way of recording provided in an embodiment of the present invention；
Voice data flows to schematic diagram when Fig. 4 is a kind of recording provided in an embodiment of the present invention；
Fig. 5 is a kind of flow diagram handled recording data provided in an embodiment of the present invention；
Fig. 6 is a kind of structure diagram of client provided in an embodiment of the present invention；
Fig. 7 is a kind of structure diagram of terminal device provided in an embodiment of the present invention.
Embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other without creative efforts
Embodiment, belongs to the scope of protection of the invention.
The described terminal device of the embodiment of the present invention can specifically refer to install the smart mobile phone of iOS operating systems, put down
The mobile terminal devices such as plate computer.
The described terminal device operation of the embodiment of the present invention has live client and multimedia service process, live client
End is live for the picture to behaviors such as the game on terminal device, sound progress, with other clients on terminal device (such as
Game client) adhere to different processes separately, stable, system robustness is high；Multimedia service process is one in iOS system
A service processes, are responsible for all voice datas of processing system and view data.In addition, the described audio of the embodiment of the present invention
Service interface is specifically an application programming interfaces (Application Programming Interface, API), is system
The programming interface of offer, can change the audio frequency parameter of system, such as audio service pattern, audio number by audio service interface
According to output channel etc..
The internal audio frequency data of the described terminal device of the embodiment of the present invention refer to the audio of output inside terminal device
Data, such as game sound；Environmental audio data outside terminal device can specifically refer to that user inputs during live
Sound (such as player's sound, explain sound).
Referring to Fig. 1, it is a kind of flow diagram of the way of recording provided in an embodiment of the present invention.Retouched in the present embodiment
The way of recording stated, comprises the following steps：
101st, live client and multimedia service process, which are established, throws the shared connection of screen.
In the specific implementation, when needing the screen to terminal device to carry out sharing live, for example, need the picture to game,
The progress such as the sound of game, sound input by user is live, and user can start live client, operation circle of live client
Face can as shown in Figure 2 a and 2 b, and operation interface is provided with the live button of beginning/end in the lower right corner, the startup game on right side
Button, it is live during beholder issue barrage display area, and some other quick bottons (such as bottom it is quiet
The switch buttons such as sound, secret, barrage, data statistics), the live button of beginning that user is clicked in Fig. 2 a can start live TV stream
Journey, live client are established to throw to shield with multimedia service process and share connection after detecting that user's click starts live button,
Throw screen and share and refer to that the picture to behaviors such as the game on terminal device, sound progress are live, to be shared with other people.
In some feasible embodiments, throw the shared connection of screen and refer to that the aerial Airplay that plays that iOS system provides connects
Connect, the specific implementation that live client establishes the shared connection of throwing screen with multimedia service process can be such as the step 1 in Fig. 3
Shown in~5, the live assistant in Fig. 3 is above-mentioned live client, Media Sever be above-mentioned multimedia service into
Journey, audio service are above-mentioned audio service interface, and live assistant issues Bonjour service requests in a local network,
The interface statement of Bonjour service requests is desirable for Airplay mirror images Mirror services, and live assistant waits Airplay
Mirror service registrations success, Media Sever are detecting Airplay Mirror services, Airplay Mirror are being serviced
It is added in the Airplay options of terminal device system, live assistant is by calling privately owned API to be asked to Media Sever
Airplay services are connected to, Media Sever initiate to be connected with the Airplay of live assistant, and live assistant confirms to connect into
Work(, so far, sets up stable transmission control protocol (Transmission between Media Sever and live assistant
Control Protocol, TCP) connection.
Further, as shown in the step 6 in Fig. 3, after connection is successfully established, terminal device system is originally from audio output
The internal audio frequency data of equipment (such as loudspeaker) output, which turn to, throws screen sharing channel (i.e. Airplay passages), namely internal audio frequency
The output channel of data has been switched to throwing screen sharing channel by audio output apparatus, and the performance of terminal device at this time is no sound
Output.
102nd, the multimedia service process sends the internal audio frequency data of terminal device to the live client.
Correspondingly, the live client receives the internal audio frequency data.
In the specific implementation, live client is established with multimedia service process after throwing the shared connection of screen, user can pass through
Startup game button in the operation interface of live client shown in Fig. 2 b quickly starts target game set in advance, target
After game starts, live client can be automatically into running background.As shown in the step 7 in Fig. 3 and 8, live client etc.
The system sounds (i.e. internal audio frequency data) that multimedia service process to be received is sent, multimedia service process can be by terminal device
Internal audio frequency data (sound of such as target game) be sent to live client, certainly, multimedia service process also can be by end
The video data (picture of such as target game) of end equipment is sent to live client.Wherein, real-time transport protocol (Real-
Time Transport Protocol, RTP) it is a kind of network transmission protocol, AAC ELD are a kind of audio formats.
103rd, the live client is when receiving the internal audio frequency data, by calling audio service interface ought
Preceding audio service pattern switching is to Video chat pattern.
In the specific implementation, after establishing the shared connection of throwing screen due to live client and multimedia service process, internal audio frequency
The output channel of data has been switched to throwing screen sharing channel by audio output apparatus, and terminal device does not have sound output, in order to protect
Card terminal device can normally export internal audio frequency data, and live client is receiving the inside of multimedia service process transmission
During voice data, it can realize that terminal device normally exports internal audio frequency data by adjusting audio service pattern.In Fig. 3
Shown in step 9, live client is when receiving internal audio frequency data, by calling audio service interface to take current audio
Business pattern is first switched to audio broadcasting and recording mode (i.e.
AVAudioSessionCategoryPlayAndRecordCategory), audio broadcasting and recording mode represent to be currently needed for defeated
Go out sound and need to record, the pattern of instant communication client work is simulated with this, wait preset duration (such as
1 second~2 seconds) after, by calling audio service interface again by current audio service pattern switching to Video chat pattern
(i.e. AVAudioSessionModeVideoChat), so that allow system to think to be currently entering the scene for needing Video chat,
Sound and recording can be exported under the scene.
It should be noted that audio service pattern switching to Video chat pattern is not meant to be currently needed for being regarded
Frequency is chatted, but states to need the audio output apparatus of using terminal equipment to export sound in current scene to system, and is made
Recorded with the audio input device of terminal device.
104th, the live client is by calling the audio service interface to lead to the output of the internal audio frequency data
Road is switched to the audio output apparatus of the terminal device by throwing screen sharing channel.
In the specific implementation, live client is when definite Video chat pattern comes into force, by calling audio service interface to change
Become the output channel of internal audio frequency data, the audio output apparatus of terminal device is specifically switched to by throwing screen sharing channel.Such as
Shown in step 10 in Fig. 3, live client call audio service interface, is exported using the loudspeaker Speaker of terminal device
Internal audio frequency data, internal audio frequency data are normally exported so as to fulfill terminal device.
It should be noted that the audio output apparatus of terminal device can include loudspeaker, receiver etc., since receiver exports
Sound it is usually smaller, it is necessary to human ear can just hear sound close to receiver, to ensure that subsequently records is normally carried out, live visitor
Family end need to open hand-free function when definite Video chat pattern comes into force, that is, represent it is defeated by loudspeaker (rather than receiver)
Go out sound.
105th, the live client utilizes the audio input of the terminal device by calling the audio service interface
Equipment records the environmental audio data outside the internal audio frequency data and the terminal device.
In the specific implementation, after terminal device can normally export internal audio frequency data, you can to internal voice data and
Environmental audio data outside terminal device are recorded, and as shown in the step 11 in Fig. 3, live client passes through described in calling
Audio service interface starts sound-recording function, and the audio input device (such as microphone) of terminal device can be utilized to record and pass through terminal
The internal audio frequency data of the audio output apparatus output of equipment, can also be at the same time using outside audio input device recording terminal equipment
The environmental audio data in portion, sound is inputted so as to complete when carrying out playing etc. live to terminal device internal sound and user
Recording.
It should be noted that during recording the flow direction of voice data specifically can with as shown in figure 4, when establishing Airplay connections,
Internal audio frequency data (audio 1) and video data are input to and live apply journey by cell phone system (be specifically multimedia service process)
Sequence (Application, APP) (live APP, that is, live client), then by the Transmission of audio 1, opens recording, forces
Internal audio frequency data are output to loudspeaker, in the internal audio frequency data and environmental audio exported by microphone to loudspeaker
Data are recorded, and the internal audio frequency data of recording and environmental audio data are input to live APP.
In some feasible embodiments, due to directly by microphone records sound, although loudspeaker can be recorded
The sound (i.e. internal audio frequency data) of output, but because echo existing for the audio system of terminal device system in itself suppresses work(
And the function can not be closed, cause the sound that the loudspeaker recorded exports less than normal, ambient sound (i.e. environmental audio data)
The problem of bigger than normal, the sound that can be exported for this to loudspeaker improve the processing of acoustic gain.It is, of course, also possible to recording
Internal audio frequency data carry out noise reduction process, to filter out noise therein.As shown in figure 5, can be to the internal audio frequency number of recording
It is amplified (such as non-linear amplification) according to (such as pulse code modulation (Pulse Code Modulation, PCM) voice data)
Processing and noise reduction process, the internal audio frequency data after being handled.
Wherein, the algorithm of non-linear amplification can be described as follows：
The array of recording PCM data is obtained, array metadata is double types, and each double data of searching loop are
Item, will be assigned to item by obtained value after item divided by 36727.0 (corresponding 16 bit bit codings), item is multiplied by increasing
Beneficial ratio, i.e. item=(item*gain), gain are the ratio of gains (i.e. sound amplification coefficients), for being multiplied by item after the ratio of gains
Value, if the value of item is less than 0, then it is -1.0 to set item, if the value of item is more than 0 and less than 1, then set
Item is 1.0, carries out following computing to item, obtains item=(1.5*item- (0.5*item*item*item)) *
36727.0, so as to fulfill the non-linear amplification of internal audio frequency data, and the sharp audio component of comparison can also be filtered out, i.e.,
Volume is improved, also improves tonequality.
In some feasible embodiments, it can first compare the sound of loudspeaker output and the size of ambient sound, example
The amplitude of the internal audio frequency data of recording and the amplitude of environmental audio data can such as be compared, if comparative result is the interior of recording
The amplitude of portion's voice data is less than the amplitude of environmental audio data, such as the amplitude of environmental audio data subtracts internal audio frequency data
Amplitude reached default first amplitude threshold, then show that the sound of loudspeaker output recorded is less than normal, determine to need at this time pair
Internal audio frequency data are amplified processing.
Certainly, if comparative result, which is the amplitude for the environmental audio data recorded, is less than the amplitude of internal audio frequency data, example
The amplitude that amplitude such as internal audio frequency data subtracts environmental audio data has reached default first amplitude threshold, then shows what is recorded
Ambient sound is less than normal, at this time it is contemplated that being amplified processing to environmental audio data.
In some feasible embodiments, if comparative result is the amplitude and ambient sound for the internal audio frequency data recorded
The amplitude of frequency evidence is not much different, but the amplitude for the internal audio frequency data recorded and the amplitude of environmental audio data are respectively less than and preset
Second amplitude threshold, then show that the sound of the loudspeaker output of recording and ambient sound are all less than normal, at this time it is contemplated that internal
Portion's voice data and environmental audio data are amplified processing.
It is of course also possible to noise reduction process is carried out to the environmental audio data of recording, to filter out noise therein.
In some feasible embodiments, above-mentioned ratio of gains gain can be according to the amplitude of the internal audio frequency data of recording
The absolute value of difference carries out accommodation between the amplitude of environmental audio data, and the embodiment of the present invention does not limit.
In the embodiment of the present invention, live client is established with multimedia service process throws the shared connection of screen, multimedia service
Process to live client send terminal device internal audio frequency data, live client when receiving internal audio frequency data,
By calling audio service interface by current audio service pattern switching to Video chat pattern, by calling audio service to connect
The output channel of internal audio frequency data is switched to the audio output apparatus of terminal device by mouth by throwing screen sharing channel, is ensured internal
The normal output of voice data, then by calling audio service interface, recorded using the audio input device of terminal device internal
Environmental audio data outside voice data and terminal device, so as to it is convenient, efficiently complete terminal device internal sound
With the recording of outside environmental sounds, it is not necessary to which the auxiliary of external tool, can carry out playing live whenever and wherever possible, and can ensure
The normal output of terminal device internal sound, and system robustness is high.
In some feasible embodiments, computer-readable storage medium is additionally provided, it is characterised in that the computer stores
Have program stored therein instruction in medium, which is performed, for performing the method corresponding to above-mentioned Fig. 1 and Fig. 3.
Referring to Fig. 6, it is a kind of structure diagram of client provided in an embodiment of the present invention.Described in the present embodiment
Client, including：
Module 601 is established, the shared connection of screen is thrown for being established with multimedia service process；
Receiving module 602, the internal audio frequency data of the terminal device sent for receiving the multimedia service process；
Handover module 603, for when the receiving module receives the internal audio frequency data, by calling audio to take
Interface be engaged in by current audio service pattern switching to Video chat pattern；
The handover module 603, is additionally operable to by calling the audio service interface by the defeated of the internal audio frequency data
Go out the audio output apparatus that passage is switched to the terminal device by throwing screen sharing channel；
Module 604 is recorded, for by calling the audio service interface, being set using the audio input of the terminal device
Internal audio frequency data described in priming system and the environmental audio data outside the terminal device.
In some feasible embodiments, the handover module 603, is specifically used for：
When the receiving module receives the internal audio frequency data, by calling audio service interface by current sound
The business pattern switching that is taken in small doses at short intervals is played to audio and recording mode；
After preset duration is waited, by calling the audio service interface to cut the current audio service pattern
Change to Video chat pattern.
In some feasible embodiments, the audio output apparatus is loudspeaker, and the client further includes：
Output module 605, for by calling the audio service interface, utilizing the loudspeaker output internal sound
Frequency evidence.
In some feasible embodiments, the client further includes：
Processing module 606, for being amplified processing to the internal audio frequency data of recording, the inside after being handled
Voice data, and the audio number that the internal audio frequency data after the processing and the environmental audio data are obtained as recording
According to.
It is described to establish module 601 in some feasible embodiments, it is specifically used for：
The shared Connection Service request of screen is thrown in issue；
When the throwing screen for receiving the multimedia service progress feedback shares the response of Connection Service request, with institute
State multimedia service process and establish to throw and shield shared connection；
Wherein, established described after module 601 and the multimedia service process establish and throw the shared connection of screen, internal sound
The output channel of frequency evidence is switched to throwing screen sharing channel by audio output apparatus.
It is understood that the function of each function module of the client of the present embodiment can be according in above method embodiment
Method specific implementation, its specific implementation process is referred to the associated description of above method embodiment, and details are not described herein again.
In the embodiment of the present invention, client is established with multimedia service process throws the shared connection of screen, is receiving multimedia
During the internal audio frequency data for the terminal device that service processes are sent, by calling audio service interface by current audio service mould
Formula is switched to Video chat pattern, by calling audio service interface that the output channel of internal audio frequency data is shared logical by throwing screen
Road is switched to the audio output apparatus of terminal device, ensures the normal output of internal audio frequency data, then by calling audio service
Interface, the environmental audio data outside internal audio frequency data and terminal device are recorded using the audio input device of terminal device,
So as to recording that is convenient, efficiently completing terminal device internal sound and outside environmental sounds, it is not necessary to external tool
Auxiliary, and can ensure the normal output of terminal device internal sound, and system robustness is high.
Referring to Fig. 7, it is a kind of structure diagram of terminal device provided in an embodiment of the present invention.Retouched in the present embodiment
The terminal device stated, including：Processor 701, user interface 702, network interface 703 and storage device 704.Wherein, processor
701st, user interface 702, network interface 703 and storage device 704 can be connected by bus or other modes, the embodiment of the present invention
Exemplified by being connected by bus.
Wherein, processor 701 (or CPU (Central Processing Unit, central processing unit)) is terminal device
Calculating core and control core, it can parse all kinds of numbers of all kinds of instructions and processing terminal equipment in terminal device
According to, such as：CPU can be used for parsing the switching on and shutting down instruction transmitted by user to terminal device, and control terminal equipment is opened
Power-off operation；For another example：CPU can transmit all kinds of interaction datas, etc. between terminal device internal structure.User interface 702
It is to realize the medium that user is interacted with terminal device with information exchange, it embodies the display that can include for exporting
Shield (Display) and the keyboard (Keyboard) for input etc., it is necessary to which explanation, keyboard herein both can be real
Body keyboard, or touch screen dummy keyboard, can also be the keyboard that entity is combined with touch screen virtualphase.Network interface 703 can
Choosing can include standard wireline interface and wireless interface (such as WI-FI, mobile communication interface), by the control of processor 701
For transceiving data.Storage device 704 (Memory) is the memory device in terminal device, for storing program and data.Can
With understanding, storage device 704 herein can both include the internal memory of terminal device, naturally it is also possible to including terminal
The extended menory that equipment is supported.Storage device 704 provides memory space, which stores the operation of terminal device
System, it may include but be not limited to：IOS system etc., the present invention is to this and is not construed as limiting.
In embodiments of the present invention, processor 701 passes through the executable program code in Running storage device 704：
The processor 701, the shared connection of screen is thrown for being established with multimedia service process；Receiving the multimedia
During the internal audio frequency data for the terminal device that service processes are sent, by calling audio service interface to take current audio
Pattern switching of being engaged in is to Video chat pattern；By calling the audio service interface by the output channel of the internal audio frequency data
The audio output apparatus of the terminal device is switched to by throwing screen sharing channel；By calling the audio service interface, utilize
The audio input device of the terminal device records the ambient sound frequency outside the internal audio frequency data and the terminal device
According to.
In some feasible embodiments, the processor 701, is specifically used for：
When receiving the internal audio frequency data for the terminal device that the multimedia service process is sent, pass through calling
Audio service interface by current audio service pattern switching to audio play and recording mode；
After preset duration is waited, by calling the audio service interface to cut the current audio service pattern
Change to Video chat pattern.
In some feasible embodiments, the audio output apparatus is loudspeaker,
The processor 701, is additionally operable to by calling the audio service interface, described interior using loudspeaker output
Portion's voice data.
In some feasible embodiments, the processor 701, be additionally operable to the internal audio frequency data of recording into
Row enhanced processing, the internal audio frequency data after being handled, and by the internal audio frequency data after the processing and the ambient sound
Frequency is according to the voice data obtained as recording.
In some feasible embodiments, the processor 701, is specifically used for：
The shared Connection Service request of screen is thrown in issue；
When the throwing screen for receiving the multimedia service progress feedback shares the response of Connection Service request, with institute
State multimedia service process and establish to throw and shield shared connection；
Wherein, after the processor 701 and the multimedia service process are established and throw the shared connection of screen, the terminal
The output channel of the internal audio frequency data of equipment is switched to throwing screen sharing channel by the audio output apparatus of the terminal device.
In the specific implementation, processor 701, user interface 702, network interface 703 described in the embodiment of the present invention and
Storage device 704 can perform the implementation described in a kind of flow of way of recording provided in an embodiment of the present invention, also may be used
The implementation described in a kind of client provided in an embodiment of the present invention is performed, details are not described herein.
In the embodiment of the present invention, processor 701 is established with multimedia service process throws the shared connection of screen, is receiving more matchmakers
During the internal audio frequency data for the terminal device that body service processes are sent, by calling audio service interface by current audio service
Pattern switching is to Video chat pattern, by calling audio service interface that the output channel of internal audio frequency data is shared by throwing screen
Passage is switched to the audio output apparatus of terminal device, ensures the normal output of internal audio frequency data, then by calling audio to take
Business interface, utilizes the ambient sound frequency outside the audio input device recording internal audio frequency data and terminal device of terminal device
According to so as to recording that is convenient, efficiently completing terminal device internal sound and outside environmental sounds, it is not necessary to external tool
Auxiliary, and can ensure the normal output of terminal device internal sound, and system robustness is high.
One of ordinary skill in the art will appreciate that realize all or part of flow in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the program can be stored in a computer read/write memory medium
In, the program is upon execution, it may include such as the flow of the embodiment of above-mentioned each method.Wherein, the storage medium can be magnetic
Dish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random Access
Memory, RAM) etc..
The above disclosed power for being only a kind of preferred embodiment of the present invention, the present invention cannot being limited with this certainly
Sharp scope, one of ordinary skill in the art will appreciate that realizing all or part of flow of above-described embodiment, and is weighed according to the present invention
Profit requires made equivalent variations, still falls within and invents covered scope.
Claims (11)
1. a kind of way of recording, it is characterised in that applied to terminal device, terminal device operation has live client and more
Media services process, the described method includes：
The live client is established with the multimedia service process throws the shared connection of screen；
The live client is receiving the internal audio frequency data for the terminal device that the multimedia service process is sent
When, by calling audio service interface by current audio service pattern switching to Video chat pattern；
The live client is by calling the audio service interface to shield the output channel of the internal audio frequency data by throwing
Sharing channel is switched to the audio output apparatus of the terminal device；
The live client is recorded by calling the audio service interface using the audio input device of the terminal device
Environmental audio data outside the internal audio frequency data and the terminal device.
2. according to the method described in claim 1, it is characterized in that, the live client is receiving the multimedia service
During the internal audio frequency data for the terminal device that process is sent, by calling audio service interface by current audio service mould
Formula is switched to Video chat pattern, including：
The live client is receiving the internal audio frequency data for the terminal device that the multimedia service process is sent
When, by calling audio service interface by current audio service pattern switching to audio broadcasting and recording mode；
The live client is after preset duration is waited, by calling the audio service interface by the current audio
Service mode is switched to Video chat pattern.
3. method according to claim 1 or 2, it is characterised in that the audio output apparatus is loudspeaker, described live
Client records the internal audio frequency by calling the audio service interface, using the audio input device of the terminal device
Before environmental audio data outside data and the terminal device, the method further includes：
The live client exports the internal audio frequency number by calling the audio service interface, using the loudspeaker
According to.
4. according to the method described in claim 1, it is characterized in that, the live client is by calling the audio service to connect
Mouthful, the environment outside the internal audio frequency data and the terminal device is recorded using the audio input device of the terminal device
After voice data, the method further includes：
The live client is amplified processing to the internal audio frequency data of recording, the internal audio frequency number after being handled
According to, and the voice data that the internal audio frequency data after the processing and the environmental audio data are obtained as recording.
5. according to the method described in claim 1, it is characterized in that, the live client is built with the multimedia service process
Vertical screen of throwing shares connection, including：
The shared Connection Service request of screen is thrown in the live client issue；
The live client shares Connection Service request in the throwing screen for receiving the multimedia service progress feedback
During response, established with the multimedia service process and throw the shared connection of screen；
Wherein, after the live client and the multimedia service process are established and throw the shared connection of screen, the terminal is set
The output channel of standby internal audio frequency data is switched to throwing screen sharing channel by the audio output apparatus of the terminal device.
A kind of 6. client, it is characterised in that including：
Module is established, the shared connection of screen is thrown for being established with multimedia service process；
Receiving module, the internal audio frequency data of the terminal device sent for receiving the multimedia service process；
Handover module, for when the receiving module receives the internal audio frequency data, by calling audio service interface
By current audio service pattern switching to Video chat pattern；
The handover module, be additionally operable to by call the audio service interface by the output channel of the internal audio frequency data by
Throw the audio output apparatus that screen sharing channel is switched to the terminal device；
Module is recorded, for by calling the audio service interface, being recorded using the audio input device of the terminal device
Environmental audio data outside the internal audio frequency data and the terminal device.
A kind of 7. terminal device, it is characterised in that including：Processor and storage device；
The storage device, instructs for storage program；
The processor, calls the programmed instruction stored in the storage device, and screen is thrown for being established with multimedia service process
Shared connection；When receiving the internal audio frequency data for the terminal device that the multimedia service process is sent, pass through tune
With audio service interface by current audio service pattern switching to Video chat pattern；By calling the audio service interface
The output channel of the internal audio frequency data is switched to the audio output apparatus of the terminal device by throwing screen sharing channel；It is logical
Cross and call the audio service interface, the internal audio frequency data and institute are recorded using the audio input device of the terminal device
State the environmental audio data outside terminal device.
8. terminal device according to claim 7, it is characterised in that the processor, is specifically used for：
When receiving the internal audio frequency data for the terminal device that the multimedia service process is sent, by calling audio
Service interface by current audio service pattern switching to audio play and recording mode；
After preset duration is waited, by calling the audio service interface to arrive the current audio service pattern switching
Video chat pattern.
9. the terminal device according to claim 7 or 8, it is characterised in that the audio output apparatus is loudspeaker,
The processor, is additionally operable to by calling the audio service interface, and the internal audio frequency is exported using the loudspeaker
Data.
10. terminal device according to claim 7, it is characterised in that
The processor, is additionally operable to be amplified processing to the internal audio frequency data of recording, the inside sound after being handled
Frequency evidence, and the voice data that the internal audio frequency data after the processing and the environmental audio data are obtained as recording.
11. a kind of computer-readable storage medium, it is characterised in that have program stored therein instruction in the computer-readable storage medium, the program
Instruction is performed, and is used for realization such as claim 1-5 any one of them methods.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711156861.9A CN107948663A (en) | 2017-11-20 | 2017-11-20 | A kind of way of recording, client and terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711156861.9A CN107948663A (en) | 2017-11-20 | 2017-11-20 | A kind of way of recording, client and terminal device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107948663A true CN107948663A (en) | 2018-04-20 |
Family
ID=61929223
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711156861.9A Pending CN107948663A (en) | 2017-11-20 | 2017-11-20 | A kind of way of recording, client and terminal device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107948663A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110704202A (en) * | 2018-07-10 | 2020-01-17 | 深圳市优必选科技有限公司 | Multimedia recording data sharing method and terminal equipment |
| CN112509608A (en) * | 2020-11-25 | 2021-03-16 | 广州朗国电子科技有限公司 | Method and device for recording sound along with channel of USB (Universal Serial bus) equipment and storage medium |
| CN115484430A (en) * | 2021-05-31 | 2022-12-16 | 华为技术有限公司 | Screen sharing method, related electronic equipment and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104967960A (en) * | 2015-03-25 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Voice data processing method, and voice data processing method and system in game live broadcasting |
| CN106507161A (en) * | 2016-11-29 | 2017-03-15 | 腾讯科技（深圳）有限公司 | Net cast method and live broadcast device |
| US20170098466A1 (en) * | 2015-10-02 | 2017-04-06 | Bose Corporation | Encoded Audio Synchronization |
| CN106686424A (en) * | 2017-01-06 | 2017-05-17 | 广州四三九九信息科技有限公司 | Screen recording and live streaming method based on mobile terminal |
| CN107195314A (en) * | 2017-05-04 | 2017-09-22 | 腾讯科技（深圳）有限公司 | The method for recording and device of voice data |
-
2017
- 2017-11-20 CN CN201711156861.9A patent/CN107948663A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104967960A (en) * | 2015-03-25 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Voice data processing method, and voice data processing method and system in game live broadcasting |
| US20170098466A1 (en) * | 2015-10-02 | 2017-04-06 | Bose Corporation | Encoded Audio Synchronization |
| CN106507161A (en) * | 2016-11-29 | 2017-03-15 | 腾讯科技（深圳）有限公司 | Net cast method and live broadcast device |
| CN106686424A (en) * | 2017-01-06 | 2017-05-17 | 广州四三九九信息科技有限公司 | Screen recording and live streaming method based on mobile terminal |
| CN107195314A (en) * | 2017-05-04 | 2017-09-22 | 腾讯科技（深圳）有限公司 | The method for recording and device of voice data |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110704202A (en) * | 2018-07-10 | 2020-01-17 | 深圳市优必选科技有限公司 | Multimedia recording data sharing method and terminal equipment |
| CN110704202B (en) * | 2018-07-10 | 2022-08-05 | 深圳市优必选科技有限公司 | Multimedia recording data sharing method and terminal equipment |
| CN112509608A (en) * | 2020-11-25 | 2021-03-16 | 广州朗国电子科技有限公司 | Method and device for recording sound along with channel of USB (Universal Serial bus) equipment and storage medium |
| CN115484430A (en) * | 2021-05-31 | 2022-12-16 | 华为技术有限公司 | Screen sharing method, related electronic equipment and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106531177B (en) | Audio processing method, mobile terminal and system | |
| US10142578B2 (en) | Method and system for communication | |
| CN108449507B (en) | Voice call data processing method and device, storage medium and mobile terminal | |
| JP7353497B2 (en) | Server-side processing method and server for actively proposing the start of a dialogue, and voice interaction system capable of actively proposing the start of a dialogue | |
| CN105611055B (en) | Call method and device | |
| CN105141730B (en) | Method for controlling volume and device | |
| CN107948663A (en) | A kind of way of recording, client and terminal device | |
| TWI302801B (en) | Mobile communication device and system supporting personal media recorder functionality | |
| CN105556955A (en) | Video telephone communication device and video telephone communication processing method | |
| CN107105339B (en) | A kind of methods, devices and systems playing live video | |
| WO2019174492A1 (en) | Voice call data detection method, device, storage medium and mobile terminal | |
| CN107728973A (en) | Screen sharing method, system, initiating terminal and computer-readable recording medium | |
| CN109582976A (en) | A kind of interpretation method and electronic equipment based on voice communication | |
| CN106303350A (en) | A kind of multimodal video call method and device | |
| CN113078921B (en) | Data processing method, device and storage medium | |
| CN113411759B (en) | Voice call transfer method and electronic equipment | |
| US8526919B2 (en) | Message injection system and method | |
| WO2019144292A1 (en) | Video answering communication method, and terminal | |
| CN109194998A (en) | Data transmission method, device, electronic equipment and computer-readable medium | |
| CN110266508A (en) | Method, apparatus, system and the storage medium of intercommunication function are realized based on earphone | |
| EP4191990A1 (en) | Media resource playback method, related device and system | |
| KR101188895B1 (en) | Method for emoticon utilization with multimedia effect using messenger in mobile communication terminal | |
| CN108449505B (en) | voice call data detection method and device, storage medium and mobile terminal | |
| CN100536510C (en) | Access audio frequency output through capturing service | |
| CN106911828A (en) | STB network telephone system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180420 |
|
| RJ01 | Rejection of invention patent application after publication |