CN108989901A - Method for processing video frequency, client and terminal - Google Patents
Method for processing video frequency, client and terminal Download PDFInfo
- Publication number
- CN108989901A CN108989901A CN201810892977.7A CN201810892977A CN108989901A CN 108989901 A CN108989901 A CN 108989901A CN 201810892977 A CN201810892977 A CN 201810892977A CN 108989901 A CN108989901 A CN 108989901A
- Authority
- CN
- China
- Prior art keywords
- video
- anything
- image
- attending
- photographing module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 73
- 238000000034 method Methods 0.000 title claims abstract description 63
- 238000012544 monitoring process Methods 0.000 claims abstract description 59
- 244000035744 Hura crepitans Species 0.000 claims abstract description 39
- 230000006870 function Effects 0.000 claims description 69
- 230000006854 communication Effects 0.000 claims description 24
- 238000004891 communication Methods 0.000 claims description 23
- 230000008859 change Effects 0.000 claims description 11
- 230000000903 blocking effect Effects 0.000 claims description 10
- 230000008901 benefit Effects 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 5
- 230000003796 beauty Effects 0.000 claims description 4
- 238000009877 rendering Methods 0.000 description 14
- 238000010586 diagram Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 6
- 239000004576 sand Substances 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 230000006399 behavior Effects 0.000 description 4
- 230000001151 other effect Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000002087 whitening effect Effects 0.000 description 3
- 230000000712 assembly Effects 0.000 description 2
- 238000000429 assembly Methods 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 230000001815 facial effect Effects 0.000 description 2
- 238000012905 input function Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the invention discloses and a kind of method for processing video frequency, client and terminal, it is related to technical field of image processing, the photographing module in electronic equipment whether is called to carry out Video chat the described method includes: monitoring and operating in apply attending to anything else in sandbox, Video chat is carried out using the calling photographing module if listening to and attending to anything else, then intercept the first video attended to anything else using calling photographing module to carry out the preview of Video chat institute, wherein, first video includes at least first image of frame, the first image of each frame in first video is handled, obtain the second video, second video is sent to the application of attending to anything else, it can use the second video and opposite end progress Video chat so as to attend to anything else and apply;So, the second video is obtained after handling the first image of each frame in the first video, application attend to anything else with the second video and opposite end progress Video chat after treatment, application of attending to anything else can be with the second video and opposite end progress Video chat after landscaping treatment.
Description
Technical field
The present invention relates to technical field of image processing more particularly to a kind of method for processing video frequency, client and terminal.
Background technique
With the development of intelligent terminal, intelligent terminal carries more and more functions.Wherein, Video chat function intelligence
An essential function in terminal.
But when carrying out Video chat, show personage or scene is all original image, and some users want to show
The relatively good image of other side, it is desirable to personage and scene can be beautified in Video chat, therefore how in Video chat
When to image carry out beautification be urgent need to resolve the problem of.
Summary of the invention
In view of the above problems, the embodiment of the invention provides a kind of method for processing video frequency, client and terminals, for solving
In the prior art in Video chat, the image of Video chat can not be beautified, the demand of user is caused to be not being met
The technical issues of.
In a first aspect, the present invention provides a kind of method for processing video frequency, which comprises monitor point operated in sandbox
Whether body application calls the photographing module in electronic equipment to carry out Video chat;If listening to described attend to anything else using described in calling
Photographing module carries out Video chat, then intercept described in attend to anything else using call the photographing module to carry out the preview of Video chat institute the
One video, wherein first video includes at least first image of frame;To the first image of each frame in first video
It is handled, obtains the second video;Second video is sent to the application of attending to anything else, so that the application of attending to anything else can benefit
Video chat is carried out with second video and opposite end.
Optionally, first image of each frame in first video is handled, and obtains the second video, packet
It includes: obtaining respective first texture information of the first image of every frame in first video;Utilize first texture information pair
Corresponding first image of first texture information is rendered to realize that image beautifies, and the second image, second figure are obtained
As the second video of composition.
Optionally, using first texture information to corresponding first image of first texture information rendered with
It realizes image beautification, obtains the second image, comprising: render to first texture information, obtain the second texture information;It will
First texture information in the first image replaces with the second texture information corresponding with first texture information, obtains
To the second image.
Optionally, after second video to be sent to the application of attending to anything else, the method for processing video frequency further include:
It monitors to operate in apply whether to mediate attending to anything else in sandbox and only carries out Video chat with the photographing module in electronic equipment;Work as monitoring
When to the application of attending to anything else stopping that the photographing module is called to carry out Video chat, memory shared by the texture information is discharged.
Optionally, attend to anything else described in the interception using the first video for calling the photographing module to carry out the preview of Video chat institute
Later, the method for processing video frequency further include: first video is sent to the application of attending to anything else, so that the application of attending to anything else
It can use first video and opposite end carry out Video chat.
Optionally, whether the monitoring operates in apply attending to anything else in sandbox calls the photographing module in electronic equipment to carry out
Video chat, comprising: taken the photograph described in calling by attending to anything else to apply whether to instruct using video capture described in the monitoring of the first Hook Function
As module;Attend to anything else described in being listened to when first Hook Function and calls the photographing module using using video capture instruction
When, expression listens to described attend to anything else using the calling photographing module progress Video chat.
Optionally, whether the monitoring operates in apply and stops calling the photographing module in electronic equipment attending to anything else in sandbox
Carry out Video chat, comprising: by attending to anything else to apply whether utilize stopping video capture instruction tune described in the monitoring of the second Hook Function
With the photographing module;Attend to anything else described in being listened to when second Hook Function and instructs calling institute using using stopping video capture
Attend to anything else when stating photographing module, described in expression and calls the photographing module to carry out Video chat using stopping.
Second aspect, the present invention, which implements, additionally provides a kind of client, and described device includes: the first monitoring module, uses
The photographing module in electronic equipment whether is called to carry out Video chat in monitoring to operate in apply attending to anything else in sandbox;Intercept mould
Block, if for listen to it is described attend to anything else using calling the photographing module to carry out Video chat, then intercept described in attend to anything else application
The photographing module is called to carry out the first video of Video chat institute preview, wherein first video includes an at least frame the
One image;Processing module obtains the second video for handling the first image of each frame in first video;The
One communication module, for second video to be sent to the application of attending to anything else so that the application of attending to anything else can use it is described
Second video and opposite end carry out Video chat.
Optionally, the processing module, comprising: texture cell is obtained, for obtaining every frame in first video the
Respective first texture information of one image;Beautify unit, for utilizing first texture information to first texture information
Corresponding first image is rendered to realize that image beautifies, and the second image is obtained, and second image forms the second video.
Optionally, the beautification unit, comprising: rendering subelement is obtained for rendering to first texture information
To the second texture information;Replace subelement, for by first texture information in the first image replace with it is described
Corresponding second texture information of first texture information, obtains the second image.
Optionally, the client further include: second monitors module, is for monitoring to operate in apply attending to anything else in sandbox
No mediate only carries out Video chat with the photographing module in electronic equipment;Release module listens to the application of attending to anything else for working as
When stopping that the photographing module is called to carry out Video chat, memory shared by the texture information is discharged.
Optionally, the client further include: the second communication module, for first video to be sent to described attend to anything else
Using so that the application of attending to anything else can use first video and opposite end carries out Video chat.
Optionally, described first module is monitored, comprising: the first monitoring unit, for monitoring institute by the first Hook Function
It states and attends to anything else to apply whether utilize the video capture instruction calling photographing module;First judging unit, for working as first hook
Subfunction listens to described when attending to anything else using the photographing module is called using video capture instruction, and expression listens to described attend to anything else
Video chat is carried out using the calling photographing module.
Optionally, described second module is monitored, comprising: the second monitoring unit, for monitoring institute by the second Hook Function
It states and attends to anything else to apply whether utilize the stopping video capture instruction calling photographing module;Second prison judging unit, for when described
Second Hook Function listen to it is described when attending to anything else using using stopping video capture instruction and calling the photographing module, described in expression
Attend to anything else and calls the photographing module to carry out Video chat using stopping.
The third aspect, the embodiment of the invention also provides a kind of computer readable storage mediums, are stored thereon with computer
Program, which is characterized in that the step of any of the above-described the method is realized when the program is executed by processor.
Fourth aspect, it to include memory and one or one that the embodiment of the invention also provides a kind of mobile terminals
A above program, perhaps more than one program is stored in memory and is configured to by one or one for one of them
It includes the instruction for performing the following operation that the above processor, which executes the one or more programs:
Whether monitor to operate in apply attending to anything else in sandbox calls the photographing module in electronic equipment to carry out Video chat;If
Be listen to it is described attend to anything else using calling the photographing module to carry out Video chat, then intercept described in attend to anything else and taken the photograph using described in calling
As module carries out the first video of Video chat institute preview, wherein first video includes at least first image of frame;To institute
The first image of each frame stated in the first video is handled, and the second video is obtained;Second video is sent to described point
Body application, so that the application of attending to anything else can use second video and opposite end carries out Video chat.
The technical solution provided in the embodiment of the present application, has at least the following technical effects or advantages:
The embodiment of the invention provides a kind of method for processing video frequency, client and terminals, which comprises monitors operation
Attending to anything else using whether the photographing module in electronic equipment being called to carry out Video chat, if listening to described attend to anything else in sandbox
Video chat is carried out using the calling photographing module, then attends to anything else described in interception and is chatted using the calling photographing module progress video
First video of its preview, wherein first video includes at least first image of frame, to every in first video
One the first image of frame is handled, and the second video is obtained, and second video is sent to the application of attending to anything else, so that described point
Body application can use second video and opposite end carries out Video chat;In this way, can be in routine call camera shooting mould of attending to anything else
Block carries out the first video that photographing module acquisition is intercepted when Video chat, that program of attending to anything else has not yet been displayed, by the first video
In the first image of each frame handled after obtain the second video, then the second video is sent to application of attending to anything else, application of attending to anything else
With after treatment the second video and opposite end carry out Video chat, the second video can be by beautifying the first video
Processing obtains, in this way, application of attending to anything else can be with the second video and opposite end progress Video chat after landscaping treatment.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention,
And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can
It is clearer and more comprehensible, the followings are specific embodiments of the present invention.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field
Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention
Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:
Fig. 1 shows a kind of flow chart of method for processing video frequency provided in an embodiment of the present invention.
Fig. 2 shows the frame structure schematic diagrames of client 200.
Fig. 3 shows the frame structure schematic diagram of the first monitoring module 210.
Fig. 4 shows the frame structure schematic diagram of processing module 230.
Fig. 5 shows the frame structure schematic diagram of beautification unit 132.
Fig. 6 shows the frame structure schematic diagram of the second monitoring module 250.
Fig. 7 shows the block diagram of the part-structure of mobile phone relevant to terminal provided in an embodiment of the present invention.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
It is fully disclosed to those skilled in the art.
The embodiment of the invention provides one kind to be used for method for processing video frequency, applies in terminal, it should be noted that the present invention
The implementation process for the method for processing video frequency that embodiment provides is realized in sandbox.As shown in Figure 1, which comprises
Step S100: it monitors to operate in apply attending to anything else in sandbox and whether the photographing module in electronic equipment is called to be regarded
Frequency is chatted;
In embodiments of the present invention, sandbox (Sandboxie) is called sand table, refers to a virtual system program, allows
Browser or other programs are run in sand table environment, generated variation can be deleted then in the process of running.It is created
The independently working environment of one similar sandbox, the program that runs inside it can not generate permanent influence to hard disk.
Attend to anything else and attending to anything else using the native applications program for being then mounted to electronic equipment, be using technology of attending to anything else to native applications programs into
Row is attended to anything else, the application program that can be run in sandbox, and the institute for having native applications program is functional, is capable of providing and original
The raw identical service of application program.The present invention discloses in embodiment, native applications program can be QQ, wechat, nail nail,
263 clouds communication etc..
In this step, whether monitor to operate in apply attending to anything else in sandbox calls the photographing module in electronic equipment to carry out
Whether Video chat can specifically be realized by following step: being utilized by attending to anything else to apply described in the monitoring of the first Hook Function
The photographing module is called in video capture instruction;Attend to anything else to apply described in listening to when first Hook Function and utilizes video capture
When instructing the calling photographing module, expression listens to described attend to anything else using the calling photographing module progress Video chat.
Herein, term " hook " cover for by intercept transmitted between component software function call, message,
Or event changes or increases the technology of the behavior of operating system, application program or other software component.And handle this blocked
The code of function call, event or the message cut is thus referred to as hook (hook) function.Hook is commonly used in various targets, including
Function debug and be extended to function.Its example may include keyboard or mouse event be transmitted to application program it
It is preceding to intercept they or hooking system service call (system call) or system function behavior, function implementing result etc., with prison
Depending on or modification application program or the function of other assemblies etc..
The first hook hook function can be used to the process generation of the camera manager for application program of attending to anything else in the present embodiment
Code is modified, so that Softcam manager takes over the processing logic of the camera manager for application program of attending to anything else.
In this case, Softcam manager can take over the management to camera, so as to take over camera acquisition
Video, and adapter tube to application program of attending to anything else video window etc..
Here, in order to the processing such as carrying out U.S. face to video, sprout face, it is also necessary to mask application program itself of attending to anything else
Video window.Here, the video window includes two, one be for for showing the window of opposite end video image, it is described right
End can be understood as the peer user that Video chat is carried out with user itself, also be understood as instant messaging used in peer user
Application program, one is for for showing the window of itself video image.Or the video window include three, one be for
For showing the window of opposite end video image, the opposite end that the opposite end can be understood as carrying out Video chat with user itself is used
Family also is understood as instant messaging application program used in peer user, and one is for for showing itself after treatment
The window of video image, one be for for show itself it is untreated after video image window.
Here, it when the video window of Softcam manager adapter tube to application program of attending to anything else, that is, listens to attend to anything else and answer
When with calling photographing module to carry out Video chat, the video window of the application program that is just defaulted as attending to anything else itself has been shielded.
Step S200: if attending to anything else described in listening to using calling the photographing module to carry out Video chat, then institute is intercepted
State the first video attended to anything else using calling the photographing module to carry out the preview of Video chat institute, wherein first video includes
At least first image of frame;
In this step, attend to anything else using the first view for calling the photographing module to carry out the preview of Video chat institute described in the interception
After frequency, the first video application of attending to anything else be can also be sent to, the first video and opposite end progress can use so as to attend to anything else and apply
Video chat.
Herein, when the video image for needing to show the first video, the second video and opposite end transmission in application of attending to anything else
When, the video window includes three windows, and a user shows the first video without beautifying, sprouting the processing such as face, a use
The second video for passing through beautification in display, sprouting the processing such as face, a video image sent for showing opposite end.
When needs are shown in the video image for showing the second video and opposite end transmission in application of attending to anything else, the video window
Including two windows, one is used to show the second video by beautifying, sprouting the processing such as face, and one for showing what opposite end was sent
Video image.
Step S300: the first image of each frame in first video is handled, the second video is obtained;
In general, people are during Video chat, it may be desirable to relatively good image is shown to other side, then need to
Image in the video chatted with object carries out landscaping treatment.
In this step, carrying out landscaping treatment to the image in the video for chatting with object can be by as follows
Mode is realized: obtaining respective first texture information of the first image of every frame in the first video;Utilize first texture information
The first image corresponding to the first texture information is rendered to realize that image beautifies, and the second image, the second image composition are obtained
Second video.
Herein, texture refers to the cromogram on the texture of the body surface in image or the smooth surface of object
Case, texture information refer to the location information of these textures, pixel value etc..Here, corresponding first texture of each frame image
Information.
Here, there are many ways to obtaining the first texture information of every the first image of frame, such as LBP (Local Binary
Patterns, local binary patterns) algorithm, edge histogram nomography, Gabor filter etc..
In embodiments of the present invention, corresponding first texture information of each the first image of frame.Utilize the first texture information
The first image corresponding to the first texture information is rendered to realize that image beautifies, specifically, can be, to first line
Reason information is rendered, and the second texture information is obtained;First texture information in the first image is replaced with and institute
Corresponding second texture information of the first texture information is stated, the second image is obtained.
Herein, the step of the first texture information being rendered, obtains the second texture information, it can be understood as, to
One texture information carry out color rendering, rendering can be understood as change pixel pixel value and or brightness value, with rendering after
First texture information is as the second texture information.Herein change pixel pixel value and or brightness value, can be according to should
The pixel value of pixel in pixel field and or brightness value to the pixel value of the pixel and or brightness value change
Become.
By the way that the first texture information in the first image is replaced with the second texture information corresponding with the first texture information,
Then the pixel value of the first image and or brightness value changed.By the first texture information is replaced with and the first texture
Rear first image of corresponding second texture information of information is as the second image.
The texture information can be rendered by OpenGL, to realize the landscaping treatment to the first image, be obtained
Second image.
Landscaping treatment to the first image obtains the second image, and landscaping treatment, which can be, to be carried out whitening to the first image, sprouts
The processing such as face, virtualization, using the first image after landscaping treatment as the second image.
In embodiments of the present invention, using first texture information to corresponding first image of first texture information
The step of being rendered to realize that image beautifies, obtain the second image, can render whole the first image, can also be right
The regional area of first image is rendered.
As an implementation, it when it is only necessary to handle the facial image in the first image, can mention
Human face region is identified in the first texture information out, then according to corresponding first texture information of human face region to human face region
It is rendered to realize landscaping treatment.Specifically, the first texture information corresponding to human face region renders, face area is obtained
Corresponding second texture information in domain replaces with corresponding first texture information of human face region in the first image and first line
Corresponding second texture information of the corresponding human face region of information is managed, the second image is obtained.The face of the second image obtained as a result,
Region is by having handled that treated, and human face region can have sprouts face, whitening, makeup and other effects.
When needing to carry out landscaping treatment to the non-face region in the first image, can be identified in the first texture information
Then non-face region out renders to realize U.S. non-face region according to corresponding first texture information in non-face region
Change processing.Wherein, non-face region refers to the region other than the human face region in the first image.Specifically, to non-face area
Corresponding first texture information in domain is rendered, and corresponding second texture information in non-face region is obtained, will be in the first image
Corresponding first texture information in non-face region replaces with non-face region corresponding second corresponding with first texture information
Texture information obtains the second image.The non-face region of the second image obtained as a result, is by having handled, and treated
Non-face region can have powerful connections virtualization, light enhancing and other effects.
In embodiments of the present invention, carrying out landscaping treatment to the image in the video for chatting with object can be with
It is accomplished in that respective first texture information of the first image of every frame obtained in the first video;By each frame first
First texture information of image is stored, wherein the corresponding address ID of each texture information obtains each texture letter
The corresponding address ID is ceased, is rendered according to the address ID the first image corresponding to each texture information to realize image beauty
Change, obtain the second image, the second image forms the second video.In embodiments of the present invention, can by OpenGL to for
The image in video that object is chatted is rendered to realize landscaping treatment.
Step S400: being sent to the application of attending to anything else for second video, so that the application of attending to anything else can use institute
It states the second video and opposite end carries out Video chat.
In embodiments of the present invention, there are many embodiments that the second video is sent to application of attending to anything else, for example, by second
The second image in video is on a frame-by-frame basis sent in application of attending to anything else, alternatively, the second image in video is divided into several groups,
Then it is sent in application of attending to anything else a group by a group.In order to guarantee to keep the continuity of video in Video chat and keep view
The synchronism of audio and video in frequency and Video chat, it is preferred that as soon as it is intercepted when camera collects the first image of frame
First image carries out landscaping treatment to first image and obtains the second image, then is sent to attend to anything else by the second image again and answer
In, attend to anything else using transmission second image to opposite end, carries out Video chat using the second image and opposite end to realize to attend to anything else, this
Sample, the first image of camera continuous acquisition is continuous to intercept the first image, handles in real time the first image, by treated
First image, i.e. the second image are sent in application of attending to anything else, and are attended to anything else and are chatted using with second image and opposite end progress real-time video
It.When multiple second images continuously transmit to attend to anything else in application, multiple images and constituting attend to anything else using for opposite end video
Second video of chat.
In this step, after second video to be sent to the application of attending to anything else, it is also necessary to which monitoring operates in sand
It applies whether to mediate attending to anything else in case and only carries out Video chat with the photographing module in electronic equipment, stop when listening to attend to anything else to apply
When only photographing module being called to carry out Video chat, memory shared by texture information is discharged.It releases to have been sent in this way and attend to anything else
Application the second video texture information shared by memory so that it is subsequent attend to anything else using transfer electronic equipment in photographing module into
When row Video chat, the texture information for the video image that the available photographing module is passed back, and then according to the texture information pair
The video carries out rendering processing.
When detect it is described attend to anything else application program launching Video chat when, set Video chat for the video window
First video window, first video window is the window for showing itself video image, the specific can be that above-mentioned
Second video;One layer of second video window is covered on the video window, second video window is for showing opposite end
The window of video.When needs, one layer of third video window is covered on the video window, for showing itself video figure
The window of picture, the specific can be that the first above-mentioned video.First video window and third video window and the second video
Window size is different, and can switch mutually.
Herein, whether monitor to operate in apply attending to anything else in sandbox stops calling the photographing module in electronic equipment to carry out
Video chat, the specific can be that: by the second Hook Function monitor described in attend to anything else using whether using stop video capture referring to
It enables and calls the photographing module;Attend to anything else described in being listened to when second Hook Function and instructs tune using using stopping video capture
When with the photographing module, attends to anything else described in expression and call the photographing module to carry out Video chat using stopping.
The sub- hook function of second hook can be used to the process generation of the camera manager for application program of attending to anything else in the present embodiment
Code is modified, so that Softcam manager takes over the processing logic of the camera manager for application program of attending to anything else.
When second Hook Function listens to described attend to anything else using the photographing module is called using stopping video capture instruction, table
Attend to anything else described in showing using the calling photographing module progress Video chat is stopped, such words, Softcam manager can
To stop adapter tube to the management to camera, camera is closed.
Specifically, attend to anything else when the first Hook Function listens to using calling photographing module to carry out Video chat, in camera
After collecting video image data, is attending to anything else using before carrying out reality to the video image, then immediately intercepting camera acquisition
The video image data arrived, described image data refer to first video, the first video are being carried out handling from the background
To the second video, the second video is sent to application of attending to anything else, so that application of attending to anything else can use the second video and opposite end is regarded
Frequency is chatted.For the video that when attending to anything else using calling photographing module to carry out Video chat next time, can be acquired to camera
Image data is handled to obtain the second image, and needing to monitor by the second Hook Function to operate in apply attending to anything else in sandbox is
No mediate only with the photographing module in electronic equipment carries out Video chat, when listen to attend to anything else using stopping calling photographing module into
When row Video chat, memory shared by the first video is discharged, discharges memory shared by texture information.Each texture information is corresponding
One address ID, discharging memory shared by texture information, to discharge the corresponding address ID of each texture information corresponding slow
It deposits.
As one embodiment, it monitors to operate in by the first Hook Function and applies whether call electronics attending to anything else in sandbox
Photographing module in equipment carries out Video chat, attends to anything else if listening to using calling photographing module to carry out Video chat, then blocks
First video attended to anything else using calling photographing module progress Video chat institute preview is cut, is answered specifically, calling and monitoring to attend to anything else
Jni method corresponding with photographing module is called, is specially called in class android.harware.camara in
SetpreviewTexture method.Then the texture information of the image in the first video is obtained, specially calling setpreview
Then surfacetexture object in texture (surfacetexturesurfacetexture) passes through OPenGL root
According to the texture information, i.e. surfacetexture object, the first image of each frame in the first video is rendered, obtains
Second video is sent to application of attending to anything else by two videos, so that application of attending to anything else can use the second video and opposite end carries out video and chats
It.Meanwhile jni method corresponding with calling photographing module is stopped in application of attending to anything else is monitored by the second Hook Function, work as monitoring
To when attending to anything else using stopping calling photographing module, the corresponding memory cache of texture information, i.e. surfacetexture object are discharged
Corresponding memory cache, specifically, by call android.harware.camara in method native-release come
It realizes.
By using above scheme, mould can be imaged to intercepting when routine call photographing module of attending to anything else carries out Video chat
The first video that block acquisition, program of attending to anything else have not yet been displayed, after handling the first image of each frame in the first video
The second video is obtained, then the second video is sent to application of attending to anything else, attend to anything else the second video applied with after treatment and opposite end
Video chat is carried out, the second video can be by obtaining the progress landscaping treatment of the first video, in this way, attending to anything else using can be with
The second video and opposite end after landscaping treatment carry out Video chat.
Based on same inventive concept, the present invention also provides a kind of clients 200.Referring to Fig. 2, Fig. 2 shows visitors
The frame structure schematic diagram at family end 200.In embodiments of the present invention, client 200 includes the first monitoring module 210, intercepts mould
Block 220, processing module 230 and the first communication module 240, wherein
First monitors module 210, applies whether call taking the photograph in electronic equipment attending to anything else in sandbox for monitoring to operate in
As module carries out Video chat.In embodiments of the present invention, the first monitoring module 210 can be used for executing above-mentioned steps S100 institute
Content is stated, content described in above-mentioned steps S100 is suitable for first and monitors module 210.
In embodiments of the present invention, sandbox (Sandboxie) is called sand table, refers to a virtual system program, allows
Browser or other programs are run in sand table environment, generated variation can be deleted then in the process of running.It is created
The independently working environment of one similar sandbox, the program that runs inside it can not generate permanent influence to hard disk.
Attend to anything else and attending to anything else using the native applications program for being then mounted to electronic equipment, be using technology of attending to anything else to native applications programs into
Row is attended to anything else, the application program that can be run in sandbox, and the institute for having native applications program is functional, is capable of providing and original
The raw identical service of application program.The present invention discloses in embodiment, native applications program can be QQ, wechat, nail nail,
263 clouds communication etc..
Referring to Fig. 3, Fig. 3 shows the frame structure schematic diagram of the first monitoring module 210.In embodiments of the present invention,
First, which monitors module 210, determines subelement including the first monitoring unit 211 and the first prison, and the first monitoring module 210 is executing prison
Listen operate in sandbox attending to anything else using whether call photographing module in electronic equipment to carry out Video chat when, specifically can be with
Determine that subelement is realized by the first monitoring unit 211 and the first prison, wherein
First monitoring unit 211, for by attending to anything else to apply whether utilize video capture described in the monitoring of the first Hook Function
The photographing module is called in instruction.
Herein, term " hook " cover for by intercept transmitted between component software function call, message,
Or event changes or increases the technology of the behavior of operating system, application program or other software component.And handle this blocked
The code of function call, event or the message cut is thus referred to as hook (hook) function.Hook is commonly used in various targets, including
Function debug and be extended to function.Its example may include keyboard or mouse event be transmitted to application program it
It is preceding to intercept they or hooking system service call (system call) or system function behavior, function implementing result etc., with prison
Depending on or modification application program or the function of other assemblies etc..The first hook hook function can be used in first monitoring unit 211
It modifies to the process code of the camera manager for application program of attending to anything else, so that Softcam manager is taken over point
The processing logic of the camera manager of body application program.In this case, Softcam manager can be taken over to taking the photograph
As the management of head, so as to take over the video of camera acquisition, and the video window etc. taken over to application program of attending to anything else.
First judging unit, for when first Hook Function listen to it is described attend to anything else instructed using using video capture
When calling the photographing module, expression listens to described attend to anything else using the calling photographing module progress Video chat.In order to
It reaches and carries out U.S. face to video, sprouts face etc. to handle, the first judging unit also needs to mask the video window of application program of attending to anything else itself
Mouthful.Here, the video window includes two, and one is for for showing the window of opposite end video image, and the opposite end can be with
It is interpreted as carrying out the peer user of Video chat with user itself, also is understood as instant messaging application journey used in peer user
Sequence, one is for for showing the window of itself video image.Or the video window includes three, one is for for showing
Show the window of opposite end video image, the opposite end can be understood as the peer user that Video chat is carried out with user itself, can also
It is interpreted as instant messaging application program used in peer user, one is for for showing itself video image after treatment
Window, one be for for show itself it is untreated after video image window.
When the video window of Softcam manager adapter tube to application program of attending to anything else, i.e., member, which listens to, attends to anything else using tune
When carrying out Video chat with photographing module, the video window of the application program that is just defaulted as attending to anything else itself has been shielded.
Blocking module 220, if for listening to described attend to anything else using calling the photographing module to carry out Video chat, then
Attend to anything else described in interception using the first video for calling the photographing module to carry out the preview of Video chat institute, wherein first view
Frequency includes at least first image of frame.In embodiments of the present invention, blocking module 220 can be used for executing above-mentioned steps S200 institute
Content is stated, content described in above-mentioned steps S200 is suitable for blocking module 220.When need attend to anything else application in show the first video,
When the video image that the second video and opposite end are sent, the video window includes three windows, and a user shows without beauty
Change, sprout the first video of the processing such as face, one is used to show the second video by beautifying, sprouting the processing such as face, and one for showing
Show the video image that opposite end is sent.
When needs are shown in the video image for showing the second video and opposite end transmission in application of attending to anything else, the video window
Including two windows, one is used to show the second video by beautifying, sprouting the processing such as face, and one for showing what opposite end was sent
Video image.
In embodiments of the present invention, client 200 further includes the second communication module 270, and the second communication module 270 is used for will
First video is sent to the application of attending to anything else, so that the application of attending to anything else can use first video and opposite end carries out
Video chat.
In embodiments of the present invention, attend to anything else described in being intercepted in blocking module 220 and regarded using the calling photographing module
After first video of frequency chat institute's preview, first video can also be sent to application of attending to anything else by the second communication module 270, with
Make to attend to anything else to apply and can use the first video and opposite end progress Video chat.
Specifically, when first monitoring module 210 using the first Hook Function listen to attend to anything else using call photographing module into
Row Video chat, after camera collects video image data, before attending to anything else using to video image progress reality, by
Blocking module 220 then immediately intercepts the collected video image data of camera, and described image data refer to described first
Then video is being handled the first video to obtain the second video from the background by processing module 230, finally by the first communication mould
Second video is sent to application of attending to anything else by block 240, can use the second video and opposite end progress Video chat so that attending to anything else and applying.
Processing module 230 obtains the second view for handling the first image of each frame in first video
Frequently.In embodiments of the present invention, processing module 230 can be used for executing content described in above-mentioned steps S300, above-mentioned steps S300
The content is suitable for processing module 230.In general, people are during Video chat, it may be desirable to be shown to other side relatively good
Image, then need in the video for chatting with object image carry out landscaping treatment.
Referring to Fig. 4, Fig. 4 shows the frame structure schematic diagram of processing module 230.As an implementation, it handles
Module 230 includes obtaining texture cell 231 and beautification unit 132.Processing module 230 is to the view for chatting with object
When image in frequency carries out landscaping treatment, it can be realized by obtaining texture cell 231 and beautification unit 132, wherein
Texture cell 231 is obtained, for obtaining the respective first texture letter of the first image of every frame in first video
Breath.Herein, texture refers to the multicolour pattern on the texture of the body surface in image or the smooth surface of object, texture
Information refers to the location information of these textures, color pixel values etc..Obtain the side of the first texture information of every the first image of frame
There are many methods, such as LBP (Local Binary Patterns, local binary patterns) algorithm, edge histogram nomography, Gabor
Filter etc..
Beautify unit 132, for utilizing first texture information to corresponding first image of first texture information
It being rendered to realize that image beautifies, obtains the second image, second image forms the second video in embodiments of the present invention,
Corresponding first texture information of each the first image of frame.
Referring to Fig. 5, Fig. 5 shows the frame structure schematic diagram of beautification unit 132.Beautifying unit 132 includes rendering
Unit 1321 and replacement subelement 1322, wherein
It renders subelement 1321 and obtains the second texture information for rendering to first texture information.
To the first texture information carry out color rendering, rendering can be understood as change pixel pixel value and or brightness
Value, using the first texture information after rendering as the second texture information.Herein change pixel pixel value and or brightness
Value, can be according to the pixel value of the pixel in the pixel field and or brightness value to the pixel value of the pixel and
Or brightness value is changed.
Subelement 1322 is replaced, for replacing with and described first first texture information in the first image
Corresponding second texture information of texture information, obtains the second image.By the way that the first texture information in the first image is replaced with
The second texture information corresponding with the first texture information, then the pixel value of the first image and or brightness value changed.With warp
It crosses and the first texture information is replaced with into rear first image of the second texture information corresponding with the first texture information as the second figure
Picture.
The texture information can be rendered by OpenGL, to realize the landscaping treatment to the first image, be obtained
Second image.
Here, to the landscaping treatment of the first image, the second image is obtained, landscaping treatment, which can be, carries out beauty to the first image
The white, processing such as sprout face, virtualization, using the first image after landscaping treatment as the second image.
In embodiments of the present invention, beautification unit 132 is using first texture information to first texture information pair
The first image answered is rendered to realize that image beautifies, and is obtained the second image, can be rendered to whole the first image,
The regional area of first image can be rendered.
As an implementation, it when it is only necessary to handle the facial image in the first image, can mention
Human face region is identified in the first texture information out, then according to corresponding first texture information of human face region to human face region
It is rendered to realize landscaping treatment.Specifically, the first texture information corresponding to human face region renders, face area is obtained
Corresponding second texture information in domain replaces with corresponding first texture information of human face region in the first image and first line
Corresponding second texture information of the corresponding human face region of information is managed, the second image is obtained.The face of the second image obtained as a result,
Region is by having handled that treated, and human face region can have sprouts face, whitening, makeup and other effects.
When needing to carry out landscaping treatment to the non-face region in the first image, can be identified in the first texture information
Then non-face region out renders to realize U.S. non-face region according to corresponding first texture information in non-face region
Change processing.Wherein, non-face region refers to the region other than the human face region in the first image.Specifically, to non-face area
Corresponding first texture information in domain is rendered, and corresponding second texture information in non-face region is obtained, will be in the first image
Corresponding first texture information in non-face region replaces with non-face region corresponding second corresponding with first texture information
Texture information obtains the second image.The non-face region of the second image obtained as a result, is by having handled, and treated
Non-face region can have powerful connections virtualization, light enhancing and other effects.
In embodiments of the present invention, processing module 230 can be also used for the first texture information of each the first image of frame
It is stored, wherein the corresponding address ID of each texture information obtains the corresponding address ID of each texture information, root
It is rendered according to the address ID the first image corresponding to each texture information to realize that image beautifies, obtains the second image, the
Two images form the second video.It in embodiments of the present invention, can be by OpenGL to the video for chatting with object
In image rendered to realize landscaping treatment.
First communication module 240, for second video to be sent to the application of attending to anything else, so that the application of attending to anything else
It can use second video and opposite end carry out Video chat.In embodiments of the present invention, the first communication module 240 can be used
In executing content described in above-mentioned steps S400, content described in above-mentioned steps S400 is suitable for the first communication module 240.
In embodiments of the present invention, the first communication module 240 can be used for one frame one of the second image in the second video
It is sent to frame in application of attending to anything else, alternatively, the second image in video is divided into several groups, is then sent to a group by a group point
In body application.In order to guarantee to keep the continuity of video in Video chat and keep audio in video and Video chat and
The synchronism of video, it is preferred that as soon as first image is intercepted when camera collects the first image of frame, to first figure
Obtain the second image as carrying out landscaping treatment, then the second image be sent in application of attending to anything else again, attend to anything else using send this
Two images carry out Video chat applied to opposite end to opposite end, to realize to attend to anything else, in this way, the first image of camera continuous acquisition, so
Continuously intercept the first image afterwards, the first image handled in real time, will treated the first image, i.e. the second image is sent to
Attend to anything else in application, attends to anything else and carry out real-time video chat using with second image and opposite end.When multiple second images continuously transmit
To attending to anything else in application, multiple image constructions are attended to anything else using for the second video with opposite end Video chat.
After the second video is sent to the application of attending to anything else by the first communication module 240, it is also necessary to which monitoring operates in sand
It applies whether to mediate attending to anything else in case and only carries out Video chat with the photographing module in electronic equipment, stop when listening to attend to anything else to apply
When only photographing module being called to carry out Video chat, memory shared by texture information is discharged.Therefore, in embodiments of the present invention, objective
Family end 200 further includes the second monitoring module 250 and release module 260, wherein
Whether second monitors module 250, mediate only for monitoring to operate in apply attending to anything else in sandbox in electronic equipment
Photographing module carry out Video chat.
When detect it is described attend to anything else application program launching Video chat when, set Video chat for the video window
First video window, first video window is the window for showing itself video image, the specific can be that above-mentioned
Second video;One layer of second video window is covered on the video window, second video window is for showing opposite end
The window of video.When needs, one layer of third video window is covered on the video window, for showing itself video figure
The window of picture, the specific can be that the first above-mentioned video.First video window and third video window and the second video
Window size is different, and can switch mutually.
Referring to Fig. 6, Fig. 6 shows the frame structure schematic diagram of the second monitoring module 250.Second, which monitors module 250, wraps
Include the second monitoring unit 251 and the second prison judging unit 252, wherein
Second monitoring unit 251, for by attending to anything else to apply whether utilize stopping video described in the monitoring of the second Hook Function
Shooting instruction calls the photographing module.
Second prison judging unit 252, for listening to described attend to anything else using using stopping view when second Hook Function
When frequency shooting instruction calls the photographing module, attends to anything else described in expression and call the photographing module progress video to chat using stopping
It.
Second monitoring unit 251 is using the second hook hook function to the process of the camera manager for application program of attending to anything else
Code is modified, so that Softcam manager is patrolled to take over the processing of the camera manager for application program of attending to anything else
Volume.Attend to anything else described in being listened to when second Hook Function and instructs the calling photographing module using using stopping video capture
When, one can be sent and assert signals to the second prison judging unit 252, the second prison judging unit 252 determines the signal to indicate
It is described to attend to anything else using the stopping calling photographing module progress Video chat, in this case, Softcam manager
Stop adapter tube to the management to camera, closes camera.
Release module 260 listens to described attend to anything else using the stopping calling photographing module progress Video chat for working as
When, discharge memory shared by the texture information.Each texture information corresponds to an address ID, when completion is to each texture
After corresponding first image of information is handled, memory shared by the corresponding address ID of the texture information can be discharged, with
Continue after an action of the bowels and the texture information is rendered again or guarantees there are enough memory storage texture informations, so as to texture information
Corresponding first image is rendered to realize landscaping treatment.The second video for having been sent to application of attending to anything else is released in this way
Memory shared by texture information can when so that the photographing module progress Video chat in electronic equipment is transferred in subsequent application of attending to anything else
To obtain the texture information for the video image that the photographing module is passed back, and then the video is carried out at rendering according to the texture information
Reason.
Wherein, the first monitoring module 210, blocking module 220, the processing module 230, first that client 200 includes communicate
Module 240, second is monitored module 250, release module 260 and the second communication module 270 and can be connected by communication bus.
As one embodiment, the first monitoring module 210 operates in attending to anything else in sandbox by the monitoring of the first Hook Function
Using whether photographing module in electronic equipment being called to carry out Video chat, if listen to attend to anything else using call photographing module into
Row Video chat, blocking module 220 intercept described attend to anything else using the first view for calling photographing module to carry out the preview of Video chat institute
Frequently, it specifically, blocking module 220 calls jni method corresponding with photographing module is called in application of attending to anything else of monitoring, specially calls
SetpreviewTexture method in class android.harware.camara.Then processing module 230 obtains the first video
In image texture information, specially processing module 230 call setpreview texture
(surfacetexturesurfacetexture) the surfacetexture object in, then by OPenGL according to the texture
Information, i.e. surfacetexture object render the first image of each frame in the first video, obtain the second video,
Second video is sent to application of attending to anything else by last first communication module 240, so as to attend to anything else using can use the second video and right
End carries out Video chat.At the same time it can also call 250 module of the second monitoring module, specific second monitors module 250 by the
Two Hook Functions monitor jni method corresponding with calling photographing module is stopped in application of attending to anything else, and attend to anything else when listening to using stopping
When calling photographing module, release module 260 discharges the corresponding memory cache of texture information, i.e. surfacetexture object is corresponding
Memory cache, specifically, by release module 260 call android.harware.camara in method native-
Release is realized.
By using above scheme, mould can be imaged to intercepting when routine call photographing module of attending to anything else carries out Video chat
The first video that block acquisition, program of attending to anything else have not yet been displayed, after handling the first image of each frame in the first video
The second video is obtained, then the second video is sent to application of attending to anything else, attend to anything else the second video applied with after treatment and opposite end
Video chat is carried out, the second video can be by obtaining the progress landscaping treatment of the first video, in this way, attending to anything else using can be with
The second video and opposite end after landscaping treatment carry out Video chat.
The present invention additionally provides a kind of mobile terminal simultaneously, as shown in fig. 7, for ease of description, illustrating only and this hair
The relevant part of bright embodiment, it is disclosed by specific technical details, please refer to present invention method part.The terminal can be with
Being includes mobile phone, tablet computer, PDA (Personal Digital Assistant, personal digital assistant), POS
Any terminal device such as (PointofSales, point-of-sale terminal), vehicle-mounted computer, taking the terminal as an example:
Fig. 7 shows the block diagram of the part-structure of mobile phone relevant to terminal provided in an embodiment of the present invention.With reference to figure
7, mobile phone includes: radio frequency (Radio Frequency, RF) circuit 31, memory 132, input unit 33, display unit 34, passes
Sensor 35, voicefrequency circuit 36, Wireless Fidelity (wireless-fidelity, Wi-Fi) module 37, processor 38 and power supply 39
Equal components.It will be understood by those skilled in the art that handset structure shown in Fig. 7 does not constitute the restriction to mobile phone, can wrap
It includes than illustrating more or fewer components, perhaps combines certain components or different component layouts.
It is specifically introduced below with reference to each component parts of the Fig. 7 to mobile phone:
RF circuit 31 can be used for receiving and sending messages or communication process in, signal sends and receivees, particularly, will be under base station
After row information receives, handled to processor 38;In addition, the data for designing uplink are sent to base station.In general, RF circuit 31 includes
But be not limited to antenna, at least one amplifier, transceiver, coupler, low-noise amplifier (LowNoiseAmplifier,
LNA), duplexer etc..In addition, RF circuit 31 can also be communicated with network and other equipment by wireless communication.Above-mentioned channel radio
Any communication standard or agreement, including but not limited to global system for mobile communications (Global System of can be used in letter
Mobile communication, GSM), general packet radio service (General Packet Radio Service,
GPRS), CDMA (Code Division Multiple Access, CDMA), wideband code division multiple access (Wideband Code
Division Multiple Access, WCDMA), it is long term evolution (Long Term Evolution, LTE), Email, short
Messaging service (Short Messaging Service, SMS) etc..
Memory 32 can be used for storing software program and module, and processor 38 is stored in the soft of memory 32 by operation
Part program and module, thereby executing the various function application and data processing of mobile phone.Memory 32 can mainly include storage
Program area and storage data area, wherein storing program area can application program needed for storage program area, at least one function
(such as sound-playing function, image player function etc.) etc.;Storage data area, which can be stored, uses created number according to mobile phone
According to (such as audio data, phone directory etc.) etc..In addition, memory 32 may include high-speed random access memory, can also wrap
Include nonvolatile memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Input unit 33 can be used for receiving the number or character information of input, and generate with the user setting of mobile phone and
The related key signals input of function control.Specifically, input unit 33 may include touch panel 331 and other input equipments
332.Touch panel 331, also referred to as touch screen, collect user on it or nearby touch operation (such as user use hand
The operation of any suitable object or attachment such as finger, stylus on touch panel 331 or near touch panel 331), and according to
Preset formula drives corresponding attachment device.Optionally, touch panel 331 may include touch detecting apparatus and touch control
Two parts of device processed.Wherein, the touch orientation of touch detecting apparatus detection user, and touch operation bring signal is detected, it will
Signal sends touch controller to;Touch controller receives touch information from touch detecting apparatus, and is converted into contact
Coordinate, then give processor 38, and order that processor 38 is sent can be received and executed.Furthermore, it is possible to using resistance-type,
The multiple types such as condenser type, infrared ray and surface acoustic wave realize touch panel 331.In addition to touch panel 331, input unit 33
It can also include other input equipments 332.Specifically, other input equipments 332 can include but is not limited to physical keyboard, function
One of key (such as volume control button, switch key etc.), trace ball, mouse, operating stick etc. are a variety of.
Display unit 34 can be used for showing information input by user or be supplied to user information and mobile phone it is various
Menu.Display unit 34 may include display panel 341, optionally, can use liquid crystal display (Liquid Crystal
Display, LCD), the forms such as Organic Light Emitting Diode (Organic Light-Emitting Diode, OLED) it is aobvious to configure
Show panel 341.Further, touch panel 331 can cover display panel 341, when touch panel 331 detect it is on it or attached
After close touch operation, processor 38 is sent to determine the type of touch event, is followed by subsequent processing device 38 according to touch event
Type provides corresponding visual output on display panel 341.Although in Fig. 7, touch panel 331 is with display panel 341
The input and input function of mobile phone are realized as two independent components, but in some embodiments it is possible to by touch surface
Plate 331 and display panel 341 are integrated and that realizes mobile phone output and input function.
Mobile phone may also include at least one sensor 35, such as optical sensor, motion sensor and other sensors.Tool
Body, optical sensor may include ambient light sensor and proximity sensor, wherein ambient light sensor can be according to ambient light
Light and shade adjusts the brightness of display panel 341, proximity sensor can when mobile phone is moved in one's ear, close display panel 341 and/
Or backlight.As a kind of motion sensor, accelerometer sensor can detect (generally three axis) acceleration in all directions
Size can detect that size and the direction of gravity when static, can be used to identify mobile phone posture application (such as horizontal/vertical screen switching,
Dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.;It can also configure as mobile phone
The other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, details are not described herein.
Voicefrequency circuit 36, loudspeaker 361, microphone 362 can provide the audio interface between user and mobile phone.Voicefrequency circuit
Electric signal after the audio data received conversion can be transferred to loudspeaker 361 by 36, be converted to sound letter by loudspeaker 361
Number output;On the other hand, the voice signal of collection is converted to electric signal by microphone 362, is converted after being received by voicefrequency circuit 360
For audio data, then by after the processing of audio data output processor 38, such as another mobile phone is sent to through RF circuit 31, or
Audio data is exported to memory 32 to be further processed.
WiFi belongs to short range wireless transmission technology, and mobile phone can help user's transceiver electronics postal by WiFi module 37
Part, browsing webpage and access streaming video etc., it provides wireless broadband internet access for user.Although Fig. 7 is shown
WiFi module 37, but it is understood that, and it is not belonging to must be configured into for mobile phone, it can according to need do not changing completely
It is omitted in the range of the essence of invention.
Processor 38 is the control centre of mobile phone, using the various pieces of various interfaces and connection whole mobile phone, is led to
It crosses operation or executes the software program and/or module being stored in memory 32, and call the number being stored in memory 32
According to, execute mobile phone various functions and processing data, thus to mobile phone carry out integral monitoring.Optionally, processor 38 may include
One or more processing units;Preferably, processor 38 can integrate application processor and modem processor, wherein application
The main processing operation system of processor, user interface and application program etc., modem processor mainly handles wireless communication.It can
With understanding, above-mentioned modem processor can not also be integrated into processor 38.
Mobile phone further includes the power supply 39 (such as battery) powered to all parts, it is preferred that power supply can pass through power supply pipe
Reason system and processor 38 are logically contiguous, to realize management charging, electric discharge and power managed etc. by power-supply management system
Function.
Although being not shown, mobile phone can also include camera, bluetooth module etc., and details are not described herein.
In embodiments of the present invention, processor 38 included by the terminal is also with the following functions: monitoring operates in sandbox
In attend to anything else using whether photographing module in electronic equipment being called to carry out Video chat;
Video chat is carried out using the calling photographing module if attending to anything else described in listening to, then application of attending to anything else described in interception
The photographing module is called to carry out the first video of Video chat institute preview, wherein first video includes an at least frame the
One image;The first image of each frame in first video is handled, the second video is obtained;Second video is sent out
It send to the application of attending to anything else, so that the application of attending to anything else can use second video and opposite end carries out Video chat.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
Algorithm and display are not inherently related to any particular computer, virtual system, or other device provided herein.
It should be understood that can use various programming languages realizes summary of the invention described herein, and above to language-specific institute
The description done is in order to disclose the best mode of carrying out the invention.
In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that implementation of the invention
Example can be practiced without these specific details.In some instances, well known method, structure is not been shown in detail
And technology, so as not to obscure the understanding of this specification.
Similarly, it should be understood that in order to simplify the disclosure and help to understand one or more of the various inventive aspects,
Above in the description of exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes
In example, figure or descriptions thereof.However, the disclosed method should not be interpreted as reflecting the following intention: i.e. required to protect
Shield the present invention claims features more more than feature expressly recited in each claim.More precisely, as following
Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore,
Thus the claims for following specific embodiment are expressly incorporated in the specific embodiment, wherein each claim itself
All as a separate embodiment of the present invention.
Those skilled in the art will understand that can be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more devices different from this embodiment.It can be the module or list in embodiment
Member or component are combined into a module or unit or component, and furthermore they can be divided into multiple submodule or subelement or
Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it can use any
Combination is to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed
All process or units of what method or apparatus are combined.Unless expressly stated otherwise, this specification is (including adjoint power
Benefit require, abstract and attached drawing) disclosed in each feature can carry out generation with an alternative feature that provides the same, equivalent, or similar purpose
It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments in this include institute in other embodiments
Including certain features rather than other feature, but the combination of the feature of different embodiment means in the scope of the present invention
Within and form different embodiments.For example, in the following claims, embodiment claimed it is any it
One can in any combination mode come using.
Various component embodiments of the invention can be implemented in hardware, or to run on one or more processors
Software module realize, or be implemented in a combination thereof.It will be understood by those of skill in the art that can be used in practice
Microprocessor or digital signal processor (DSP) realize gateway according to an embodiment of the present invention, proxy server, in system
Some or all components some or all functions.The present invention is also implemented as executing side as described herein
Some or all device or device programs (for example, computer program and computer program product) of method.It is such
It realizes that program of the invention can store on a computer-readable medium, or can have the shape of one or more signal
Formula.Such signal can be downloaded from an internet website to obtain, and perhaps be provided on the carrier signal or with any other shape
Formula provides.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and ability
Field technique personnel can be designed alternative embodiment without departing from the scope of the appended claims.In the claims,
Any reference symbol between parentheses should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not
Element or step listed in the claims.Word "a" or "an" located in front of the element does not exclude the presence of multiple such
Element.The present invention can be by means of including the hardware of several different elements and being come by means of properly programmed computer real
It is existing.In the unit claims listing several devices, several in these devices can be through the same hardware branch
To embody.The use of word first, second, and third does not indicate any sequence.These words can be explained and be run after fame
Claim.
The foregoing is only a preferred embodiment of the present invention, is not intended to limit the scope of the present invention, it is all
Made any modifications, equivalent replacements, and improvements etc. within the spirit and principles in the present invention, should be included in protection of the invention
Within the scope of.
The present invention provides a kind of method for processing video frequency of A1., comprising:
Whether monitor to operate in apply attending to anything else in sandbox calls the photographing module in electronic equipment to carry out Video chat;
Video chat is carried out using the calling photographing module if attending to anything else described in listening to, then application of attending to anything else described in interception
The photographing module is called to carry out the first video of Video chat institute preview, wherein first video includes an at least frame the
One image;
The first image of each frame in first video is handled, the second video is obtained;
Second video is sent to the application of attending to anything else, so that the application of attending to anything else can use second video
Video chat is carried out with opposite end.
A2. method for processing video frequency according to a1, first image of each frame in first video carry out
Processing, obtains the second video, comprising:
Obtain respective first texture information of the first image of every frame in first video;
Corresponding first image of first texture information is rendered to realize figure using first texture information
As beautification, the second image is obtained, second image forms the second video.
A3. the method for processing video frequency according to A2, using first texture information to first texture information pair
The first image answered is rendered to realize that image beautifies, and the second image is obtained, comprising:
First texture information is rendered, the second texture information is obtained;
First texture information in the first image is replaced with and first texture information corresponding second
Texture information obtains the second image.
A4. the method for processing video frequency according to A2, after second video to be sent to the application of attending to anything else, institute
State method for processing video frequency further include:
It monitors and operates in attending to anything else using whether mediating and only carry out video with the photographing module in electronic equipment and chat in sandbox
It;
When listening to described attend to anything else using stopping that the photographing module is called to carry out Video chat, the texture letter is discharged
The shared memory of breath.
A5. method for processing video frequency according to a1 is attended to anything else described in the interception using calling the photographing module to be regarded
After first video of frequency chat institute's preview, the method for processing video frequency further include:
First video is sent to the application of attending to anything else, so that the application of attending to anything else can use first video
Video chat is carried out with opposite end.
A6. method for processing video frequency according to a1, the monitoring, which operates in, applies whether call electricity attending to anything else in sandbox
Photographing module in sub- equipment carries out Video chat, comprising:
By attending to anything else to apply whether utilize the video capture instruction calling photographing module described in the monitoring of the first Hook Function;
Attend to anything else described in being listened to when first Hook Function and calls the photographing module using using video capture instruction
When, expression listens to described attend to anything else using the calling photographing module progress Video chat.
A7. method for processing video frequency according to a4, the monitoring operate in apply whether stop adjusting attending to anything else in sandbox
Video chat is carried out with the photographing module in electronic equipment, comprising:
By attending to anything else to apply whether utilize the camera shooting of stopping video capture instruction calling described in the monitoring of the second Hook Function
Module;
Attend to anything else described in being listened to when second Hook Function and instructs the calling camera shooting using using stopping video capture
Attend to anything else when module, described in expression and calls the photographing module to carry out Video chat using stopping.
B8. a kind of client, described device include:
First monitors module, for monitoring the camera shooting mould applied and whether called in electronic equipment of attending to anything else operated in sandbox
Block carries out Video chat;
Blocking module then blocks if calling the photographing module to carry out Video chat for listening to the application of attending to anything else
Cut described attend to anything else using the first video for calling the photographing module to carry out the preview of Video chat institute, wherein first video
Including at least first image of frame;
Processing module obtains the second video for handling the first image of each frame in first video;
First communication module, for second video to be sent to the application of attending to anything else so that it is described attend to anything else application can
To carry out Video chat using second video and opposite end.
B9. the client according to B8, the processing module, comprising:
Texture cell is obtained, for obtaining respective first texture information of the first image of every frame in first video;
Beautify unit, for carrying out using first texture information to corresponding first image of first texture information
Rendering obtains the second image to realize that image beautifies, and second image forms the second video.
B10. the client according to B9, the beautification unit, comprising:
It renders subelement and obtains the second texture information for rendering to first texture information;
Subelement is replaced, for replacing with and first texture first texture information in the first image
Corresponding second texture information of information, obtains the second image.
B11. the client according to B9, the client further include:
Whether second monitors module, mediate only with taking the photograph in electronic equipment for monitoring to operate in apply attending to anything else in sandbox
As module carries out Video chat;
Release module, for when listening to described attend to anything else using stopping that the photographing module is called to carry out Video chat,
Discharge memory shared by the texture information.
B12. the client according to B8, the client further include:
Second communication module, for first video to be sent to the application of attending to anything else so that it is described attend to anything else application can
To carry out Video chat using first video and opposite end.
B13. the client according to B8, described first monitors module, comprising:
First monitoring unit, for by attending to anything else to apply whether utilize video capture instruction described in the monitoring of the first Hook Function
Call the photographing module;
First judging unit, for when first Hook Function listen to it is described attend to anything else instructed using using video capture
When calling the photographing module, expression listens to described attend to anything else using the calling photographing module progress Video chat.
B14. client according to b12, described second monitors module, comprising:
Second monitoring unit, for by attending to anything else to apply whether utilize stopping video capture described in the monitoring of the second Hook Function
The photographing module is called in instruction;
Second prison judging unit, for when second Hook Function listen to it is described attend to anything else clapped using using stopping video
When taking the photograph the instruction calling photographing module, attends to anything else described in expression and call the photographing module to carry out Video chat using stopping.
C15. a kind of computer readable storage medium, is stored thereon with computer program, when which is executed by processor
The step of realizing any one of A1-A7 the method.
D16. a kind of mobile terminal, include memory and one perhaps more than one program one of them or
More than one program is stored in memory, and be configured to be executed by one or more than one processor it is one or
More than one program includes the instruction for performing the following operation:
Whether monitor to operate in apply attending to anything else in sandbox calls the photographing module in electronic equipment to carry out Video chat;
Video chat is carried out using the calling photographing module if attending to anything else described in listening to, then application of attending to anything else described in interception
The photographing module is called to carry out the first video of Video chat institute preview, wherein first video includes an at least frame the
One image;
The first image of each frame in first video is handled, the second video is obtained;
Second video is sent to the application of attending to anything else, so that the application of attending to anything else can use second video
Video chat is carried out with opposite end.
Claims (10)
1. a kind of method for processing video frequency, which is characterized in that the described method includes:
Whether monitor to operate in apply attending to anything else in sandbox calls the photographing module in electronic equipment to carry out Video chat;
If attending to anything else described in listening to using calling the photographing module to carry out Video chat, then attends to anything else to apply described in interception and call
The photographing module carries out the first video of Video chat institute preview, wherein first video includes at least first figure of frame
Picture;
The first image of each frame in first video is handled, the second video is obtained;
Second video is sent to the application of attending to anything else, so that the application of attending to anything else can use second video and right
End carries out Video chat.
2. method for processing video frequency according to claim 1, which is characterized in that each frame in first video
First image is handled, and the second video is obtained, comprising:
Obtain respective first texture information of the first image of every frame in first video;
Corresponding first image of first texture information is rendered using first texture information to realize image beauty
Change, obtain the second image, second image forms the second video.
3. method for processing video frequency according to claim 2, which is characterized in that using first texture information to described the
Corresponding first image of one texture information is rendered to realize that image beautifies, and the second image is obtained, comprising:
First texture information is rendered, the second texture information is obtained;
First texture information in the first image is replaced with into the second texture corresponding with first texture information
Information obtains the second image.
4. method for processing video frequency according to claim 2, which is characterized in that second video is being sent to described point
After body application, the method for processing video frequency further include:
It monitors to operate in apply whether to mediate attending to anything else in sandbox and only carries out Video chat with the photographing module in electronic equipment;
When listening to described attend to anything else using stopping that the photographing module is called to carry out Video chat, the texture information institute is discharged
The memory accounted for.
5. method for processing video frequency according to claim 1, which is characterized in that attend to anything else described in the interception and taken the photograph using described in calling
After the first video for carrying out the preview of Video chat institute as module, the method for processing video frequency further include:
First video is sent to the application of attending to anything else, so that the application of attending to anything else can use first video and right
End carries out Video chat.
6. method for processing video frequency according to claim 1, which is characterized in that the monitoring, which operates in, answers attending to anything else in sandbox
With whether the photographing module in electronic equipment being called to carry out Video chat, comprising:
By attending to anything else to apply whether utilize the video capture instruction calling photographing module described in the monitoring of the first Hook Function;
When first Hook Function listens to described attend to anything else using the photographing module is called using video capture instruction, table
Show and listens to described attend to anything else using the calling photographing module progress Video chat.
7. method for processing video frequency according to claim 4, which is characterized in that the monitoring, which operates in, answers attending to anything else in sandbox
With whether stop call electronic equipment in photographing module carry out Video chat, comprising:
By attending to anything else to apply whether utilize the stopping video capture instruction calling photographing module described in the monitoring of the second Hook Function;
Attend to anything else described in being listened to when second Hook Function and instructs the calling photographing module using using stopping video capture
When, attend to anything else described in expression using stopping that the photographing module is called to carry out Video chat.
8. a kind of client, which is characterized in that described device includes:
First monitors module, for monitors the attending to anything else application operated in sandbox whether call photographing module in electronic equipment into
Row Video chat;
Blocking module then intercepts institute if calling the photographing module to carry out Video chat for listening to the application of attending to anything else
State the first video attended to anything else using calling the photographing module to carry out the preview of Video chat institute, wherein first video includes
At least first image of frame;
Processing module obtains the second video for handling the first image of each frame in first video;
First communication module, for second video to be sent to the application of attending to anything else, so that the application of attending to anything else can benefit
Video chat is carried out with second video and opposite end.
9. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is held by processor
The step of any one of claim 1-7 the method is realized when row.
10. a kind of mobile terminal, which is characterized in that include memory and one or more than one program, wherein one
A perhaps more than one program is stored in memory and is configured to execute described one by one or more than one processor
A or more than one program includes the instruction for performing the following operation:
Whether monitor to operate in apply attending to anything else in sandbox calls the photographing module in electronic equipment to carry out Video chat;
If attending to anything else described in listening to using calling the photographing module to carry out Video chat, then attends to anything else to apply described in interception and call
The photographing module carries out the first video of Video chat institute preview, wherein first video includes at least first figure of frame
Picture;
The first image of each frame in first video is handled, the second video is obtained;
Second video is sent to the application of attending to anything else, so that the application of attending to anything else can use second video and right
End carries out Video chat.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810892977.7A CN108989901A (en) | 2018-08-07 | 2018-08-07 | Method for processing video frequency, client and terminal |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810892977.7A CN108989901A (en) | 2018-08-07 | 2018-08-07 | Method for processing video frequency, client and terminal |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108989901A true CN108989901A (en) | 2018-12-11 |
Family
ID=64555305
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810892977.7A Pending CN108989901A (en) | 2018-08-07 | 2018-08-07 | Method for processing video frequency, client and terminal |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108989901A (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110769316A (en) * | 2019-10-30 | 2020-02-07 | 北京博睿宏远数据科技股份有限公司 | Method, device, equipment and storage medium for calculating first frame time |
CN111565292A (en) * | 2019-02-13 | 2020-08-21 | 夏普株式会社 | Image processing apparatus, image communication system, and image processing method |
CN112732553A (en) * | 2020-12-25 | 2021-04-30 | 北京百度网讯科技有限公司 | Image testing method and device, electronic equipment and storage medium |
CN114093350A (en) * | 2020-08-05 | 2022-02-25 | 腾讯科技(深圳)有限公司 | Voice data acquisition method, voice call device and computer equipment |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105979194A (en) * | 2016-05-26 | 2016-09-28 | 努比亚技术有限公司 | Video image processing apparatus and method |
CN106897610A (en) * | 2017-01-19 | 2017-06-27 | 北京奇虎科技有限公司 | A kind of method and apparatus for positioning protection |
CN107908444A (en) * | 2017-10-26 | 2018-04-13 | 北京奇虎科技有限公司 | The hook method and device of terminal applies |
-
2018
- 2018-08-07 CN CN201810892977.7A patent/CN108989901A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105979194A (en) * | 2016-05-26 | 2016-09-28 | 努比亚技术有限公司 | Video image processing apparatus and method |
CN106897610A (en) * | 2017-01-19 | 2017-06-27 | 北京奇虎科技有限公司 | A kind of method and apparatus for positioning protection |
CN107908444A (en) * | 2017-10-26 | 2018-04-13 | 北京奇虎科技有限公司 | The hook method and device of terminal applies |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111565292A (en) * | 2019-02-13 | 2020-08-21 | 夏普株式会社 | Image processing apparatus, image communication system, and image processing method |
CN110769316A (en) * | 2019-10-30 | 2020-02-07 | 北京博睿宏远数据科技股份有限公司 | Method, device, equipment and storage medium for calculating first frame time |
CN110769316B (en) * | 2019-10-30 | 2022-03-15 | 北京博睿宏远数据科技股份有限公司 | Method, device, equipment and storage medium for calculating first frame time |
CN114093350A (en) * | 2020-08-05 | 2022-02-25 | 腾讯科技(深圳)有限公司 | Voice data acquisition method, voice call device and computer equipment |
CN112732553A (en) * | 2020-12-25 | 2021-04-30 | 北京百度网讯科技有限公司 | Image testing method and device, electronic equipment and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108989901A (en) | Method for processing video frequency, client and terminal | |
CN103905885B (en) | Net cast method and device | |
CN110149552A (en) | A kind of processing method and terminal of video flowing frame data | |
CN109218731A (en) | The throwing screen method, apparatus and system of mobile device | |
CN110248254A (en) | Display control method and Related product | |
CN107948543A (en) | A kind of special video effect processing method and processing device | |
CN107203147B (en) | Internet of Things network control system based on cloud platform and method | |
CN104780338A (en) | Method and electronic equipment for loading expression effect animation in instant video | |
CN108900778A (en) | A kind of image pickup method, mobile terminal and computer readable storage medium | |
CN107197146A (en) | Image processing method and related product | |
CN108551411A (en) | Collecting method, mobile terminal and computer readable storage medium | |
CN108921941A (en) | Image processing method, device, storage medium and electronic equipment | |
CN110213440A (en) | A kind of images share method and terminal | |
CN108063901A (en) | A kind of image-pickup method, terminal and computer readable storage medium | |
CN108874258A (en) | Share the method and device of record screen video | |
CN109218626A (en) | A kind of photographic method and terminal | |
CN108762829A (en) | A kind of method, client and terminal for image beautification | |
CN109769067A (en) | Terminal screen method for handover control, terminal and computer readable storage medium | |
CN110177177A (en) | Message back method, mobile terminal and computer readable storage medium | |
CN109213407A (en) | A kind of screenshot method and terminal device | |
CN110209332A (en) | A kind of information processing method and terminal device | |
CN109992183A (en) | Preview picture and the method for selection, terminal and storage medium | |
CN109407948A (en) | A kind of interface display method and mobile terminal | |
CN109493821A (en) | Screen brightness regulation method, device and storage medium | |
CN110535211A (en) | Charge control method, terminal and computer readable storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181211 |