CN108989901A - Method for processing video frequency, client and terminal - Google Patents

Method for processing video frequency, client and terminal Download PDF

Info

Publication number
CN108989901A
CN108989901A CN201810892977.7A CN201810892977A CN108989901A CN 108989901 A CN108989901 A CN 108989901A CN 201810892977 A CN201810892977 A CN 201810892977A CN 108989901 A CN108989901 A CN 108989901A
Authority
CN
China
Prior art keywords
video
anything
image
attending
photographing module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810892977.7A
Other languages
Chinese (zh)
Inventor
王春雷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Qihoo Technology Co Ltd
Original Assignee
Beijing Qihoo Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Qihoo Technology Co Ltd filed Critical Beijing Qihoo Technology Co Ltd
Priority to CN201810892977.7A priority Critical patent/CN108989901A/en
Publication of CN108989901A publication Critical patent/CN108989901A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44012Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the invention discloses and a kind of method for processing video frequency, client and terminal, it is related to technical field of image processing, the photographing module in electronic equipment whether is called to carry out Video chat the described method includes: monitoring and operating in apply attending to anything else in sandbox, Video chat is carried out using the calling photographing module if listening to and attending to anything else, then intercept the first video attended to anything else using calling photographing module to carry out the preview of Video chat institute, wherein, first video includes at least first image of frame, the first image of each frame in first video is handled, obtain the second video, second video is sent to the application of attending to anything else, it can use the second video and opposite end progress Video chat so as to attend to anything else and apply;So, the second video is obtained after handling the first image of each frame in the first video, application attend to anything else with the second video and opposite end progress Video chat after treatment, application of attending to anything else can be with the second video and opposite end progress Video chat after landscaping treatment.

Description

Method for processing video frequency, client and terminal
Technical field
The present invention relates to technical field of image processing more particularly to a kind of method for processing video frequency, client and terminal.
Background technique
With the development of intelligent terminal, intelligent terminal carries more and more functions.Wherein, Video chat function intelligence An essential function in terminal.
But when carrying out Video chat, show personage or scene is all original image, and some users want to show The relatively good image of other side, it is desirable to personage and scene can be beautified in Video chat, therefore how in Video chat When to image carry out beautification be urgent need to resolve the problem of.
Summary of the invention
In view of the above problems, the embodiment of the invention provides a kind of method for processing video frequency, client and terminals, for solving In the prior art in Video chat, the image of Video chat can not be beautified, the demand of user is caused to be not being met The technical issues of.
In a first aspect, the present invention provides a kind of method for processing video frequency, which comprises monitor point operated in sandbox Whether body application calls the photographing module in electronic equipment to carry out Video chat;If listening to described attend to anything else using described in calling Photographing module carries out Video chat, then intercept described in attend to anything else using call the photographing module to carry out the preview of Video chat institute the One video, wherein first video includes at least first image of frame;To the first image of each frame in first video It is handled, obtains the second video;Second video is sent to the application of attending to anything else, so that the application of attending to anything else can benefit Video chat is carried out with second video and opposite end.
Optionally, first image of each frame in first video is handled, and obtains the second video, packet It includes: obtaining respective first texture information of the first image of every frame in first video;Utilize first texture information pair Corresponding first image of first texture information is rendered to realize that image beautifies, and the second image, second figure are obtained As the second video of composition.
Optionally, using first texture information to corresponding first image of first texture information rendered with It realizes image beautification, obtains the second image, comprising: render to first texture information, obtain the second texture information;It will First texture information in the first image replaces with the second texture information corresponding with first texture information, obtains To the second image.
Optionally, after second video to be sent to the application of attending to anything else, the method for processing video frequency further include: It monitors to operate in apply whether to mediate attending to anything else in sandbox and only carries out Video chat with the photographing module in electronic equipment;Work as monitoring When to the application of attending to anything else stopping that the photographing module is called to carry out Video chat, memory shared by the texture information is discharged.
Optionally, attend to anything else described in the interception using the first video for calling the photographing module to carry out the preview of Video chat institute Later, the method for processing video frequency further include: first video is sent to the application of attending to anything else, so that the application of attending to anything else It can use first video and opposite end carry out Video chat.
Optionally, whether the monitoring operates in apply attending to anything else in sandbox calls the photographing module in electronic equipment to carry out Video chat, comprising: taken the photograph described in calling by attending to anything else to apply whether to instruct using video capture described in the monitoring of the first Hook Function As module;Attend to anything else described in being listened to when first Hook Function and calls the photographing module using using video capture instruction When, expression listens to described attend to anything else using the calling photographing module progress Video chat.
Optionally, whether the monitoring operates in apply and stops calling the photographing module in electronic equipment attending to anything else in sandbox Carry out Video chat, comprising: by attending to anything else to apply whether utilize stopping video capture instruction tune described in the monitoring of the second Hook Function With the photographing module;Attend to anything else described in being listened to when second Hook Function and instructs calling institute using using stopping video capture Attend to anything else when stating photographing module, described in expression and calls the photographing module to carry out Video chat using stopping.
Second aspect, the present invention, which implements, additionally provides a kind of client, and described device includes: the first monitoring module, uses The photographing module in electronic equipment whether is called to carry out Video chat in monitoring to operate in apply attending to anything else in sandbox;Intercept mould Block, if for listen to it is described attend to anything else using calling the photographing module to carry out Video chat, then intercept described in attend to anything else application The photographing module is called to carry out the first video of Video chat institute preview, wherein first video includes an at least frame the One image;Processing module obtains the second video for handling the first image of each frame in first video;The One communication module, for second video to be sent to the application of attending to anything else so that the application of attending to anything else can use it is described Second video and opposite end carry out Video chat.
Optionally, the processing module, comprising: texture cell is obtained, for obtaining every frame in first video the Respective first texture information of one image;Beautify unit, for utilizing first texture information to first texture information Corresponding first image is rendered to realize that image beautifies, and the second image is obtained, and second image forms the second video.
Optionally, the beautification unit, comprising: rendering subelement is obtained for rendering to first texture information To the second texture information;Replace subelement, for by first texture information in the first image replace with it is described Corresponding second texture information of first texture information, obtains the second image.
Optionally, the client further include: second monitors module, is for monitoring to operate in apply attending to anything else in sandbox No mediate only carries out Video chat with the photographing module in electronic equipment;Release module listens to the application of attending to anything else for working as When stopping that the photographing module is called to carry out Video chat, memory shared by the texture information is discharged.
Optionally, the client further include: the second communication module, for first video to be sent to described attend to anything else Using so that the application of attending to anything else can use first video and opposite end carries out Video chat.
Optionally, described first module is monitored, comprising: the first monitoring unit, for monitoring institute by the first Hook Function It states and attends to anything else to apply whether utilize the video capture instruction calling photographing module;First judging unit, for working as first hook Subfunction listens to described when attending to anything else using the photographing module is called using video capture instruction, and expression listens to described attend to anything else Video chat is carried out using the calling photographing module.
Optionally, described second module is monitored, comprising: the second monitoring unit, for monitoring institute by the second Hook Function It states and attends to anything else to apply whether utilize the stopping video capture instruction calling photographing module;Second prison judging unit, for when described Second Hook Function listen to it is described when attending to anything else using using stopping video capture instruction and calling the photographing module, described in expression Attend to anything else and calls the photographing module to carry out Video chat using stopping.
The third aspect, the embodiment of the invention also provides a kind of computer readable storage mediums, are stored thereon with computer Program, which is characterized in that the step of any of the above-described the method is realized when the program is executed by processor.
Fourth aspect, it to include memory and one or one that the embodiment of the invention also provides a kind of mobile terminals A above program, perhaps more than one program is stored in memory and is configured to by one or one for one of them It includes the instruction for performing the following operation that the above processor, which executes the one or more programs:
Whether monitor to operate in apply attending to anything else in sandbox calls the photographing module in electronic equipment to carry out Video chat;If Be listen to it is described attend to anything else using calling the photographing module to carry out Video chat, then intercept described in attend to anything else and taken the photograph using described in calling As module carries out the first video of Video chat institute preview, wherein first video includes at least first image of frame;To institute The first image of each frame stated in the first video is handled, and the second video is obtained;Second video is sent to described point Body application, so that the application of attending to anything else can use second video and opposite end carries out Video chat.
The technical solution provided in the embodiment of the present application, has at least the following technical effects or advantages:
The embodiment of the invention provides a kind of method for processing video frequency, client and terminals, which comprises monitors operation Attending to anything else using whether the photographing module in electronic equipment being called to carry out Video chat, if listening to described attend to anything else in sandbox Video chat is carried out using the calling photographing module, then attends to anything else described in interception and is chatted using the calling photographing module progress video First video of its preview, wherein first video includes at least first image of frame, to every in first video One the first image of frame is handled, and the second video is obtained, and second video is sent to the application of attending to anything else, so that described point Body application can use second video and opposite end carries out Video chat;In this way, can be in routine call camera shooting mould of attending to anything else Block carries out the first video that photographing module acquisition is intercepted when Video chat, that program of attending to anything else has not yet been displayed, by the first video In the first image of each frame handled after obtain the second video, then the second video is sent to application of attending to anything else, application of attending to anything else With after treatment the second video and opposite end carry out Video chat, the second video can be by beautifying the first video Processing obtains, in this way, application of attending to anything else can be with the second video and opposite end progress Video chat after landscaping treatment.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention, And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can It is clearer and more comprehensible, the followings are specific embodiments of the present invention.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:
Fig. 1 shows a kind of flow chart of method for processing video frequency provided in an embodiment of the present invention.
Fig. 2 shows the frame structure schematic diagrames of client 200.
Fig. 3 shows the frame structure schematic diagram of the first monitoring module 210.
Fig. 4 shows the frame structure schematic diagram of processing module 230.
Fig. 5 shows the frame structure schematic diagram of beautification unit 132.
Fig. 6 shows the frame structure schematic diagram of the second monitoring module 250.
Fig. 7 shows the block diagram of the part-structure of mobile phone relevant to terminal provided in an embodiment of the present invention.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure It is fully disclosed to those skilled in the art.
The embodiment of the invention provides one kind to be used for method for processing video frequency, applies in terminal, it should be noted that the present invention The implementation process for the method for processing video frequency that embodiment provides is realized in sandbox.As shown in Figure 1, which comprises
Step S100: it monitors to operate in apply attending to anything else in sandbox and whether the photographing module in electronic equipment is called to be regarded Frequency is chatted;
In embodiments of the present invention, sandbox (Sandboxie) is called sand table, refers to a virtual system program, allows Browser or other programs are run in sand table environment, generated variation can be deleted then in the process of running.It is created The independently working environment of one similar sandbox, the program that runs inside it can not generate permanent influence to hard disk. Attend to anything else and attending to anything else using the native applications program for being then mounted to electronic equipment, be using technology of attending to anything else to native applications programs into Row is attended to anything else, the application program that can be run in sandbox, and the institute for having native applications program is functional, is capable of providing and original The raw identical service of application program.The present invention discloses in embodiment, native applications program can be QQ, wechat, nail nail, 263 clouds communication etc..
In this step, whether monitor to operate in apply attending to anything else in sandbox calls the photographing module in electronic equipment to carry out Whether Video chat can specifically be realized by following step: being utilized by attending to anything else to apply described in the monitoring of the first Hook Function The photographing module is called in video capture instruction;Attend to anything else to apply described in listening to when first Hook Function and utilizes video capture When instructing the calling photographing module, expression listens to described attend to anything else using the calling photographing module progress Video chat.
Herein, term " hook " cover for by intercept transmitted between component software function call, message, Or event changes or increases the technology of the behavior of operating system, application program or other software component.And handle this blocked The code of function call, event or the message cut is thus referred to as hook (hook) function.Hook is commonly used in various targets, including Function debug and be extended to function.Its example may include keyboard or mouse event be transmitted to application program it It is preceding to intercept they or hooking system service call (system call) or system function behavior, function implementing result etc., with prison Depending on or modification application program or the function of other assemblies etc..
The first hook hook function can be used to the process generation of the camera manager for application program of attending to anything else in the present embodiment Code is modified, so that Softcam manager takes over the processing logic of the camera manager for application program of attending to anything else. In this case, Softcam manager can take over the management to camera, so as to take over camera acquisition Video, and adapter tube to application program of attending to anything else video window etc..
Here, in order to the processing such as carrying out U.S. face to video, sprout face, it is also necessary to mask application program itself of attending to anything else Video window.Here, the video window includes two, one be for for showing the window of opposite end video image, it is described right End can be understood as the peer user that Video chat is carried out with user itself, also be understood as instant messaging used in peer user Application program, one is for for showing the window of itself video image.Or the video window include three, one be for For showing the window of opposite end video image, the opposite end that the opposite end can be understood as carrying out Video chat with user itself is used Family also is understood as instant messaging application program used in peer user, and one is for for showing itself after treatment The window of video image, one be for for show itself it is untreated after video image window.
Here, it when the video window of Softcam manager adapter tube to application program of attending to anything else, that is, listens to attend to anything else and answer When with calling photographing module to carry out Video chat, the video window of the application program that is just defaulted as attending to anything else itself has been shielded.
Step S200: if attending to anything else described in listening to using calling the photographing module to carry out Video chat, then institute is intercepted State the first video attended to anything else using calling the photographing module to carry out the preview of Video chat institute, wherein first video includes At least first image of frame;
In this step, attend to anything else using the first view for calling the photographing module to carry out the preview of Video chat institute described in the interception After frequency, the first video application of attending to anything else be can also be sent to, the first video and opposite end progress can use so as to attend to anything else and apply Video chat.
Herein, when the video image for needing to show the first video, the second video and opposite end transmission in application of attending to anything else When, the video window includes three windows, and a user shows the first video without beautifying, sprouting the processing such as face, a use The second video for passing through beautification in display, sprouting the processing such as face, a video image sent for showing opposite end.
When needs are shown in the video image for showing the second video and opposite end transmission in application of attending to anything else, the video window Including two windows, one is used to show the second video by beautifying, sprouting the processing such as face, and one for showing what opposite end was sent Video image.
Step S300: the first image of each frame in first video is handled, the second video is obtained;
In general, people are during Video chat, it may be desirable to relatively good image is shown to other side, then need to Image in the video chatted with object carries out landscaping treatment.
In this step, carrying out landscaping treatment to the image in the video for chatting with object can be by as follows Mode is realized: obtaining respective first texture information of the first image of every frame in the first video;Utilize first texture information The first image corresponding to the first texture information is rendered to realize that image beautifies, and the second image, the second image composition are obtained Second video.
Herein, texture refers to the cromogram on the texture of the body surface in image or the smooth surface of object Case, texture information refer to the location information of these textures, pixel value etc..Here, corresponding first texture of each frame image Information.
Here, there are many ways to obtaining the first texture information of every the first image of frame, such as LBP (Local Binary Patterns, local binary patterns) algorithm, edge histogram nomography, Gabor filter etc..
In embodiments of the present invention, corresponding first texture information of each the first image of frame.Utilize the first texture information The first image corresponding to the first texture information is rendered to realize that image beautifies, specifically, can be, to first line Reason information is rendered, and the second texture information is obtained;First texture information in the first image is replaced with and institute Corresponding second texture information of the first texture information is stated, the second image is obtained.
Herein, the step of the first texture information being rendered, obtains the second texture information, it can be understood as, to One texture information carry out color rendering, rendering can be understood as change pixel pixel value and or brightness value, with rendering after First texture information is as the second texture information.Herein change pixel pixel value and or brightness value, can be according to should The pixel value of pixel in pixel field and or brightness value to the pixel value of the pixel and or brightness value change Become.
By the way that the first texture information in the first image is replaced with the second texture information corresponding with the first texture information, Then the pixel value of the first image and or brightness value changed.By the first texture information is replaced with and the first texture Rear first image of corresponding second texture information of information is as the second image.
The texture information can be rendered by OpenGL, to realize the landscaping treatment to the first image, be obtained Second image.
Landscaping treatment to the first image obtains the second image, and landscaping treatment, which can be, to be carried out whitening to the first image, sprouts The processing such as face, virtualization, using the first image after landscaping treatment as the second image.
In embodiments of the present invention, using first texture information to corresponding first image of first texture information The step of being rendered to realize that image beautifies, obtain the second image, can render whole the first image, can also be right The regional area of first image is rendered.
As an implementation, it when it is only necessary to handle the facial image in the first image, can mention Human face region is identified in the first texture information out, then according to corresponding first texture information of human face region to human face region It is rendered to realize landscaping treatment.Specifically, the first texture information corresponding to human face region renders, face area is obtained Corresponding second texture information in domain replaces with corresponding first texture information of human face region in the first image and first line Corresponding second texture information of the corresponding human face region of information is managed, the second image is obtained.The face of the second image obtained as a result, Region is by having handled that treated, and human face region can have sprouts face, whitening, makeup and other effects.
When needing to carry out landscaping treatment to the non-face region in the first image, can be identified in the first texture information Then non-face region out renders to realize U.S. non-face region according to corresponding first texture information in non-face region Change processing.Wherein, non-face region refers to the region other than the human face region in the first image.Specifically, to non-face area Corresponding first texture information in domain is rendered, and corresponding second texture information in non-face region is obtained, will be in the first image Corresponding first texture information in non-face region replaces with non-face region corresponding second corresponding with first texture information Texture information obtains the second image.The non-face region of the second image obtained as a result, is by having handled, and treated Non-face region can have powerful connections virtualization, light enhancing and other effects.
In embodiments of the present invention, carrying out landscaping treatment to the image in the video for chatting with object can be with It is accomplished in that respective first texture information of the first image of every frame obtained in the first video;By each frame first First texture information of image is stored, wherein the corresponding address ID of each texture information obtains each texture letter The corresponding address ID is ceased, is rendered according to the address ID the first image corresponding to each texture information to realize image beauty Change, obtain the second image, the second image forms the second video.In embodiments of the present invention, can by OpenGL to for The image in video that object is chatted is rendered to realize landscaping treatment.
Step S400: being sent to the application of attending to anything else for second video, so that the application of attending to anything else can use institute It states the second video and opposite end carries out Video chat.
In embodiments of the present invention, there are many embodiments that the second video is sent to application of attending to anything else, for example, by second The second image in video is on a frame-by-frame basis sent in application of attending to anything else, alternatively, the second image in video is divided into several groups, Then it is sent in application of attending to anything else a group by a group.In order to guarantee to keep the continuity of video in Video chat and keep view The synchronism of audio and video in frequency and Video chat, it is preferred that as soon as it is intercepted when camera collects the first image of frame First image carries out landscaping treatment to first image and obtains the second image, then is sent to attend to anything else by the second image again and answer In, attend to anything else using transmission second image to opposite end, carries out Video chat using the second image and opposite end to realize to attend to anything else, this Sample, the first image of camera continuous acquisition is continuous to intercept the first image, handles in real time the first image, by treated First image, i.e. the second image are sent in application of attending to anything else, and are attended to anything else and are chatted using with second image and opposite end progress real-time video It.When multiple second images continuously transmit to attend to anything else in application, multiple images and constituting attend to anything else using for opposite end video Second video of chat.
In this step, after second video to be sent to the application of attending to anything else, it is also necessary to which monitoring operates in sand It applies whether to mediate attending to anything else in case and only carries out Video chat with the photographing module in electronic equipment, stop when listening to attend to anything else to apply When only photographing module being called to carry out Video chat, memory shared by texture information is discharged.It releases to have been sent in this way and attend to anything else Application the second video texture information shared by memory so that it is subsequent attend to anything else using transfer electronic equipment in photographing module into When row Video chat, the texture information for the video image that the available photographing module is passed back, and then according to the texture information pair The video carries out rendering processing.
When detect it is described attend to anything else application program launching Video chat when, set Video chat for the video window First video window, first video window is the window for showing itself video image, the specific can be that above-mentioned Second video;One layer of second video window is covered on the video window, second video window is for showing opposite end The window of video.When needs, one layer of third video window is covered on the video window, for showing itself video figure The window of picture, the specific can be that the first above-mentioned video.First video window and third video window and the second video Window size is different, and can switch mutually.
Herein, whether monitor to operate in apply attending to anything else in sandbox stops calling the photographing module in electronic equipment to carry out Video chat, the specific can be that: by the second Hook Function monitor described in attend to anything else using whether using stop video capture referring to It enables and calls the photographing module;Attend to anything else described in being listened to when second Hook Function and instructs tune using using stopping video capture When with the photographing module, attends to anything else described in expression and call the photographing module to carry out Video chat using stopping.
The sub- hook function of second hook can be used to the process generation of the camera manager for application program of attending to anything else in the present embodiment Code is modified, so that Softcam manager takes over the processing logic of the camera manager for application program of attending to anything else. When second Hook Function listens to described attend to anything else using the photographing module is called using stopping video capture instruction, table Attend to anything else described in showing using the calling photographing module progress Video chat is stopped, such words, Softcam manager can To stop adapter tube to the management to camera, camera is closed.
Specifically, attend to anything else when the first Hook Function listens to using calling photographing module to carry out Video chat, in camera After collecting video image data, is attending to anything else using before carrying out reality to the video image, then immediately intercepting camera acquisition The video image data arrived, described image data refer to first video, the first video are being carried out handling from the background To the second video, the second video is sent to application of attending to anything else, so that application of attending to anything else can use the second video and opposite end is regarded Frequency is chatted.For the video that when attending to anything else using calling photographing module to carry out Video chat next time, can be acquired to camera Image data is handled to obtain the second image, and needing to monitor by the second Hook Function to operate in apply attending to anything else in sandbox is No mediate only with the photographing module in electronic equipment carries out Video chat, when listen to attend to anything else using stopping calling photographing module into When row Video chat, memory shared by the first video is discharged, discharges memory shared by texture information.Each texture information is corresponding One address ID, discharging memory shared by texture information, to discharge the corresponding address ID of each texture information corresponding slow It deposits.
As one embodiment, it monitors to operate in by the first Hook Function and applies whether call electronics attending to anything else in sandbox Photographing module in equipment carries out Video chat, attends to anything else if listening to using calling photographing module to carry out Video chat, then blocks First video attended to anything else using calling photographing module progress Video chat institute preview is cut, is answered specifically, calling and monitoring to attend to anything else Jni method corresponding with photographing module is called, is specially called in class android.harware.camara in SetpreviewTexture method.Then the texture information of the image in the first video is obtained, specially calling setpreview Then surfacetexture object in texture (surfacetexturesurfacetexture) passes through OPenGL root According to the texture information, i.e. surfacetexture object, the first image of each frame in the first video is rendered, obtains Second video is sent to application of attending to anything else by two videos, so that application of attending to anything else can use the second video and opposite end carries out video and chats It.Meanwhile jni method corresponding with calling photographing module is stopped in application of attending to anything else is monitored by the second Hook Function, work as monitoring To when attending to anything else using stopping calling photographing module, the corresponding memory cache of texture information, i.e. surfacetexture object are discharged Corresponding memory cache, specifically, by call android.harware.camara in method native-release come It realizes.
By using above scheme, mould can be imaged to intercepting when routine call photographing module of attending to anything else carries out Video chat The first video that block acquisition, program of attending to anything else have not yet been displayed, after handling the first image of each frame in the first video The second video is obtained, then the second video is sent to application of attending to anything else, attend to anything else the second video applied with after treatment and opposite end Video chat is carried out, the second video can be by obtaining the progress landscaping treatment of the first video, in this way, attending to anything else using can be with The second video and opposite end after landscaping treatment carry out Video chat.
Based on same inventive concept, the present invention also provides a kind of clients 200.Referring to Fig. 2, Fig. 2 shows visitors The frame structure schematic diagram at family end 200.In embodiments of the present invention, client 200 includes the first monitoring module 210, intercepts mould Block 220, processing module 230 and the first communication module 240, wherein
First monitors module 210, applies whether call taking the photograph in electronic equipment attending to anything else in sandbox for monitoring to operate in As module carries out Video chat.In embodiments of the present invention, the first monitoring module 210 can be used for executing above-mentioned steps S100 institute Content is stated, content described in above-mentioned steps S100 is suitable for first and monitors module 210.
In embodiments of the present invention, sandbox (Sandboxie) is called sand table, refers to a virtual system program, allows Browser or other programs are run in sand table environment, generated variation can be deleted then in the process of running.It is created The independently working environment of one similar sandbox, the program that runs inside it can not generate permanent influence to hard disk. Attend to anything else and attending to anything else using the native applications program for being then mounted to electronic equipment, be using technology of attending to anything else to native applications programs into Row is attended to anything else, the application program that can be run in sandbox, and the institute for having native applications program is functional, is capable of providing and original The raw identical service of application program.The present invention discloses in embodiment, native applications program can be QQ, wechat, nail nail, 263 clouds communication etc..
Referring to Fig. 3, Fig. 3 shows the frame structure schematic diagram of the first monitoring module 210.In embodiments of the present invention, First, which monitors module 210, determines subelement including the first monitoring unit 211 and the first prison, and the first monitoring module 210 is executing prison Listen operate in sandbox attending to anything else using whether call photographing module in electronic equipment to carry out Video chat when, specifically can be with Determine that subelement is realized by the first monitoring unit 211 and the first prison, wherein
First monitoring unit 211, for by attending to anything else to apply whether utilize video capture described in the monitoring of the first Hook Function The photographing module is called in instruction.
Herein, term " hook " cover for by intercept transmitted between component software function call, message, Or event changes or increases the technology of the behavior of operating system, application program or other software component.And handle this blocked The code of function call, event or the message cut is thus referred to as hook (hook) function.Hook is commonly used in various targets, including Function debug and be extended to function.Its example may include keyboard or mouse event be transmitted to application program it It is preceding to intercept they or hooking system service call (system call) or system function behavior, function implementing result etc., with prison Depending on or modification application program or the function of other assemblies etc..The first hook hook function can be used in first monitoring unit 211 It modifies to the process code of the camera manager for application program of attending to anything else, so that Softcam manager is taken over point The processing logic of the camera manager of body application program.In this case, Softcam manager can be taken over to taking the photograph As the management of head, so as to take over the video of camera acquisition, and the video window etc. taken over to application program of attending to anything else.
First judging unit, for when first Hook Function listen to it is described attend to anything else instructed using using video capture When calling the photographing module, expression listens to described attend to anything else using the calling photographing module progress Video chat.In order to It reaches and carries out U.S. face to video, sprouts face etc. to handle, the first judging unit also needs to mask the video window of application program of attending to anything else itself Mouthful.Here, the video window includes two, and one is for for showing the window of opposite end video image, and the opposite end can be with It is interpreted as carrying out the peer user of Video chat with user itself, also is understood as instant messaging application journey used in peer user Sequence, one is for for showing the window of itself video image.Or the video window includes three, one is for for showing Show the window of opposite end video image, the opposite end can be understood as the peer user that Video chat is carried out with user itself, can also It is interpreted as instant messaging application program used in peer user, one is for for showing itself video image after treatment Window, one be for for show itself it is untreated after video image window.
When the video window of Softcam manager adapter tube to application program of attending to anything else, i.e., member, which listens to, attends to anything else using tune When carrying out Video chat with photographing module, the video window of the application program that is just defaulted as attending to anything else itself has been shielded.
Blocking module 220, if for listening to described attend to anything else using calling the photographing module to carry out Video chat, then Attend to anything else described in interception using the first video for calling the photographing module to carry out the preview of Video chat institute, wherein first view Frequency includes at least first image of frame.In embodiments of the present invention, blocking module 220 can be used for executing above-mentioned steps S200 institute Content is stated, content described in above-mentioned steps S200 is suitable for blocking module 220.When need attend to anything else application in show the first video, When the video image that the second video and opposite end are sent, the video window includes three windows, and a user shows without beauty Change, sprout the first video of the processing such as face, one is used to show the second video by beautifying, sprouting the processing such as face, and one for showing Show the video image that opposite end is sent.
When needs are shown in the video image for showing the second video and opposite end transmission in application of attending to anything else, the video window Including two windows, one is used to show the second video by beautifying, sprouting the processing such as face, and one for showing what opposite end was sent Video image.
In embodiments of the present invention, client 200 further includes the second communication module 270, and the second communication module 270 is used for will First video is sent to the application of attending to anything else, so that the application of attending to anything else can use first video and opposite end carries out Video chat.
In embodiments of the present invention, attend to anything else described in being intercepted in blocking module 220 and regarded using the calling photographing module After first video of frequency chat institute's preview, first video can also be sent to application of attending to anything else by the second communication module 270, with Make to attend to anything else to apply and can use the first video and opposite end progress Video chat.
Specifically, when first monitoring module 210 using the first Hook Function listen to attend to anything else using call photographing module into Row Video chat, after camera collects video image data, before attending to anything else using to video image progress reality, by Blocking module 220 then immediately intercepts the collected video image data of camera, and described image data refer to described first Then video is being handled the first video to obtain the second video from the background by processing module 230, finally by the first communication mould Second video is sent to application of attending to anything else by block 240, can use the second video and opposite end progress Video chat so that attending to anything else and applying.
Processing module 230 obtains the second view for handling the first image of each frame in first video Frequently.In embodiments of the present invention, processing module 230 can be used for executing content described in above-mentioned steps S300, above-mentioned steps S300 The content is suitable for processing module 230.In general, people are during Video chat, it may be desirable to be shown to other side relatively good Image, then need in the video for chatting with object image carry out landscaping treatment.
Referring to Fig. 4, Fig. 4 shows the frame structure schematic diagram of processing module 230.As an implementation, it handles Module 230 includes obtaining texture cell 231 and beautification unit 132.Processing module 230 is to the view for chatting with object When image in frequency carries out landscaping treatment, it can be realized by obtaining texture cell 231 and beautification unit 132, wherein
Texture cell 231 is obtained, for obtaining the respective first texture letter of the first image of every frame in first video Breath.Herein, texture refers to the multicolour pattern on the texture of the body surface in image or the smooth surface of object, texture Information refers to the location information of these textures, color pixel values etc..Obtain the side of the first texture information of every the first image of frame There are many methods, such as LBP (Local Binary Patterns, local binary patterns) algorithm, edge histogram nomography, Gabor Filter etc..
Beautify unit 132, for utilizing first texture information to corresponding first image of first texture information It being rendered to realize that image beautifies, obtains the second image, second image forms the second video in embodiments of the present invention, Corresponding first texture information of each the first image of frame.
Referring to Fig. 5, Fig. 5 shows the frame structure schematic diagram of beautification unit 132.Beautifying unit 132 includes rendering Unit 1321 and replacement subelement 1322, wherein
It renders subelement 1321 and obtains the second texture information for rendering to first texture information.
To the first texture information carry out color rendering, rendering can be understood as change pixel pixel value and or brightness Value, using the first texture information after rendering as the second texture information.Herein change pixel pixel value and or brightness Value, can be according to the pixel value of the pixel in the pixel field and or brightness value to the pixel value of the pixel and Or brightness value is changed.
Subelement 1322 is replaced, for replacing with and described first first texture information in the first image Corresponding second texture information of texture information, obtains the second image.By the way that the first texture information in the first image is replaced with The second texture information corresponding with the first texture information, then the pixel value of the first image and or brightness value changed.With warp It crosses and the first texture information is replaced with into rear first image of the second texture information corresponding with the first texture information as the second figure Picture.
The texture information can be rendered by OpenGL, to realize the landscaping treatment to the first image, be obtained Second image.
Here, to the landscaping treatment of the first image, the second image is obtained, landscaping treatment, which can be, carries out beauty to the first image The white, processing such as sprout face, virtualization, using the first image after landscaping treatment as the second image.
In embodiments of the present invention, beautification unit 132 is using first texture information to first texture information pair The first image answered is rendered to realize that image beautifies, and is obtained the second image, can be rendered to whole the first image, The regional area of first image can be rendered.
As an implementation, it when it is only necessary to handle the facial image in the first image, can mention Human face region is identified in the first texture information out, then according to corresponding first texture information of human face region to human face region It is rendered to realize landscaping treatment.Specifically, the first texture information corresponding to human face region renders, face area is obtained Corresponding second texture information in domain replaces with corresponding first texture information of human face region in the first image and first line Corresponding second texture information of the corresponding human face region of information is managed, the second image is obtained.The face of the second image obtained as a result, Region is by having handled that treated, and human face region can have sprouts face, whitening, makeup and other effects.
When needing to carry out landscaping treatment to the non-face region in the first image, can be identified in the first texture information Then non-face region out renders to realize U.S. non-face region according to corresponding first texture information in non-face region Change processing.Wherein, non-face region refers to the region other than the human face region in the first image.Specifically, to non-face area Corresponding first texture information in domain is rendered, and corresponding second texture information in non-face region is obtained, will be in the first image Corresponding first texture information in non-face region replaces with non-face region corresponding second corresponding with first texture information Texture information obtains the second image.The non-face region of the second image obtained as a result, is by having handled, and treated Non-face region can have powerful connections virtualization, light enhancing and other effects.
In embodiments of the present invention, processing module 230 can be also used for the first texture information of each the first image of frame It is stored, wherein the corresponding address ID of each texture information obtains the corresponding address ID of each texture information, root It is rendered according to the address ID the first image corresponding to each texture information to realize that image beautifies, obtains the second image, the Two images form the second video.It in embodiments of the present invention, can be by OpenGL to the video for chatting with object In image rendered to realize landscaping treatment.
First communication module 240, for second video to be sent to the application of attending to anything else, so that the application of attending to anything else It can use second video and opposite end carry out Video chat.In embodiments of the present invention, the first communication module 240 can be used In executing content described in above-mentioned steps S400, content described in above-mentioned steps S400 is suitable for the first communication module 240.
In embodiments of the present invention, the first communication module 240 can be used for one frame one of the second image in the second video It is sent to frame in application of attending to anything else, alternatively, the second image in video is divided into several groups, is then sent to a group by a group point In body application.In order to guarantee to keep the continuity of video in Video chat and keep audio in video and Video chat and The synchronism of video, it is preferred that as soon as first image is intercepted when camera collects the first image of frame, to first figure Obtain the second image as carrying out landscaping treatment, then the second image be sent in application of attending to anything else again, attend to anything else using send this Two images carry out Video chat applied to opposite end to opposite end, to realize to attend to anything else, in this way, the first image of camera continuous acquisition, so Continuously intercept the first image afterwards, the first image handled in real time, will treated the first image, i.e. the second image is sent to Attend to anything else in application, attends to anything else and carry out real-time video chat using with second image and opposite end.When multiple second images continuously transmit To attending to anything else in application, multiple image constructions are attended to anything else using for the second video with opposite end Video chat.
After the second video is sent to the application of attending to anything else by the first communication module 240, it is also necessary to which monitoring operates in sand It applies whether to mediate attending to anything else in case and only carries out Video chat with the photographing module in electronic equipment, stop when listening to attend to anything else to apply When only photographing module being called to carry out Video chat, memory shared by texture information is discharged.Therefore, in embodiments of the present invention, objective Family end 200 further includes the second monitoring module 250 and release module 260, wherein
Whether second monitors module 250, mediate only for monitoring to operate in apply attending to anything else in sandbox in electronic equipment Photographing module carry out Video chat.
When detect it is described attend to anything else application program launching Video chat when, set Video chat for the video window First video window, first video window is the window for showing itself video image, the specific can be that above-mentioned Second video;One layer of second video window is covered on the video window, second video window is for showing opposite end The window of video.When needs, one layer of third video window is covered on the video window, for showing itself video figure The window of picture, the specific can be that the first above-mentioned video.First video window and third video window and the second video Window size is different, and can switch mutually.
Referring to Fig. 6, Fig. 6 shows the frame structure schematic diagram of the second monitoring module 250.Second, which monitors module 250, wraps Include the second monitoring unit 251 and the second prison judging unit 252, wherein
Second monitoring unit 251, for by attending to anything else to apply whether utilize stopping video described in the monitoring of the second Hook Function Shooting instruction calls the photographing module.
Second prison judging unit 252, for listening to described attend to anything else using using stopping view when second Hook Function When frequency shooting instruction calls the photographing module, attends to anything else described in expression and call the photographing module progress video to chat using stopping It.
Second monitoring unit 251 is using the second hook hook function to the process of the camera manager for application program of attending to anything else Code is modified, so that Softcam manager is patrolled to take over the processing of the camera manager for application program of attending to anything else Volume.Attend to anything else described in being listened to when second Hook Function and instructs the calling photographing module using using stopping video capture When, one can be sent and assert signals to the second prison judging unit 252, the second prison judging unit 252 determines the signal to indicate It is described to attend to anything else using the stopping calling photographing module progress Video chat, in this case, Softcam manager Stop adapter tube to the management to camera, closes camera.
Release module 260 listens to described attend to anything else using the stopping calling photographing module progress Video chat for working as When, discharge memory shared by the texture information.Each texture information corresponds to an address ID, when completion is to each texture After corresponding first image of information is handled, memory shared by the corresponding address ID of the texture information can be discharged, with Continue after an action of the bowels and the texture information is rendered again or guarantees there are enough memory storage texture informations, so as to texture information Corresponding first image is rendered to realize landscaping treatment.The second video for having been sent to application of attending to anything else is released in this way Memory shared by texture information can when so that the photographing module progress Video chat in electronic equipment is transferred in subsequent application of attending to anything else To obtain the texture information for the video image that the photographing module is passed back, and then the video is carried out at rendering according to the texture information Reason.
Wherein, the first monitoring module 210, blocking module 220, the processing module 230, first that client 200 includes communicate Module 240, second is monitored module 250, release module 260 and the second communication module 270 and can be connected by communication bus.
As one embodiment, the first monitoring module 210 operates in attending to anything else in sandbox by the monitoring of the first Hook Function Using whether photographing module in electronic equipment being called to carry out Video chat, if listen to attend to anything else using call photographing module into Row Video chat, blocking module 220 intercept described attend to anything else using the first view for calling photographing module to carry out the preview of Video chat institute Frequently, it specifically, blocking module 220 calls jni method corresponding with photographing module is called in application of attending to anything else of monitoring, specially calls SetpreviewTexture method in class android.harware.camara.Then processing module 230 obtains the first video In image texture information, specially processing module 230 call setpreview texture (surfacetexturesurfacetexture) the surfacetexture object in, then by OPenGL according to the texture Information, i.e. surfacetexture object render the first image of each frame in the first video, obtain the second video, Second video is sent to application of attending to anything else by last first communication module 240, so as to attend to anything else using can use the second video and right End carries out Video chat.At the same time it can also call 250 module of the second monitoring module, specific second monitors module 250 by the Two Hook Functions monitor jni method corresponding with calling photographing module is stopped in application of attending to anything else, and attend to anything else when listening to using stopping When calling photographing module, release module 260 discharges the corresponding memory cache of texture information, i.e. surfacetexture object is corresponding Memory cache, specifically, by release module 260 call android.harware.camara in method native- Release is realized.
By using above scheme, mould can be imaged to intercepting when routine call photographing module of attending to anything else carries out Video chat The first video that block acquisition, program of attending to anything else have not yet been displayed, after handling the first image of each frame in the first video The second video is obtained, then the second video is sent to application of attending to anything else, attend to anything else the second video applied with after treatment and opposite end Video chat is carried out, the second video can be by obtaining the progress landscaping treatment of the first video, in this way, attending to anything else using can be with The second video and opposite end after landscaping treatment carry out Video chat.
The present invention additionally provides a kind of mobile terminal simultaneously, as shown in fig. 7, for ease of description, illustrating only and this hair The relevant part of bright embodiment, it is disclosed by specific technical details, please refer to present invention method part.The terminal can be with Being includes mobile phone, tablet computer, PDA (Personal Digital Assistant, personal digital assistant), POS Any terminal device such as (PointofSales, point-of-sale terminal), vehicle-mounted computer, taking the terminal as an example:
Fig. 7 shows the block diagram of the part-structure of mobile phone relevant to terminal provided in an embodiment of the present invention.With reference to figure 7, mobile phone includes: radio frequency (Radio Frequency, RF) circuit 31, memory 132, input unit 33, display unit 34, passes Sensor 35, voicefrequency circuit 36, Wireless Fidelity (wireless-fidelity, Wi-Fi) module 37, processor 38 and power supply 39 Equal components.It will be understood by those skilled in the art that handset structure shown in Fig. 7 does not constitute the restriction to mobile phone, can wrap It includes than illustrating more or fewer components, perhaps combines certain components or different component layouts.
It is specifically introduced below with reference to each component parts of the Fig. 7 to mobile phone:
RF circuit 31 can be used for receiving and sending messages or communication process in, signal sends and receivees, particularly, will be under base station After row information receives, handled to processor 38;In addition, the data for designing uplink are sent to base station.In general, RF circuit 31 includes But be not limited to antenna, at least one amplifier, transceiver, coupler, low-noise amplifier (LowNoiseAmplifier, LNA), duplexer etc..In addition, RF circuit 31 can also be communicated with network and other equipment by wireless communication.Above-mentioned channel radio Any communication standard or agreement, including but not limited to global system for mobile communications (Global System of can be used in letter Mobile communication, GSM), general packet radio service (General Packet Radio Service, GPRS), CDMA (Code Division Multiple Access, CDMA), wideband code division multiple access (Wideband Code Division Multiple Access, WCDMA), it is long term evolution (Long Term Evolution, LTE), Email, short Messaging service (Short Messaging Service, SMS) etc..
Memory 32 can be used for storing software program and module, and processor 38 is stored in the soft of memory 32 by operation Part program and module, thereby executing the various function application and data processing of mobile phone.Memory 32 can mainly include storage Program area and storage data area, wherein storing program area can application program needed for storage program area, at least one function (such as sound-playing function, image player function etc.) etc.;Storage data area, which can be stored, uses created number according to mobile phone According to (such as audio data, phone directory etc.) etc..In addition, memory 32 may include high-speed random access memory, can also wrap Include nonvolatile memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Input unit 33 can be used for receiving the number or character information of input, and generate with the user setting of mobile phone and The related key signals input of function control.Specifically, input unit 33 may include touch panel 331 and other input equipments 332.Touch panel 331, also referred to as touch screen, collect user on it or nearby touch operation (such as user use hand The operation of any suitable object or attachment such as finger, stylus on touch panel 331 or near touch panel 331), and according to Preset formula drives corresponding attachment device.Optionally, touch panel 331 may include touch detecting apparatus and touch control Two parts of device processed.Wherein, the touch orientation of touch detecting apparatus detection user, and touch operation bring signal is detected, it will Signal sends touch controller to;Touch controller receives touch information from touch detecting apparatus, and is converted into contact Coordinate, then give processor 38, and order that processor 38 is sent can be received and executed.Furthermore, it is possible to using resistance-type, The multiple types such as condenser type, infrared ray and surface acoustic wave realize touch panel 331.In addition to touch panel 331, input unit 33 It can also include other input equipments 332.Specifically, other input equipments 332 can include but is not limited to physical keyboard, function One of key (such as volume control button, switch key etc.), trace ball, mouse, operating stick etc. are a variety of.
Display unit 34 can be used for showing information input by user or be supplied to user information and mobile phone it is various Menu.Display unit 34 may include display panel 341, optionally, can use liquid crystal display (Liquid Crystal Display, LCD), the forms such as Organic Light Emitting Diode (Organic Light-Emitting Diode, OLED) it is aobvious to configure Show panel 341.Further, touch panel 331 can cover display panel 341, when touch panel 331 detect it is on it or attached After close touch operation, processor 38 is sent to determine the type of touch event, is followed by subsequent processing device 38 according to touch event Type provides corresponding visual output on display panel 341.Although in Fig. 7, touch panel 331 is with display panel 341 The input and input function of mobile phone are realized as two independent components, but in some embodiments it is possible to by touch surface Plate 331 and display panel 341 are integrated and that realizes mobile phone output and input function.
Mobile phone may also include at least one sensor 35, such as optical sensor, motion sensor and other sensors.Tool Body, optical sensor may include ambient light sensor and proximity sensor, wherein ambient light sensor can be according to ambient light Light and shade adjusts the brightness of display panel 341, proximity sensor can when mobile phone is moved in one's ear, close display panel 341 and/ Or backlight.As a kind of motion sensor, accelerometer sensor can detect (generally three axis) acceleration in all directions Size can detect that size and the direction of gravity when static, can be used to identify mobile phone posture application (such as horizontal/vertical screen switching, Dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.;It can also configure as mobile phone The other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, details are not described herein.
Voicefrequency circuit 36, loudspeaker 361, microphone 362 can provide the audio interface between user and mobile phone.Voicefrequency circuit Electric signal after the audio data received conversion can be transferred to loudspeaker 361 by 36, be converted to sound letter by loudspeaker 361 Number output;On the other hand, the voice signal of collection is converted to electric signal by microphone 362, is converted after being received by voicefrequency circuit 360 For audio data, then by after the processing of audio data output processor 38, such as another mobile phone is sent to through RF circuit 31, or Audio data is exported to memory 32 to be further processed.
WiFi belongs to short range wireless transmission technology, and mobile phone can help user's transceiver electronics postal by WiFi module 37 Part, browsing webpage and access streaming video etc., it provides wireless broadband internet access for user.Although Fig. 7 is shown WiFi module 37, but it is understood that, and it is not belonging to must be configured into for mobile phone, it can according to need do not changing completely It is omitted in the range of the essence of invention.
Processor 38 is the control centre of mobile phone, using the various pieces of various interfaces and connection whole mobile phone, is led to It crosses operation or executes the software program and/or module being stored in memory 32, and call the number being stored in memory 32 According to, execute mobile phone various functions and processing data, thus to mobile phone carry out integral monitoring.Optionally, processor 38 may include One or more processing units;Preferably, processor 38 can integrate application processor and modem processor, wherein application The main processing operation system of processor, user interface and application program etc., modem processor mainly handles wireless communication.It can With understanding, above-mentioned modem processor can not also be integrated into processor 38.
Mobile phone further includes the power supply 39 (such as battery) powered to all parts, it is preferred that power supply can pass through power supply pipe Reason system and processor 38 are logically contiguous, to realize management charging, electric discharge and power managed etc. by power-supply management system Function.
Although being not shown, mobile phone can also include camera, bluetooth module etc., and details are not described herein.
In embodiments of the present invention, processor 38 included by the terminal is also with the following functions: monitoring operates in sandbox In attend to anything else using whether photographing module in electronic equipment being called to carry out Video chat;
Video chat is carried out using the calling photographing module if attending to anything else described in listening to, then application of attending to anything else described in interception The photographing module is called to carry out the first video of Video chat institute preview, wherein first video includes an at least frame the One image;The first image of each frame in first video is handled, the second video is obtained;Second video is sent out It send to the application of attending to anything else, so that the application of attending to anything else can use second video and opposite end carries out Video chat.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
Algorithm and display are not inherently related to any particular computer, virtual system, or other device provided herein. It should be understood that can use various programming languages realizes summary of the invention described herein, and above to language-specific institute The description done is in order to disclose the best mode of carrying out the invention.
In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that implementation of the invention Example can be practiced without these specific details.In some instances, well known method, structure is not been shown in detail And technology, so as not to obscure the understanding of this specification.
Similarly, it should be understood that in order to simplify the disclosure and help to understand one or more of the various inventive aspects, Above in the description of exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes In example, figure or descriptions thereof.However, the disclosed method should not be interpreted as reflecting the following intention: i.e. required to protect Shield the present invention claims features more more than feature expressly recited in each claim.More precisely, as following Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore, Thus the claims for following specific embodiment are expressly incorporated in the specific embodiment, wherein each claim itself All as a separate embodiment of the present invention.
Those skilled in the art will understand that can be carried out adaptively to the module in the equipment in embodiment Change and they are arranged in one or more devices different from this embodiment.It can be the module or list in embodiment Member or component are combined into a module or unit or component, and furthermore they can be divided into multiple submodule or subelement or Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it can use any Combination is to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed All process or units of what method or apparatus are combined.Unless expressly stated otherwise, this specification is (including adjoint power Benefit require, abstract and attached drawing) disclosed in each feature can carry out generation with an alternative feature that provides the same, equivalent, or similar purpose It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments in this include institute in other embodiments Including certain features rather than other feature, but the combination of the feature of different embodiment means in the scope of the present invention Within and form different embodiments.For example, in the following claims, embodiment claimed it is any it One can in any combination mode come using.
Various component embodiments of the invention can be implemented in hardware, or to run on one or more processors Software module realize, or be implemented in a combination thereof.It will be understood by those of skill in the art that can be used in practice Microprocessor or digital signal processor (DSP) realize gateway according to an embodiment of the present invention, proxy server, in system Some or all components some or all functions.The present invention is also implemented as executing side as described herein Some or all device or device programs (for example, computer program and computer program product) of method.It is such It realizes that program of the invention can store on a computer-readable medium, or can have the shape of one or more signal Formula.Such signal can be downloaded from an internet website to obtain, and perhaps be provided on the carrier signal or with any other shape Formula provides.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and ability Field technique personnel can be designed alternative embodiment without departing from the scope of the appended claims.In the claims, Any reference symbol between parentheses should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not Element or step listed in the claims.Word "a" or "an" located in front of the element does not exclude the presence of multiple such Element.The present invention can be by means of including the hardware of several different elements and being come by means of properly programmed computer real It is existing.In the unit claims listing several devices, several in these devices can be through the same hardware branch To embody.The use of word first, second, and third does not indicate any sequence.These words can be explained and be run after fame Claim.
The foregoing is only a preferred embodiment of the present invention, is not intended to limit the scope of the present invention, it is all Made any modifications, equivalent replacements, and improvements etc. within the spirit and principles in the present invention, should be included in protection of the invention Within the scope of.
The present invention provides a kind of method for processing video frequency of A1., comprising:
Whether monitor to operate in apply attending to anything else in sandbox calls the photographing module in electronic equipment to carry out Video chat;
Video chat is carried out using the calling photographing module if attending to anything else described in listening to, then application of attending to anything else described in interception The photographing module is called to carry out the first video of Video chat institute preview, wherein first video includes an at least frame the One image;
The first image of each frame in first video is handled, the second video is obtained;
Second video is sent to the application of attending to anything else, so that the application of attending to anything else can use second video Video chat is carried out with opposite end.
A2. method for processing video frequency according to a1, first image of each frame in first video carry out Processing, obtains the second video, comprising:
Obtain respective first texture information of the first image of every frame in first video;
Corresponding first image of first texture information is rendered to realize figure using first texture information As beautification, the second image is obtained, second image forms the second video.
A3. the method for processing video frequency according to A2, using first texture information to first texture information pair The first image answered is rendered to realize that image beautifies, and the second image is obtained, comprising:
First texture information is rendered, the second texture information is obtained;
First texture information in the first image is replaced with and first texture information corresponding second Texture information obtains the second image.
A4. the method for processing video frequency according to A2, after second video to be sent to the application of attending to anything else, institute State method for processing video frequency further include:
It monitors and operates in attending to anything else using whether mediating and only carry out video with the photographing module in electronic equipment and chat in sandbox It;
When listening to described attend to anything else using stopping that the photographing module is called to carry out Video chat, the texture letter is discharged The shared memory of breath.
A5. method for processing video frequency according to a1 is attended to anything else described in the interception using calling the photographing module to be regarded After first video of frequency chat institute's preview, the method for processing video frequency further include:
First video is sent to the application of attending to anything else, so that the application of attending to anything else can use first video Video chat is carried out with opposite end.
A6. method for processing video frequency according to a1, the monitoring, which operates in, applies whether call electricity attending to anything else in sandbox Photographing module in sub- equipment carries out Video chat, comprising:
By attending to anything else to apply whether utilize the video capture instruction calling photographing module described in the monitoring of the first Hook Function;
Attend to anything else described in being listened to when first Hook Function and calls the photographing module using using video capture instruction When, expression listens to described attend to anything else using the calling photographing module progress Video chat.
A7. method for processing video frequency according to a4, the monitoring operate in apply whether stop adjusting attending to anything else in sandbox Video chat is carried out with the photographing module in electronic equipment, comprising:
By attending to anything else to apply whether utilize the camera shooting of stopping video capture instruction calling described in the monitoring of the second Hook Function Module;
Attend to anything else described in being listened to when second Hook Function and instructs the calling camera shooting using using stopping video capture Attend to anything else when module, described in expression and calls the photographing module to carry out Video chat using stopping.
B8. a kind of client, described device include:
First monitors module, for monitoring the camera shooting mould applied and whether called in electronic equipment of attending to anything else operated in sandbox Block carries out Video chat;
Blocking module then blocks if calling the photographing module to carry out Video chat for listening to the application of attending to anything else Cut described attend to anything else using the first video for calling the photographing module to carry out the preview of Video chat institute, wherein first video Including at least first image of frame;
Processing module obtains the second video for handling the first image of each frame in first video;
First communication module, for second video to be sent to the application of attending to anything else so that it is described attend to anything else application can To carry out Video chat using second video and opposite end.
B9. the client according to B8, the processing module, comprising:
Texture cell is obtained, for obtaining respective first texture information of the first image of every frame in first video;
Beautify unit, for carrying out using first texture information to corresponding first image of first texture information Rendering obtains the second image to realize that image beautifies, and second image forms the second video.
B10. the client according to B9, the beautification unit, comprising:
It renders subelement and obtains the second texture information for rendering to first texture information;
Subelement is replaced, for replacing with and first texture first texture information in the first image Corresponding second texture information of information, obtains the second image.
B11. the client according to B9, the client further include:
Whether second monitors module, mediate only with taking the photograph in electronic equipment for monitoring to operate in apply attending to anything else in sandbox As module carries out Video chat;
Release module, for when listening to described attend to anything else using stopping that the photographing module is called to carry out Video chat, Discharge memory shared by the texture information.
B12. the client according to B8, the client further include:
Second communication module, for first video to be sent to the application of attending to anything else so that it is described attend to anything else application can To carry out Video chat using first video and opposite end.
B13. the client according to B8, described first monitors module, comprising:
First monitoring unit, for by attending to anything else to apply whether utilize video capture instruction described in the monitoring of the first Hook Function Call the photographing module;
First judging unit, for when first Hook Function listen to it is described attend to anything else instructed using using video capture When calling the photographing module, expression listens to described attend to anything else using the calling photographing module progress Video chat.
B14. client according to b12, described second monitors module, comprising:
Second monitoring unit, for by attending to anything else to apply whether utilize stopping video capture described in the monitoring of the second Hook Function The photographing module is called in instruction;
Second prison judging unit, for when second Hook Function listen to it is described attend to anything else clapped using using stopping video When taking the photograph the instruction calling photographing module, attends to anything else described in expression and call the photographing module to carry out Video chat using stopping.
C15. a kind of computer readable storage medium, is stored thereon with computer program, when which is executed by processor The step of realizing any one of A1-A7 the method.
D16. a kind of mobile terminal, include memory and one perhaps more than one program one of them or More than one program is stored in memory, and be configured to be executed by one or more than one processor it is one or More than one program includes the instruction for performing the following operation:
Whether monitor to operate in apply attending to anything else in sandbox calls the photographing module in electronic equipment to carry out Video chat;
Video chat is carried out using the calling photographing module if attending to anything else described in listening to, then application of attending to anything else described in interception The photographing module is called to carry out the first video of Video chat institute preview, wherein first video includes an at least frame the One image;
The first image of each frame in first video is handled, the second video is obtained;
Second video is sent to the application of attending to anything else, so that the application of attending to anything else can use second video Video chat is carried out with opposite end.

Claims (10)

1. a kind of method for processing video frequency, which is characterized in that the described method includes:
Whether monitor to operate in apply attending to anything else in sandbox calls the photographing module in electronic equipment to carry out Video chat;
If attending to anything else described in listening to using calling the photographing module to carry out Video chat, then attends to anything else to apply described in interception and call The photographing module carries out the first video of Video chat institute preview, wherein first video includes at least first figure of frame Picture;
The first image of each frame in first video is handled, the second video is obtained;
Second video is sent to the application of attending to anything else, so that the application of attending to anything else can use second video and right End carries out Video chat.
2. method for processing video frequency according to claim 1, which is characterized in that each frame in first video First image is handled, and the second video is obtained, comprising:
Obtain respective first texture information of the first image of every frame in first video;
Corresponding first image of first texture information is rendered using first texture information to realize image beauty Change, obtain the second image, second image forms the second video.
3. method for processing video frequency according to claim 2, which is characterized in that using first texture information to described the Corresponding first image of one texture information is rendered to realize that image beautifies, and the second image is obtained, comprising:
First texture information is rendered, the second texture information is obtained;
First texture information in the first image is replaced with into the second texture corresponding with first texture information Information obtains the second image.
4. method for processing video frequency according to claim 2, which is characterized in that second video is being sent to described point After body application, the method for processing video frequency further include:
It monitors to operate in apply whether to mediate attending to anything else in sandbox and only carries out Video chat with the photographing module in electronic equipment;
When listening to described attend to anything else using stopping that the photographing module is called to carry out Video chat, the texture information institute is discharged The memory accounted for.
5. method for processing video frequency according to claim 1, which is characterized in that attend to anything else described in the interception and taken the photograph using described in calling After the first video for carrying out the preview of Video chat institute as module, the method for processing video frequency further include:
First video is sent to the application of attending to anything else, so that the application of attending to anything else can use first video and right End carries out Video chat.
6. method for processing video frequency according to claim 1, which is characterized in that the monitoring, which operates in, answers attending to anything else in sandbox With whether the photographing module in electronic equipment being called to carry out Video chat, comprising:
By attending to anything else to apply whether utilize the video capture instruction calling photographing module described in the monitoring of the first Hook Function;
When first Hook Function listens to described attend to anything else using the photographing module is called using video capture instruction, table Show and listens to described attend to anything else using the calling photographing module progress Video chat.
7. method for processing video frequency according to claim 4, which is characterized in that the monitoring, which operates in, answers attending to anything else in sandbox With whether stop call electronic equipment in photographing module carry out Video chat, comprising:
By attending to anything else to apply whether utilize the stopping video capture instruction calling photographing module described in the monitoring of the second Hook Function;
Attend to anything else described in being listened to when second Hook Function and instructs the calling photographing module using using stopping video capture When, attend to anything else described in expression using stopping that the photographing module is called to carry out Video chat.
8. a kind of client, which is characterized in that described device includes:
First monitors module, for monitors the attending to anything else application operated in sandbox whether call photographing module in electronic equipment into Row Video chat;
Blocking module then intercepts institute if calling the photographing module to carry out Video chat for listening to the application of attending to anything else State the first video attended to anything else using calling the photographing module to carry out the preview of Video chat institute, wherein first video includes At least first image of frame;
Processing module obtains the second video for handling the first image of each frame in first video;
First communication module, for second video to be sent to the application of attending to anything else, so that the application of attending to anything else can benefit Video chat is carried out with second video and opposite end.
9. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is held by processor The step of any one of claim 1-7 the method is realized when row.
10. a kind of mobile terminal, which is characterized in that include memory and one or more than one program, wherein one A perhaps more than one program is stored in memory and is configured to execute described one by one or more than one processor A or more than one program includes the instruction for performing the following operation:
Whether monitor to operate in apply attending to anything else in sandbox calls the photographing module in electronic equipment to carry out Video chat;
If attending to anything else described in listening to using calling the photographing module to carry out Video chat, then attends to anything else to apply described in interception and call The photographing module carries out the first video of Video chat institute preview, wherein first video includes at least first figure of frame Picture;
The first image of each frame in first video is handled, the second video is obtained;
Second video is sent to the application of attending to anything else, so that the application of attending to anything else can use second video and right End carries out Video chat.
CN201810892977.7A 2018-08-07 2018-08-07 Method for processing video frequency, client and terminal Pending CN108989901A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810892977.7A CN108989901A (en) 2018-08-07 2018-08-07 Method for processing video frequency, client and terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810892977.7A CN108989901A (en) 2018-08-07 2018-08-07 Method for processing video frequency, client and terminal

Publications (1)

Publication Number Publication Date
CN108989901A true CN108989901A (en) 2018-12-11

Family

ID=64555305

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810892977.7A Pending CN108989901A (en) 2018-08-07 2018-08-07 Method for processing video frequency, client and terminal

Country Status (1)

Country Link
CN (1) CN108989901A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110769316A (en) * 2019-10-30 2020-02-07 北京博睿宏远数据科技股份有限公司 Method, device, equipment and storage medium for calculating first frame time
CN111565292A (en) * 2019-02-13 2020-08-21 夏普株式会社 Image processing apparatus, image communication system, and image processing method
CN112732553A (en) * 2020-12-25 2021-04-30 北京百度网讯科技有限公司 Image testing method and device, electronic equipment and storage medium
CN114093350A (en) * 2020-08-05 2022-02-25 腾讯科技(深圳)有限公司 Voice data acquisition method, voice call device and computer equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105979194A (en) * 2016-05-26 2016-09-28 努比亚技术有限公司 Video image processing apparatus and method
CN106897610A (en) * 2017-01-19 2017-06-27 北京奇虎科技有限公司 A kind of method and apparatus for positioning protection
CN107908444A (en) * 2017-10-26 2018-04-13 北京奇虎科技有限公司 The hook method and device of terminal applies

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105979194A (en) * 2016-05-26 2016-09-28 努比亚技术有限公司 Video image processing apparatus and method
CN106897610A (en) * 2017-01-19 2017-06-27 北京奇虎科技有限公司 A kind of method and apparatus for positioning protection
CN107908444A (en) * 2017-10-26 2018-04-13 北京奇虎科技有限公司 The hook method and device of terminal applies

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111565292A (en) * 2019-02-13 2020-08-21 夏普株式会社 Image processing apparatus, image communication system, and image processing method
CN110769316A (en) * 2019-10-30 2020-02-07 北京博睿宏远数据科技股份有限公司 Method, device, equipment and storage medium for calculating first frame time
CN110769316B (en) * 2019-10-30 2022-03-15 北京博睿宏远数据科技股份有限公司 Method, device, equipment and storage medium for calculating first frame time
CN114093350A (en) * 2020-08-05 2022-02-25 腾讯科技(深圳)有限公司 Voice data acquisition method, voice call device and computer equipment
CN112732553A (en) * 2020-12-25 2021-04-30 北京百度网讯科技有限公司 Image testing method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN108989901A (en) Method for processing video frequency, client and terminal
CN103905885B (en) Net cast method and device
CN110149552A (en) A kind of processing method and terminal of video flowing frame data
CN109218731A (en) The throwing screen method, apparatus and system of mobile device
CN110248254A (en) Display control method and Related product
CN107948543A (en) A kind of special video effect processing method and processing device
CN107203147B (en) Internet of Things network control system based on cloud platform and method
CN104780338A (en) Method and electronic equipment for loading expression effect animation in instant video
CN108900778A (en) A kind of image pickup method, mobile terminal and computer readable storage medium
CN107197146A (en) Image processing method and related product
CN108551411A (en) Collecting method, mobile terminal and computer readable storage medium
CN108921941A (en) Image processing method, device, storage medium and electronic equipment
CN110213440A (en) A kind of images share method and terminal
CN108063901A (en) A kind of image-pickup method, terminal and computer readable storage medium
CN108874258A (en) Share the method and device of record screen video
CN109218626A (en) A kind of photographic method and terminal
CN108762829A (en) A kind of method, client and terminal for image beautification
CN109769067A (en) Terminal screen method for handover control, terminal and computer readable storage medium
CN110177177A (en) Message back method, mobile terminal and computer readable storage medium
CN109213407A (en) A kind of screenshot method and terminal device
CN110209332A (en) A kind of information processing method and terminal device
CN109992183A (en) Preview picture and the method for selection, terminal and storage medium
CN109407948A (en) A kind of interface display method and mobile terminal
CN109493821A (en) Screen brightness regulation method, device and storage medium
CN110535211A (en) Charge control method, terminal and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20181211