Specific embodiment
In order to make those skilled in the art more fully understand the technical solution in this specification, below in conjunction with this explanation
Attached drawing in book embodiment is clearly and completely described the technical solution in this specification embodiment, it is clear that described
Embodiment be only this specification a part of the embodiment, instead of all the embodiments.The embodiment of base in this manual, this
This all should belong in field those of ordinary skill every other embodiment obtained without making creative work
The range of specification protection.
This specification embodiment provides a kind of video communication method and device.
The some concepts being related in this specification embodiment are introduced first below.
Face recognition technology: being a kind of biological identification technology for carrying out identification based on facial feature information of people.Tool
Body, the image containing face is acquired by image capture device, and detect face in the picture automatically, and then to detecting
Face carries out a series of the relevant technologies of processing, also referred to as " Identification of Images or face recognition ".
Video is social: referring to that people carry out a kind of communication way of information interchange using network video as carrier.
Video communication program: being the application program linked up using picture pick-up device, network and Realizing Multimedia Technique video, packet
It includes but is not limited to software, small routine, application program of mobile phone, the webpage with interactive function, in operating system support camera function
Module etc..
Next a kind of video communication method provided this specification embodiment is introduced.
It should be noted that the video communication method that this specification embodiment provides is suitable for video equipment, actually answering
In, which may include: the mobile terminals such as mobile phone, tablet computer and personal digital assistant, also may include: notes
The computer equipments such as this computer, desktop computer and tabletop machine, this specification embodiment are not construed as limiting this.
Fig. 1 is the flow chart of the video communication method of one embodiment of this specification, as shown in Figure 1, this method can be with
The following steps are included: step 102, step 104 and step 106, wherein
In a step 102, during multi-party video communication, the video pictures of at least one party are obtained.
In this specification embodiment, multi-party video communication can communicate for two-party video, or tripartite and tripartite
Above video communication.
It, can be every preset duration (such as 0.5 second) to more during multi-party video communication in this specification embodiment
The video pictures of square video communication are acquired, and obtain the video pictures of at least one party.
In this specification embodiment, when for two-party video communication, the video pictures of available local terminal, or can obtain
Take the video pictures of the video pictures of distal end or the video pictures of available local terminal and distal end;When for tripartite and tripartite
When the above video communication, the video pictures of the video pictures of available local terminal or at least one available distal end, or
The video pictures of the video pictures of the available all distal ends of person or the video pictures of available local terminal and all distal ends,
Obtain the video pictures of all video participants.
At step 104, the video object in video pictures is identified.
In this specification embodiment, the video object is face.
In this specification embodiment, face recognition technology can be used, each video got in step 102 is drawn
Face carries out recognition of face, identifies the face in each video pictures.
In one example, multi-party video communication is two-party video communication, if obtained in two-party video communication process
The video pictures of local terminal and the video pictures of distal end, then the video pictures of face and distal end in the video pictures of identification local terminal
In face.
In step 106, according to the image feature data of the image feature data of the video object and preset reference object, sentence
Whether the video object preset reference object except is occurred in disconnected video pictures;If occurring preset reference object in video pictures
Except the video object, then execute default privacy preserving operations.
In this specification embodiment, reference object is video participant, if occurring preset reference object in video pictures
Except the video object, then explanation there is non-video participant to swarm into current video communication picture.
In this specification embodiment, image feature data can be the face characteristic of face, or in face
The iris characteristic data of human eye, or the combination of face characteristic and iris characteristic data, this specification embodiment pair
This is not construed as limiting.
, can be for each video pictures that step 102 is got in this specification embodiment, it will be every in video pictures
The image feature data of a the video object is compared with the image feature data of reference object, if each the video object and base
The similarity of quasi- object is all larger than preset threshold, it is determined that does not occur the video pair except reference object in the video pictures
As;If at least one the video object and the similarity of reference object are not more than preset threshold, it is determined that occur in video pictures
The video object except reference object.
In one example, preset threshold 85%, for each the video object in video pictures, by the video object
Face characteristic be compared with the face characteristic of reference object, if each the video object and base in video pictures
The face similarity of quasi- object is all larger than 85%, it is determined that does not occur the video pair except reference object in the video pictures
As;If at least one the video object and the face similarity of reference object are not more than 85% in video pictures, it is determined that video
Occurs the video object except reference object in picture.
In this specification embodiment, if not occurring the video object except preset reference object in video pictures, that is, do not have
There is non-video participant to swarm into video pictures, then keep multi-party video communication process, and continues to obtain the video of at least one party
Picture.
In this specification embodiment, if occurring the video object except preset reference object in video pictures, that is, have non-
Video participant swarms into video pictures, then executes default privacy preserving operations.
In this specification embodiment, default privacy preserving operations can be set by user, can also be by video equipment
Random setting, wherein default privacy preserving operations may include: to be shielded by way of figure layer covering to video pictures, tool
Body, the figure layer that multiple color pattern (such as white, black, grey, mosaic etc.) can be used hides video pictures
Lid, to avoid the privacy leakage of video participant, alternatively, after the video communication program for being used for multi-party video communication is switched to
Platform, alternatively, closing the video communication program for being used for multi-party video communication.
In this specification embodiment, the image feature data of reference object be can store in video equipment local terminal, multi-party
During video communication, the ratio of face in reference object and video communication picture can be carried out in video equipment local terminal in real time
Right, if occurring non-video participant in video communication picture, break of video is linked up, and does not depend on network condition and video is soft
Part server-side.In addition, also not needing to carry out video equipment additional HardwareUpgring transformation, the camera shooting of equipment itself is directly used
It acquires function and face recognition technology, secure memory techniques, data encryption comparison techniques realizes secret protection, have extensive
The feasibility of application.
In one example, it as shown in Fig. 2, the application scenarios in Fig. 2 are two-party video communication, is wrapped in the application scenarios
Include: video equipment 210,230 side of the video participant 220 of 210 side of video equipment, video equipment 230 and video equipment video
Participant 240, wherein show video pictures 211 and video pictures 212 on video equipment 210, view is shown in video pictures 211
The image of frequency participant 240 shows the image of video participant 220 in video pictures 212, shows video on video equipment 230
Picture 231 and video pictures 232 show the image of video participant 220 in video pictures 231, show in video pictures 232
The image of video participant 240.By taking video equipment 210 as an example, when non-video participant 250 swarms into video pictures, if view
Frequency equipment 210, which can detect, has non-video participant to swarm into video pictures 211, then interrupts logical with the video of video equipment 230
News.
As seen from the above-described embodiment, in the embodiment, during carrying out multi-party video communication, benchmark pair can be based on
As (i.e. video participant) automatically determine whether have in the video pictures of multi-party video communication people except video participant into
Enter video pictures, if there is the people except video participant enters the video pictures of multi-party video communication, then executes default privacy
Protection operation, to be effectively protected the privacy of video participant, safety is higher.
Fig. 3 is the flow chart of the video communication method of another embodiment of this specification, can in this specification embodiment
To be authenticated in advance to video participant, as reference object, at this point, as shown in figure 3, this method may include following
Step: step 302, step 304, step 306, step 308, step 310, step 312 and step 314, wherein
In step 302, benchmark image is obtained.
It include the face of video participant in this specification embodiment, in benchmark image.
In this specification embodiment, certification shooting can be carried out to video participant, obtained before multi-party video communication
Benchmark image obtains benchmark image by way of taking pictures.
In this specification embodiment, it can be drawn during multi-party video communication from the video of current multi-party video communication
Benchmark image is obtained in face.
In this specification embodiment, multi-party video communication can communicate for two-party video, or tripartite and tripartite
Above video communication.In this case, benchmark image can be the video pictures of local terminal, or the video of distal end is drawn
Face.
In this specification embodiment, it can be set by the user and obtain benchmark from the video pictures of current multi-party video communication
The opportunity of image, for example, when the user clicks specific button when, trigger video pictures of the video equipment from current multi-party video communication
Middle acquisition benchmark image.
In step 304, the face in benchmark image is identified.
In this specification embodiment, face recognition technology can be used, identify all faces in benchmark image.
Within step 306, the face in benchmark image is determined as reference object, and by the figure of face in benchmark image
As characteristic, it is determined as the image feature data of reference object.
In this specification embodiment, reference object is video participant.
In this specification embodiment, all faces in benchmark image can be determined as reference object, alternatively, considering
To when carrying out certification shooting to video participant, it is possible to be mixed into non-video participant, therefore can be by user from benchmark image
In face select reference object.
In this specification embodiment, if selecting reference object, above-mentioned steps from the face in benchmark image by user
306 can specifically include following steps:
The object selection operation of user's triggering is received, the object selection operation from the face in benchmark image for selecting
Reference object;
The face that user is chosen is determined as reference object, and the image feature data for the face that user is chosen, really
It is set to the image feature data of reference object.
In this specification embodiment, object selection operation may include: clicking operation, slide and pressing operation.Tool
Body, when object selection operation is clicking operation, the face that user clicks can be determined as reference object;Work as Object Selection
When operation is slide, the face that the sliding trace of user is covered can be determined as reference object;When Object Selection is grasped
When as pressing operation, the face that user presses can be determined as reference object.
In this specification embodiment, the image feature data of reference object can on the basis of face face characteristic,
It may be the iris characteristic data of human eye in benchmark face, or the group of face characteristic and iris characteristic data
It closes, this specification embodiment is not construed as limiting this.
As it can be seen that user can be supported voluntarily to select reference object in this specification embodiment, since user selects usually tool
There is certain error correction effect, therefore can guarantee the selection accuracy of reference object.
In step 308, the image feature data of reference object is saved.
In this specification embodiment, in order to guarantee the safety of data, can image feature data to reference object into
Row encryption;Image feature data after saving encryption.
For example, can be using secure hash algorithm (Secure Hash Algorithm, SHA) to the image of reference object
Characteristic is encrypted, and encrypted image feature data is stored in video equipment.
In the step 310, during multi-party video communication, the video pictures of at least one party are obtained.
In this specification embodiment, after the image feature data for obtaining reference object, after monitoring multi-party video communication
Non-video participant whether is swarmed into continuous video pictures.
It, can be every preset duration (such as 0.5 second) to more during multi-party video communication in this specification embodiment
The video pictures of square video communication are acquired, and obtain the video pictures of at least one party.
In this specification embodiment, when for two-party video communication, the video pictures of available local terminal, or can obtain
Take the video pictures of the video pictures of distal end or the video pictures of available local terminal and distal end;When for tripartite and tripartite
When the above video communication, the video pictures of the video pictures of available local terminal or at least one available distal end, or
The video pictures of the video pictures of the available all distal ends of person or the video pictures of available local terminal and all distal ends,
Obtain the video pictures of all video participants.
In step 312, the video object in video pictures is identified.
In this specification embodiment, the video object is face.
In this specification embodiment, face recognition technology can be used, each video got in step 310 is drawn
Face carries out recognition of face, identifies the face in each video pictures.
In one example, multi-party video communication is tripartite's video communication, if obtained in two-party video communication process
The video pictures of the video pictures of local terminal and two distal ends, then face and two distal ends in the video pictures of identification local terminal
Face in video pictures.
In a step 314, according to the image feature data of the image feature data of the video object and preset reference object, sentence
Whether the video object preset reference object except is occurred in disconnected video pictures;If occurring preset reference object in video pictures
Except the video object, then execute default privacy preserving operations.
In this specification embodiment, reference object is video participant, if occurring preset reference object in video pictures
Except the video object, then explanation there is non-video participant to swarm into current video communication picture.
In this specification embodiment, image feature data can be the face characteristic of face, or in face
The iris characteristic data of human eye, or the combination of face characteristic and iris characteristic data, this specification embodiment pair
This is not construed as limiting.
, can be for each video pictures that step 310 is got in this specification embodiment, it will be every in video pictures
The image feature data of a the video object is compared with the image feature data of reference object, if each the video object and base
The similarity of quasi- object is all larger than preset threshold, it is determined that does not occur the video pair except reference object in the video pictures
As;If at least one the video object and the similarity of reference object are not more than preset threshold, it is determined that occur in video pictures
The video object except reference object.
In one example, preset threshold 95%, for each the video object in video pictures, by the video object
Iris characteristic data be compared with the iris characteristic data of reference object, if each the video object and base in video pictures
The iris similarity of quasi- object is all larger than 95%, it is determined that does not occur the video pair except reference object in the video pictures
As;If at least one the video object and the iris similarity of reference object are not more than 95% in video pictures, it is determined that video
Occurs the video object except reference object in picture.
In this specification embodiment, if not occurring the video object except preset reference object in video pictures, that is, do not have
There is non-video participant to swarm into video pictures, then keep multi-party video communication process, and continues to obtain the video of at least one party
Picture.
In this specification embodiment, if occurring the video object except preset reference object in video pictures, that is, have non-
Video participant swarms into video pictures, then executes default privacy preserving operations.
In this specification embodiment, default privacy preserving operations can be set by user, can also be by video equipment
Random setting, wherein default privacy preserving operations may include: to be shielded by way of figure layer covering to video pictures, tool
Body, the figure layer that multiple color pattern (such as white, black, grey, mosaic etc.) can be used hides video pictures
Lid, to avoid the privacy leakage of video participant, alternatively, after the video communication program for being used for multi-party video communication is switched to
Platform, alternatively, closing the video communication program for being used for multi-party video communication.
In this specification embodiment, the image feature data of reference object be can store in video equipment local terminal, multi-party
During video communication, the ratio of face in reference object and video communication picture can be carried out in video equipment local terminal in real time
Right, if occurring non-video participant in video communication picture, break of video is linked up, and does not depend on network condition and video is soft
Part server-side.In addition, also not needing to carry out video equipment additional HardwareUpgring transformation, the camera shooting of equipment itself is directly used
It acquires function and face recognition technology, secure memory techniques, data encryption comparison techniques realizes secret protection, have extensive
The feasibility of application.
As seen from the above-described embodiment, in the embodiment, video participant can be authenticated in advance, and is known using image
Other technology identifies the face of the video participant in benchmark image, as reference object, is carrying out in many ways so as to subsequent
During video communication, the video that multi-party video communication can be automatically determined based on reference object (i.e. video participant) is drawn
Whether there is the people except video participant to enter video pictures in face, if there is the people except video participant enters multi-party video
The video pictures of communication then execute default privacy preserving operations, to be effectively protected the privacy of video participant, safety compared with
It is high.
Fig. 4 is the structural schematic diagram of the video communication device of one embodiment of this specification, as shown in figure 4, in one kind
In Software Implementation, video communication device 400 may include: the first acquisition module 401, the first identification module 402, judgement
Module 403 and processing module 404, wherein
First obtains module 401, for obtaining the video pictures of at least one party during multi-party video communication;
First identification module 402, for identification the video object in the video pictures;
Judgment module 403, for special according to the image feature data of the video object and the image of preset reference object
Data are levied, judge the video object for whether occurring except preset reference object in the video pictures;
Processing module 404, for occurring the case where the video object except preset reference object in the video pictures
Under, execute default privacy preserving operations.
As seen from the above-described embodiment, in the embodiment, during carrying out multi-party video communication, benchmark pair can be based on
As (i.e. video participant) automatically determine whether have in the video pictures of multi-party video communication people except video participant into
Enter video pictures, if there is the people except video participant enters the video pictures of multi-party video communication, then executes default privacy
Protection operation, to be effectively protected the privacy of video participant, safety is higher.
Optionally, as one embodiment, the processing module 404 may include following any submodules:
Submodule is covered, for shielding by way of figure layer covering to video pictures;
Program switching submodule, for the video communication program for being used for multi-party video communication to be switched to backstage;
Stop submodule closes the video communication program.
Optionally, as one embodiment, the video communication device 400 can also include:
Second obtains module, for obtaining benchmark image;
Second identification module, for identification face in the benchmark image;
Determining module, for the face in the benchmark image to be determined as the reference object, and by the benchmark
The image feature data of face in image, is determined as the image feature data of the reference object;
Preserving module, for saving the image feature data of the reference object.
Optionally, module is obtained as one embodiment, described second, may include:
Benchmark image acquisition submodule is used for during multi-party video communication, from the video of current multi-party video communication
Benchmark image is obtained in picture.
Optionally, as one embodiment, the determining module may include:
Operate receiving submodule, for receive user triggering object selection operation, the object selection operation be used for from
The reference object is selected in face in the benchmark image;
Determine submodule, the face for choosing the user is determined as the reference object, and by the user
The image feature data for the face chosen is determined as the image feature data of the reference object.
Optionally, as one embodiment, the preserving module may include:
Characteristic encrypts submodule, is encrypted for the image feature data to the reference object;
Characteristic saves submodule, for saving the image feature data after encryption.
Fig. 5 is the structural schematic diagram of the electronic equipment of one embodiment of this specification, as shown in figure 5, in hardware view,
The electronic equipment includes processor, optionally further comprising internal bus, network interface, memory.Wherein, memory may include
Memory, such as high-speed random access memory (Random-Access Memory, RAM), it is also possible to further include non-volatile deposit
Reservoir (non-volatile memory), for example, at least 1 magnetic disk storage etc..Certainly, which is also possible that it
Hardware required for his business.
Processor, network interface and memory can be connected with each other by internal bus, which can be ISA
(Industry Standard Architecture, industry standard architecture) bus, PCI (Peripheral
Component Interconnect, Peripheral Component Interconnect standard) bus or EISA (Extended Industry Standard
Architecture, expanding the industrial standard structure) bus etc..The bus can be divided into address bus, data/address bus, control always
Line etc..Only to be indicated with a four-headed arrow in Fig. 5, it is not intended that an only bus or a type of convenient for indicating
Bus.
Memory, for storing program.Specifically, program may include program code, and said program code includes calculating
Machine operational order.Memory may include memory and nonvolatile memory, and provide instruction and data to processor.
Processor is from the then operation into memory of corresponding computer program is read in nonvolatile memory, in logical layer
Video communication device is formed on face.Processor executes the program that memory is stored, and is specifically used for executing following operation:
During multi-party video communication, the video pictures of at least one party are obtained;
Identify the video object in the video pictures;
According to the image feature data of the image feature data of the video object and preset reference object, the view is judged
Whether the video object preset reference object except is occurred in frequency picture;
If occurring the video object except preset reference object in the video pictures, default secret protection behaviour is executed
Make.
It, can be based on reference object (i.e. video ginseng during carrying out multi-party video communication in this specification embodiment
With person) it automatically determines in the video pictures of multi-party video communication and whether there is the people except video participant to enter video pictures,
If there is the people except video participant enters the video pictures of multi-party video communication, then default privacy preserving operations are executed, from
And it is effectively protected the privacy of video participant, safety is higher.
Optionally, as one embodiment, the default privacy preserving operations, including following any one:
Video pictures are shielded by way of figure layer covering;
The video communication program for being used for multi-party video communication is switched into backstage;
Close the video communication program.
Optionally, as one embodiment, the video pictures for obtaining at least one party the step of before, further includes:
Obtain benchmark image;
Identify the face in the benchmark image;
Face in the benchmark image is determined as the reference object, and by the figure of face in the benchmark image
As characteristic, it is determined as the image feature data of the reference object;
Save the image feature data of the reference object.
Optionally, as one embodiment, the acquisition benchmark image, comprising:
During multi-party video communication, benchmark image is obtained from the video pictures of current multi-party video communication.
Optionally, as one embodiment, the face by the benchmark image is determined as the reference object, with
And by the image feature data of face in the benchmark image, it is determined as the image feature data of the reference object, comprising:
The object selection operation of user's triggering is received, the object selection operation is for the face from the benchmark image
The middle selection reference object;
The face that the user chooses is determined as the reference object, and the image for the face that the user is chosen
Characteristic is determined as the image feature data of the reference object.
Optionally, as one embodiment, the image feature data for saving the reference object, comprising:
The image feature data of the reference object is encrypted;
Image feature data after saving encryption.
The method that video communication device disclosed in the above-mentioned embodiment illustrated in fig. 5 such as this specification executes can be applied to handle
In device, or realized by processor.Processor may be a kind of IC chip, the processing capacity with signal.It is realizing
In the process, each step of the above method can pass through the integrated logic circuit of the hardware in processor or the instruction of software form
It completes.Above-mentioned processor can be general processor, including central processing unit (Central Processing Unit,
CPU), network processing unit (Network Processor, NP) etc.;It can also be digital signal processor (Digital Signal
Processor, DSP), it is specific integrated circuit (Application Specific Integrated Circuit, ASIC), existing
Field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device are divided
Vertical door or transistor logic, discrete hardware components.It may be implemented or execute and is in this specification embodiment disclosed
Each method, step and logic diagram.General processor can be microprocessor or the processor be also possible to it is any conventional
Processor etc..The step of method in conjunction with disclosed in this specification embodiment, can be embodied directly in hardware decoding processor execution
Complete, or in decoding processor hardware and software module combine execute completion.Software module can be located at random storage
Device, flash memory, read-only memory, this fields such as programmable read only memory or electrically erasable programmable memory, register at
In ripe storage medium.The storage medium is located at memory, and processor reads the information in memory, completes in conjunction with its hardware
The step of stating method.
The method that the electronic equipment can also carry out Fig. 1, and realize the function of video communication device embodiment shown in Fig. 1,
Details are not described herein for this specification embodiment.
This specification embodiment additionally provides a kind of computer readable storage medium, the computer-readable recording medium storage
One or more programs, the one or more program include instruction, and the instruction is when by the portable electric including multiple application programs
When sub- equipment executes, the method that the portable electronic device can be made to execute embodiment illustrated in fig. 1, and be specifically used for executing following
Method:
During multi-party video communication, the video pictures of at least one party are obtained;
Identify the video object in the video pictures;
According to the image feature data of the image feature data of the video object and preset reference object, the view is judged
Whether the video object preset reference object except is occurred in frequency picture;
If occurring the video object except preset reference object in the video pictures, default secret protection behaviour is executed
Make.
In short, being not intended to limit the protection of this specification the foregoing is merely the preferred embodiment of this specification
Range.For all spirit in this specification within principle, any modification, equivalent replacement, improvement and so on should be included in this
Within the protection scope of specification.
System, device, module or the unit that above-described embodiment illustrates can specifically realize by computer chip or entity,
Or it is realized by the product with certain function.It is a kind of typically to realize that equipment is computer.Specifically, computer for example may be used
Think personal computer, laptop computer, cellular phone, camera phone, smart phone, personal digital assistant, media play
It is any in device, navigation equipment, electronic mail equipment, game console, tablet computer, wearable device or these equipment
The combination of equipment.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer readable instructions, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory (SRAM), moves
State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable
Programmable read only memory (EEPROM), flash memory or other memory techniques, read-only disc read only memory (CD-ROM) (CD-ROM),
Digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or other magnetic storage devices
Or any other non-transmission medium, can be used for storage can be accessed by a computing device information.As defined in this article, it calculates
Machine readable medium does not include temporary computer readable media (transitory media), such as the data-signal and carrier wave of modulation.
It should also be noted that, the terms "include", "comprise" or its any other variant are intended to nonexcludability
It include so that the process, method, commodity or the equipment that include a series of elements not only include those elements, but also to wrap
Include other elements that are not explicitly listed, or further include for this process, method, commodity or equipment intrinsic want
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including described want
There is also other identical elements in the process, method of element, commodity or equipment.
All the embodiments in this specification are described in a progressive manner, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for system reality
For applying example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method
Part explanation.