WO2016206468A1

WO2016206468A1 - Method and device for processing video communication image

Info

Publication number: WO2016206468A1
Application number: PCT/CN2016/080271
Authority: WO
Inventors: 陈军; 黄强
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-06-24
Filing date: 2016-04-26
Publication date: 2016-12-29
Also published as: CN106331890A

Abstract

A method and device for processing a video communication image. The method comprises: acquiring a remote command token, the remote command token being configured to control a peer device in a video communication; selecting person feature information of a video image in the video communication as focus information; and transmitting the focus information to the peer device, the focus information being configured for the device to search for a facial image corresponding to the person feature information in the video image of the video communication. The present invention addresses the problem of an inconvenient operation when remotely controlling a camera at a peer via a remote control, and improves convenience when remotely controlling the camera at the peer.

Description

Video communication image processing method and device

Technical field

This document relates to, but is not limited to, the field of communications, and in particular, to a method and apparatus for processing video communication images.

Background technique

In video communication, it is common practice to use the remote control up and down buttons to access the content of the camera. When the technology is updated to the touch screen operation, this practice results in a single unfriendly, unsatisfactory operation, delay in image movement, and problems such as misalignment.

In view of the related art, there is currently no effective solution to the problem that the remote camera is not operated quickly by the remote controller.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

The embodiment of the invention provides a method and a device for processing a video communication image, which can avoid the problem that the remote camera is not operated quickly by the remote controller.

According to an aspect of the embodiments of the present invention, a method for processing a video communication image is provided, including:

Obtaining a remote token, the remote token is used to control a device in the opposite end of the video communication;

Selecting the character feature information of the video image in the video communication as the focus information;

Sending the focus information to the device at the opposite end, where the focus information is used by the device to search for a face image corresponding to the character feature information in the video image of the video communication.

Optionally, the obtaining the remote token includes:

In the peer-to-peer communication, sending a remote control application instruction to obtain the remote token; or

In the multipoint communication, after applying to the master control location, the remote control application command is sent to obtain the remote token.

Optionally, selecting the character feature information of the video image in the video communication as the focus information includes:

The character feature information of the video image in the video communication is selected as the focus information by receiving the touch gesture of the touch screen, wherein the touch gesture includes one of the following: a touch gesture of double tap, a touch gesture of a circle.

According to another aspect of the embodiments of the present invention, a method for processing a video communication image is further provided, including:

Receiving focus information sent by the terminal of the opposite end, where the focus information includes character feature information;

Searching for a face image corresponding to the character feature information in the video image, the video image being a video image in video communication with the device at the opposite end.

Optionally, after the searching for the face image corresponding to the character feature information in the video image, the method further includes:

After the face image corresponding to the character feature information is aligned, the face image is scaled to a preset threshold, where the preset threshold is a ratio of the face image to the device screen.

Adjusting the focus of the camera changes the sharpness of the face image.

According to another aspect of the embodiments of the present invention, a device for processing a video communication image, including:

Obtaining a module, configured to obtain a remote remote token, wherein the remote remote token is used to control a device in a peer end of the video communication;

Selecting a module, configured to select character feature information of the video image in the video communication as focus information;

The sending module is configured to send the focus information to the device of the peer end, where the focus information is used by the device to search for a face image corresponding to the character feature information in the video image of the video communication.

Optionally, the obtaining module includes:

The first obtaining unit is configured to send a remote control application instruction to obtain the remote remote token in the point-to-point communication;

The second obtaining unit is configured to send, after applying to the master control location, the remote control application instruction to acquire the remote remote token.

Optionally, the selecting module includes:

The touch selection unit is configured to select, according to the touch gesture of the touch screen, the character feature information of the video image in the video communication as the focus information, wherein the touch gesture includes one of the following: a double-touch gesture, a circled touch gesture .

a receiving module, configured to receive focus information sent by the terminal of the opposite end, where the focus information includes character feature information;

The search module is configured to search for a face image corresponding to the character feature information in the video image, where the video image is a video image in video communication with the device at the opposite end.

Optionally, the device further includes:

And after the zooming module is configured to align the face image corresponding to the character feature information, the face image is scaled to a preset threshold, where the preset threshold is a ratio of the face image to the device screen.

Optionally, the device further includes:

The focal length module is configured to adjust the focal length of the camera to change the sharpness of the face image.

According to the embodiment of the present invention, the remote remote token is obtained, and the remote remote token is used to control the device in the video communication, and the character feature information of the video image in the video communication is selected as the focus information, and the device is sent to the peer device. Sending the focus information, the focus information being used by the device to search for the The face image corresponding to the character feature information in the video image of the video communication solves the problem that the remote camera is not operated quickly by the remote controller, and the convenience of the camera of the other party is improved.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

1 is a flow chart 1 of a method for processing a video communication image according to an embodiment of the present invention;

2 is a second flowchart of a method for processing a video communication image according to an embodiment of the present invention;

3 is a block diagram 1 of a processing apparatus for a video communication image according to an embodiment of the present invention;

4 is a block diagram 2 of a processing apparatus for a video communication image according to an embodiment of the present invention;

5 is a flow diagram of an image of a far-away far end camera in accordance with an alternate embodiment of the present invention.

Embodiments of the invention

The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

It is to be understood that the terms "first", "second" and the like in the specification and claims of the present invention are used to distinguish similar objects, and are not necessarily used to describe a particular order or order.

In the embodiment, a method for processing a video communication image is provided. FIG. 1 is a flowchart 1 of a method for processing a video communication image according to an embodiment of the present invention. As shown in FIG. 1, the process includes the following steps:

Step S102, acquiring a remote remote token, where the remote remote token is used to control a device in the opposite end of the video communication;

Step S104, selecting character feature information of the video image in the video communication as the focus information;

In step S106, the focus information is sent to the peer device, and the focus information is used by the peer device to search for a face image corresponding to the character feature information in the video image of the video communication.

Through the above steps, the remote token is obtained, and the remote token is used to control the peer end of the video communication. The device selects the character feature information of the video image in the video communication as the focus information, and sends the focus information to the device at the opposite end, where the focus information is used by the device to search for a face corresponding to the character feature information in the video image of the video communication. The image avoids the problem that the operation of the remote camera is far from the remote camera and the operation is not fast, and the convenience of the camera of the other party is improved.

Optionally, in this embodiment, in the point-to-point communication, sending a remote control application instruction to obtain the remote remote token; or

In this embodiment, the character feature information of the video image may be selected as the focus information in a plurality of manners, wherein the character feature information of the video image in the video communication may be selected as the focus information by receiving the touch gesture of the touch screen, where Touch gestures include one of the following: a double-touch gesture, a circled touch gesture.

In this embodiment, a method for processing a video communication image is also provided. FIG. 2 is a second flowchart of a method for processing a video communication image according to an embodiment of the present invention. As shown in FIG. 2, the process includes the following steps. :

Step S202, receiving focus information sent by the terminal of the opposite end, where the focus information includes character feature information;

Step S204, searching for a face image corresponding to the character feature information in the video image, where the video image is a video image in video communication with the device at the opposite end.

Through the above steps, receiving focus information sent by the terminal of the opposite end, the focus information includes character feature information, and searching for a face image corresponding to the character feature information in the video image, where the video image is a video image in video communication with the device at the opposite end The problem that the remote camera is not operated quickly by the remote controller is solved, and the convenience of the camera of the other party is improved.

In this embodiment, after the face image corresponding to the character feature information is aligned, the face image is scaled to a preset threshold, and the preset threshold is a ratio of the face image to the device screen, and the ratio may be 3 /4, that is, the face image accounts for 3/4 of the screen.

In this embodiment, the focal length of the camera can also be adjusted to change the sharpness of the face image.

The embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the above method.

In the embodiment, a video communication image processing device is further provided, which is used to implement the above-mentioned embodiments and optional embodiments, and has not been described again. As used below, the term "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.

FIG. 3 is a block diagram showing a structure of a video communication image processing apparatus according to an embodiment of the present invention. As shown in FIG. 3, the apparatus includes:

The obtaining module 32 is configured to obtain a remote remote token, where the remote remote token is used to control a device in the opposite end of the video communication;

The selecting module 34 is configured to select the character feature information of the video image in the video communication as the focus information;

The sending module 36 is configured to send the focus information to the device of the peer end, where the focus information is used by the device to search for a face image corresponding to the character feature information in the video image of the video communication.

Obtaining a remote remote token by using the foregoing device, the remote remote token is used to control a device in the video communication, and the character feature information of the video image in the video communication is selected as the focus information, and the focus information is sent to the device at the opposite end. The focus information is used by the device to search for a face image corresponding to the character feature information in the video image of the video communication, which solves the problem that the remote camera is not operated quickly by the remote controller, and improves the convenience of the remote camera.

In this embodiment, the obtaining module 32 includes:

The second obtaining unit is configured to send a remote control application instruction to obtain the remote remote token after applying to the master control location in the multipoint communication.

In this embodiment, the selection module 34 includes:

The touch selection unit is configured to select the character feature information of the video image in the video communication as the focus information by receiving the touch gesture of the touch screen, wherein the touch gesture includes one of the following: a touch gesture of double tapping, a touch gesture of circled.

FIG. 4 is a second structural block diagram of a video communication image processing apparatus according to an embodiment of the present invention. As shown in FIG. 4, the apparatus includes:

The receiving module 42 is configured to receive focus information sent by the terminal of the opposite end, where the focus information includes character feature information;

The searching module 44 is configured to search for a face image corresponding to the character feature information in the video image, where the video image is a video image in video communication with the device at the opposite end.

Receiving the focus information sent by the terminal of the opposite end, the focus information includes the character feature information, and searching for a face image corresponding to the character feature information in the video image, where the video image is a video image in video communication with the device at the opposite end The problem that the remote camera is not operated quickly by the remote controller is solved, and the convenience of the camera of the other party is improved.

In this embodiment, the device further includes:

The invention will now be described in detail in conjunction with alternative embodiments and embodiments.

This alternative embodiment provides a simple and easy way to select the focus of the far end image through the touch screen and to align the image to the focus and zoom to a reasonable size.

5 is a flow chart of an image of a far-away remote camera according to an alternative embodiment of the present invention. As shown in FIG. 5, the flow includes:

Step S502, in the video communication, the user obtains the remote token;

Step S504, the user selects a person of interest through the touch screen as a focus;

Step S506, the terminal sends the focus coordinate information to the remote end;

Step S508, after the remote end obtains the focus information, the nearest face near the focus is searched;

Step S510, the remote end moves the camera to the face and zooms to a suitable size, for example, the face occupies 3/4 of the screen;

In step S512, if the focal length of the camera is not aligned with the face, the focal length is adjusted until the face is aligned, that is, the face is the clearest.

In another alternative embodiment, the remote camera processing steps are as follows:

The first step: in the video communication, the user gets the far-away token. In the peer-to-peer communication, directly press the remote control button to get the token. In the multi-point communication, after applying to the chairman, press the button. The remote control button gets the control token.

Step 2: The user selects the person of interest through the touch screen as the focus, and the method can be a double click to select a character, or a circled face.

The third step: the terminal sends the focus coordinate information to the remote end through the network;

Step 4: After getting the focus information at the far end, use face recognition technology to find the nearest face near the focus. Searching for faces can be done using the skin color model algorithm:

1. Input the data of the acquired YUV pixel format;

2. Bind the image through the skin color model, that is, set the non-skinning part to 0, and set the skin color part to 1, wherein the skin color value range can be obtained by statistical learning in the actual device;

3. Call the corrosion expansion algorithm to filter

4. Using the Unicom area detection, the face position is determined by the width of the Unicom area conforming to the size of the face and the size of the face.

5. Calculate the absolute value of the distance between all face positions and the focus coordinates, and take the minimum value corresponding to the face coordinates.

Step 5: The far end moves the camera to the face and zooms to a suitable size, such as a face that occupies 3/4 of the screen.

Step 6: If the focal length of the camera is not aligned with the face, adjust the focus until the face is aligned, that is, the face is the clearest.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, The optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present invention.

Embodiments of the present invention also provide a storage medium. Optionally, in this embodiment, the foregoing storage medium may be configured to store program code for performing the method steps of the above embodiment:

Optionally, in this embodiment, the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory. A variety of media that can store program code, such as a disc or a disc.

Optionally, in this embodiment, the processor performs the method steps of the foregoing embodiments according to the stored program code in the storage medium.

It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.

The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Industrial applicability

The above technical solution avoids the problem that the remote camera is not operated quickly by the remote controller, and improves the convenience of the camera of the other party.

Claims

A method for processing a video communication image, comprising:

Obtaining a remote token, the remote token is used to control a device in the opposite end of the video communication;

Selecting the character feature information of the video image in the video communication as the focus information;

Sending the focus information to the device at the opposite end, where the focus information is used by the device to search for a face image corresponding to the character feature information in the video image of the video communication.
The method of claim 1 wherein said obtaining a remote token comprises:

In the peer-to-peer communication, sending a remote control application instruction to obtain the remote token; or

In the multipoint communication, after applying to the master control location, the remote control application command is sent to obtain the remote token.
The method according to claim 1 or claim 2, wherein the selecting the character feature information of the video image in the video communication as the focus information comprises:

The character feature information of the video image in the video communication is selected as the focus information by receiving the touch gesture of the touch screen, wherein the touch gesture includes one of the following: a touch gesture of double tap, a touch gesture of a circle.
A method for processing a video communication image, comprising:

Receiving focus information sent by the terminal of the opposite end, where the focus information includes character feature information;

Searching for a face image corresponding to the character feature information in the video image, the video image being a video image in video communication with the device at the opposite end.
The method of claim 4 further comprising:

After the face image corresponding to the character feature information in the search video image is aligned with the face image corresponding to the character feature information, the face image is scaled to a preset threshold, and the preset threshold is The ratio of the face image to the screen of the device.
A method according to claim 4 or claim 5, further comprising:

After searching the face image corresponding to the character feature information in the video image, adjusting the focal length of the camera changes the sharpness of the face image.
A processing device for video communication images, comprising:

Obtaining a module, configured to obtain a remote remote token, wherein the remote remote token is used to control a device in a peer end of the video communication;

Selecting a module, configured to select character feature information of the video image in the video communication as focus information;

The sending module is configured to send the focus information to the device of the peer end, where the focus information is used by the device to search for a face image corresponding to the character feature information in the video image of the video communication.
The apparatus of claim 7, wherein the obtaining module comprises:

The first obtaining unit is configured to send a remote control application instruction to obtain the remote remote token in the point-to-point communication;

The second obtaining unit is configured to send, after applying to the master control location, the remote control application instruction to acquire the remote remote token.
The apparatus of claim 7 or claim 8, wherein the selection module comprises:

The touch selection unit is configured to select, according to the touch gesture of the touch screen, the character feature information of the video image in the video communication as the focus information, wherein the touch gesture includes one of the following: a double-touch gesture, a circled touch gesture .
A processing device for video communication images, comprising:

a receiving module, configured to receive focus information sent by the terminal of the opposite end, where the focus information includes character feature information;

The search module is configured to search for a face image corresponding to the character feature information in the video image, where the video image is a video image in video communication with the device at the opposite end.
The device of claim 10, the device further comprising:

And after the zooming module is configured to align the face image corresponding to the character feature information, the face image is scaled to a preset threshold, where the preset threshold is a ratio of the face image to the device screen.
The device according to claim 10 or claim 11, further comprising:

The focal length module is configured to adjust the focal length of the camera to change the sharpness of the face image.