WO2017166360A1

WO2017166360A1 - Video calling method and device

Info

Publication number: WO2017166360A1
Application number: PCT/CN2016/080621
Authority: WO
Inventors: 胡凯伟; 高建平
Original assignee: 宇龙计算机通信科技(深圳)有限公司
Priority date: 2016-04-01
Filing date: 2016-04-29
Publication date: 2017-10-05
Also published as: CN105721821A

Abstract

Provided in the present invention are a video calling method and device, used to solve the problem in the prior art wherein a video calling party cannot adjust a capture image according to a reaction of an opposite terminal user. A video calling method is applied to a terminal of a local calling terminal, the method comprising: acquiring head movement data of an opposite calling terminal; controlling a camera in the terminal of the local calling terminal to capture a video according to the head movement data, so as to acquire calling video data; and sending the calling video data to a virtual reality device of the opposite calling terminal, such that the virtual reality device plays back the calling video data. The present technical solution can provide a user with a more realistic, "face-to-face" video calling experience.

Description

Video call method and device

The present application claims priority to Chinese Patent Application No. 201610200942.3, the entire disclosure of which is hereby incorporated by reference.

Technical field

The present invention relates to the field of communications, and in particular, to a video call method and apparatus.

Background technique

At present, the mobile terminal user can implement the video call by means of the camera on the terminal. However, at this stage, the method can only provide a two-dimensional video picture for both parties of the call, and the user can only view the specified picture taken by the camera on the other terminal. Therefore, the experience of the video call to the user is relatively rigid, and it is impossible for the two parties to have a face-to-face chat experience. Imagine that if the video call screen can adjust the shooting screen according to the reaction of the caller, the two parties can get a better call experience. It can be seen that a more humanized video calling method has yet to be proposed.

Summary of the invention

The present invention provides a video calling method and apparatus for solving the problem that the video calling party cannot adjust the shooting picture according to the reaction of the opposite end of the call in the prior art.

According to an aspect of the present invention, a video call method is provided, which is applied to a terminal of a call end, and includes: acquiring head motion data of a user of the call end; and controlling, by the head motion data, a camera of the terminal of the call end to perform shooting, The call video data is obtained; the call video data is sent to the virtual reality device at the opposite end of the call, so that the virtual reality device plays the call video data.

The obtaining the head motion data of the user of the opposite end of the call includes: receiving the head motion data of the user of the call end collected by the virtual reality device sent by the opposite end of the call.

The terminal at the local end of the call has a plurality of cameras, and the camera of the terminal at the local end of the call is controlled according to the head motion data to obtain the video data of the call, including: adjusting the shooting angle of the plurality of cameras according to the head motion data, and obtaining multiple shootings. The screen combines multiple shooting screens into a 3D screen.

The head motion data includes: a head rotation direction data and an angle data of the opposite end user of the call, and the camera of the terminal of the call end is controlled according to the head motion data, and includes: adjusting the call according to the head rotation direction data and the angle data. The shooting angle of the camera of the terminal at the local end is shot using the adjusted camera.

Further, after the camera of the terminal of the call end is controlled according to the head motion data to obtain the call video data, the method further includes: compressing the call scene and the voice data in the call video data, respectively, and transmitting the call scene and the voice data to the opposite end of the call. The terminal is configured to enable the terminal at the opposite end of the call to send the call scene and the voice data to the virtual reality device at the opposite end of the call.

According to the video call method provided by the embodiment of the present invention, the camera of the terminal of the call end is adjusted according to the acquired head motion data of the call end user to capture the picture of the video call, so that the user of the opposite end of the call can rotate according to the head of the call. To see different pictures, so that users can get a more realistic call experience.

According to a second aspect of the present invention, a video call method is provided, which is applied to a virtual reality device at a call end, including: receiving call video data sent by a terminal at a call end; playing call video data; and performing a call process by the user The user's head motion data is collected; the user's head motion data is sent to the terminal at the opposite end of the call, so that the terminal at the opposite end of the call sends the head motion data to the terminal at the call end.

The call video data sent by the terminal that receives the local end of the call includes: a call scene and voice data that are sent by the terminal at the opposite end of the call and decompressed by the terminal at the opposite end of the call.

The video call method provided by the embodiment of the present invention compresses the head motion data of the user according to the motion data of the user's head collected during the call, and sends the data to the terminal at the opposite end of the call, so that the terminal at the opposite end of the call The motion data is sent to the terminal at the local end of the call, thereby controlling the camera of the terminal at the local end of the call to take a picture of the video call, so that the user at the opposite end can view different pictures according to the rotation of the head, thereby enabling the user to obtain A more realistic call experience.

According to a third aspect of the present invention, a video communication device includes: an acquisition module, configured to acquire head motion data of a user of a call end; and a control module, configured to control a terminal of the call end according to the head motion data The camera is shooting to get the call video data; the first sending module is used The call video data is sent to the virtual reality device at the opposite end of the call, so that the virtual reality device plays the call video data.

The acquiring module is specifically configured to: receive the head motion data of the user of the call end collected by the virtual reality device sent by the terminal at the opposite end of the call.

The control module is specifically configured to: adjust a shooting angle of the plurality of cameras according to the head motion data, obtain a plurality of shooting images, and combine the plurality of shooting images into a 3D image.

The head motion data includes: a head rotation direction data and an angle data of the user of the call end, and the control module is specifically configured to: adjust a photographing angle of the camera of the terminal of the call end according to the head rotation direction data and the angle data, and use The adjusted camera is used for shooting.

Further, the first sending module is further configured to: after the camera on the terminal that controls the call end according to the head motion data is photographed, and obtain the call video data, the call scene and the voice data in the call video data are separately compressed and sent to The terminal at the opposite end of the call, so that the terminal at the opposite end of the call sends the call scene and the voice data to the virtual reality device at the opposite end of the call.

The video call device provided by the embodiment of the present invention adjusts the camera of the terminal of the call end according to the obtained head motion data of the user of the call to capture the picture of the video call, so that the user of the opposite end of the call can rotate according to the head of the call. To see different pictures, so that users can get a more realistic call experience.

According to a fourth aspect of the present invention, a video communication device is provided, comprising: a receiving module, configured to receive call video data sent by a terminal at a call end; a play module, configured to play call video data; and an acquisition module, configured to: The user's head motion data is collected during the user's call; the second sending module is configured to send the user's head motion data to the call peer terminal, so that the call end terminal sends the head motion data to The terminal of the call.

The receiving module is specifically configured to: receive a call scenario and voice data after being decompressed by the terminal at the opposite end of the call sent by the terminal at the opposite end of the call.

The video call device provided by the embodiment of the present invention compresses the head motion data of the user according to the motion data of the user's head collected during the call, and sends the data to the terminal at the opposite end of the call, so that the terminal at the opposite end of the call The motion data is sent to the terminal at the local end of the call, thereby controlling the camera of the terminal at the local end of the call to take a picture of the video call, so that the user at the opposite end can make a call according to the head of the user. Turn the situation to see different pictures, so that users can get a more realistic call experience.

DRAWINGS

1 is a flowchart of a video call method according to Embodiment 1 of the present invention;

2 is a flowchart of a video calling method according to Embodiment 2 of the present invention;

3 is a structural block diagram of a video communication device according to Embodiment 3 of the present invention;

FIG. 4 is a structural block diagram of a video communication apparatus according to Embodiment 4 of the present invention.

detailed description

In order to solve the problem that the video calling party cannot adjust the shooting picture according to the reaction of the calling end in the prior art, the present invention provides a video calling method and apparatus. The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

Example 1

This embodiment provides a video call method, which is applied to a terminal at the local end of the call. FIG. 1 is a flowchart of the method. As shown in FIG. 1, the method includes the following steps:

Step 101: Acquire head movement data of the user of the opposite end of the call;

In this step, the head motion data of the calling end user may be collected by a VR (Virtual Reality) device at the opposite end of the call, and then sent to the terminal at the opposite end of the call, and then sent to the call book by the terminal at the opposite end of the call. Terminals of the terminal, preferably, in this embodiment, the terminal and the VR device on the same side can communicate using wifi. In addition, in this embodiment, the user of the call peer can also obtain the call peer user through a device such as a motion sensor disposed at the opposite end of the call. Head movement data.

Step 102: Control, according to the head motion data, the camera of the terminal of the call end to perform shooting, and obtain call video data;

Preferably, the terminal at the local end of the call in this embodiment may have multiple cameras. Based on this, the terminal at the local end of the call controls the camera of the terminal at the local end of the call according to the received head motion data of the opposite end user to obtain a call. The operation of the video data may specifically include: according to the call pair The head user's head motion data adjusts the shooting angles of the plurality of cameras of the terminal at the call end to obtain a plurality of shooting screens, and combines the plurality of shooting screens into a 3D screen.

Preferably, in this embodiment, the head motion data of the user at the opposite end of the call may specifically include: a head rotation direction data of the opposite end user and angle data, and based on this, the terminal of the call origin is controlled according to the head motion data. The camera may be configured to: according to the user's head rotation direction data and the angle data, adjust the shooting angle of the camera of the terminal, and use the adjusted camera to perform shooting, that is, when the first user and the second user make a video call, The first user sees the video image of the second user, and the first user can habitually rotate the head to adjust the viewing angle as if viewing the real object. At this time, the VR device of the first user acquires the data of the first user's head rotation and sends the data to the first user. a terminal of the second user, the terminal of the second user controls the camera on the second terminal according to the data of the head rotation to adjust the currently photographed angle of view, so as to capture the video image that the first user desires to see, A user can obtain a different angle of rotation as if he is in a real scene. Like experience.

Step 103: Send the call video data to the VR device at the opposite end of the call, so that the virtual reality device plays the received call video data.

In this step 103, preferably, the terminal at the local end of the call sends the call video data to the terminal at the opposite end of the call, and then the terminal at the opposite end of the call sends the call video data to the VR device at the opposite end of the call.

Further, the method may further include: after capturing the video according to the head motion data control terminal, obtaining the call video data, compressing the call scene and the voice data in the call video data, and transmitting the call scene and the voice data to the terminal at the opposite end of the call, The terminal at the opposite end of the call decompresses the call scenario and the voice data, and sends the call scenario and the voice data to the VR device at the opposite end of the call.

It should be noted that, in this embodiment, the VR device at the opposite end of the call can directly communicate with the terminal at the call end, and the user head rotation information in this embodiment can be directly sent to the call by the VR device at the opposite end of the call. At the local end, at the same time, after the terminal at the local end generates the 3D call video data, it can also directly send the VR device to the opposite end of the call.

In the process of performing the above steps 101 to 103, the VR device at the opposite end of the call communicates with the terminal at the opposite end of the call, and the VR device at the local end of the call can communicate with the terminal at the local end of the call to complete the entire video call process.

Example 2

This embodiment provides a video call method, which is applied to a virtual reality device at the opposite end of the call. FIG. 2 is a flowchart of the method. As shown in FIG. 2, the method includes the following steps:

Step 201: Receive call video data sent by the terminal at the local end of the call;

Step 202: Play the received call video data.

Step 203: Collect, during the call by the user, the head motion data of the user.

Step 204: Send the user's head motion data to the terminal at the opposite end of the call, so that the terminal at the opposite end of the call sends the head motion data to the terminal at the call end.

The method for receiving the call video data sent by the terminal at the local end of the call may include: receiving the call scene and the voice data after being decompressed by the terminal of the opposite end of the call sent by the terminal at the opposite end of the call.

The call video data received by the VR device may be a 3D picture generated by the terminal of the call local end, and voice data.

The user head usage data collected by the VR device may be direction data and angle data of the user's head rotation.

Example 3

The present embodiment provides a video call device, which is used to implement the first video call method described in Embodiment 1, and FIG. 3 is a structural block diagram of the device 30. As shown in FIG. Includes the following components:

The obtaining module 31 is configured to acquire head motion data of the user of the call end;

The control module 32 is configured to control, according to the head motion data, a camera of the terminal of the call end to perform shooting, to obtain call video data;

The first sending module 33 is configured to send the call video data to the VR device at the opposite end of the call, so that the virtual reality device plays the call video data.

The acquiring module 31 is specifically configured to: receive the head motion data of the call peer user collected by the virtual reality device sent by the terminal at the opposite end of the call.

The control module 32 is specifically configured to: control a shooting angle of the plurality of cameras according to the head motion data, obtain a plurality of shooting images, and combine the plurality of shooting images into a 3D image.

The above-mentioned head motion data includes: a head rotation direction and an angle data of the user of the opposite end of the call, and the control module 32 is specifically configured to: adjust the shooting angle of the camera of the terminal according to the direction and the angle data, and use the adjustment The camera is taken after shooting.

Preferably, the first sending module in this embodiment is further configured to: when the camera on the terminal that controls the call end according to the head motion data is used for shooting, and after the call video data is obtained, the call scene and the sound data in the call video data are used. After being compressed, the terminal is sent to the terminal at the opposite end of the call, so that the terminal at the opposite end of the call sends the call scene and the voice data to the virtual reality device at the opposite end of the call.

Example 4

This embodiment provides another video calling device, which is used to implement the second video calling method provided in Embodiment 1 above. FIG. 4 is a structural block diagram of the device. As shown in FIG. 4, the device 40 includes The following components:

The receiving module 41 is configured to receive call video data sent by the terminal at the local end of the call;

a playing module 42, configured to play call video data;

The collecting module 43 is configured to collect the head motion data of the user during the user's call;

The second sending module 44 is configured to send the head motion data of the user to the terminal at the opposite end of the call, so that the terminal at the opposite end of the call sends the head motion data to the terminal at the call end.

The receiving module 41 may be specifically configured to: receive a call scenario and voice data that is decompressed by the terminal of the opposite end of the call sent by the terminal at the opposite end of the call.

The video call device provided by the embodiment of the present invention compresses the head motion data of the user according to the motion data of the user's head collected during the call, and sends the data to the terminal at the opposite end of the call, so that the terminal at the opposite end of the call The motion data is sent to the terminal at the local end of the call, thereby controlling the camera of the terminal at the local end of the call to take a picture of the video call, so that the user at the opposite end can view different pictures according to the rotation of the head, thereby enabling the user to obtain A more realistic call experience.

Example 5

In this embodiment, the mobile phone and the VR device are coupled together (for example, the two can communicate via wifi), and a plurality of cameras on the mobile phone generate a 3D virtual scene of the local video call party and compress the terminal sent to the other party, the other party's After receiving the video data, the terminal sends the video data to the VR device of the other party, and the VR device of the other party plays the received video data, so that both parties can obtain the face-to-face chat experience.

In this embodiment, each of the video call has a mobile phone and a VR device. Preferably, the VR device in this embodiment may be a VR helmet, and the mobile phone and the VR device can communicate through the wifi. The meter is aimed at the user, the user can wear the VR helmet; compress the virtual scene and sound generated by the multi-camera on the mobile phone and send it to the terminal of the other party in real time, and the terminal of the other party receives the video data and decompresses it. The decompressed data is sent to the VR helmet worn by the caller's user for real-time screen presentation and voice interaction, thereby realizing face-to-face chat effect; when the other party's user turns the head, the information of the other party's user's head is sent to the opposite end of the call. The mobile phone and the mobile phone at the opposite end of the call automatically fine-tune the perspective of the camera on the terminal according to the received head rotation information, thereby generating a corresponding picture to be transmitted to the mobile phone at the opposite end of the call, and the mobile phone at the opposite end of the call forwards the received data to the opposite end of the call. The VR helmet worn by the user is presented.

The solution of the embodiment can simulate the appearance of the opposite scene chat effect on the existing VR device and the mobile phone, combining the characteristics of the mobile phone and the VR device, and has a 3D stereoscopic sense of the scene, and can also be applied to the video in the later stage. Meetings and other scenarios have improved the user experience.

While the preferred embodiments of the present invention have been disclosed for purposes of illustration, those skilled in the art will recognize that various modifications, additions and substitutions are possible, and the scope of the invention should not be limited to the embodiments described above.

Claims

A video call method is applied to a terminal at a call end, and is characterized in that:

Obtaining head movement data of the user of the opposite end of the call;

Controlling, according to the head motion data, a camera of the terminal of the call end to perform shooting, and obtaining call video data;

And transmitting the call video data to the virtual reality device of the call peer to enable the virtual reality device to play the call video data.
The method according to claim 1, wherein the obtaining the head motion data of the user of the call end comprises:

Receiving, by the terminal of the call end, the head motion data of the call peer user collected by the virtual reality device.
The method according to claim 1, wherein the terminal at the local end of the call has a plurality of cameras, and the camera that controls the terminal of the call end according to the head motion data is photographed to obtain call video data, including:

Adjusting a shooting angle of the plurality of cameras according to the head motion data to obtain a plurality of shooting images, and combining the plurality of shooting images into a 3D screen.
The method according to claim 1, wherein the head motion data comprises: head rotation direction data of the call end user and angle data, and the control of the call origin according to the head motion data The camera of the terminal is photographed, including:

The shooting angle of the camera of the terminal of the call end is adjusted according to the head rotation direction data and the angle data, and the image is captured using the adjusted camera.
A video calling method is applied to a virtual reality device at a call end, and is characterized in that:

Receiving call video data sent by the terminal at the local end of the call;

Playing the call video data;

Collecting the head motion data of the user during a call by the user;

Transmitting the head motion data of the user to the terminal of the call peer end, so that the terminal of the call peer end sends the head motion data to the terminal of the call local end.
The method according to claim 5, wherein the terminal that receives the call end The video data of the call sent, including:

Receiving call scene data and sound data decompressed by the terminal of the call end sent by the terminal at the opposite end of the call.
A video calling device, comprising:

An obtaining module, configured to acquire head motion data of a user opposite to the call;

a control module, configured to control, according to the head motion data, a camera of a terminal of the call end to perform shooting, to obtain call video data;

The first sending module is configured to send the call video data to the virtual reality device at the opposite end of the call, so that the virtual reality device plays the call video data.
The device according to claim 7, wherein the obtaining module is specifically configured to:

Receiving, by the terminal of the call end, the head motion data of the call peer user collected by the virtual reality device.
The device according to claim 7, wherein the control module is specifically configured to:

Adjusting a shooting angle of the plurality of cameras according to the head motion data to obtain a plurality of shooting images, and combining the plurality of shooting images into a 3D screen.
The apparatus according to claim 7, wherein the head motion data comprises: head rotation direction data and angle data of the call end user, and the control module is specifically configured to:

The shooting angle of the camera of the terminal of the call end is adjusted according to the head rotation direction data and the angle data, and the image is captured using the adjusted camera.
A video calling device, comprising:

a receiving module, configured to receive call video data sent by the terminal at the local end of the call;

a playing module, configured to play the call video data;

An acquisition module, configured to collect, during a call by the user, the head motion data of the user;

The second sending module is configured to send the head motion data of the user to the terminal of the call peer, so that the terminal of the call peer end sends the head motion data to the terminal of the call end.
The device according to claim 11, wherein the receiving module is specifically configured to:

Receiving call scene data and sound data decompressed by the terminal of the call end sent by the terminal at the opposite end of the call.