CN113179434A

CN113179434A - VR-based television remote co-watching method and system

Info

Publication number: CN113179434A
Application number: CN202110416667.XA
Authority: CN
Inventors: 范晓波
Original assignee: Guangdong Huanwang Technology Co Ltd
Current assignee: Guangdong Huanwang Technology Co Ltd
Priority date: 2021-04-19
Filing date: 2021-04-19
Publication date: 2021-07-27
Anticipated expiration: 2041-04-19
Also published as: CN113179434B

Abstract

The application relates to a television remote co-watching method based on VR, belonging to the technical field of VR televisions. The application includes: configuring the television playing configuration of each user in a VR television group into synchronization, and acquiring real-time panoramic images and audio information of each user watching the television; and creating a virtual reality television watching real-time scene containing each user according to the real-time panoramic image and the audio information of the television watched by each user, and displaying the virtual reality television watching real-time scene for each user. By the method and the device, the requirement that the users can enter the same VR television scene to watch television contents together can be met under the condition that friends of the users cannot be gathered together.

Description

VR-based television remote co-watching method and system

Technical Field

The application belongs to the technical field of VR televisions, and particularly relates to a television remote co-watching method based on VR.

Background

The intelligent television is powerful in function and supports multiple functions, wherein the VR technology is introduced into the intelligent television, VR resources are obtained through VR application software of the intelligent television, and users can watch VR television contents through VR experience equipment, so that very good watching experience can be obtained.

In the related art, the experience of watching VR television contents by multiple people is carried out on the same intelligent television, so that a user can invite three or two friends to watch the VR television at home and enter the same VR scene for experience, but under the working pressure of modern society life, the friends are often difficult to gather together in working days, and the gathering is advocated to be reduced as much as possible under the condition of current epidemic situation. Under the current situation, the VR television cannot meet the requirement of the user for experience of multiple people.

Disclosure of Invention

In order to overcome the problems in the related art at least to a certain extent, the application provides a VR-based television remote co-watching method, which aims to meet the requirement that users can enter the same VR television scene to watch television content together under the condition that friends of the users cannot be gathered together.

In order to achieve the purpose, the following technical scheme is adopted in the application:

in a first aspect,

the application provides a VR-based television remote co-watching method, which comprises the following steps:

configuring the television playing configuration of each user in a VR television group into synchronization, and acquiring real-time panoramic images and audio information of each user watching the television;

and creating a virtual reality television watching real-time scene containing each user according to the real-time panoramic image and the audio information of the television watched by each user, and displaying the virtual reality television watching real-time scene for each user.

Further, the method further comprises:

receiving invitation information sent by an inviter, wherein the invitation information carries ID information of an invitee and the VR television group to which the invitation enters;

initiating a request to the invitee to invite to the VR television group based on the invitee's ID information to configure the invitee's television playback to be synchronized with other users in the VR television group when the invitee enters the VR television group.

Further, the creating a virtual reality tv viewing real-time scene containing each user according to the real-time panoramic image and audio information of each user watching tv includes:

creating a VR environment scene for watching television; extracting real-time panoramic images of the human bodies of the users from the real-time panoramic images of the users; real-time audio information of each user is synthesized in real time;

and creating the virtual reality television watching real-time scene according to the VR environment scene, the real-time panoramic image of each user and the real-time synthesized audio information.

Further, the creating a VR environment scene for watching television includes:

acquiring current television playing content and acquiring environment scenes in real-time panoramic images of users;

matching and calculating the current television playing content and the environment scene in the real-time panoramic image of each user;

and selecting the environment scene in the real-time panoramic image of the user with the best matching degree as the VR environment scene for watching the television.

Further, the matching calculation of the current television playing content and the environment scene in the real-time panoramic image of each user includes:

and respectively carrying out matching calculation according to a plurality of home items in a preset home environment scene, multiplying the matching calculation result of each home item by the corresponding weight, and then summing to obtain the matching degree of the environment scene in the real-time panoramic image of each user and the current television playing content.

Further, wherein the plurality of household items comprise: home color tone, home style and home article layout.

Further, the creating a VR environment scene for watching television includes:

and displaying a plurality of VR environment scenes preset by the system to each user, and determining a target VR environment scene as the VR environment scene for watching the television according to the response of each user.

In a second aspect of the present invention,

the present application provides a VR-based television remote co-watch system configured to implement the method of any one of the above, the system comprising:

the system comprises VR experience equipment, panoramic camera equipment, an intelligent television, a VR television co-watching management server and a VR television co-watching video processing server;

wherein the content of the first and second substances,

VR experience equipment panorama camera equipment respectively with smart television connects, smart television respectively with VR TV is with watching management server and VR TV is with watching video processing server and being connected, VR TV is with watching management server with VR TV is with watching video processing server and being connected.

Further, the users log in the VR television co-watching management server through the smart television to perform operations of registering and adding friends, wherein each user has a unique ID.

Further, the panoramic shooting equipment is used for collecting real-time panoramic shooting and audio information.

This application adopts above technical scheme, possesses following beneficial effect at least:

the utility model provides a TV remote co-watching method based on VR, the method can realize the remote association of users who are not together through the VR TV group, configure the TV broadcast of each user in the VR TV group into synchronization, and obtain the real-time panoramic image and audio information that each user watches TV, establish the virtual reality TV that contains each user and watch the real-time scene with this, and carry out the show that virtual reality TV watches the real-time scene to each user, thereby can satisfy the condition that user's friends can not gather together, provide the demand that can get into the same VR TV scene and watch and experience VR TV content together for each user.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 is a flow diagram illustrating a VR-based remote co-watch method for television in accordance with an exemplary embodiment;

fig. 2 is a block diagram of a VR-based television remote co-watch system in accordance with an exemplary embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail below. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the examples given herein without making any creative effort, shall fall within the protection scope of the present application.

In the related art, the experience of watching VR television contents by multiple people is carried out on the same intelligent television, so that a user can invite three or two friends to watch the VR television at home and enter the same VR scene for experience, but under the working pressure of modern society life, the friends are often difficult to gather together in working days, and the gathering is advocated to be reduced as much as possible under the condition of current epidemic situation. Under the current situation, the VR television cannot meet the requirement of the user for experience of multiple people, and therefore the following related scheme contents are provided.

Referring to fig. 1, fig. 1 is a flowchart illustrating a VR-based television remote co-watching method according to an exemplary embodiment, where as shown in fig. 1, the VR-based television remote co-watching method includes the following steps:

s101, configuring the television playing configuration of each user in a VR television group to be synchronous, and acquiring real-time panoramic images and audio information of the users watching the television;

step S102, creating a virtual reality television watching real-time scene containing each user according to the real-time panoramic image and the audio information of the television watched by each user, and displaying the virtual reality television watching real-time scene for each user.

Under the scheme, remote association of users who are not together can be achieved through the VR television group, in practical application, at least one part of users in the VR television group are not together with other users in the group, and all users in the VR television group watch television through respective VR experience equipment. And configuring the television broadcasting of each user in the VR television group to be synchronous, so that each user can synchronously watch television contents on respective VR experience equipment. The method comprises the steps of obtaining real-time panoramic images and audio information of watching televisions of all users, creating virtual reality television watching real-time scenes containing all users, and displaying the virtual reality television watching real-time scenes of all the users, so that the requirement that users can enter the same VR television scene and watch and experience VR television contents together under the condition that friends of the users cannot be gathered together is met.

To the real-time panoramic image that obtains the user, accessible panoramic camera and VR experience equipment acquire, and the panoramic camera acquires holistic panoramic image, and VR experience equipment acquires user's facial expression to this obtains real-time panoramic image.

In one embodiment, the method further comprises:

Specifically, a user can create a VR television group through the smart television and initiate an invitation to a friend user, and the user can select one or more friends to watch and experience the VR television together with the user through the VR television group. After the friend receives the invitation to enter the VR television group, the VR television playing content is synchronous with other users in the VR television group.

In one embodiment, the creating a virtual reality tv viewing real-time scene containing each user according to the real-time panoramic image and audio information of each user watching tv comprises:

Specifically, a VR environment scene for watching television is created, so that users in each group can enter the same VR environment scene together to watch television content, and experience of being personally on the scene and naturally communicating when watching television is provided for the users. Extracting real-time panoramic images of the human bodies of the users from the real-time panoramic images of the users; and real-time audio information of each user is synthesized in real time and configured in a VR environment scene for watching television, so that a virtual reality television watching real-time scene is created and formed to be displayed to the user, and the user can experience the television by friends in a virtual reality manner through the VR experience equipment worn by the user.

The following is further described with respect to the above-described scenario of creating a VR environment for watching tv.

In one embodiment, the creating a VR environment scene for viewing television includes:

Specifically, the plurality of VR environment scenarios preset by the system may include: the system comprises a plurality of VR environment scenes such as calm, hot, bright and dim, and the like, wherein the VR environment scenes can be selected by users, each user can discuss each VR environment scene to form a response, the system can collect the response of each user through a panoramic camera or VR experience equipment, and a target VR environment scene is determined through analysis, for example, most users in each user agree to adopt a certain VR environment scene, the system collects the response, and the VR environment scene is automatically used as the VR environment scene for watching television.

Specifically, under the scheme, a home environment scene most matched with the current television playing content can be selected from the home environment scenes of the users, for example, A, B, C three respective home users are together in a group to be ready to watch VR televisions, A, B, C three user home environments are different, such as a brief modern style, a natural style and an ancient style, if the current television playing content is a city drama, the brief modern style home environment scene is selected to be most matched, and the brief modern style home environment scene is used as a VR environment scene for watching televisions, so that a better home television watching environment experience is provided for the users with different home environment types.

Specifically, the plurality of home items may include: the home color tone, the home style, the home article layout and the like, a weight may be configured in advance for each home item, and a specific weight may be configured according to a personal idea of a user, for example, the weights of the home color tone, the home style and the home article layout may be configured in sequence as follows: 0.3, 0.4 and 0.3, wherein the home style is the most priority in the environmental scene matching calculation through the weight configuration, so that the environmental scene in the real-time panoramic image of the user with the best matching degree selected by adding the idea of the user can be realized.

Referring to fig. 2, fig. 2 is a block diagram of a VR-based television remote co-watch system according to an exemplary embodiment, where the VR-based television remote co-watch system is configured to implement any of the above methods, as shown in fig. 2, and the VR-based television remote co-watch system 2 includes:

the system comprises VR experience equipment 21, panoramic camera equipment 22, an intelligent television 23, a VR television co-watching management server 24 and a VR television co-watching video processing server 25;

wherein the content of the first and second substances,

VR experiences equipment 21 panorama camera equipment 22 respectively with smart television 23 is connected, smart television 23 respectively with VR TV is with watching management server 24 and VR TV is with watching video processing server 25 and being connected, VR TV is with watching management server 24 with VR TV is with watching video processing server 25 and being connected.

Through the configuration of the VR-based television remote watching system 2, the requirement that users can enter the same VR television scene and watch and experience VR television content together can be met under the condition that friends of the users cannot be gathered together.

Specifically, the user can log in and register on the VR television co-watching management server 24 through the operation of the smart television 23, add friends, and each user has a unique ID, so that the user can conveniently find friends; the user invites the remote friends to watch together through the smart television 23, the remote friends receive the invitation on the smart television 23, and enter the same VR television scene to watch and experience VR television content together through the agreement of joining.

The intelligent television 23 starts the VR experiencing equipment 21 and the panoramic camera 22, panoramic camera shooting can be carried out through the panoramic camera 22, sound information can be obtained simultaneously, facial expressions of users can be collected through the VR experiencing equipment 21, synthesis and transmission of pictures and sounds are processed through the VR television co-watching video processing server 25 and are sent to users of all parties after processing, and the users of all parties experience the same VR scene through the VR experiencing equipment 21 and watch the television.

It is understood that the same or similar parts in the above embodiments may be mutually referred to, and the same or similar parts in other embodiments may be referred to for the content which is not described in detail in some embodiments.

It should be noted that, in the description of the present application, the terms "first", "second", etc. are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In addition, in the description of the present application, the meaning of "plurality" means at least two unless otherwise specified.

It will be understood that when an element is referred to as being "secured to" or "disposed on" another element, it can be directly on the other element or intervening elements may also be present; when an element is referred to as being "connected" to another element, it can be directly connected to the other element or intervening elements may also be present, and further, as used herein, connected may include wirelessly connected; the term "and/or" is used to include any and all combinations of one or more of the associated listed items.

Any process or method descriptions in flow charts or otherwise described herein may be understood as: represents modules, segments or portions of code which include one or more executable instructions for implementing specific logical functions or steps of a process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present application.

It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.

In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.

In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Claims

1. A VR-based remote co-viewing method for television, the method comprising:

2. The method of claim 1, further comprising:

3. The method of claim 1, wherein creating a virtual reality television viewing real-time scene containing each user based on the real-time panoramic image and audio information of each user viewing the television comprises:

4. The method of claim 3, wherein creating the TV-watching VR environment scene comprises:

5. The method of claim 4, wherein the matching the current TV playing content with the environment scene in the real-time panoramic image of each user comprises:

6. The method of claim 5, wherein the plurality of household items comprises: home color tone, home style and home article layout.

7. The method of claim 3, wherein creating the TV-watching VR environment scene comprises:

8. A VR-based television remote co-watch system configured to implement the method of any of claims 1-7, the system comprising:

wherein the content of the first and second substances,

9. The system of claim 8, wherein users log on to the VR television co-watch management server via the smart tv to perform operations of registering and adding friends, wherein each user has a unique ID.

10. The system of claim 8, wherein the panoramic camera device is configured to capture real-time panoramic camera and audio information.