WO2019128138A1

WO2019128138A1 - Three-dimensional live streaming systems and methods

Info

Publication number: WO2019128138A1
Application number: PCT/CN2018/091425
Authority: WO
Inventors: Seng Fook LEE; Zhaoyun WANG
Original assignee: Guangdong Grandeur International Exhibition Group Co., Ltd.
Priority date: 2017-12-27
Filing date: 2018-06-15
Publication date: 2019-07-04
Also published as: CN108419090A

Abstract

Embodiments of the present disclosure provide systems and methods of presenting three-dimensional live streaming of a place. A method comprising retrieving a plurality of pre-stored scanned images of the place from a database; generating a 3D live streaming of the place by superimposing a two-dimensional live stream of the place with the plurality of 3D scanned images; and presenting the 3D live streaming to the viewer.

Description

THREE-DIMENSIONAL LIVE STREAMING SYSTEMS AND METHODS

TECHNICAL FIELD

The presently disclosed embodiments relate to the field of three-dimensional (3D) imaging systems. More specifically, embodiments of the present disclosure relate to systems and methods for presenting three-dimensional live streaming of a place to a viewer.

BACKGROUND

Many exhibitions happen these days about different type of items and arts. For many people, exhibitions are a good way for demonstrating their skills. An exhibition can be a demonstration or public display of works of arts, items of interest that may be held in a museum or an art gallery, or at a trade fair. Usually these exhibitions have a fixed venue and fixed timings. Further, most of the exhibitions have a limit on maximum number of people who can come to see the exhibitions due to many limitations such as a size of the venue, timing, and so forth. Further, people also have their limitations like timing of the exhibition doesn’t suits them, or may be venue for the exhibition is far from their location. Therefore, many people who would want to view the exhibition sometimes are not able to view it due to these limitations. Also when people visit a place or an exhibition physically, then looking at the large number of people in the place, it becomes difficult to understand preference, interest of the people. Currently only two-dimensional live streaming systems exist. But in two-dimensional streaming the details, colour, etc. is not clear.

SUMMARY

In light of above, there exist need for providing techniques for presenting 3D live streaming.

The present disclosure provides a system for presenting three-dimensional live streaming to viewers via a virtual 3D display system.

The present disclosure provides a method for presenting three-dimensional live streaming to viewers via a virtual 3D display system.

The present disclosure provides a method for superimposing a two-dimensional live streaming with a plurality of 3D scanned images for generating 3D live streaming.

The present disclosure also provides a system for superimposing a two-dimensional live streaming with a plurality of 3D scanned images for generating 3D live streaming.

The present disclosure also provides a method for presenting a three-dimensional live streaming of a place to a viewer via a virtual 3D display system.

The present disclosure also provides a system for presenting a three-dimensional live streaming of a place to a viewer via a virtual 3D display system.

The present disclosure further provides a method for generating a three-dimensional live streaming of a place via a virtual 3D display system.

The present disclosure also provides a system for generating a three-dimensional live streaming of a place via a virtual 3D display system.

The present disclosure provides a method for enabling a viewer to view a 3D live streaming of a place by using a virtual 3D system.

The present disclosure provides a system for enabling a viewer to view a 3D live streaming of a place by using a virtual 3D system.

An embodiment of the present disclosure provides a three-dimensional live streaming system comprising: a database configured to store a plurality of three-dimensional scanned images of a place, wherein the plurality of scanned images are captured by a plurality of scanners to cover a 360 degree view of the place; a superimposing module configured to: retrieve the plurality of pre-scanned images of the place; and superimposing a two-dimensional live stream of the place with the plurality of 3D scanned images for generating a 3D live streaming of the place; and a display managing module configured to present the 3D live streaming to the viewer.

According to an aspect of the present disclosure, the 3D live streaming is generated and presented to the viewer in real-time.

According to another aspect of the present disclosure, the plurality of 3D scanned images are pre-captured and pre-stored in the database.

According to another aspect of the present disclosure, the 3D live streaming is presented to the viewer via at least one of a web based system, a virtual 3D display system, an augmented reality device, /system and a virtual reality device/system.

According to other aspect of the present disclosure, the database is further configured to store and maintain users’login credential information, pre-stored 3D scanned images, history of the viewer, interest of the viewer, details about one or more products/services, information of the plurality of exhibition/place, virtual 3D display, the plurality of scanned images, one or more past activities of the viewer while viewing the virtual 3D display.

According to another aspect of the present disclosure, the database is located on a remote device comprising a server.

According to another aspect of the present disclosure, the three-dimensional live streaming and/or the virtual display of the place is presented to the viewer via at least one of a web based system, an augmented reality device and a virtual reality device.

According to another aspect of the present disclosure, the viewer views the virtual 3D display of the place via a web browser.

According to another aspect of the present disclosure, the virtual 3D display is presented to the viewer in real-time.

According to another aspect of the present disclosure, the three-dimensional live streaming system 106 is also configured to generate a two-dimensional live stream of the place.

In some embodiments, the virtual 3D display is viewed in non-real time.

In some embodiments, the plurality of 3D scanned images are stored in a database located on a remote device comprising a server.

Another embodiment of the present disclosure provides a method for three-dimensional live streaming of a place, comprising: retrieving a plurality of pre-stored scanned images of the place from a database; generating a 3D live streaming of the place by superimposing a two-dimensional live stream of the place with the plurality of 3D scanned images; and presenting the 3D live streaming to the viewer.

In some embodiments of the present disclosure, the method comprises capturing the plurality of 3D images of the place for covering a 360-degree view of the place.

According to an aspect of the present disclosure, the viewer is authorized based on a valid login credential for viewing the 3D live streaming of the place.

According to an aspect of the present disclosure, the place can be an exhibition comprising display of a number of products and services.

BRIEF DESCRIPTION OF THE DRAWINGS

Non-limiting and non-exhaustive embodiments of the present invention are described with reference to the following drawings. In the drawings, like reference numerals refer to like parts throughout the various figures unless otherwise specified.

For a better understanding of the present invention, reference will be made to the following Detailed Description, which is to be read in association with the accompanying drawings, wherein:

FIG. 1 illustrates an exemplary environment where various embodiments of the present disclosure may function;

FIG. 2 illustrates a block diagram depicting various system elements of an exemplary three-dimensional live streaming system, in accordance with various embodiments of the present disclosure; and

FIG. 3 illustrates a flowchart of a method for presenting a three-dimensional (3D) live streaming of a place, in accordance with an embodiment of the present disclosure.

The headings used herein are for organizational purposes only and are not meant to be used to limit the scope of the description or the claims. As used throughout this application, the word “may” is used in a permissive sense (i.e., meaning having the potential to) , rather than the mandatory sense (i.e., meaning must) . To facilitate understanding, like reference numerals have been used, where possible, to designate like elements common to the figures.

DETAILED DESCRIPTION

The presently disclosed subject matter is described with specificity to meet statutory requirements. However, the description itself is not intended to limit the scope of this patent. Rather, the inventors have contemplated that the claimed subject matter might also be embodied in other ways, to include different steps or elements similar to the ones described in this document, in conjunction with other present or future technologies. Moreover, although the term “step” may be used herein to connote different aspects of methods employed, the term should not be interpreted as implying any particular order among or between various steps herein disclosed unless and except when the order of individual steps is explicitly described.

Reference throughout this specification to “a select embodiment” , “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosed subject matter. Thus, appearances of the phrases “a select embodiment” “in one embodiment” or “in an embodiment” in various places throughout this specification are not necessarily referring to the same embodiment.

Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided, to provide a thorough understanding of embodiments of the disclosed subject matter. One skilled in the relevant art will recognize, however, that the disclosed subject matter can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring aspects of the disclosed subject matter.

All numeric values are herein assumed to be modified by the term “about, ” whether or not explicitly indicated. The term “about” generally refers to a range of numbers that one of skill in the art would consider equivalent to the recited value (i.e., having the same or substantially the same function or result) . In many instances, the terms “about” may include numbers that are rounded to the nearest significant figure. The recitation of numerical ranges by endpoints includes all numbers within that range (e.g., 1 to 5 includes 1, 1.5, 2, 2.75, 3, 3.80, 4, and 5) .

As used in this specification and the appended claims, the singular forms “a, ” “an, ” and “the” include or otherwise refer to singular as well as plural referents, unless the content clearly dictates otherwise. As used in this specification and the appended claims, the term “or” is generally employed to include “and/or, ” unless the content clearly dictates otherwise.

The following detailed description should be read with reference to the drawings, in which similar elements in different drawings are identified with the same reference numbers. The drawings, which are not necessarily to scale, depict illustrative embodiments and are not intended to limit the scope of the disclosure.

FIG. 1 illustrates an exemplary environment 100 where various embodiments of the present disclosure may function. As shown, the environment 100 primarily includes a viewer 102, a computing device 104 comprising a three-dimensional live streaming system 106, and a server 108. The viewer 102 may register with the three-dimensional live streaming system 106 by entering one or more personal details such as a name, an age, a location, a gender, and so forth on an interface of the computing device 104. The viewer 102 can be any user with authorized login credentials for accessing virtual view of a place such as, but not limited to, an exhibition by using the three-dimensional live streaming system 106 and at least one of an augmented reality device/system, a web based system, or/and a virtual reality device/system. In an exemplary scenario, the three-dimensional live streaming system 106 may allow the viewer 102 to view a virtual 3D live stream and/or a virtual 3D display of a place such as, an exhibition on the computing device 104 by entering the valid login credentials from anywhere and at anytime. Further, the viewer 102 may not be required to physically visit the exhibition for viewing it. The viewer 102 may be presented with a three-dimensional (3D) live streaming and/or three-dimensional (3D) virtual display including a virtual view of the exhibition/place by the three-dimensional live streaming system 106 such that the viewer 102 may feel as being part of the exhibition/place and virtually may feel the environment of the exhibition or the place. The examples of the exhibition may include a painting exhibition, a museum exhibition, a product exhibition, a service exhibition, and so forth. Further, an exhibition may be a display of products or services in an indoor area such as a hall, or in an outdoor area such as a ground.

In some embodiments, the three-dimensional live streaming system 106 may be an application installed on the computing device 104. In alternative embodiments, the viewer 102 may access the three-dimensional live streaming system 106 via a website URL on a web browser such as, but not limited to, Google Chrome, Internet Explorer, and so forth on the computing device 104. In some embodiments, the three-dimensional live streaming system 106 may be a single device or combination or multiple device or modules or systems capable of analyzing data generated during such as, a session of the viewer 102 while viewing the virtual 3D view of the place/exhibition. Further, the three-dimensional live streaming system 106 may be software, hardware, firmware, and combination of these. In some embodiments, the computing device 104 may be such as, but not limited to, a smart phone, a tablet computer, a television, a laptop, a smart watch, a smart TV, a computer, and so forth.

The three-dimensional live streaming system 106 is configured to authorize the viewer 102 based on a valid login credentials. Further, the three-dimensional live streaming system 106 is configured to present a virtual 3D display of a place to the viewer 102 such that the viewer 102 feels as being part of the virtual 3D display. The viewer 102 can feel one or more products for display in the virtual 3D display of the place. The virtual 3D display comprises a plurality of scanned images of the place captured by one or more scanners. In some embodiments, the virtual 3D display is presented to the viewer 102 via at least one of a web based system, an augmented reality device and a virtual reality device/system.

The three-dimensional live streaming system 106 is further configured to sense a movement, behavior, one or more activities of the viewer 102, a current interest of the viewer in a product/service in the first virtual 3D display, and/or one or more gestures of the viewer 102 within the virtual 3D display. The three-dimensional live streaming system 106 is further configured to receive one or more inputs from the viewer 102.

The three-dimensional live streaming system 106 is further configured to store a plurality of virtual 3D displays of a plurality of places, a plurality of scanned images of the place, and a plurality of links associated with the plurality of virtual 3D displays. The links may comprise a uniform resource locator. In further embodiments, the three- dimensional live streaming system 106 is configured to store and maintain users’login credential information, history of the viewer 102, interest of the viewer 102, details about one or more products/services, information of the plurality of exhibition/place, virtual 3D display, the plurality of scanned images, one or more activities of the viewer 102 while viewing the virtual 3D display. In some embodiments, the database is located on a remote device comprising the server 108. The 3D scanned displays, 3D scanned images, login credentials of the viewer 102 may be saved or stored either locally on the computing device 104 or on a database or storage device of the server 108. The server 108 may be a remotely located computation and storage device. In some embodiments, the data comprising users’login credential information, information of the plurality of exhibition, virtual 3D display, the plurality of scanned images, one or more activities of the viewer while viewing the virtual 3D display. The one or more activities of the viewer comprises a time spent at a particular position by the viewer, an area of the virtual 3D display of the place viewed by the viewer, and so forth.

The three-dimensional live streaming system 106 is also configured to retrieve the plurality of 3D scanned images of the place. The three-dimensional live streaming system 106 is also configured to generate a two-dimensional live stream of the place. The three-dimensional live streaming system 106 is also configured to superimpose the two-dimensional live streaming of the place with the plurality of 3D scanned images for generating a three-dimensional live streaming of the place. The three-dimensional live streaming system 106 is also configured to present the 3D live streaming of the place to the viewer 102.

In some embodiments, the three-dimensional live streaming system 106 is also configured to capture a plurality of images of the place such that a 360 degree view of the place is covered for generating the plurality of scanned images of the place.

FIG. 2 illustrates a block diagram depicting various system elements of an exemplary three-dimensional live streaming system 202, in accordance with various embodiments of the present disclosure. As shown, the three-dimensional live streaming system 202 comprises an access managing module 204, a display managing module 206, one or more scanners 208, a database 210, and a superimposing module 212. In some embodiments, a user, such as the viewer 102 of FIG. 1, accesses the three-dimensional live streaming system 202 via a web browser on a computing device such as, a smart phone. The viewer 102 may view a virtual 3D view comprising a 3Dlive streaming of a place such as, an exhibition in real-time when the exhibition is actually happening. In some embodiments, the viewer 102 may view the exhibition at a later time may be after the exhibition has finished. The viewer 102 may view the place/exhibition anytime and from anywhere by using a smart phone comprising the three-dimensional live streaming system 202.

The access managing module 204 may be configured to authorize an identity of the viewer 102 based on a valid login credential. The login credential may include, but are not limited to, a password, a login identifier (ID) , a name, a location, and so forth. Post authorization, the viewer 102 may gain access to one or more features of the three-dimensional live streaming system 202.

The scanners 208 are configured to take one or more images covering a 360-degree view of the place for generating a plurality of 3D scanned images of the place. The database 210 may store the plurality of images, and plurality of 3D scanned images of the place. The database 210 is further configured to store a plurality of virtual 3D displays of a plurality of places, and plurality of 3D scanned images of the place. In some embodiments, the database 210 is configured to store and maintain a plurality of multimedia comprising advertisement of products/services, users’login credential information, history of the viewer 102, interest of the viewer 102, details about one or more products/services, information of the plurality of exhibition/place, virtual 3D display, the plurality of scanned images, one or more past activities of the viewer 102 while viewing the virtual 3D display, profile of the viewers. The database 210 may be located on a remote device comprising the server 108 as discussed with reference to FIG. 1.

The superimposing module 212 is configured to retrieve the plurality of 3D scanned images from the database 210. The superimposing module 212 is further configured to superimpose a two-dimensional live stream of the place onto the plurality of 3D scanned images of the place for generating a 3D live streaming of the place.

The display managing module 206 is configured to present the 3D live streaming of the place to the viewer. In some embodiments, the display managing module 206 is further configured to present a virtual 3D display of the place to the viewer 102 such that the viewer 102 feels as being part of the virtual 3D display. The virtual 3D display comprises a plurality of scanned images. In some embodiments, the display managing module 206 is configured to create the virtual 3D display based on the plurality of scanned images in real-time or non-real time. The virtual 3D display may be a scanned model of the exhibition/place. In some embodiments, the virtual 3D display and/or the 3D live stream of the place is presented to the viewer 102 via at least one of a web based system, an augmented reality device and a virtual reality device. Further, the viewer 102 may be able to view the virtual 3D display by using at least one of an augmented reality device or a virtual reality device.

In some embodiments, the 3D live streaming is generated and presented to the viewer 102 in real-time. In some embodiments, the 3D live streaming is presented to the viewer 102 via at least one of a web based system, an augmented reality device and a virtual reality device.

FIG. 3 illustrates a flowchart of a method 300 for presenting a 3D live streaming of a place, in accordance with an embodiment of the present disclosure. As discussed with respect to FIG. 2, the 3D live streaming system 202 enables the viewer 102 to view an online 3D live streaming of the place.

The method initiates at step 302, a viewer, such as the viewer 102, may be authorized by the access managing module 204 of the 3D live streaming system 202 based on a valid login credential. The viewer may select a place of which the viewer wants to see a virtual view.

Then at step 304, the superimposing module 212 retrieves a plurality of 3D scanned images from the database 210. Then at step 306, the superimposing module 212 superimposes a two-dimensional live stream of the place with the retrieved plurality of 3D scanned images of the place for generating a 3D live streaming of the place.

Thereafter at step 308, the display managing module 206 presents the 3D live streaming of the place to the viewer 102. In some embodiments, the viewer 102 views the 3D live streaming of the place by using at least one of a web-based system, an augmented reality (AR) system, and a virtual reality (VR) system.

The present disclosure provides a system for live 3D streaming of an exhibition, which enables the viewer to view the product in the exhibition with more clarity and depth. The products in 3D live streaming looks more realistic.

The present disclosure provides a more realistic view of products within the 3D live stream of a place. The products may be at display in the place. The viewer can see exact depth, color, texture, height, length, and other details of the products. The 3D live streaming may be viewed by the viewer by using a web-based display system, a virtual reality system, an augmented reality system, a virtual 3D display system, and the like.

The present disclosure provides a system for superimposing already captured scanned images of a place with a 2D stream of the place for generating a 3D live stream of the place.

Embodiments of the disclosure are also described above with reference to flowchart illustrations and/or block diagrams of methods and systems. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, may be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the acts specified in the flowchart and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the acts specified in the flowchart and/or block diagram block or blocks. The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operations to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the acts specified in the flowchart and/or block diagram block or blocks.

In addition, methods and functions described herein are not limited to any particular sequence, and the acts or blocks relating thereto can be performed in other sequences that are appropriate. For example, described acts or blocks may be performed in an order other than that specifically disclosed, or multiple acts or blocks may be combined in a single act or block.

While the invention has been described in connection with what is presently considered to be the most practical and various embodiments, it is to be understood that the invention is not to be limited to the disclosed embodiments, but on the contrary, is intended to cover various modifications and equivalent arrangements.

Claims

A three-dimensional live streaming system comprising:

a database configured to store a plurality of three-dimensional scanned images of a place, wherein the plurality of scanned images are captured by a plurality of scanners to cover a 360 degree view of the place;

a superimposing module configured to:

retrieve the plurality of pre-scanned images of the place; and

superimposing a two-dimensional live stream of the place with the plurality of 3D scanned images for generating a 3D live streaming of the place; and

a display managing module configured to present the 3D live streaming to the viewer.
The three-dimensional live streaming system of claim 1 further comprising an access managing module configured to authorize the viewer based on a valid login credential for viewing the 3D live streaming of the place.
The system of claim 1, wherein the display managing module is further configured to present a virtual 3D display of the place to the viewer such that the viewer feels as being part of the virtual 3D display.
The system of claim 1, wherein the 3D live streaming is generated and presented to the viewer in real-time.
The system of claim 1, wherein the database is further configured to store and maintain users’ login credential information, 3D live streaming of a plurality of places, the plurality of 3D scanned images of the places, history of the viewer, interest of the viewer, details about one or more products/services, information of the plurality of exhibition/place, virtual 3D display, the plurality of scanned images, one or more past activities of the viewer while viewing the virtual 3D display.
The system of claim 1, wherein the database is located on a remote device comprising a server.
The system of claim 1, wherein the 3D live streaming is presented to the viewer via at least one of a web based system, an augmented reality device and a virtual reality device.
A method for three-dimensional live streaming of a place, comprising:

retrieving a plurality of pre-stored scanned images of the place from a database;

generating a 3D live streaming of the place by superimposing a two-dimensional live stream of the place with the plurality of 3D scanned images; and

presenting the 3D live streaming to the viewer.
The method of claim 8 further comprising presenting a virtual 3D display of the place to the viewer such that the viewer feels as being part of the first virtual 3D display.
The method of claim 8 further comprising authorizing the viewer based on a valid login credential for viewing the 3D live streaming of the place.
The method of claim 8 further comprising storing and maintaining, by a database, users’ login credential information, the plurality of scanned 3D images of the place, history of the viewer, an interest of the viewer, details about one or more products/services, information of the plurality of exhibition/place, virtual 3D display, the plurality of scanned images, one or more activities of the viewer while viewing the virtual 3D display.
The method of claim 8, wherein the database is located on a remote device comprising a server.
The method of claim 8, wherein the 3D live streaming is presented to the viewer via at least one of a web based system, an augmented reality device and a virtual reality device.