TWI652582B - File sharing system and method based on virtual reality/amplification reality combined with instant messaging service - Google Patents

Abstract

An embodiment of the present invention provides a file sharing system and method based on virtual reality / augmented reality and combining instant messaging services. The file sharing system includes a first client, a cloud server, and at least one second client And the file sharing system is not exactly the same as the existing Internet chat room application, but provides a way to present files using virtual reality technology, augmented reality technology, or augmented reality technology. Content chat rooms, so the file sharing system and method of the embodiments of the present invention will enable people to have a more immersive experience and better interactive effects.

Description

   File sharing system and method based on virtual reality / augmented reality and combining instant messaging service   

The invention relates to a file sharing system and method, and in particular to a file sharing system and method based on virtual reality / augmented reality (VR / AR) and combined with instant messaging (IM) services. File sharing system and method.

In recent years, due to the popularity of network applications, network chat rooms using instant messaging services have clearly become a trend of interpersonal communication. Generally, users can upload and distribute the information content they want to recommend or share to this online chat room to share with all friends in this online chat room. However, for friends who are in this online chat room, these information contents are usually still expressed by text, photos, voice, or video, so it is difficult for people to deeply understand what the distributors want to recommend or share. Feelings.

For example, when a user wants to recommend or share a special scenic spot, the user can often only take a picture or photograph of the special scenic spot, and then upload the photographed or photographed result to an online chat room for share it. However, since the results of these photos or photography are only fixed video and audio content, and cannot achieve interactive effects, even if friends in the online chat room can watch these photos or photography results, but Still can't make people experience this special attraction as if they were there.

An embodiment of the present invention provides a file sharing system based on virtual reality / augmented reality and combining instant messaging services. The file sharing system includes a first client, a cloud server, and at least one second client. The cloud server is used to generate at least one Instant Message channel, and a registration operation is performed to the instant message channel through the first client, thereby enabling the cloud server to establish an online chat accordingly. Room, and the second client terminal joins the online chat room by an invitation instruction, and through the online chat room, the first client terminal and the second client terminal are engaged in a conversation. During the meeting, the cloud server will receive at least one file content from the first or second client, and transmit the file content to the corresponding second or first client, so that the first or The second client is used to selectively decide whether to use the associated electronic display device to open the file content.

Preferably, the archive content may be expressed as 720-degree augmentation and virtual reality image data associated with an environmental space, or 720-degree three-dimensional (3D) data associated with the environmental space; or alternatively, the archive content It can be represented as 3D model data associated with a product.

An embodiment of the present invention further provides a file sharing method based on virtual reality / augmented reality and combined with an instant messaging service, which is executed in a file sharing system. The file sharing system includes a first client and a cloud server. And at least one second client, and the file sharing method includes the following steps. First, the cloud server is used to generate at least one instant messaging channel, and the first client is used to perform a registration action on the instant communication channel, thereby enabling the cloud server to establish an online chat room accordingly. Then, a second client is invited to join this online chat room, and the first and second clients are allowed to conduct a meeting by using this online chat room. During the meeting, the cloud server receives the first or second client. The content of at least one file of the two clients, and transmitting the content of the file to the corresponding second or first client, so that the first or second client can selectively determine whether to use its associated Electronic display device to open the contents of this file.

Preferably, the archive content may be expressed as 720-degree augmentation and virtual reality image data associated with an environmental space, or 720-degree three-dimensional (3D) data associated with the environmental space; or alternatively, the archive content It can be represented as 3D model data associated with a product.

In summary, the file sharing system and method based on the virtual reality / augmented reality and combined with the instant messaging service provided by the embodiments of the present invention are not completely the same as the existing online chat room applications. Instead, it provides an online chat room that can use virtual reality technology, augmented reality technology, or augmented reality technology to present file content. Therefore, the file sharing system and method of the embodiment of the present invention will enable People have more immersive experiences and better interaction effects.

In order to further understand the features and technical contents of the present invention, please refer to the following detailed description and accompanying drawings of the present invention, but these descriptions and attached drawings are only used to illustrate the present invention, not the right to the present invention. No limitation on scope.

10‧‧‧File Sharing System

101‧‧‧first client

103‧‧‧ Cloud Server

105‧‧‧Second Client

CH_1 ~ CH_N‧‧‧ IM channel

110‧‧‧Internet chat room

101a, 105a‧‧‧ electronic display device

107‧‧‧ Operator server

201, 301, 401‧‧‧ archive contents

30‧‧‧ Real Space Image

310‧‧‧table

320, 420‧‧‧ indicators

40‧‧‧Virtual space image

410‧‧‧Vase

S501 ~ S507, S601, S701‧‧‧Process steps

FIG. 1 is a schematic diagram of a file sharing system based on virtual reality / augmented reality and combining instant messaging services according to an embodiment of the present invention.

FIG. 2A is a schematic diagram of presenting information in an online chat room of the file sharing system of FIG. 1 under the first preferred embodiment.

FIG. 2B is a schematic diagram of browsing file content performed by the electronic display device under the first preferred embodiment of the file sharing system of FIG. 1.

FIG. 3A is a schematic diagram of presenting information in an online chat room in the file sharing system of FIG. 1 under a second preferred embodiment.

FIG. 3B is a schematic diagram of browsing file content performed by the electronic display device under the second preferred embodiment of the file sharing system of FIG. 1. FIG.

FIG. 4A is a schematic diagram of presenting information in an online chat room in the file sharing system of FIG. 1 under a third preferred embodiment.

FIG. 4B is a schematic diagram of browsing file content performed by the electronic display device under the third preferred embodiment of the file sharing system of FIG. 1.

4C is a schematic diagram of another browsing of the file content performed by the electronic display device under the third preferred embodiment of the file sharing system of FIG. 1.

5 is a schematic flowchart of a file sharing method based on a virtual reality / augmented reality and combined with an instant messaging service according to an embodiment of the present invention.

FIG. 6 is a schematic flowchart of a file sharing method based on virtual reality / augmented reality and combined with an instant messaging service according to another embodiment of the present invention.

7 is a schematic flowchart of a file sharing method based on a virtual reality / augmented reality and combined with an instant messaging service according to another embodiment of the present invention.

Hereinafter, the present invention will be described in detail by explaining various embodiments of the present invention with drawings. However, the inventive concept may be embodied in many different forms and should not be construed as limited to the exemplary embodiments set forth herein. Moreover, the same reference numbers may be used in the drawings to indicate similar elements.

First, please refer to FIG. 1. FIG. 1 is a schematic diagram of a file sharing system based on a virtual reality / augmented reality and combined with an instant messaging service according to an embodiment of the present invention. The file sharing system 10 mainly includes a first client 101, a cloud server 103, and at least one second client 105. The first client 101, the cloud server 103, and the second client 105 can be connected to an Internet (not shown) through at least one network protocol interface (not shown), respectively. . In addition, it is worth mentioning that in order to facilitate the following description, the second user terminal 105 in the embodiment of the present invention is described by using only one example, but it is not intended to limit the present invention.

In detail, the cloud server 103 is configured to generate at least one instant messaging channel CH_1 ~ CH_N (that is, N is any positive integer greater than or equal to 1), and pass the first client 101 to the instant messaging channel CH_i (also That is, i is equal to any positive integer from 1 to N) to perform a registration action, so that the cloud server 103 establishes an online chat room 110 accordingly, and the second client 105 uses an invitation instruction (not (Illustrated) to join the online chat room 110, and through the online chat room 110, the first client 101 and the second client 105 can be allowed to have a talk. It is worth noting that, in practice, the embodiment of the present invention does not limit the specific implementation manner in which the second user terminal 105 joins the online chat room 110.

For example, the invitation instruction may be, for example, an invitation message sent by the first client 101 to the second client 105 via the Internet. After receiving the invitation message, the second client 105 may follow the invitation message. Subsequent instructions are added to this online chat room 110 to talk with the first client 101, or, in other embodiments, the invitation instruction may also be, for example, that the second client 105 finds this online chat room A request message that is actively sent at 110 hours, and after the first client 101 (that is, the initiator of the online chat room 110) receives and agrees to the request message, the second client 105 can follow the follow-up The instruction is added to the online chat room 110 to have a meeting with the first client 101. All in all, the specific implementation methods used above are just examples, and they are not intended to limit the present invention. Those with ordinary knowledge in the technical field should be able to design the network chat room 110 according to actual needs or applications. . In addition, since the operation principle of the Internet chat room 110 is known to those having ordinary knowledge in the technical field, detailed descriptions thereof will not be repeated here.

In short, according to the teachings of the above content, those with ordinary knowledge in the technical field should understand that the cloud server 103 is a server device with cloud management functions, and the first client 101 and the second client 105 can be regarded as electronic devices of a user added to the online chat room 110 respectively. Therefore, in practice, the first client terminal 101 and the second client terminal 105 may be, for example, a mobile communication device, a desktop computer, a notebook computer, or a tablet computer; or, alternatively, the first client terminal The 101 and the second client 105 may also be directly, for example, a head-mounted display (ie, the electronic display devices 101a, 105a). All in all, the present invention is not limited thereto.

In one of the applications, during this meeting, the cloud server 103 receives at least one file content (not shown) from the first client 101 or the second client 105, and transmits the file content to all In the corresponding second client terminal 105 or the first client terminal 101, the first client terminal 101 or the second client terminal 105 is used to selectively decide whether to use the associated electronic display devices 101a and 105a to turn on. Content of this file. Among them, it is worth mentioning that the file content can be expressed as 720-degree augmentation and virtual reality image data associated with an environmental space, or 720-degree three-dimensional (3D) data associated with the environmental space; or The content of the file may be expressed as 3D model data associated with a product, but the present invention is not limited thereto.

In addition, in another application, the file sharing system 10 may further include at least one operator server 107, and the operator server 107 is used to provide the file content, and the cloud server 103 may simultaneously upload the file The content is transmitted to the first client 101 and the second client 105, respectively, so that the first client 101 or the second client 105 can be used to selectively decide whether to use its associated electronic display devices 101a, 105a To open the contents of this file.

However, it is worth noting that, no matter in which of the above applications, when the first client 101 or the second client 105 has decided to use its associated electronic display device 101a, 105a to open this file content, the electronic The display device 101a or the electronic display device 105a can further provide browsing of the file content in a virtual reality mode, an augmented reality mode, or an augmented virtuality mode. It should be understood that the above applications are only a part of the multiple applications of the present invention, and the present invention is not limited to the above applications.

Next, the following describes the file sharing system provided by the embodiments of the present invention with multiple embodiments and diagrammatic descriptions. It should be understood, however, that the inventive concept may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein.

[First Preferred Embodiment]

Please refer to FIGS. 2A to 2B at the same time. FIGS. 2A and 2B are the first preferred embodiments of the file sharing system 10 according to the embodiment of the present invention. Among them, FIG. 2A is a schematic diagram of presenting information in an online chat room under the first preferred embodiment of the file sharing system of FIG. 1, and FIG. 2B is an electronic presentation of the file sharing system of FIG. 1 under the first preferred embodiment. A schematic diagram of browsing the file content performed by the device.

For example, in the first preferred embodiment, the first client 101 may be, for example, a computer host of a house seller, and the online chat room 110 is for the house seller to effectively recommend or An online chat room platform established by sharing at least one house object, and the second client 105 may be, for example, a mobile communication device of a buyer who joins the online chat room 110. Among them, when the first client 101 wants to recommend or share a certain house object (that is, a certain environmental space), the first client 101 can expand and virtualize a 720 degree associated with the house object. The file content 201 of the real-world image data (or a 720-degree three-dimensional data) is uploaded and distributed to this online chat room 110 for sharing. Therefore, the second client 105 can learn from the online chat room 110 that the first client 101 has shared the information of the file content 201, as shown in FIG. 2A. That is, when the cloud server 103 receives the file content 201 from the first client 101, the cloud server 103 transmits the file content 201 to the corresponding second client 105.

Then, the second client 105 can selectively decide whether to open the file content 201 according to the user's personal wishes or needs. When the second client 105 has decided to open the file content 201, the second client 105 then uses its associated electronic display device 105a to open the file content 201. Therefore, in this embodiment, the electronic display device 105 a may be, for example, the head-mounted display illustrated in FIG. 1, but the present invention is not limited thereto. In addition, the second user terminal 105 and the electronic display device 105a may transmit data through a wired or wireless method, and the second user terminal 105 and the electronic display device 105a may also be integrated at the beginning. Or they may be provided separately, but the present invention is not limited thereto. In summary, the present invention does not limit the specific implementation of the electronic display device 105a. However, since the operation principle of the head-mounted display (ie, the electronic display device 105a) is well known to those having ordinary knowledge in the technical field, detailed descriptions thereof will not be repeated here.

In addition, as described above, the file content 201 is represented as 720-degree augmented and virtual reality image data (or 720-degree three-dimensional data) associated with the house object. Therefore, in the first preferred embodiment, when the second client 105 has decided to use its associated electronic display device 105a to open the file content 201, the electronic display device 105a will then provide a virtual The content mode 201 is browsed in the real mode, as shown in FIG. 2B. However, since the technical principle of the virtual reality mode is known to those having ordinary knowledge in the technical field, the detailed content will not be repeated here.

According to the teachings of the above content, those with ordinary knowledge in the technical field should understand that one of the main spirits of the present invention is to use an Internet chat room 110 with an instant messaging service to perform the connection to a certain environmental space. 720-degree augmented and virtual reality image data (or 720-dimensional three-dimensional data) file content 201, and the user agrees to open this 720-degree augmented and virtual reality image data (or 720-dimensional three-dimensional data) file Content 201, further enabling the client to browse the 720-degree augmented and virtual reality image data (or 720-degree three-dimensional data) file content 201 through the virtual reality mode provided by an electronic display device 105a. In this way, the user terminal can experience the environment space as if it were immersive, and then provide a more human-like interactive experience.

However, it should be understood that the file content 201 may also be uploaded to the online chat room 110 via the second client 105 for sharing. That is, when the cloud server receives the file content 201 from the second client 105, the cloud server 103 transmits the file content 201 to the corresponding first client 101, and causes the first The client 101 may selectively decide whether to use the associated electronic display device 101a to open the file content 201. Therefore, when the first client 101 has also decided to use its associated electronic display device 101a to open the file content 201, the electronic display device 101a will similarly provide a virtual reality mode for performing file content 201. Browse. In addition, the first client terminal 101 and the second client terminal 105 should each have at least one memory unit (not shown) to record the uploaded file contents 201. Therefore, in the embodiment, no matter whether the uploader of the file content 201 is the first client 101 or the second client 105, the uploader will still be able to choose whether to perform the file processing through the built-in memory unit. Read the content 201, and use the associated electronic display devices 101a, 105a to open the file content 201.

On the other hand, if the first client 101 and the second client 105 are considered, for example, they may be ordinary consumers that are added to the online chat room 110, respectively. Therefore, the file sharing system 10 may further include at least one server 107. Among them, the vendor server 107 can be provided by, for example, a real estate agent, and the vendor server 107 can be used to provide 720-degree augmentation and virtual reality image data related to a certain house object. (Or 720-degree three-dimensional data) file content 201, and the cloud server 103 simultaneously transmits this file content 201 to the first client 101 and the second client 105, respectively, so that the first client 101 or The second client terminal 105 is used to selectively determine whether to use the associated electronic display devices 101a and 105a to open the file content 201. It is worth noting that the vendor server 107 may be integrated in the cloud server 103 at the beginning, or the vendor server 107 may be established by the real estate vendor after joining the online chat room 110 Up. In a word, the embodiment of the present invention does not limit the specific implementation manner of the server 107 related to the supplier. In addition, the application here is not intended to limit the present invention.

[Second Preferred Embodiment]

Next, please refer to FIG. 3A to FIG. 3B together. FIG. 3A and FIG. 3B are second preferred embodiments of the file sharing system 10 according to the embodiment of the present invention. Among them, FIG. 3A is a schematic diagram of presenting information in an online chat room under the second preferred embodiment of the file sharing system of FIG. 1, and FIG. 3B is an electronic representation of the file sharing system of FIG. 1 under the second preferred embodiment. A schematic diagram of browsing the file content performed by the device.

In the embodiments of FIGS. 3A and 3B, when the first client 101 wants to recommend or share a specific product (for example, the table 310 in FIG. 3B), the first client 101 may associate the specific client with the specific product. The file content 301 of the 3D model data of the product is uploaded to this online chat room 110 for sharing. Therefore, the second client 105 can learn from the online chat room 110 that the first client 101 has shared the information of the file content 301, as shown in FIG. 3A. Among them, it is worth noting that, in practice, the format of this 3D model data can be, for example, OBJ or FBX. In a word, the embodiment of the present invention does not limit the specific implementation of the 3D model data related to this specific product.

In the same way, the second client terminal 105 can selectively determine whether to associate the electronic display device 105a to open the file content 301 according to the user's personal wishes or needs. However, because the file content 301 here is represented as the 3D model data associated with this particular product. Therefore, in the second preferred embodiment, when the second client 105 has decided to use the associated electronic display device 105a to open the file content 301, the electronic display device 105a will further provide an augmentation based on this. Browse the file content 301 in the real mode, as shown in FIG. 3B. Among them, since the technical principle of the augmented reality mode is known to those having ordinary knowledge in the technical field, detailed descriptions thereof will not be repeated here.

Simply put, augmented reality technology can display a virtual object in a real environment image, and calculate the position and angle (direction) of the electronic display device 105a in real time and change the viewing of the virtual object in real time according to the information generated by the user operation. angle. In other words, the main purpose of augmented reality technology is to put a virtual object in a real world for interaction. Therefore, according to the teachings of the above content, those with ordinary knowledge in the technical field should understand that when the electronic display device 105a is a When browsing the file content 301 in the augmented reality mode, the file sharing system 10 should further include an image processing unit (not shown). The image processing unit is used to capture a real space image 30 of the environment in which the electronic display device 105a is located, and according to an index position of the real space image 30 selected by an indicator 320, to use this specific product The 3D model data (ie, the file content 301) is combined into the index position of the real space image 30, and the combined image is displayed in the electronic display device 105a, as shown in FIG. 3B. It is worth noting that the image processing unit here may be, for example, a camera device, and the camera device may be integrated on the electronic display device 105a, or may be disposed separately from each other. In a word, the embodiments of the present invention do not limit the specific implementation of the image processing unit.

Therefore, obviously, in this augmented reality mode, the user can operate an indicator 320 through the electronic display device 105a, and thereby make the 3D model data (for example, the table 310) of a virtual object be displayed and integrated with this real At a specific position in the spatial image 30. In other words, according to the teachings of the above content, those with ordinary knowledge in the technical field should understand that one of the main spirits of the present invention is to use an Internet chat room 110 with an instant messaging service to perform association with a specific product. (I.e., virtual object) sharing of the file content 301 of the 3D model data, and when the client agrees to open the file content 301 of the 3D model data, so that the client can use the augmentation provided by an electronic display device 105a Real-world mode to browse to the file content 301 of this 3D model data. In this way, the user terminal can more easily browse the images displayed in the real environment of this specific product, and view the placement feeling in a preferred position in the real environment, so as to further clearly understand the characteristics of this specific product.

Similarly, the file content 301 may be uploaded to the online chat room 110 via the second client 105 for sharing. That is, when the cloud server receives the file content 301 from the second client 105, the cloud server 103 transmits the file content 301 to the corresponding first client 101, and makes the first The client 101 may selectively decide whether to use its associated power The sub display device 101a opens the file content 301. Therefore, when the first client 101 has also decided to use its associated electronic display device 101a to open the file content 301, the electronic display device 101a will similarly provide the file content 301 in an augmented reality mode. Browse. In addition, in the second preferred embodiment, the vendor server 107 may be provided by, for example, a furniture vendor, and the vendor server 107 may be similarly used to provide information related to a specific product. The file content 301 of the 3D model data, and causes the cloud server 103 to simultaneously transmit the file content 301 to the first client 101 and the second client 105, so that the first client 101 or the second user The terminal 105 is used to selectively decide whether to use the associated electronic display devices 101a, 105a to open the file content 301.

On the other hand, it should be understood that in the application of the above-mentioned augmented reality mode, the virtual objects applied in the real world should not be limited to 3D model data for a specific commodity. That is, the file content 301 can also be represented as, for example, a 3D surround sound effect data. Therefore, in the embodiment, the user can also operate an indicator 320 through the electronic display device 105a, and integrate a 3D surround sound effect data into the index position of the real space image 30. All in all, the application here is not the same to limit the present invention.

[Third Preferred Embodiment]

In addition, please refer to FIG. 4A to FIG. 4B together. FIG. 4A and FIG. 4B are the third preferred embodiment of the file sharing system 10 according to the embodiment of the present invention. Among them, FIG. 4A is a schematic diagram of presenting information in an online chat room under the third preferred embodiment of the file sharing system of FIG. 1, and FIG. 4B is an electronic representation of the file sharing system of FIG. 1 under the third preferred embodiment. A schematic diagram of browsing the file content performed by the device.

In the embodiments of FIGS. 4A and 4B, when the first client 101 wants to similarly recommend or share a specific product (for example, the vase 410 in FIG. 4B), the first client 101 will associate the The file content 401 of the 3D model data of this specific product is uploaded to this online chat room 110 for sharing. As a result, the second client 105 can learn from this online chat room 110 that the first client 101 has been divided. Share the message of this file content 401, as shown in Figure 4A. However, because the file content 401 here is also only represented as 3D model data associated with a specific product. Therefore, in the third preferred embodiment, when the second client 105 has also decided to use the associated electronic display device 105a to open the file content 401, the electronic display device 105a may also provide additional An augmented reality mode is used to browse the file content 401, as shown in FIG. 4B.

In short, the augmented reality technology can display a virtual object in a virtual environment image, and calculate the position and angle (direction) of the electronic display device 105a in real time according to the information generated by the user operation and change the viewing of the virtual object in real time. angle. In other words, compared with the main purpose of augmented reality technology, the main purpose of augmented reality technology is to put a virtual object in a virtual world for interaction. Therefore, obviously, in this augmented reality mode, the electronic display device 105a must first generate a virtual space image 40 before the user can operate an indicator 420 through the electronic display device 105a, and thereby make the The 3D model data of the specific product (for example, the vase 410 in FIG. 4B) is placed and combined at a specific position in the virtual space image 40, as shown in FIG. 4B.

However, it is worth noting that the embodiment of the present invention does not limit the specific implementation of the generated virtual space image 40. For example, in an application equipped with the first preferred embodiment at the same time, the virtual space image 40 can be, for example, a 720-degree augmentation and virtual reality of an environment space that the first client 101 has previously uploaded. The file content 401 of the environment image data, and when the second client 105 has also used its associated electronic display device 105a to open the file content 401 of the 720-degree augmented and virtual reality image data (such as (As shown in FIG. 4A), if the second client 105 again decides to use its associated electronic display device 105a to open the file content 401 of the 3D model data associated with this specific product, the electronic display device 105a may directly The 3D model data of this specific commodity is integrated into a specific position in the file content 401 (ie, the virtual space image 40) of the 720-degree augmented and virtual reality image data, as shown in FIG. 4B.

In this way, compared with augmented reality technology, the file sharing system 10 of the present invention simultaneously satisfies the characteristics that can make a virtual object and a virtual world mutually combine (that is, augmented reality technology ) To provide more diversified modes of operation.

Similarly, the file content 401 may be uploaded to the online chat room 110 via the second client 105 for sharing. That is, when the cloud server receives the file content 401 from the second client 105, the cloud server 103 sends the file content 401 to the corresponding first client 101, and makes the first The client 101 can selectively decide whether to use its associated electronic display device 101a to open the file content 401. Therefore, when the first client 101 has also decided to use its associated electronic display device 101a to open the file content 401, the electronic display device 101a will similarly provide the file content 401 in an augmented virtual mode. Browse. All in all, the application here is not the same to limit the present invention.

It should be noted that, the embodiments of the present invention do not limit the conditions of the electronic display device when providing the augmented reality mode or augmented virtual mode to browse the file content associated with a specific product. In other words, the user can also selectively control whether the electronic display device is in an augmented reality mode or an augmented reality mode to browse the content associated with the file according to personal wishes or needs. For example, in the third preferred embodiment, when the second client 105 has also decided to use the associated electronic display device 105a to open the file content 401 associated with this specific product (ie, the vase 410) The electronic display device 105a may also choose to provide an augmented reality mode for browsing the file content 401 according to the user's personal wishes or needs, as shown in FIG. 4C. That is to say, in this augmented reality mode, the user can operate the indicator 420 through the electronic display device 105a, and thereby make the 3D model data of this specific product be combined with one of the real space images 30 At a specific location.

On the other hand, as described in the foregoing, the second user terminal 105 may also be, for example, the head-mounted display illustrated in FIG. 1 (that is, the electronic display device 105a). Therefore, when the above situation is true, those with ordinary knowledge in the technical field should understand that users will also be able to directly use the head-mounted display to conduct conversations in online chat rooms. That is to say, the user can directly upload the content of the file to the online chat room for sharing by operating the head-mounted display (for example, the operation of voice or gesture).

[Example of File Sharing Method]

Finally, in order to further explain the operation flow of the file sharing system 10, the present invention further provides an implementation manner of the file sharing method. Please refer to FIG. 5. FIG. 5 is a schematic flowchart of a file sharing method based on virtual reality / augmented reality and combined with an instant messaging service according to an embodiment of the present invention. The method described in this example can be executed in the file sharing system 10 shown in FIG. 1, so please refer to FIG. 1 to FIG. 4B together for better understanding. In addition, the detailed step flow is as described in the previous embodiment, so it will only be outlined here and will not be described in detail.

First, in step S501, at least one instant messaging channel is generated by using a cloud server. Secondly, in step S503, the first client is used to perform a registration operation to the instant messaging channel, thereby enabling the cloud server to establish an online chat room accordingly. Next, in step S505, the second client is invited to join the online chat room, and the first and second clients are allowed to conduct a meeting by using the online chat room. Finally, in step S507, during the meeting, the cloud server receives at least one file content from the first or second client, and transmits the file content to the corresponding second or first client In this case, the first client or the second client is used to selectively decide whether to use the associated electronic display device to open the file content.

In addition, as mentioned above, the content of the file may be expressed as 720-degree augmented and virtual reality image data associated with an environmental space, or 720-degree three-dimensional (3D) data associated with the environmental space; Alternatively, the archive content may be represented as 3D model data related to a certain product. In a word, the embodiments of the present invention are not limited thereto.

On the other hand, please refer to FIG. 6, which is a schematic flowchart of a file sharing method based on virtual reality / augmented reality and combined with an instant messaging service according to another embodiment of the present invention. Among them, a part of the process steps in FIG. 6 that are the same as those in FIG. 5 are marked with the same drawing numbers, so details thereof will not be described in detail here. In short, compared to the file sharing in FIG. 5, the file sharing in FIG. 6 takes into account at least one server of the industry. Therefore, the embodiment of FIG. 6 further includes step S601. In step S601, during the talk, the cloud server will receive the file content provided by at least one server of the server, and simultaneously transmit the file content to the first and second clients, respectively, so that The first or second client is used to selectively decide whether to use the electronic display device associated with it to open the file content.

Therefore, according to the teachings of the above content, those with ordinary knowledge in the technical field should understand that steps S507 and S601 should be performed in parallel without conflict. In addition, it should be understood that, whether in the file sharing method of FIG. 5 or FIG. 6 above, when the first or second client has decided to use its associated electronic display device to open the file content, the electronic The display device will provide browsing of the file content in a virtual reality mode, an augmented reality mode, or an augmented reality mode.

Further, please refer to FIG. 7, which is a schematic flowchart of a file sharing method based on virtual reality / augmented reality and combined with an instant messaging service according to another embodiment of the present invention. Among them, a part of the process steps in FIG. 7 that are the same as those in FIG. 5 are marked with the same drawing numbers, so the details are not described in detail here. In short, compared to the file sharing in Fig. 5, the file sharing in Fig. 7 takes into account the application principle of the augmented reality model. Therefore, the embodiment of FIG. 7 may further include step S701. Wherein, in step S701, when the electronic display device is provided to browse the file content in the augmented reality mode, the file sharing method will use an image processing unit to capture the environment where the electronic display device is located. A real space image, and an index position of the real space image selected according to an indicator, used to combine this file content with the index position of the real space image, and display the combined image in This electronic display device.

In summary, the file sharing system and method based on the virtual reality / augmented reality and combined with the instant messaging service provided by the embodiments of the present invention are not completely the same as the existing online chat room applications. Instead, it provides an online chat room that can use virtual reality technology, augmented reality technology, or augmented reality technology to present file content. Therefore, the file sharing system and method of the embodiment of the present invention will enable People have more immersive experiences and better interaction effects.

The above description is only an embodiment of the present invention, and is not intended to limit the patent scope of the present invention.

Claims (8)

A file sharing system based on Virtual Reality / Augmented Reality (VR / AR) and combined with Instant Message (IM) services, including: a first client; a cloud server Device for generating at least one Instant Message channel, and performing a registration action to the instant messaging channel through the first client, thereby enabling the cloud server to establish an online chat accordingly Room (Network chat room); and at least one second client, which is added to the online chat room by an invitation instruction, and through the online chat room, the first client and the second client end with A talk is held, and during the talk, the cloud server receives one or more video file contents from the first or the second client in the online chat room, and The video file content is transmitted to the corresponding second or first client, so that the first or the second client can be used to selectively decide whether to use an electronic display device associated with it. Setting to open the video file content; wherein the one or more video file contents are represented as one or more 720 degrees of one or more real environment space images associated with one or more environment spaces in which the electronic display device is located Augmented and virtual reality image data, or one or more 720-degree three-dimensional (3D) data associated with the one or more environmental spaces; or, the content of the video file is displayed as being associated with the display of the electronic display device One or more 3D model data of one or more real product images; wherein when the first client and / or the second client continuously play the one or more real environments uploaded to the online chat room The one or more audio and video file contents of the spatial image, the first client and / or the second client then simultaneously play the one or more of the one or more real product images uploaded to the online chat room The contents of each video file, the electronic display device places each real product image in the one or more real space images according to one or more indicators output by the first client and / or the second client of A position indicator. The file sharing system according to item 1 of the claim further includes: at least one operator server for providing the content of the video file, and the cloud server simultaneously transmits the content of the video file to the first And the second client, the first or the second client is used to selectively decide whether to use the electronic display device associated with it to open the content of the video file. The file sharing system according to claim 1, wherein when the first or the second client decides to use the associated electronic display device to open the video file content, the electronic display device will It further provides browsing of the contents of the video and audio file in a virtual reality mode, an augmented reality mode, or an augmented virtuality mode. The file sharing system according to claim 3, wherein when the electronic display device is provided to browse the content of the audio and video file in the augmented reality mode, the file sharing system further includes: an image processing A unit for capturing a real space image of the environment in which the electronic display device is located, and an index position of the real space image selected according to an indicator for combining the content of the video file with the real space image The index position is displayed, and the combined image is displayed on the electronic display device. A file sharing method based on virtual reality / augmented reality and combined with an instant messaging service is executed in the file sharing system described in item 1 of the claim, the file sharing system includes a first client, a A cloud server and at least one second client, and the file sharing method includes using the cloud server to generate at least one instant messaging channel, and using the first client to perform a registration action to the instant messaging channel, borrow This allows the cloud server to establish an online chat room accordingly; and invites the second client to join the online chat room, and utilizes the online chat room to enable the first and second client terminals to During the talk, during the talk, the cloud server receives at least one video file content from the first or the second client in the online chat room, and the video and audio in the online chat room The file content is transmitted to the corresponding second or the first client, so that the first or the second client is used to selectively decide whether to use the associated one. Sub-display device to open the content of the video file; wherein the content of the video file is represented as 720-degree augmented and virtual reality image data associated with an environmental space, or 720-degree three-dimensional (3D) data associated with the environmental space; Or, the content of the video file is represented as 3D model data associated with a product. The file sharing method according to claim 5, further comprising: during the meeting, the cloud server receives the content of the video file provided by at least one server of the server, and simultaneously separates the content of the video file Send to the first and the second client, so that the first or the second client is used to selectively decide whether to use the electronic display device associated with it to open the video file content. The file sharing method according to claim 5, wherein when the first or the second client decides to use the associated electronic display device to open the audio and video file content, the electronic display device will It further provides browsing of the content of the video and audio file in a virtual reality mode, an augmented reality mode, or an augmented reality mode. The file sharing method according to claim 7, wherein when the electronic display device is provided to browse the content of the audiovisual file in the augmented reality mode, the file sharing method further includes: using an image The processing unit captures a real space image of the environment in which the electronic display device is located, and uses an index position of the real space image selected according to an indicator to combine the content of the audio and video file with the real space image. And the combined image is displayed on the electronic display device.