TW201918986A - Mixed reality community life circle house finding device generates an information window related to real estate on the mixed reality picture seen by the user - Google Patents

Abstract

The invention provides a mixed reality community life circle house finding device, which comprises a storage module, a virtual community life circle projection module, a sensing module, and a processing module. The sensing module is used for capturing the eye, gesture, and sound of a user, and the processing module is configured to project the projected images of the virtual community, the virtual house, and the virtual indoor image of the virtual community life circle projection module onto the fluoroscopic lenses of the mixed reality community life circle house finding device, then the user wearing the device interacts with the projected images of the virtual community, the virtual house, and the virtual indoor image on the external real scenes displayed on the fluoroscopic lenses.

Description

Mixed reality community living circle looking for a device

The present invention relates to a hybrid reality device, and more particularly to a hybrid reality device for finding a house in a community living circle.

With the rapid development of technology products, with the emergence of virtual reality (VR) and augmented reality (AR), 3C products have entered a new era and consumers have entered a new field of visual senses. Because of this, all industries and industries are thinking about how to combine VR. , AR to provide consumers with a more complete experience.

In order to allow users to find a house that meets their needs, the room owner provides a variety of search methods for buyers to find, for example, by map search, traffic network search, search for popular landmarks, etc., after finding the right item, the buyer Then, through the photographs of the houses that the prefectures took in advance to understand the house, the purpose of the transaction was achieved.

There are obvious deficiencies in the situation of the house through the use of flat photos and textual narratives, because the flat image can only be understood through the eyes, and it is impossible to visit the house as a whole. It is mainly limited by technical and network bandwidth limitations, which limits the modes consumers can use when they use a computer or other electronic device to enjoy a house.

Nowadays, the MR technology of VR, AR and hybrid has become more mature, and the mobile network bandwidth has also leapt greatly. How to make the buyer can find the room and interact with the virtual image seen through a device. The device is the direction that the industry players are striving to make breakthroughs.

In view of this, the present invention provides a hybrid real estate community living room finding device.

In order to achieve the above object, the present invention provides a hybrid reality community living circle finding device, which comprises: a storage module, which stores virtual community data, virtual house data, and virtual indoor image data; a virtual community living circle projection module; a sensing module for sensing a user's eyes, gestures, and sounds, and for generating a gaze sensing signal, a gesture sensing signal, and a sound sensing signal; and a processing module electrically connected to the storage module The virtual community living circle projection module and the sensing module, the processing module processes the virtual community data, the virtual house data, and the virtual indoor image data, and after the processing is completed, the virtual community living circle projection module will correspond to the virtual community. Data, virtual house data, and virtual indoor image data are projected onto the fluoroscopy lens of the hybrid real-world community living room finding device by virtual community image, virtual house image, and virtual indoor image projection; processing module receiving And in response to the eye-sensing signal, the gesture sensing signal and the sound sensing signal, so as to make the wearing mixed Users of the real estate community circle looking for a device can interact with virtual community projections, virtual house projections, and virtual indoor image projections.

The present invention will be explained below by way of examples, which relate to a mixed reality community living circle finding device. However, the embodiments of the present invention are not intended to limit any particular environment, application, or particular mode of carrying out the invention. Therefore, the description of the embodiments is merely illustrative of the invention and is not intended to limit the invention. It is to be noted that in the following embodiments and drawings, elements that are not directly related to the present invention have been omitted and are not shown; and for the sake of simplicity, the dimensional relationships between the elements are not drawn to scale.

It should be noted that the so-called Mixed Reality (MR) MR is an interactive type of Augmented Reality (AR) and Virtual Reality (VR), which will perform virtual effects in the real world. And can interact with reality, the present invention is based on this technical basis to provide a home-seeking device for users to carry out a mixed-real community living circle.

As shown in FIG. 1 , the present invention is a mixed reality (MR) community living circle finding device 1 , which comprises: a storage module 12 , a virtual community living circle projection module 14 , and a sensing module 16, and processing module 10.

The storage module 12 stores virtual community data 122, virtual house data 124, and virtual indoor image data 126;

Virtual community living circle projection module 14;

The sensing module 16 is configured to sense the gaze, the gesture, and the sound of the user, and generate the gaze sensing signal 101, the gesture sensing signal 103, and the sound sensing signal 105;

The processing module 10 is electrically connected to the storage module 12, the virtual community living circle projection module 14 and the sensing module 16, and the processing module 10 processes the virtual community data 122, the virtual house data 124, and the virtual indoor image data 126. After the processing is completed, the virtual community living circle projection module 14 will respectively correspond the virtual community material 122, the virtual house material 124, and the virtual indoor image data 126 to the virtual community image 132, the virtual house image 134, and the virtual indoor. The image cast image 136 is projected onto the fluoroscopic lens of the mixed reality community living circle finding device 1;

The processing module 10 receives and responds to the gaze sensing signal 101, the gesture sensing signal 103, and the sound sensing signal 105, so that the user wearing the mixed reality community living circle finding device 1 can vote with the virtual community 132. The virtual house projection image 134 and the virtual indoor image projection image 136 interact.

Among them, the implementation method of the mixed reality community living circle finding device 1 includes, but is not limited to, the MR head-mounted hybrid reality device Hololens introduced by Microsoft. Hololens is only an example, as long as it is a mixed reality based head. Wearable devices are within the scope of the invention.

As described above, the manner in which the user wearing the mixed reality community living area finding device 1 can interact with the virtual community projection image 132, the virtual housing projection image 134, and the virtual indoor image projection image 136 includes gaze, gesture, One of the sounds or any combination of the three; that is, through one of the gaze, the gesture, the sound, or any combination thereof, to control or give an instruction.

In addition to interacting with the virtual community projection image 132, the virtual housing projection image 134, and the virtual indoor image projection image 136, in addition to being able to manipulate it, an information window can be additionally generated, wherein the information window can be a dialogue window and interaction. One or a combination of menus, virtual keyboards, text, pictures, movies, animations.

The presentation manners of the virtual community projection image 132, the virtual housing projection image 134, and the virtual indoor image projection image 136 may be real-life photographs, pre-videos, live broadcast movies, virtual 3D objects, and any combination thereof.

Referring to FIG. 2, the mixed reality community living circle finding device 1 can further include a data record in addition to the storage module 12, the virtual community living circle projection module 14, the sensing module 16, and the processing module 10. The module 18 is electrically connected to the processing module 10, and the data recording module 18 is used to record the user's home search record and preferences, so as to serve as a user's future personal suitability recommendation. In the figure, the description related to Fig. 1 will not be described again.

Referring to FIG. 3, the mixed reality community living circle finding device 1 can further include a network in addition to the storage module 12, the virtual community living circle projection module 14, the sensing module 16, and the processing module 10. The module 20 is electrically connected to the processing module 10, which allows the device 1 of the present invention to be used in addition to external data. The network module 20 is also provided to allow the device 1 to be connected to other servers to receive data. The network module 20 can be connected to the server in a wired/wireless manner, so as to send and receive real estate related data from the server. In the figure, the description related to Fig. 1 will not be described again.

As shown in FIG. 4, it is an embodiment of the present invention, which is a schematic diagram of a user 8 who sees a mixed-reality community living circle finding device 1 when it is used. The experience of the device 1 of the present invention can be provided to the user 8 in a mixed reality.

When the user wears the mixed reality community living circle finding device 1 on the 8th, the front view of the mixed reality screen 300 as shown in the figure will be expanded, and the setting is set on the mixed reality community living circle finding device 1 There is a fluoroscopic lens 80, that is, the lens is fluoroscopy, so that the user 8 and the external real environment are not blocked, that is, even if the user 8 wears the device 1 still can clearly see the surrounding real environment. All of the virtual objects and information windows are projected on the fluoroscopy lens 80 for the user 8 to view, forming a virtual reality fusion experience.

In this embodiment, the user 8 sees the virtual community image 402 corresponding to the virtual community material 122 (please refer to FIG. 1 together) and the corresponding virtual house material 124 in the mixed reality screen 300 (please refer to the first section) The virtual house projection image 404 of FIG. 4 and the virtual indoor image projection image 406 corresponding to the virtual indoor image data 126 (please refer to FIG. 1 together), and the user 8 can also participate in the virtual community projection image 402 and the virtual house projection image 404. The virtual indoor image casts 406 to interact.

For example, the virtual indoor image projection image 406 of FIG. 4 is displayed in a room layout manner. When the user 8 interacts with the virtual indoor image projection image 406, the virtual indoor image projection image 406 can be played. In addition, it can also be used to further generate information windows about the room, including text introductions, pictures, videos, and animations, making it easier to find a room.

It should be noted that the figures shown in the figure are only schematic and are not accurately shown. The main purpose is to express the image content including virtual community, virtual house and virtual indoor image, and the information window will be generated after interaction. 450.

The interactive manner may be through sensing the gaze, gesture, sound or a combination thereof of the user 8, and the result of the interaction will generate an information window 450, including but not limited to the dialog window, the interactive menu, the virtual keyboard, and the text. One of or a combination of pictures, movies, animations.

Since the present invention is applied in the technical field of the real estate community living circle, the content of the information window 450 generated during the interaction is related to real estate, and the content of the information window 450 can be further referred to in Figures 5-7. Show.

In the fifth to seventh figures, the virtual community image 402, the virtual house image 404, and the virtual indoor image cast image 406 are displayed.

The information window 450 shown in Figure 5 is the basic information about the house 4501; the sixth picture is about the functional facilities of the community living area around the house 4502 and the house price chart 4503; the seventh picture shows the community living circle around the house Eat and drink information 4504 and related comments 4505.

The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the present invention; all other equivalent changes or modifications which are not departing from the spirit of the present invention should be included in the following patents. Within the scope.

1‧‧‧Mixed reality community living circle looking for a device

10‧‧‧Processing module

12‧‧‧ Storage Module

14‧‧‧Virtual Community Living Circle Projection Module

16‧‧‧Sensor module

18‧‧‧Data Recording Module

20‧‧‧Network Module

122‧‧‧Virtual Community Information

124‧‧‧Virtual Housing Information

126‧‧‧Virtual indoor imagery

101‧‧‧ eye-sensing signal

103‧‧‧ gesture sensing signal

105‧‧‧Sound sensing signal

132‧‧‧Virtual community image

134‧‧‧Virtual housing projection

136‧‧‧Virtual indoor image projection

8‧‧‧Users

80‧‧‧Perspective lenses

300‧‧‧ Mixed reality screen

402‧‧‧Virtual community image

404‧‧‧Virtual Housing Project

406‧‧‧Virtual indoor image projection

450‧‧‧Information window

4501‧‧‧House Information Information Window

4502‧‧‧Information window of functional facilities in the community life circle around the house

4503‧‧‧House price chart information window

4504‧‧‧Houses around the community life circle eat and drink information window

4505‧‧‧Residential community living circle comment information window

The first picture is a schematic diagram of the equipment for finding a house in a mixed reality community living circle; the second picture is another schematic diagram of a device for finding a house in a mixed reality community living circle; the third picture is a device for finding a house in a mixed reality community living circle. FIG. 4 is an embodiment of the present invention, which is a schematic diagram of a user who sees a device in a mixed-reality community living circle to find a house when it is used; FIG. 5 is an implementation In the example, the screen of the virtual projection and information window is shown; FIG. 6 is a screen representation of the virtual projection and information window in the embodiment; and FIG. 7 is a screen representation of the virtual projection and information window in the embodiment.

Claims (8)

A mixed reality community living circle finding device comprises: a storage module storing a virtual community data, a virtual house data and a virtual indoor image data; a virtual community living circle projection module; a sensing module a group for sensing a user's gaze, a gesture, and a sound, and correspondingly generating a gaze sensing signal, a gesture sensing signal, and a sound sensing signal; and; a processing module, The storage module, the virtual community living circle projection module and the sensing module are connected, and the processing module processes the virtual community data, the virtual house data and the virtual indoor image data, and after the processing is completed, the The virtual community living circle projection module projects the corresponding virtual community data, the virtual house data, and the virtual indoor image data into a virtual community image, a virtual house image, and a virtual indoor image. The hybrid reality community living circle finding device can be seen on the lens; the processing module receives and responds to the gesture, the gesture a sensing signal and the sound sensing signal, so that a user wearing the mixed reality community living area finding device can vote with the virtual community, the virtual house image, and the virtual indoor image interactive. For example, in the mixed reality community living circle finding device described in claim 1, wherein the user wearing the mixed reality community living circle finding device transmits the virtual house to the virtual community through the gaze After the projection image and the image of the virtual indoor image are interacted, an information window may be additionally generated, wherein the information window may be a dialog window, an interactive menu, a virtual keyboard, a text, a picture, a movie, an animation. One of them or a combination thereof. For example, in the mixed reality community living circle finding device described in claim 1, wherein the user wearing the mixed reality community living circle finding device uses the gesture to cast a picture with the virtual community, the virtual house After the projection image and the image of the virtual indoor image are interacted, an information window may be additionally generated, wherein the information window may be a dialog window, an interactive menu, a virtual keyboard, a text, a picture, a movie, an animation. One of them or a combination thereof. For example, in the mixed reality community living circle finding device described in claim 1, wherein the user who wears the mixed reality community living circle finding device transmits the virtual community to the virtual community through the voice. After the projection image and the image of the virtual indoor image are interacted, an information window may be additionally generated, wherein the information window may be a dialog window, an interactive menu, a virtual keyboard, a text, a picture, a movie, an animation. One of them or a combination thereof. For example, in the mixed reality community living circle finding device described in claim 1, wherein the user wearing the mixed reality community living circle finding device transmits the gaze, the gesture, and any combination of the sounds. After interacting with the virtual community projection image, the virtual house projection image, and the projection image of the virtual indoor image, an information window may be additionally generated, wherein the information window may be a dialog window, an interactive menu, a virtual keyboard, One of a text, a picture, a movie, an animation, or a combination thereof. The hybrid real-life community living room finding device as described in claim 1, wherein the device further comprises a data recording module electrically connected to the processing module, the data recording module for recording the use The person's house search record and preferences are used as a recommendation for the user's future personal suitability. The mixed reality community living circle finding device as described in claim 1, wherein the virtual community, the virtual house, and the virtual indoor image cast image may be a real-time photograph, a pre-video, and a Live video, a virtual 3D object and any combination. For example, in the mixed reality community living circle finding device as described in claim 1, the device further includes a network module electrically connected to the processing module, and the network module is wired/wireless. The method is to connect a server, so as to send and receive real estate related materials from the server.