KR102570208B1 - System for providing virtual model house - Google Patents

Abstract

A system for providing a virtual model house is disclosed. A system for providing a virtual model house according to an embodiment of the present invention includes a plurality of image display devices displaying virtual model houses in a specific space, and a location search device for obtaining location information of the plurality of image display devices. A first image display device among the plurality of image display devices displays a virtual reality image of the first virtual model house, and a second image display device among the plurality of image display devices displays a virtual reality image of the first virtual model house and displays a virtual reality image of another second virtual model house.

Description

Virtual model house providing system {SYSTEM FOR PROVIDING VIRTUAL MODEL HOUSE}

The present invention relates to a virtual model house providing system capable of virtually experiencing various model houses within a specific space.

In the case of selling or selling a house or building, we prepare a model house so that interested customers can look around.

Because such a model house reproduces a house to be built as it is, a lot of cost is incurred in constructing the model house. In addition, after the sales are completed, the model house must be demolished, and demolition of the model house also requires a lot of cost.

In addition, since the constructed model house is located in a specific place, consumers have the inconvenience of having to visit the place where the model house is prepared. An example is that a consumer living in Busan has to visit a model house in Seoul to buy a house in Seoul.

In addition, in the case of visiting model houses of several houses, not just one model house, there is an inconvenience of having to visit several model houses in person. An example is that a consumer living in Busan has to visit a model house in Seoul and a model house in Gwangju to look around a house in Seoul and Gwangju that are scheduled to be sold.

Therefore, consumers do not go directly to the model house and evaluate the house through the floor plan or photos of the house. However, there is a problem in that it is difficult for non-experts to understand the structure of a house only with a floor plan or photograph of the house.

In addition, model houses reproduce only the internal structure of ordinary houses. Therefore, from the consumer's point of view, there is a problem in that it is difficult to grasp the view of the house and the amount of sunlight according to the building or floor.

The present invention is to solve the above problems, and an object of the present invention is to provide a virtual model house providing system capable of virtually experiencing various model houses within a specific space.

A system for providing a virtual model house according to an embodiment of the present invention includes a plurality of image display devices displaying virtual model houses in a specific space, and a location search device for obtaining location information of the plurality of image display devices. A first image display device among the plurality of image display devices displays a virtual reality image of the first virtual model house, and a second image display device among the plurality of image display devices displays a virtual reality image of the first virtual model house and displays a virtual reality image of another second virtual model house.

The present invention has the advantage of being able to experience a model house in a different area within a specific space. For example, if an operator of a virtual model house provision system provides a virtual model house service by providing a specific space in Seoul, Daegu, Daejeon, Gwangju, or Busan, users in Daegu can experience all model houses nationwide in Daegu. Users in the Gwangju area can experience all model houses across the country in Gwangju.

In addition, from the perspective of a construction company, it is possible to save construction and demolition costs of model houses by producing and providing only virtual model house contents without constructing model houses nationwide.

In addition, a user who is interested in a plurality of houses has the advantage of being able to experience a plurality of model houses in one space without visiting a plurality of model houses.

In addition, each user may have different houses of interest. In this case, a plurality of users can each experience a model house of a desired house within a specific space. For example, a first user in Busan can experience a house in Seoul in a specific space prepared in Busan, and a second user in Busan can experience a house in Gwangju in a specific space prepared in Busan.

In addition, a virtual model house provision system operator having a specific space or a plurality of image display devices has the advantage of providing various virtual model houses to a number of users and receiving money from a number of construction companies to make a profit.

The present invention has the advantage of providing an effect similar to directly experiencing a real model house by providing a virtual space having the same size as a real house and a virtual moving distance equal to the actual moving distance.

According to the present invention, while allowing a plurality of users to enjoy different virtual model houses within a specific space, other people can be displayed on their virtual reality images. In addition, by displaying another person's image displayed on the virtual reality image to correspond to the other person's actual location, there is an advantage in that it is possible to detect the location of another person and prevent collision while viewing the virtual reality image. In addition, there is an advantage in preventing a collision with another person even while viewing a virtual reality image by outputting an alarm even if another person's image is not displayed because the other person is located outside the viewing angle.

According to the present invention, the user may move along a movable path in an actual house, and may move along a path passing through a wall to reduce a moving distance.

The present invention provides an environment in which the user can experience the outside of the house as well as the inside of the house. For example, while looking at a house from the outside of the house, the user can experience the location of the house, how much the inside of the house can be seen, and what the color of the outside of the house is like in a real environment. For another example, the user may experience a building including the house from the outside of the house, the arrangement of surrounding buildings, and the distance from the surrounding buildings similarly to the real environment.

The present invention provides finishing material companies, interior companies, furniture companies, etc., with opportunities to promote and sell products, and provides users with an opportunity to directly place and move promoted products.

The present invention has the advantage of being able to determine the view right, the right to sunlight, and the like with a virtual reality image.

1 is a diagram for explaining a system for providing a virtual model house according to an embodiment of the present invention.
2 is a block diagram illustrating an HMD device related to the present invention.
3 is a conceptual view of the HMD device related to the present invention viewed from one direction.
4 is a diagram illustrating a plurality of image display devices existing in a specific space according to an embodiment of the present invention.
5 is a diagram showing a first virtual model house according to an embodiment of the present invention.
6 is a diagram showing a virtual image of a first virtual model house according to an embodiment of the present invention.
7 is a diagram showing a second virtual model house according to an embodiment of the present invention.
8 is a diagram showing a virtual image of a second virtual model house according to an embodiment of the present invention.
9 to 11 are diagrams for explaining a method of displaying a virtual reality image from a first virtual user's point of view based on a location or direction of a first real user according to an embodiment of the present invention.
12 to 18 are diagrams for explaining a method of displaying other real users co-located in a specific space in a virtual model house according to an embodiment of the present invention.
19 to 21 are views for explaining a route guidance method according to an embodiment of the present invention.
22 to 23 are diagrams for explaining a method of displaying a virtual reality image by movement of a real user according to an embodiment of the present invention.
24 to 26 are views for explaining a method of displaying the outside of a first virtual model house according to an embodiment of the present invention.
27 is a diagram for explaining a method of outputting an alarm according to a distance from a wall of a specific space according to an embodiment of the present invention.
28 to 31 are diagrams for explaining a method of arranging a virtual article on a virtual reality image according to an embodiment of the present invention.
32 is a diagram for explaining a method of displaying an external foreground viewed from a room according to an embodiment of the present invention.

Hereinafter, the embodiments disclosed in this specification will be described in detail with reference to the accompanying drawings, but the same or similar elements are given the same reference numerals regardless of reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "unit" for components used in the following description are given or used together in consideration of ease of writing the specification, and do not have meanings or roles that are distinct from each other by themselves. In addition, in describing the embodiments disclosed in this specification, if it is determined that a detailed description of a related known technology may obscure the gist of the embodiment disclosed in this specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in this specification, the technical idea disclosed in this specification is not limited by the accompanying drawings, and all changes included in the spirit and technical scope of the present invention , it should be understood to include equivalents or substitutes.

Terms including ordinal numbers, such as first and second, may be used to describe various components, but the components are not limited by the terms. These terms are only used for the purpose of distinguishing one component from another.

It is understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, but other elements may exist in the middle. It should be. On the other hand, when an element is referred to as “directly connected” or “directly connected” to another element, it should be understood that no other element exists in the middle.

Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

1 is a diagram for explaining a system for providing a virtual model house according to an embodiment of the present invention.

The server 10 may be an operator side server of the virtual model house providing system.

Here, the operator of the virtual model house provision system may be a company that has a specific space and various types of virtual model house contents in which a virtual model house can be experienced, and provides a virtual model house experience service to consumers.

The server 10 may store a plurality of virtual model house contents.

For example, the server 10 may receive and store first virtual model house contents from a device on the side of the first virtual model house provider 20 .

As another example, the server 10 may receive and store second virtual model house contents from a device on the side of the second virtual model house provider 30 .

Here, the first virtual model house provider 20 may be a supplier of a real house corresponding to the first virtual model house.

Here, the first real house corresponding to the first virtual model house may mean a real building advertised using the first virtual model house.

For example, if G apartment in Godeok-dong, Seoul is being sold, and the first virtual model house content that reproduces the 33 pyeong A type of Godeok-dong G apartment exists to advertise the 33 pyeong A type of Godeok-dong G apartment, The first real house corresponding to 1 virtual model house may be a 33 pyeong A type of G apartment in Godeok-dong, Seoul.

In addition, the first virtual model house may refer to a virtual building in which the first real house is implemented in virtual reality.

Also, the supplier of the first real house corresponding to the first virtual model house may be a construction company that builds the first real house corresponding to the first virtual model house.

In addition, the first virtual model house content may include a virtual reality image of the first virtual model house.

Here, the virtual reality image of the first virtual model house may be an image reproduced from a scene actually viewed by a person inside or outside the first real house.

For example, the virtual reality image of the first virtual model house may be an image reproduced as it is in various scenes that can be seen inside or outside the first real house according to a change in location or direction.

Further, the virtual reality image of the first virtual model house may be an image provided by the first virtual model house provider 20, that is, a supplier of a first real house corresponding to the first virtual model house.

Meanwhile, the first virtual model house provider 20 is not limited to a supplier of a real house corresponding to the first virtual model house. For example, the first virtual model house provider 20 may be a production company requested to produce the first virtual model house contents from the supplier of the real house.

In addition, the first real house may mean not only a currently existing building, but also a building for which a design plan for an interior space or exterior is completed and virtual model house contents are produced for advertisement.

Meanwhile, the second virtual model house provider 20 may be a supplier of a second actual house corresponding to the second virtual model house.

Here, the second real house corresponding to the second virtual model house may mean a real building advertised using the second virtual model house.

For example, Apartment A in Godeok-dong, Seoul is being sold, and there is a virtual reality video of the second virtual model house that reproduces the 33-pyong C type of Apartment A in Godeok-dong in order to advertise the 33-pyong C type of Apartment A in Godeok-dong. In this case, the second real house corresponding to the second virtual model house may be type C of 33 pyeong of apartment A in Godeok-dong, Seoul.

In addition, the second virtual model house may refer to a virtual building in which the second real house is implemented in virtual reality.

Also, the supplier of the second real house corresponding to the second virtual model house may be a construction company that builds the second real house corresponding to the second virtual model house.

In addition, the content of the second virtual model house may include a virtual reality image of the second virtual model house.

Here, the virtual reality image of the second virtual model house may be an image reproduced from a scene actually seen by a person inside or outside the second real house.

For example, the virtual reality image of the second virtual model house may be an image reproduced as it is from various scenes that can be seen inside or outside the second real house according to a change in location or direction.

Further, the virtual reality image of the second virtual model house may be an image provided by the second virtual model house provider 30, that is, a supplier of a second real house corresponding to the second virtual model house.

Meanwhile, the second virtual model house provider 30 is not limited to a supplier of a real house corresponding to the second virtual model house. For example, the second virtual model house provider 30 may be a production company requested to produce second virtual model house contents from the supplier of the real house.

In addition, the second real house may mean not only a currently existing building, but also a building for which a design plan for an interior space or exterior is completed and virtual model house contents are produced for advertisement.

Meanwhile, the virtual reality image of the first virtual model house may be an image reproducing a scene actually viewed by a person in the first real house (ie, inside or outside the first real house), and a virtual reality image of the second virtual model house. may be an image reproducing a scene actually viewed by a person in the second real house (ie, inside or outside the second real house). Also, the first real house and the second real house may be different houses.

Specifically, the first real house and the second real house may be buildings of the same classification, different layout, or type. For example, the first real house may be a 33 pyeong A-type building among G apartments in Godeok-dong, Seoul, and the second real house may be a 25-pyeong B-type building among G apartments in Godeok-dong, Seoul.

Also, the first real house and the second real house may be of different classifications. For example, the first real house may be a 33 pyeong A-type building among G apartments in Godeok-dong, Seoul, and the second real house may be a 33-pyeong A-type building among N apartments in Banyeo-dong, Busan.

In addition, the first real house and the second real house may be of different classifications and may have different builders. For example, the first real house is a 33 pyeong A type building of G apartments in Godeok-dong, Seoul, and is a building constructed by Z construction company, and the second real house is a 33 pyeong A type building of N apartments in Banyeo-dong, Busan, and is a building of F construction company. It may be a building to be built.

Meanwhile, the server 10 may store a plurality of interior contents.

For example, the server 10 may receive and store the first interior content from the device of the first interior company 40 .

For another example, the server 10 may receive and store second interior content from a device of the second interior company 50 .

Here, the first interior company 40 may be a provider of first interior items (eg, wallpaper, interior materials, lighting, etc.) that may be disposed inside the building.

In addition, the first interior content may include a virtual product obtained by imaging an item provided by the first interior company 40 .

In addition, the second interior manufacturer 50 may be a manufacturer of second interior items (eg, wallpaper, interior materials, lighting, etc.) that may be placed inside a building.

And, the second interior content may include a virtual product obtained by imaging an item provided by the second interior company 50 .

On the other hand, the first interior company 40 and the second interior company 50 are not limited to providers of articles. For example, the first interior company 40 and the second interior company 50 may be production companies requested to produce interior contents from the interior company.

Meanwhile, the server 10 may store a plurality of furniture contents.

For example, the server 10 may receive and store first furniture content from a device on the side of the first furniture company 60 .

As another example, the server 10 may receive and store second furniture content from a device on the side of the second furniture company 70 .

Here, the first furniture company 60 may be a provider of first items (eg, a bed, a closet, a dining room, a sofa, etc.) that can be disposed inside a building.

Also, the first furniture content may include a virtual product obtained by imaging the first product provided by the first furniture company 60 .

In addition, the second furniture company 70 may be a provider of second items (eg, a bed, a closet, a dining room, a sofa, etc.) that can be placed inside a building.

Further, the second furniture content may include a virtual product obtained by imaging a second product provided by the second furniture company 70 .

Meanwhile, the first furniture company 60 and the second furniture company 70 are not limited to product providers. For example, the first furniture company 60 and the second furniture company 70 may be production companies requested to produce furniture contents by the furniture company.

Meanwhile, the system for providing a virtual model house may include a plurality of image display devices.

Hereinafter, the image display device is described as a head mounted display (HMD) device (hereinafter referred to as an HMD device), but is not limited thereto, and the present invention can be applied to all display devices capable of displaying virtual reality images.

The HMD device may receive virtual model house contents from the server 10 and display a virtual reality image of the virtual model house.

Specifically, the HMD device may download and store contents of the virtual model house from the server 10 and display a virtual reality image of the virtual model house.

Alternatively, the HMD device may receive a virtual reality image corresponding to at least one of the user's location and direction from the server 10 and display the received virtual reality image.

In this case, the HMD device may display a virtual reality image of a specific virtual model house among a plurality of virtual model houses.

Specifically, the first HMD device 100 may download contents of the first virtual model house from the server 10 or receive a virtual reality image of the first virtual model house, and display the virtual reality image of the first virtual model house. there is.

Further, the second HMD device 200 may download contents of the second virtual model house from the server 10 or receive a virtual reality image of the second virtual model house, and display the virtual reality image of the second virtual model house. .

That is, the first virtual model house provided with images by the first HMD device 100 may be different from the second virtual model house provided with images by the second HMD device 200 .

For example, the first virtual model house provided with images by the first HMD device 100 is a virtual model house corresponding to a 33 pyeong A-type building among G apartments in Godeok-dong, Seoul. The second virtual model house for which images are provided may be a 25 pyeong B type building among G apartments in Godeok-dong, Seoul.

Meanwhile, the third HMD device 300 may download contents of the first virtual model house from the server 10 or receive a virtual reality image of the first virtual model house, and display the virtual reality image of the first virtual model house. .

That is, the virtual model house provided with images by the first HMD device 100 is the first virtual model house, and may be the same as the first virtual model house provided with images by the third HMD device 300 .

In addition, the third HMD device 300 may download contents of the third virtual model house from the server 10 or receive a virtual reality image of the third virtual model house, and display the virtual reality image of the third virtual model house. .

Meanwhile, the HMD device may download the virtual model house contents directly from the server 10 or through a mobile terminal.

Meanwhile, the HMD device may acquire the location of the HMD device within a specific space by transmitting and receiving a signal for obtaining location information with the location search device 80 .

The HMD device described in this specification may include a wearable device (eg, a smart glass terminal) and the like.

However, except for the case where the configuration according to the embodiment described in this specification is applicable only to HMD, mobile phones, smart phones, laptop computers, digital broadcasting terminals, personal digital assistants (PDAs), PMPs ( Those skilled in the art can easily recognize that it can be applied to mobile terminals such as portable multimedia players, navigation, slate PCs, tablet PCs, ultrabooks, and smartwatches. You will be able to.

2 is a block diagram illustrating an HMD device related to the present invention.

The HMD 100 device may include a communication unit 110, an input unit 120, an output unit 150, a memory 170, a control unit 180, and a power supply unit 190. The components shown in FIG. 1 are not essential to implement the HMD device, so the HMD device described herein may have more or fewer components than the components listed above.

More specifically, among the above components, the communication unit 110 is between the HMD device 100 and a wireless communication system, between the HMD device 100 and other HMD devices 100, and between the HMD device 100 and a mobile or fixed terminal. between the HMD device 100 and the controller, between the HMD device 100 and a camera installed outside and capable of wireless communication), between the HMD device 100 and a massage chair, or between the HMD device 100 and an external server It may include one or more modules enabling wireless communication.

Also, the communication unit 110 may include one or more modules that connect the HMD device 100 to one or more networks.

The communication unit 110 includes at least one of a broadcast reception module 111, a mobile communication module 112, a wireless Internet module 113, a short-distance communication module 114, a location information module 115, and an interface unit 116. can include

The input unit 120 includes a camera 121 or video input unit for inputting a video signal, a microphone 122 for inputting an audio signal, or a user input unit 123 for receiving information from a user, for example , a touch key, a push key (mechanical key, etc.). Voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

Also, the input unit 120 may include a sensing unit 124 .

The output unit 150 is for generating an output related to sight, hearing, or touch, and includes at least one of a display unit 151, a sound output unit 152, a haptic module 153, and an optical output unit 154. can do.

Also, the memory 170 stores data supporting various functions of the HMD device 100 . The memory 170 may store a plurality of application programs (applications) driven in the HMD device 100 , data for operating the HMD device 100 , and commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs are available from the factory for basic functions of the HMD device 100 (eg, screen information output function such as image and video, incoming and outgoing call function, message reception and transmission function). It may exist on the device 100. Meanwhile, the application program may be stored in the memory 170, installed on the HMD device 100, and driven by the controller 180 to perform an operation (or function) of the HMD device.

The controller 180 controls general operations of the HMD device 100 in addition to operations related to the application program. The control unit 180 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the components described above or by running an application program stored in the memory 170.

In addition, the controller 180 may control at least some of the components reviewed in conjunction with FIG. 1A in order to drive an application program stored in the memory 170 . Furthermore, the controller 180 may combine and operate at least two or more of the components included in the HMD device 100 to drive the application program.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to each component included in the HMD device 100 . The power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the above components may operate in cooperation with each other to implement an operation, control, or control method of the HMD device according to various embodiments described below. Also, the operation, control, or control method of the HMD device may be implemented on the HMD device by driving at least one application program stored in the memory 170 .

Hereinafter, prior to examining various embodiments implemented through the above-described HMD device 100, the components listed above will be described in more detail with reference to FIG. 1 .

First, looking at the wireless communication unit 110, the broadcast reception module 111 of the wireless communication unit 110 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast reception modules may be provided in the HMD device 100 to receive simultaneous broadcasting of at least two broadcast channels or to switch broadcast channels.

The broadcast management server is a server that generates and transmits broadcast signals and/or broadcast-related information, or receives previously generated broadcast signals and/or broadcast-related information and is connected to an HMD device or the HMD device to control the HMD device. It may mean a server that transmits data to a device (eg, a control device, a terminal, etc.). The broadcast signal includes not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a TV broadcast signal or a broadcast signal in which a data broadcast signal is combined with a radio broadcast signal.

The broadcast signal may be encoded according to at least one of technical standards for transmission and reception of digital broadcast signals (or a broadcast method, eg, ISO, IEC, DVB, ATSC, etc.), and the broadcast reception module 111 The digital broadcasting signal can be received using a method suitable for technical standards determined by technical standards.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it can be received by the mobile communication module 112.

The broadcast-related information may exist in various forms, such as, for example, an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H). Broadcast signals received through the broadcast receiving module 111 and/or broadcast-related information may be stored in the memory 170 .

The mobile communication module 112 complies with technical standards or communication methods for mobile communication (eg, Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), EV) -DO(Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA(Wideband CDMA), HSDPA(High Speed Downlink Packet Access), HSUPA(High Speed Uplink Packet Access), LTE(Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc.) to transmit and receive radio signals with at least one of a base station, an external terminal, and a server on a mobile communication network.

The wireless signal may include a voice call signal, a video call signal, or various types of data according to text/multimedia message transmission/reception.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built into or external to the HMD device 100 . The wireless Internet module 113 is configured to transmit and receive radio signals in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc., and the wireless Internet module ( 113) transmits and receives data according to at least one wireless Internet technology within a range including Internet technologies not listed above.

From the viewpoint that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, the wireless Internet module (113) performing wireless Internet access through the mobile communication network ) may be understood as a kind of the mobile communication module 112.

The short-range communication module 114 is for short-range communication, and includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and NFC. Near Field Communication (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and wireless USB (Wireless Universal Serial Bus) technology may be used to support short-distance communication. Such a short-range communication module 114 may be used between the HMD device 100 and a wireless communication system, between the HMD device 100 and other HMD devices 100, and between the HMD device 100 through wireless area networks. and a mobile or fixed terminal, between the HMD device 100 and a control device, between the HMD device 100 and a camera installed outside and capable of wireless communication), or between the HMD device 100 and an external server. there is. The local area wireless communication network may be a local area wireless personal area network (Wireless Personal Area Networks).

Also, the short-distance communication module 114 may transmit data to the massage chair and receive data from the massage chair.

Here, the HMD device is a device capable of exchanging (or interlocking) data with the HMD device 100 according to the present invention (eg, a mobile phone, a smart phone, a smart watch) ), notebook computers, control devices, etc.). The short-range communication module 114 may detect (or recognize) devices capable of communicating with the HMD device 100 around the HMD device 100 . Furthermore, if the detected device is a device authorized to communicate with the HMD device 100 according to the present invention, the control unit 180 controls data processed by the HMD device 100 through the short-range communication module 114. At least a portion of data may be transmitted to the device, and at least a portion of data processed by the device may be transmitted to the HMD device 100 .

Accordingly, the user of the HMD device 100 may use data processed by the device through the HMD device 100 . For example, according to this, the user may make a phone call through the HMD device 100 when a phone call is received by the device, or send the received message through the HMD device 100 when a message is received by the device. it is possible to check

The location information module 115 is a module for acquiring the location (or current location) of the HMD device, and representative examples thereof include a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, if the HMD device utilizes a GPS module, the position of the HMD device may be obtained using a signal transmitted from a GPS satellite. As another example, if the HMD device utilizes the Wi-Fi module, the location of the HMD device may be obtained based on information of the Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal. If necessary, the location information module 115 may perform any function among other modules of the wireless communication unit 110 to obtain data on the location of the HMD device in substitution or addition. The location information module 115 is a module used to obtain the location (or current location) of the HMD device, and is not limited to a module that directly calculates or acquires the location of the HMD device.

The interface unit 116 serves as a passage for various types of external devices connected to the HMD device 100 . For example, the interface unit 116 may serve as a passage for a massage chair connected to the HMD device 100 .

The interface unit 116 connects a device equipped with a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and an identification module. It may include at least one of a port, an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port. In response to an external device being connected to the interface unit 116, the HMD device 100 may perform appropriate control related to the connected external device.

The interface unit 116 serves as a passage for all external devices connected to the HMD device 100 . The interface unit 116 receives data from an external device or receives power and transmits it to each component inside the HMD device 100, or transmits data inside the HMD device 100 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and a port for connecting a device having an identification module. The interface unit 160 may include an audio I/O (Input/Output) port, a video I/O (Input/Output) port, an earphone port, and the like.

Also, the interface unit 116 may transmit data to the massage chair or receive data from the massage chair.

Next, the input unit 120 is for inputting image information (or signals), audio information (or signals), data, or information input from a user. For inputting image information, the HMD device 100 has one Alternatively, a plurality of cameras 121 may be provided. The camera 121 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170 . Meanwhile, the plurality of cameras 121 provided in the HMD device 100 may be arranged to form a matrix structure, and through the cameras 121 forming the matrix structure, various angles or focal points may be provided to the HMD device 100. A plurality of image information having may be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to obtain left and right images for realizing a stereoscopic image.

The microphone 122 processes external sound signals into electrical voice data. The processed voice data may be utilized in various ways according to the function (or application program being executed) being executed in the HMD device 100 . Meanwhile, various noise cancellation algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122 .

The user input unit 123 is for receiving information from a user. When information is input through the user input unit 123, the control unit 180 can control the operation of the HMD device 100 to correspond to the input information. . The user input unit 123 is a mechanical input means (or a mechanical key, for example, a button located on the front/rear side or side of the HMD device 100, a dome switch, a jog wheel, jog switch, etc.) and a touch input means. As an example, the touch input unit may be at least one of a touch pad and a touch panel.

The sensing unit 124 may include one or more sensors for sensing at least one of information within the HMD device, surrounding environment information surrounding the HMD device, and user information. For example, the sensing unit 124 may include a proximity sensor, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, and a gravity sensor (G- sensor), gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor), finger scan sensor, ultrasonic sensor, light sensor ( optical sensors (e.g., cameras (see 121)), microphones (see 122), battery gauges, environmental sensors (e.g., barometers, hygrometers, thermometers, radiation detection sensors, heat detection sensors, It may include at least one of a gas detection sensor, etc.) and a chemical sensor (eg, an electronic nose, a health care sensor, a biometric sensor, etc.). Meanwhile, the HMD device disclosed in this specification may combine and utilize information sensed by at least two or more of these sensors.

Meanwhile, the sensing unit 124 senses at least one of information within the HMD device, surrounding environment information surrounding the HMD device, and user information, and generates a sensing signal corresponding thereto. Based on the sensing signal, the controller 180 may control driving or operation of the HMD device 100 or may process data, function, or operation related to an application program installed in the HMD device 100 . Representative sensors among various sensors that may be included in the sensing unit 124 will be described in more detail.

First, a proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing nearby without mechanical contact by using the force of an electromagnetic field or infrared rays. The proximity sensor may be disposed in an inner area of the HMD device surrounded by the touch screen described above or near the touch screen.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitance type proximity sensor, a magnetic type proximity sensor, an infrared proximity sensor, and the like. When the touch input means of the user input unit 123 is a capacitive type, the proximity sensor may be configured to detect the proximity of a conductive object by a change in electric field according to the proximity of the object. In this case, the user input unit 123 itself may be classified as a proximity sensor.

Meanwhile, for convenience of explanation, “proximity touch” refers to an action of recognizing that an object is located on the user input unit 123 by approaching the user input unit 123 without being in contact with it. , and an act of actually contacting an object on the user input unit 123 is referred to as a “contact touch”. The position at which an object is proximity-touched on the user input unit 123 means a position at which the object vertically corresponds to the user input unit 123 when the object is proximity-touched. The proximity sensor may detect a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch location, proximity touch movement state, etc.). Meanwhile, as described above, the control unit 180 processes data (or information) corresponding to the proximity touch operation and proximity touch pattern detected through the proximity sensor, and furthermore, displays visual information corresponding to the processed data to the display unit ( 151) can be output. Furthermore, the controller 180 controls the HMD device 100 to process different operations or data (or information) depending on whether a touch to the same point on the user input unit 123 is a proximity touch or a contact touch. can do.

The touch sensor detects a touch (or touch input) applied to the user input unit 123 using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method.

As an example, the touch sensor may be configured to convert a pressure applied to a specific region of the user input unit 123 or a change in capacitance generated at the specific region into an electrical input signal. The touch sensor may be configured to detect a location, area, pressure at the time of touch, capacitance at the time of touch, and the like at which the touch object that applies a touch to the user input unit 123 touches the touch sensor. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen, a stylus pen, or a pointer.

As such, when there is a touch input to the touch sensor, the corresponding signal(s) is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 180. Thus, the controller 180 can know which area of the user input unit 123 has been touched. Here, the touch controller may be a component separate from the controller 180 or may be the controller 180 itself.

Meanwhile, the controller 180 may perform different controls or the same control according to the type of the touch object that touches the user input unit 123 . Whether to perform different controls or the same control according to the type of the touch object may be determined according to an operating state of the HMD device 100 or an application program being executed.

Meanwhile, the touch sensor and the proximity sensor described above may be used independently or in combination to provide a short (or tap) touch, long touch, multi touch, or drag touch to the user input unit 123. Such as drag touch, flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, etc. Various types of touches may be sensed.

The ultrasonic sensor may recognize location information of a sensing object by using ultrasonic waves. Meanwhile, the controller 180 may calculate the location of the wave generating source through information detected by the optical sensor and the plurality of ultrasonic sensors. The position of the wave generating source can be calculated using the property that light is much faster than ultrasonic waves, that is, the time for light to reach the optical sensor is much faster than the time for ultrasonic waves to reach the ultrasonic sensor. More specifically, the location of the wave generating source may be calculated by using light as a reference signal and a time difference between the arrival time of ultrasonic waves.

Meanwhile, looking at the configuration of the input unit 120, the camera 121 includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. A photo sensor may be stacked on a display device, and the photo sensor is configured to scan a motion of a sensing target close to the touch screen. More specifically, the photo sensor scans the content placed on the photo sensor by mounting photo diodes and transistors (TRs) in rows/columns and using electrical signals that change according to the amount of light applied to the photo diodes. That is, the photo sensor calculates the coordinates of the sensing object according to the change in light, and through this, the location information of the sensing object can be obtained.

The display unit 151 displays (outputs) information processed by the HMD device 100 . For example, the display unit 151 may display execution screen information of an application program driven in the HMD device 100 or UI (User Interface) and GUI (Graphic User Interface) information according to such execution screen information. .

Also, the display unit 151 may be configured as a 3D display unit that displays a 3D image.

A 3D display method such as a stereoscopic method (glasses method), an auto stereoscopic method (non-glasses method), or a projection method (holographic method) may be applied to the 3D display unit.

In general, a 3D stereoscopic image is composed of a left image (image for the left eye) and a right image (image for the right eye). According to the method of combining the left and right images into a 3D stereoscopic image, top-down method in which the left and right images are arranged up and down in one frame, left and right images in one frame L-to-R (left-to-right, side by side) method for arranging left and right images, checker board method for arranging pieces of left and right images in tile form, and left and right images in units of columns Alternatively, it is divided into an interlaced method that alternately arranges rows, and a time-sequential, frame-by-frame method that alternately displays a left image and a right image by time.

Also, the 3D thumbnail image may be generated as a single image by generating left and right image thumbnails from the left and right images of the original image frame, respectively, and combining them. In general, a thumbnail refers to a reduced image or a reduced still image. The generated left and right image thumbnails are displayed with a left and right distance difference on the screen by a depth corresponding to the parallax between the left and right images, thereby representing a three-dimensional sense of space.

A left image and a right image necessary for implementing a 3D stereoscopic image may be displayed on a stereoscopic display unit by a stereoscopic processing unit. The stereoscopic processing unit receives 3D images (images at a reference point and images at an extended point of view) and sets left and right images therefrom, or receives 2D images and converts them into left and right images.

The audio output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The audio output unit 152 also outputs audio signals related to functions performed by the HMD device 100 (eg, call signal reception sound, message reception sound, etc.). The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that a user can feel. A representative example of the tactile effect generated by the haptic module 153 may be vibration. The strength and pattern of the vibration generated by the haptic module 153 may be controlled by a user's selection or a setting of a controller. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output them.

In addition to vibration, the haptic module 153 responds to stimuli such as an array of pins that move vertically with respect to the contact skin surface, air blowing force or suction force through a nozzle or suction port, rubbing against the skin surface, electrode contact, and electrostatic force. It is possible to generate various tactile effects, such as the effect of heat absorption and the effect of reproducing the feeling of coolness and warmth using an element capable of absorbing heat or generating heat.

The haptic module 153 can not only deliver tactile effects through direct contact, but can also be implemented so that the user can feel the tactile effects through muscle sensations such as head, face, fingers, or arms. Two or more haptic modules 153 may be provided according to the configuration of the HMD device 100 .

The light output unit 154 outputs a signal for notifying occurrence of an event using light from a light source of the HMD device 100 . Examples of events occurring in the HMD device 100 may include message reception, call signal reception, missed call, alarm, schedule notification, e-mail reception, information reception through an application, and video (image, video, etc.) output. That is, the light output unit 154 may play a role of notifying that the HMD device 100 is performing a specific operation (function) by the user.

A signal output from the light output unit 154 is implemented as the HMD device emits light of a single color or multiple colors toward the front or rear surface. The signal output may be terminated when the HMD device detects a user's confirmation of the event or may be terminated based on the termination of an operation being performed in the HMD device.

On the other hand, the identification module is a chip that stores various types of information for authenticating the right to use the HMD device 100, and includes a user identification module (UIM), a subscriber identity module (SIM), and universal user authentication. module (universal subscriber identity module; USIM) and the like. A device equipped with an identification module (hereinafter referred to as 'identification device') may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the terminal 100 through the interface unit 160 .

In addition, the interface unit 116 serves as a passage through which power from the cradle is supplied to the HMD device 100 when the HMD device 100 is connected to an external cradle, or a user inputs power from the cradle. It may serve as a passage through which various command signals are transmitted to the HMD device 100 . Various command signals or the power input from the cradle may operate as a signal for recognizing that the HMD device 100 is correctly mounted on the cradle.

The memory 170 may store programs for operation of the controller 180 and may temporarily store input/output data (eg, phonebook, message, still image, video, etc.). The memory 170 may store data related to vibration and sound of various patterns output when a touch is input on the touch screen.

The memory 170 may be a flash memory type, a hard disk type, a solid state disk type, a silicon disk drive type, or a multimedia card micro type. ), card-type memory (eg SD or XD memory, etc.), RAM (random access memory; RAM), SRAM (static random access memory), ROM (read-only memory; ROM), EEPROM (electrically erasable programmable read -only memory), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk. The HMD device 100 may be operated in relation to a web storage that performs a storage function of the memory 170 on the Internet.

Meanwhile, as described above, the controller 180 controls operations related to application programs and general operations of the HMD device 100 in general. For example, if the state of the HMD device satisfies a set condition, the controller 180 may execute or release a locked state that restricts a user's control command input to applications.

In addition, the controller 180 performs control and processing related to voice calls, data communications, video calls, etc., or pattern recognition capable of recognizing handwriting input or drawing input performed on the user input unit 123 as characters and images, respectively. processing can be done. Furthermore, the control unit 180 may control any one or a combination of a plurality of the components described above in order to implement various embodiments described below on the HMD device 100 according to the present invention.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for the operation of each component. The power supply unit 190 includes a battery, and the battery may be a built-in battery capable of being charged, and may be detachably coupled to the HMD device body for charging.

In addition, the power supply unit 190 may have a connection port, and the connection port may be configured as an example of an interface 160 electrically connected to an external charger that supplies power to charge the battery.

As another example, the power supply unit 190 may charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 uses at least one of an inductive coupling method based on magnetic induction from an external wireless power transmitter or a magnetic resonance coupling method based on electromagnetic resonance. power can be delivered.

Meanwhile, in this specification, the term memory 170 may be used interchangeably with the term storage unit 170 .

Meanwhile, the HMD device (Head Mounted Display) device 100 may display an image. Here, the image may be a Virtual Reality (VR) image.

The sensing unit 124 may obtain data about motion of the HMD device 100 . Specifically, the sensing unit 124 may obtain data on at least one of a movement direction, a movement amount, a rotation direction, and a rotation amount of the HMD device (Head Mounted Display) device 100 .

Meanwhile, for the above-described operation, the sensing unit 124 may include a plurality of sensing means. For example, the sensing unit 124 may include a gravity sensor, a geomagnetic sensor, a motion sensor, a gyro sensor, an acceleration sensor, an infrared sensor, an inclination sensor, a brightness sensor, an altitude sensor, an olfactory sensor, a temperature sensor, and a depth sensor. It may include at least one of a sensor, a pressure sensor, a bending sensor, an audio sensor, a video sensor, a Global Positioning System (GPS) sensor, and a touch sensor.

The communication unit 110 may transmit/receive digital data such as contents by connecting to a network by wire or wirelessly.

The controller 180 may control the display unit 151 to display an image. Specifically, when an image is received from an external device or an image is stored in the storage unit 170, the controller 180 may control the display unit 151 to display the image.

In addition, the control unit 180 based on data on the movement of the HMD device (Head Mounted Display) device 100 detected by the sensing unit 124, the movement direction of the HMD device (Head Mounted Display) device 100, Information on at least one of a movement amount, a rotation direction, and a rotation amount may be obtained.

In addition, control information of the HMD device (Head Mounted Display) device 100 obtained from the HMD device (Head Mounted Display) device 100 may be transmitted to an external device (not shown). In this case, an external device (not shown) may provide an image corresponding to control information of the HMD (Head Mounted Display) device 100 to the HMD (Head Mounted Display) device 100 .

For example, when the control information of the HMD (Head Mounted Display) device 100 is information about the direction of the HMD (Head Mounted Display) device 100, an external device (not shown) is the HMD (Head Mounted Display) device (100) may provide an image corresponding to the direction of the Head Mounted Display (MMD) device 100 to the Head Mounted Display (HMD) device 100.

Meanwhile, various embodiments hereinafter may be embodied in a recording medium readable by a computer or a similar device using, for example, software, hardware, or a combination thereof.

3 is a conceptual view of the HMD device related to the present invention viewed from one direction.

Referring to FIG. 3 , the HMD device 100 related to the present invention is formed to be worn on the head (or head, face, head) of the human body, and includes a frame part (case, housing, cover, etc.) for this purpose. can include The frame portion may be formed of a flexible material so as to be easily worn. In this drawing, it is exemplified that the frame unit includes a first frame 101 and a second frame 102 made of different materials.

For example, the first frame 101 serves to provide a space in which at least one of the components described in FIG. 1 can be placed, and the second frame 102 is the first frame 101 It may serve to support (or fix) so that it can be mounted on the head of the human body.

The frame unit may be referred to as a body (or HMD device body) or a body (or HMD device body). Here, the HMD device body (or HMD device body) may be understood as a concept referring to the HMD device 100 as at least one aggregate.

The frame part is supported on the head and provides a space in which various parts are mounted. As shown, electronic components such as a camera 121, an output unit, a user input unit 123, light emitting units 200a, 200b, and 200c, a control unit, and a sensing unit may be mounted on the first frame 101. Here, the display unit 151 may be formed to cover at least one of the user's left and right eyes (or face at least one of the user's left and right eyes) and may be detachably formed.

Electronic components such as a sound output unit 152 and a light emitting unit may be mounted on the second frame 102 . However, the present invention is not limited thereto, and components described in FIG. 1 and components necessary for the HMD device may be variously disposed in the first frame 101 and the second frame 102 according to a user's selection.

The controller 180 (see FIG. 1 ) is configured to control various electronic components included in the HMD device 100 . The controller 180 may be understood as a component corresponding to the controller 180 described in FIG. 1 .

The display unit 151 is mounted on the frame unit and serves to output screen information (eg, video, image, video, etc.) in front of the user's eyes. When the user wears the HMD device 100, the display unit 151 may be disposed to correspond to at least one of the left eye and the right eye so that screen information can be displayed in front of the user's eyes. In this drawing, it is exemplified that the display unit 151 is positioned to cover both the left and right eyes of the user so that an image can be output toward both the left and right eyes of the user.

Also, the display unit 151 may project an image onto the user's eyes using a prism. In addition, the prism may be light-transmitting so that the user can see the projected image and the general field of view (a range of the user's eyes) together.

As such, an image output through the display unit 151 may be displayed overlapping with a normal field of view. The HMD device 100 may provide augmented reality (AR) in which a virtual image is superimposed on a real image or a background to display a single image by using the characteristics of the display.

The camera 121 is disposed adjacent to at least one of the left eye and the right eye, and is configured to capture a forward image. Since the camera 121 is disposed adjacent to the eye and faces forward, the camera 121 may acquire a scene viewed by the user as an image.

In this drawing, one camera 121 is provided as an example, but is not necessarily limited thereto. A plurality of cameras 121 may be provided to obtain a stereoscopic image.

The HMD device 100 may include a user input unit 123 manipulated to receive a control command. The user input unit 123 may be employed in any tactile manner, such as a touch or a push, in which a user manipulates the input unit while experiencing a tactile feeling. In this drawing, it is exemplified that the user input unit 123 of the push and touch input method is provided in the frame unit.

In addition, the HMD device 100 may include a microphone (not shown) that receives sound and processes it into electrical voice data, and an audio output unit 152 that outputs sound. The sound output unit 152 may transmit sound using a general sound output method or a bone conduction method. When the sound output unit 152 is implemented in a bone conduction manner, when the user wears the HMD device 100, the sound output unit 152 adheres to the head and transmits sound by vibrating the skull.

On the other hand, if the frame portion including the first frame 101 and the second frame 102 is regarded as one HMD device body (hereinafter referred to as 'body'), the body of the HMD device related to the present invention may be formed in various forms. can be formed Specifically, the main body may include a plurality of surfaces 103a, 103b, and 103c forming predetermined angles. The plurality of surfaces refer to surfaces located outside the main body of the HMD device 100 . From this point of view, the plurality of surfaces may mean the surface (external surface, outer surface, etc.) of the HMD device 100 . Each of the plurality of surfaces 103a, 103b, and 103c may have a flat or curved shape.

Meanwhile, the display unit 151 of the HMD device related to the present invention may be located inside the main body. Specifically, the display unit 151 is disposed inside the HMD device and may be disposed at a position facing the user's eyes when the user wears the HMD device on the user's head.

In Figure 3, a plurality of surfaces (103a, 103b, 103c) is shown a body formed to form a right angle to each other. Hereinafter, for convenience of description, an HMD device having a plurality of surfaces formed at right angles to each other will be described as an example, but the description in this regard will be applied to all types of HMD devices including a plurality of surfaces forming predetermined angles. The same/similar analogy can be applied.

In addition, the second frame 102 of the HMD device may also include a plurality of surfaces. In the present invention, it should be understood that any one surface 103f included in the second frame 102 is included in a plurality of surfaces of the HMD device body. Any one of the surfaces 103f may be located on the back of the user's head.

For example, referring to FIG. 3 , the HMD device of the present invention may include a plurality of surfaces. The plurality of surfaces may include a front surface 103a, a left surface 103b, a lower surface 103c, a right surface 103d, an upper surface 103e, and a rear surface 103f.

The HMD device 100 related to the present invention may include a plurality of light emitting units formed on a plurality of surfaces of the main body and emitting light to the outside of the main body. Specifically, the plurality of light emitting units may be formed on a plurality of surfaces of the main body, respectively, and may be formed to emit light to the outside of the main body. Here, the fact that the plurality of light emitting units are formed on each of the plurality of surfaces of the main body should be understood as meaning that one light emitting unit is formed for each of the plurality of surfaces, not that a plurality of light emitting units are formed for each of the plurality of surfaces. do.

For example, as shown in FIG. 3, among the plurality of surfaces, the first light emitting unit 200a is on the front surface 103a, the second light emitting unit 200b is on the left side 103b, and the second light emitting unit 200b is on the lower side 103c. 3 light emitting units 200c may be provided. Although not shown, light emitting units may be provided on the right side 103d, the upper side 103e, and the rear side 103f, respectively.

The plurality of light emitting units may be used to determine (or estimate, track, detect, extract, determine, identify, recognize, etc.) the posture of the HMD device 100 . For example, the present invention may include a control device for determining the attitude of the HMD device 100, and the control device uses a plurality of light emitting units formed on a plurality of surfaces of the HMD device 100, respectively. The attitude of the HMD device 100 may be determined.

The posture of the HMD device 100 is a state in which the HMD device is placed (a state in which the HMD device is worn on the user's head), a degree of tilt of the HMD device, a direction in which the HMD device is viewed, a location of the HMD device, and rotation of the HMD device. And it can be understood as a concept including the movement of the HMD device. Also, in the present invention, determining the posture of the HMD device 100 may include determining the posture and movement of a user wearing the HMD device 100 .

Each of the plurality of light emitting units may include a plurality of light emitting devices. Each light emitting unit may be formed so that the plurality of light emitting devices have different patterns (arrangements) so that a plurality of surfaces are distinguished.

For example, a pattern (or arrangement) in which a plurality of light emitting elements included in the light emitting unit 200a provided on the front surface 103a is disposed is on a surface different from the front surface (eg, the left side 103b). The arrangement pattern of the plurality of light emitting devices included in the provided light emitting unit (for example, the light emitting unit 200b provided on the right side 103b) may be different.

The control device may identify a light emitting unit based on a plurality of light emitting devices arranged to have different patterns on a plurality of surfaces, and determine the attitude of the HMD device using the identified light emitting unit.

Meanwhile, the description of the HMD device disclosed in FIGS. 2 and 3 may be applied not only to the first HMD device 100 but also to the second HMD device 200 and the third HMD device 300 .

4 is a diagram illustrating a plurality of image display devices existing in a specific space according to an embodiment of the present invention.

Here, the specific space 400 may be a space in which a plurality of users 1000 and 2000 wearing a plurality of HMD devices 100 and 200 move.

That is, the operator of the virtual model house provision system may prepare an empty space for users to move around and provide the HMD device to the user. In addition, the user can wear the HMD device and watch virtual reality images of the virtual model house while moving around a specific space.

Meanwhile, the system for providing a virtual model house may include a location search device 80 for obtaining location information of a plurality of HMD devices.

The location search device 80 may include a plurality of sensors 411 , 412 , 413 , and 414 , and the plurality of sensors 411 , 412 , 413 , and 414 may be installed in a specific space 400 . Here, a plurality of sensors requires at least three sensors.

In addition, the HMD device may acquire the location of the HMD device within the specific space 400 by transmitting and receiving a signal for acquiring location information with the location search device 80 .

Specifically, the HMD device may acquire the location of the HMD device within a specific space 400 by transmitting and receiving wireless signals to and from the plurality of sensors 411 , 412 , 413 , and 414 .

There may be various methods for the HMD device to obtain location information of the HMD device.

For example, the control unit of the HMD device may directly calculate the location of the HMD device within a specific space 400 based on wireless signals transmitted and received to and from the plurality of sensors 411 , 412 , 413 , and 414 .

For another example, the location search device 80 may include a location calculator. In this case, the location calculation unit may obtain location information of the HMD device within a specific space 400 based on wireless signals transmitted and received by the plurality of sensors 411 , 412 , 413 , and 414 with the HMD device. The location calculation unit may transmit location information of the HMD device to the HMD device, and the control unit of the HMD device may receive the location information of the HMD device through the communication unit.

Meanwhile, in order to obtain location information of the HMD device, ultra-wideband wireless technology (Ultra Wide Band, hereinafter referred to as UWB) may be used.

In detail, the plurality of sensors 411, 412, 413, and 414 may transmit and receive wireless signals to and from the HMD device. In addition, the HMD device or position calculation unit calculates the distance between the plurality of sensors 411, 412, 413, and 414 and the HMD device by applying the time-of-flight method to the time difference from the time the signal is transmitted to the time the signal is received. can In addition, the HMD device or the location calculation unit may calculate location information of the HMD device within the specific space 400 by applying triangulation to the distance between the plurality of sensors 411, 412, 413, and 414 and the HMD device. .

Meanwhile, location information of the HMD device may refer to location information of an actual user using the HMD device (eg, an actual user wearing the HMD device).

Meanwhile, the controller of the HMD device may obtain direction information of the HMD device based on a sensing result of the sensing unit.

Here, the direction information of the HMD device may refer to direction information of an actual user using the HMD device (eg, an actual user wearing the HMD device).

Meanwhile, the system for providing a virtual model house may include a plurality of HMD devices 100 and 200 that display a virtual model house within a specific space 400 .

That is, the operator of the virtual model house provision system prepares a specific space 400 in which users can move around, and users who want to experience a virtual model house can visit the specific space 400 . In addition, users may wear a plurality of HMD devices 100 and 200 and watch a virtual reality image of a virtual model house while moving around the inside of a specific space 400 .

A first real user 1000 among the plurality of real users 1000 and 2000 may use the first HMD device 100 within a specific space 400 .

Here, a real user is a concept opposite to a virtual user, and may mean a real person who moves within a specific space 400 . In addition, a virtual user may refer to a virtual person who moves within a virtual model house in response to a movement of a real user.

Meanwhile, among the plurality of HMD devices 100 and 200, the first HMD device 100 may display a virtual reality image of the first virtual model house.

5 is a diagram showing a first virtual model house according to an embodiment of the present invention.

6 is a diagram showing a virtual image of a first virtual model house according to an embodiment of the present invention.

As shown in FIG. 5 , the first virtual model house 500 may refer to a virtual building in which the first real house is implemented in virtual reality. Also, a first virtual user 1001 corresponding to the first real user 1000 is located in the first virtual model house 500 .

In addition, as shown in FIG. 6 , the virtual reality image 610 of the first virtual model house 500 may be an image reproducing a scene that a person inside or outside the first real house can actually see.

That is, the virtual reality image 610 of the first virtual model house 500 shows a scene in the field of view of the first virtual user 1001 while moving in the first virtual model house 500. It may be an imaged virtual image.

Meanwhile, the second real user 2000 among the plurality of real users 1000 and 2000 may use the second HMD device 200 within the specific space 400 .

Also, among the plurality of HMD devices 100 and 200, the second HMD device 100 may display a virtual reality image of the second virtual model house.

7 is a diagram showing a second virtual model house according to an embodiment of the present invention.

8 is a diagram showing a virtual image of a second virtual model house according to an embodiment of the present invention.

As shown in FIG. 7 , the second virtual model house 700 may refer to a virtual building in which the second real house is implemented in virtual reality. Also, a second virtual user 2001 corresponding to the second real user 2000 is located in the second virtual model house 700 .

In addition, as shown in FIG. 8 , the virtual reality image 810 of the second virtual model house 700 is an image reproducing a scene that a person inside or outside the second real house 700 can actually see. can

That is, the virtual reality image 810 of the second virtual model house 700 shows a scene in the field of view of the second virtual user 2001 while moving in the second virtual model house 700. It may be an imaged virtual image.

In this case, the second virtual model house 700 may be different from the first virtual model house 500 . Accordingly, the virtual image 810 of the second virtual model house 700 may also be different from the virtual image 610 of the first virtual model house 500 .

As such, the present invention has the advantage of being able to experience a model house in a different area within a specific space. For example, if an operator of a virtual model house provision system provides a virtual model house service by providing a specific space in Seoul, Daegu, Daejeon, Gwangju, or Busan, users in Daegu can experience all model houses nationwide in Daegu. Users in the Gwangju area can experience all model houses across the country in Gwangju.

In addition, from the perspective of a construction company, it is possible to save construction and demolition costs of model houses by producing and providing only virtual model house contents without constructing model houses nationwide.

In addition, a user who is interested in a plurality of houses has the advantage of being able to experience a plurality of model houses in one space without visiting a plurality of model houses.

In addition, each user may have different houses of interest. In this case, within the specific space 400, a plurality of users can each experience a model house of a house they desire. For example, a first user in Busan can experience a house in Seoul in a specific space prepared in Busan, and a second user in Busan can experience a house in Gwangju in a specific space prepared in Busan.

In addition, a virtual model house provision system operator having a specific space or a plurality of image display devices has the advantage of providing various virtual model houses to a number of users and receiving money from a number of construction companies to make a profit.

9 to 11 are diagrams for explaining a method of displaying a virtual reality image from a first virtual user's point of view based on a location or direction of a first real user according to an embodiment of the present invention.

The following description may be applied not only to the first HMD device 100 but also to other HMD devices.

Based on at least one of location information and direction information of the first real user 1000 using the first HMD device 100 within the specific space 400, the controller of the first HMD device 100 generates a first virtual model The virtual reality image 1110 from the viewpoint of the first virtual user 1001 located in the house 500 may be displayed.

In this case, the movement of the first virtual user in the first virtual model house may correspond to the movement of the first real user in a specific space. Here, the movement of the first virtual user may include at least one of moving and changing direction of the first virtual user, and the movement of the first real user may include at least one of moving and changing direction of the first real user. .

In detail, the control unit of the first HMD device 100 may determine the movement of the first real user 1000 based on the location information of the first real user 1000 . In addition, the controller of the first HMD device 100 may display the virtual reality image 1110 from the viewpoint of the first virtual user 1001 moving in response to the movement of the first real user 1000 .

Also, the control unit of the first HMD device 100 may determine a direction change of the first real user 1000 based on direction information of the first real user 1000 . In addition, the controller of the first HMD device 100 may display the virtual reality image 1110 from the viewpoint of the first virtual user 1001 whose direction has changed in response to the direction change of the first real user 1000 .

For example, referring again to FIGS. 4 to 6 , at the location of the first real user 1000, the control unit of the first HMD device 100 displays a virtual image 610 from the viewpoint of the first virtual user 1001 ( An image looking toward the kitchen from the living room) was displayed. And the first actual user 1000 in FIG. 9 has moved forward from the previous position. In this case, referring to FIGS. 10 to 11 , the control unit of the first HMD device 100 controls the first virtual user 1001 moved forward from the position of the first virtual user in the previous first virtual model house 500. A virtual image 1110 of the viewpoint (an image looking toward the kitchen while approaching the kitchen) may be displayed.

As another example, when the first real user turns his/her head to the right within the specific space 400, the controller of the first HMD device 100 displays a virtual image from the viewpoint of the first virtual user who turned his/her head to the right. can do.

Meanwhile, the size of the first virtual model house 500 may be the same as that of the first real house corresponding to the first virtual model house 500 . For example, if the exclusive area of the first real house is 84.5 square meters, the exclusive area of the first virtual model house 500 corresponding to the first actual house may also be 84.5 square meters. In addition, the length, width, ceiling height, etc. of the interior of the first virtual model house 500 may also be the same as the length, width, ceiling height, etc. of the first real house.

9 and 10, the distance d2 that the first virtual user 1001 moves in the first virtual model house 500 is the movement distance d2 of the first real user 1000 in the specific space 400. It may be the same as the distance d1. For example, if the first real user 1000 moves 5 meters in a specific space 400, the first virtual user 1001 can move 5 meters in the first virtual model house 500. Also, the controller of the first HMD device 100 may display a virtual image from the viewpoint of the first virtual user 1001 who has moved 5 meters.

As described above, the present invention has the advantage of providing an effect similar to directly experiencing a real model house by providing a virtual space having the same size as the real house and a virtual moving distance equal to the actual moving distance.

Meanwhile, FIGS. 12 to 18 are diagrams for explaining a method of displaying other real users co-located in a specific space in a virtual model house according to an embodiment of the present invention.

First, in FIGS. 12 and 13 , the operation of the second HMD device 200 will be described.

The controller of the second HMD device 200 generates a second virtual model based on at least one of location information and direction information of the second real user 2000 using the second HMD device 200 within the specific space 400 . A virtual reality image from the viewpoint of the second virtual user 2001 located in the house 700 may be displayed.

In this case, the movement of the second virtual user 2001 in the second virtual model house 700 may correspond to the movement of the second real user 2000 in the specific space 400 . Here, the movement of the second virtual user 2001 may include at least one of movement and direction change of the second virtual user 2001, and movement of the second real user 2000 may include movement of the second real user 2000. It may include at least one of movement and direction change.

In detail, the control unit of the second HMD device 200 may determine the movement of the second real user 2000 based on location information of the second real user 2000 . In addition, the controller of the second HMD device 200 may display a virtual reality image from the point of view of the second virtual user 2001 moved in response to the movement of the second real user 2000 .

Also, the control unit of the second HMD device 200 may determine direction change of the second real user 2000 based on direction information of the second real user 2000 . In addition, the controller of the second HMD device 200 may display a virtual reality image from the viewpoint of the second virtual user 2001 whose direction has changed in response to the direction change of the second real user 2000 .

Also, the size of the second virtual model house 700 may be the same as the size of a second actual house corresponding to the second virtual model house 700 . Also, the moving distance of the second virtual user 2001 in the second virtual model house 700 may be the same as the moving distance of the second real user 2000 in the specific space 400 .

14 to 15 are diagrams for explaining a method of displaying a virtual user corresponding to another real user within a specific space.

The control unit of the first HMD device 100 may receive location information of the second actual user 2000 using the second HMD device 200 from the second HMD device 200 or the location search device 80. .

Further, the control unit of the first HMD device 100 controls information based on the location information and direction information of the first real user 1000 using the first HMD device 100 and the location information of the second real user 2000. The relative position of the first real user 1000 and the second real user 2000 may be calculated.

Also, based on the relative position of the second real user 2000, the control unit of the first HMD device 100 displays an image of the second virtual user 2001 corresponding to the second real user 2000 in the first virtual model house. It can be displayed on the virtual reality image of (500).

Here, the relative position of the second virtual user 2001 to the first virtual user 1001 in the first virtual model house 500 is the second real user relative to the first real user 1000 in the specific space 400. It can correspond to the relative position of (2000).

Specifically, referring again to FIGS. 9 to 11 , the first virtual model house 500 includes not only the first virtual user 1001 corresponding to the first real user 1000, but also the second real user 2000. A second virtual user 2001 may exist. Also, the relative position of the second virtual user 2001 to the first virtual user 1001 may be the same as the relative position of the second real user 2000 to the first real user 1000 within the specific space 400 . can

Meanwhile, the second real user 2000 is currently located outside the viewing angle of the first real user 1000 . Accordingly, the controller of the first HMD device 100 may not display the image of the second virtual user on the virtual reality image 1110 .

Meanwhile, referring again to FIGS. 12 and 13 , the second actual user 2000 has moved within a specific space 400 .

In this case, the second HMD device 200 may display a virtual reality image from the viewpoint of the second virtual user 2001 moving in the second virtual model house 700 in response to the movement of the second real user 2000. .

Also, as the second real user 2000 moves within the specific space 400, the relative position of the second real user 2000 relative to the first real user 1000 is changed.

In this case, referring to FIG. 14 , in response to a change in the relative position of the second real user 2000 to the first real user 1000 in a specific space 400, a first real user 2000 in the first virtual model house 500 The relative position of the second virtual user 2001 to the virtual user 1001 may also be changed.

Meanwhile, as the second real user 2000 moves within the specific space 400, the second real user 2000 is located within the first real user 1000's viewing angle.

And, when the second real user 2000 is located within the viewing angle of the first real user 1000, as shown in FIG. 15 , the controller of the first HMD device 100 displays an image ( 1711) may be displayed in the virtual reality image 1710 of the first virtual model house.

16 to 18 are diagrams for explaining operations when a second real user approaches a first real user but is positioned outside the viewing angle of the first real user.

Referring to FIG. 16 , the second actual user 2000 has moved within a specific space 400 .

Also, as the second real user 2000 moves within the specific space 400 , the relative position of the second real user 2000 with respect to the first real user 1000 is changed.

In this case, referring to FIG. 17 , in response to a change in the relative position of the second real user 2000 to the first real user 1000 in a specific space 400, a first real user 2000 in the first virtual model house 500 The relative position of the second virtual user 2001 to the virtual user 1001 may also be changed.

Meanwhile, the second real user 2000 moves within the specific space 400 and the second real user 2000 approaches the first real user 1000, but the second real user 2000 does not 1000) outside the viewing angle.

Further, when the distance between the second real user 2000 and the first real user 1000 is smaller than a predetermined distance but the second real user 2000 is located outside the viewing angle of the first real user 1000, FIG. 18 shows As such, the image of the second virtual user 2001 is not displayed in the virtual reality image 2010 of the first virtual model house.

In this case, as shown in FIG. 18 , the controller of the first HMD device 100 may output an alert 2011 warning of a collision.

In this way, the present invention allows a plurality of users to enjoy different virtual model houses within a specific space, while allowing others to be displayed on their virtual reality images. In addition, by displaying another person's image displayed on the virtual reality image to correspond to the other person's actual location, there is an advantage in that it is possible to detect the location of another person and prevent collision while viewing the virtual reality image.

For example, when the second real user is located 3 meters ahead of the first real user, the second virtual user may be located 3 meters ahead of the first virtual user even in the virtual reality space.

Also, if the second real user is located to the right of the first real user and the first real user is looking forward, the second virtual user is located to the right of the first virtual user and the first virtual user is looking forward. Therefore, the second virtual user is not displayed on the virtual reality image. However, since the first virtual user also looks to the right when the first real user looks to the right, the second virtual user is displayed on the virtual reality image. That is, there is an advantage in that the motion of a person looking around and preventing a collision can be reproduced as it is in the virtual space.

In addition, there is an advantage in preventing a collision with another person even while viewing a virtual reality image by outputting an alarm even if another person's image is not displayed because the other person is located outside the viewing angle.

Meanwhile, although it has been described that the first HDM device 100 displays an image of a second virtual user in a virtual reality image, it is not limited thereto.

Specifically, the controller of the first HDM device 100 may display a plan view of the first virtual model house in a virtual reality image. Also, the control unit of the first HDM device 100 may display a UI indicating at least one of the position and direction of the first virtual user in the plan view of the first virtual model house. Also, the control unit of the first HDM device 100 may display a UI indicating at least one of the position and direction of the second virtual user in the plan view of the first virtual model house.

19 to 21 are views for explaining a route guidance method according to an embodiment of the present invention.

Referring to FIG. 19 , the controller of the first HMD device 100 may display a list 2111 of a plurality of zones of the first virtual model house together with a virtual reality image 2110 of the first virtual model house. . Here, the plurality of zones are spaces constituting the first virtual model house, and may be, for example, a main room, a bathroom 1, a bathroom 2, a middle room, a small room, and a study.

Meanwhile, the control unit of the first HMD device 100 may receive an input for selecting a specific area from among a plurality of areas through the input unit. For example, as shown in FIG. 20 , the controller of the first HMD device 100 may receive a voice input for selecting a bedroom through a microphone.

Meanwhile, when an input for selecting a specific region among a plurality of regions is received, as shown in FIG. 21 , the controller of the first HMD device 100 may display a route 2411 to the specific region.

This embodiment may be more useful in a building having a wide and complicated structure such as a penthouse.

22 to 23 are diagrams for explaining a method of displaying a virtual reality image by movement of a real user according to an embodiment of the present invention.

As the first real user 1000 moves in the specific space 400, the first virtual user 1001 also moves in the first virtual model house 500, and the control unit of the first HMD device 100 moves in the first virtual model house 500. A virtual reality image from the viewpoint of the first virtual user 1001 moving in the virtual model house 500 may be displayed.

For example, when the first real user 1000 moves forward while the first virtual user 1001 is looking at the kitchen from the living room, the controller of the first HMD device 100 moves to the kitchen. A virtual reality image from the viewpoint of the user 1001 may be displayed.

Meanwhile, as shown in FIG. 22, although the first real user 1000 has moved, as shown in FIG. can be located In this case, the controller of the first HMD device 100 may display a virtual reality image passing through the wall 2610 .

That is, the user may move along a movable path in an actual house, and may move along a path passing through a wall to reduce a moving distance.

24 to 26 are views for explaining a method of displaying the outside of a first virtual model house according to an embodiment of the present invention.

When the first virtual user 1001, which has moved in response to the movement of the first real user 1000, is located outside the first virtual model house 500, the controller of the first HDM device 100 controls the first virtual user 1001. A virtual reality image 2910 outside the model house 500 may be displayed.

Here, the virtual reality image 2910 of the outside of the first virtual model house may be a virtual reality image showing a scene visible from the outside of the first real house. Here, the scene that can be seen from the outside of the first actual house may mean a scene predicted to be visible to the user based on a blueprint as well as a scene that currently exists.

Here, the virtual reality image 2910 of the exterior of the first virtual model house may include a virtual building 2912 including the first virtual model house 500 .

Here, the virtual building 2912 including the first virtual model house 500 may be a virtual reality image representing one building composed of a plurality of houses. For example, if the first virtual model house 500 is a virtual reality image of apartment building 106, unit 305, G, the virtual building 2912 including the first virtual model house 500 is a virtual reality image representing apartment building 106, G. can be

Meanwhile, the virtual reality image 2910 of the exterior of the first virtual model house may include a virtual exterior view 2911 of the first virtual model house 500 .

Here, the virtual external view 2911 of the first virtual model house 500 may be a virtual reality image of a real house corresponding to the first virtual model house 500 viewed from the outside.

For example, if the first virtual model house 500 is a virtual reality image of building 106, 305 of G apartment, the virtual exterior view 2911 of the first virtual model house 500 is a view of building 106, 305 of G apartment from the outside. It may be a virtual reality video.

Meanwhile, the virtual external view 2911 of the first virtual model house 500 may include an internal image of the first virtual model house 500 seen through a window.

Here, the interior image of the first virtual model house 500 may be an image showing the inside of the first real house that can be viewed from the outside of the first real house, considering the building and floor of the first real house.

Meanwhile, the controller of the first HMD device 100 may receive an input for selecting at least one of a building and a building of the first virtual model house. Further, when an input for selecting at least one of a building and a building number of the first virtual model house is received, the control unit of the first HMD device 100 performs a first virtual model corresponding to at least one of a building and a building number of the first virtual model house. A virtual reality image of the outside of the house can be displayed.

In addition, the size of the virtual external foreground of the first virtual model house may be the same as the size of the actual external foreground of the actual house corresponding to the first virtual model house. Also, the size of the virtual building including the first virtual model house may be the same as the size of the actual building including the real house corresponding to the first virtual model house.

Meanwhile, the virtual reality image 2910 of the exterior of the first virtual model house may include a virtual building 2913 around the first virtual model house 500 .

Here, the virtual building 2913 around the first virtual model house 500 may mean a virtual reality image of a real surrounding building that can be viewed from the outside of the real house corresponding to the first virtual model house 500. there is.

For example, when the first virtual model house 500 is a virtual reality image of building 106, 305 of G apartment, and the first virtual user 1001 is located in front of the first virtual model house 500, the virtual reality image 2910 The surrounding virtual building displayed in may be a virtual reality image of G apartment building 206 located in front of G apartment building 106.

On the other hand, the virtual building 2912 including the first virtual model house 500 and the virtual building 2913 around the first virtual model house 500 are arranged so that the actual building corresponding to the virtual building 2912 and the surrounding area The layout of the actual building corresponding to the virtual building 2913 may be the same.

In addition, the distance d3 between the virtual building 2912 including the first virtual model house 500 and the virtual building 2913 around the first virtual model house 500 is the actual distance corresponding to the virtual building 2912. It may be the same as the distance between the building and a real building corresponding to the surrounding virtual building 2913 .

As described above, the present invention provides an environment in which the user can experience the outside of the house as well as the inside of the house. For example, while looking at a house from the outside of the house, the user can experience the location of the house, how much the inside of the house can be seen, and what the color of the outside of the house is like in a real environment.

For another example, the user may experience a building including the house from the outside of the house, the arrangement of surrounding buildings, and the distance from the surrounding buildings similarly to the real environment.

27 is a diagram for explaining a method of outputting an alarm according to a distance from a wall of a specific space according to an embodiment of the present invention.

Since users experience virtual model houses of various sizes in a specific space 400, the specific space 400 is designed to be large. However, if the starting position of the virtual model house experience in the specific space 400 is biased to one side or the user is experiencing the outside of the virtual model house, there is a risk of the user colliding with the wall of the specific space 400. there is.

The first HMD device 100 may receive or store location information of a wall of a specific space 400 . Based on the location information of the first real user 1000 and the location information of the wall, when the location of the first real user 1000 is within a preset distance from the wall of the specific space 400, an alarm may be output. .

Here, the alert may include a visual alert, a tactile alert, an audio alert, and the like.

28 to 31 are diagrams for explaining a method of arranging a virtual article on a virtual reality image according to an embodiment of the present invention.

Referring first to FIGS. 28 to 29 , the first virtual model house 500 may include a plurality of zones.

Also, the control unit of the first HMD device 100 may determine which area among a plurality of areas in the first virtual model house 500 the first virtual user is located in.

Specifically, the control unit of the first HMD device 100 determines which area among a plurality of areas within the first virtual model house 500 the first virtual user is based on what the currently displayed virtual reality image 3210 is. location can be determined.

For example, when the currently displayed virtual reality image 3210 is a virtual reality image of a living room, the controller of the first HMD device 100 may determine that the first virtual user is located in the living room.

Meanwhile, when the first virtual user 1000 is located in the first area among a plurality of areas in the first virtual model house 500, the controller of the first HMD device 100 controls one or more virtual goods corresponding to the first area. (3211, 3212, 3213) can be displayed.

For example, when the first virtual user 1000 is located in the main room among a plurality of zones in the first virtual model house 500, the control unit of the first HMD device 100 provides various beds and various closets that can be arranged in the main room. It is possible to display a virtual article imaging the back.

For another example, when the first virtual user 1000 is located in the kitchen among a plurality of zones in the first virtual model house 500, the control unit of the first HMD device 100 can be configured to include various dining tables and refrigerators that can be placed in the kitchen. It is possible to display a virtual article imaging the back.

Meanwhile, when a specific item 3213 is selected from among one or more virtual items 3211, 3212, and 3213, the controller of the first HMD device 100 displays a virtual reality image 3210 of the first area where the specific item 3220 is placed. can display.

For example, if bed B advertised by company A is selected from among a plurality of beds, the controller of the first HMD device 100 may display a virtual reality image of the main room in which bed B is disposed. Here, bed B is a 3D image showing a bed currently on sale or scheduled to be sold, and may be provided from company A.

Meanwhile, based on a user input for moving the virtual item, the controller of the first HMD device 100 may move and display the specific item 3220 .

Referring to FIGS. 30 to 31A , the controller of the first HMD device 100 may determine which direction the first virtual user is looking.

In detail, the control unit of the first HMD device 100 may determine which direction the first virtual user 1001 is looking in the zone based on the currently displayed virtual reality image 3410 .

For example, when the currently displayed virtual reality image 3210 is an image representing a wall, the controller of the first HMD device 100 may determine that the first virtual user is looking at the wall.

The controller of the first HMD device 100 may display one or more virtual goods corresponding to the direction 3310 that the first virtual user 1001 is looking at.

For example, when the first virtual user is looking at a wall, the controller of the first HMD device 100 may display a plurality of wallpapers that can be placed on the wall.

Meanwhile, when a specific item among one or more virtual items is selected, as shown in FIG. 31B , the controller of the first HMD device 100 may display a virtual reality image 3420 in which the specific item 3421 is disposed.

For example, if wallpaper D advertised by company C is selected from among a plurality of wallpapers, the controller of the first HMD device 100 may display an image of a wall on which the wallpaper D is applied.

As described above, the present invention provides finishing materials companies, interior companies, furniture companies, etc. with opportunities to promote and sell products, and provides users with opportunities to directly place and move promoted products.

32 is a diagram for explaining a method of displaying an external foreground viewed from a room according to an embodiment of the present invention.

The control unit of the first HMD device 100 may display the external view 3210 of the first virtual model house 500 viewed from the inside of the first virtual model house 500 to the outside.

For example, when the first virtual user 1001 faces outside from the window of the first virtual model house 500, the control unit of the first HMD device 100 can see out of the window of the first virtual model house 500. 1 The external view of the virtual model house 500 may be displayed.

Here, the exterior view 3210 of the first virtual model house 500 may reflect at least one of the buildings, floors, and neighboring buildings 3211 and 3212 of the real house corresponding to the first virtual model house.

For example, when the first virtual model house 500 is a virtual reality image of building 106, 305 of G apartment, the control unit of the first HMD device 100 displays a virtual reality image of the actual external foreground viewed from building 305, building 106, G. can display

In addition, when buildings 210 and 211 are located in front of building 106 of G apartment, the exterior view 3210 of the first virtual model house 500 may include a virtual reality image of building 210 and a virtual reality image of building 211.

Meanwhile, the control unit of the first HMD device 100 may display an image representing the sunshine range of the first virtual model house 500 based on at least one of date and time.

In detail, the controller of the first HMD device 100 may receive a user input designating a date or time. In addition, the controller of the first HMD device 100 determines the interior of the first virtual model house based on the angle of the sun calculated based on the designated date, time, latitude, longitude, direction, floor, location, etc. of the first real house. An image representing a range of sunlight may be displayed.

For example, when the first virtual model house 500 faces southeast, the control unit of the first HMD device 100 determines that sunlight shines on the veranda at 5:00 am, sunlight shines on the veranda and living room at 11:00 am, and 2:00 pm. At this time, it is possible to display an image in which sunlight does not shine.

In addition, the control unit of the first HMD device 100 determines the sunlight range of the first virtual model house 500 based on at least one of date, time, latitude, longitude, direction, floor, location, and surrounding buildings of the first real house. An image representing can be displayed.

For example, when the first virtual model house 500 has three floors and another building is located in front of it, the controller of the first HMD device 100 may display an image in which sunlight shines only in the morning and evening.

As such, the present invention has the advantage of being able to determine the view right, the right to sunlight, and the like with a virtual reality image.

The above-described present invention can be implemented as computer readable code on a medium on which a program is recorded. The computer-readable medium includes all types of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. there is Also, the computer may include the control unit 180 of the terminal. Accordingly, the above detailed description should not be construed as limiting in all respects and should be considered as illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

100: first HMD device 200: second HMD device

Claims (17)

A plurality of image display devices for displaying a virtual model house within a specific space; and
A location search device for acquiring location information of the plurality of image display devices;
A first image display device among the plurality of image display devices,
Display the virtual reality image of the first virtual model house,
Among the plurality of image display devices, the second image display device,
Displaying a virtual reality image of a second virtual model house different from the first virtual model house;
The first image display device is a first virtual user viewpoint located in the first virtual model house based on at least one of location information and direction information of a first real user using the first image display device in the specific space. Display the virtual reality image of,
The movement of the first virtual user in the first virtual model house corresponds to the movement of the first real user in the specific space;
When an input for selecting a specific region among a plurality of regions is received, the first image display device displays a route to the specific region.
Virtual model house provision system. delete According to claim 1,
The distance the first virtual user moves in the first virtual model house,
equal to the distance the first real user moves in the specific space
Virtual model house provision system. According to claim 1,
The first image display device,
The relative position of the second real user is obtained based on the location information of the second real user using the second video display device in the specific space, and the relative position of the second real user in the specific space is determined. Displaying an image of a second virtual user corresponding to a second real user on a virtual reality image of the first virtual model house;
The relative position of the second virtual user in the first virtual model house,
corresponding to the relative position of the second real user in the specific space;
Virtual model house provision system. According to claim 4,
The first image display device,
When the second real user is located within the viewing angle of the first real user, the second virtual user's image is displayed on the virtual reality image of the first virtual model house.
Virtual model house provision system. According to claim 4,
The first image display device,
outputting an alarm when the second real user is located outside the viewing angle of the first real user and the distance between the second real user and the first real user is smaller than a predetermined distance;
Virtual model house provision system. According to claim 1,
The first image display device,
As the first real user moves within the specific space, displaying a virtual reality image from the viewpoint of a first virtual user moving in the first virtual model house;
When the wall of the first virtual model house is located in the moving path of the first virtual user, displaying a virtual reality image passing through the wall
Virtual model house provision system. According to claim 1,
The first image display device,
When the first virtual user who has moved in response to the movement of the first real user is located outside the first virtual model house, displaying a virtual reality image outside the first virtual model house
Virtual model house provision system. According to claim 1,
The size of the first virtual model house,
The same size as the actual house corresponding to the first virtual model house.
Virtual model house provision system. According to claim 8,
The virtual reality image of the outside of the first virtual model house,
At least one of a virtual external view of the first virtual model house, a virtual building including the first virtual model house, and a virtual building around the first virtual model house;
The arrangement of the virtual building including the first virtual model house and the virtual building around the first virtual model house,
The same layout as the real building corresponding to the virtual building and the real building corresponding to the surrounding virtual building.
Virtual model house provision system. According to claim 1,
The video display device,
Outputting an alarm when the location of the first actual user is within a predetermined distance from the wall of the specific space
Virtual model house provision system. According to claim 1,
The first image display device,
When the first virtual user is located in a first area among a plurality of areas in the first virtual model house, displaying one or more virtual goods corresponding to the first area;
When a specific item is selected from among the one or more virtual items, displaying a virtual reality image of the first zone where the specific item is placed
Virtual model house provision system. According to claim 1,
The first image display device,
displaying one or more virtual goods corresponding to a direction in which the first virtual user looks;
Displaying a virtual reality image in which the specific item is placed when a specific item is selected from among the one or more virtual items
Virtual model house provision system. delete According to claim 1,
The virtual reality image of the first virtual model house,
It is an image provided by a supplier of a real house corresponding to the first virtual model house,
The virtual reality image of the second virtual model house,
An image provided by a supplier of a real house corresponding to the second virtual model house
Virtual model house provision system. According to claim 1,
The virtual reality image of the first virtual model house,
An exterior view reflecting at least one of the dong, floor, and surrounding buildings of the real house corresponding to the first virtual model house,
The external view,
A view of the outside from the inside of the first virtual model house
Virtual model house provision system. According to claim 16,
The first image display device,
Based on at least one of date, time, and surrounding buildings, displaying an image representing the sunlight range of the first virtual model house
Virtual model house provision system.

Images