JP2019192039A - Virtual space display system and virtual space display method - Google Patents

Abstract

To provide a virtual space display system that enables performing an intuitive operation by a user.SOLUTION: A virtual space display system comprises: a two-dimensional or three-dimensional room layout structure 120 that indicates a room layout of a building; a character structure 110 that is movably arranged at any position of the room layout structure 120; a position detection unit 130 that detects a position of the character structure 110 arranged in the room layout structure 120; and a control unit 140 that displays a virtual space corresponding to a space within the building on a display unit 150. The control unit 140 displays the virtual space on the display unit 150 when seen from a position in the virtual space corresponding to the character structure 110 detected by the position detection unit 130.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a virtual space display system and a virtual space display method.

  In recent years, three-dimensional computer graphics technology has become widespread. In this technique, a virtual space is displayed on a display, and the user can move the virtual space in a pseudo manner by operating the operation unit.

  Patent Document 1 discloses a technique for sensing a user's behavior in a real space and reflecting the sensed result in a virtual space.

Japanese Patent Laid-Open No. 2002-82751

  It is desired that the operation unit operated by the user can be operated easily, that is, intuitively by the user.

  An object of this invention is to provide the virtual space display system etc. which enable the intuitive operation by a user.

  A virtual space display system according to an aspect of the present invention includes a two-dimensional or three-dimensional floor plan structure that indicates a floor plan of a building, and a character structure that is movably disposed at an arbitrary position of the floor plan structure. A position detection unit that detects a position of the character structure arranged in the floor plan structure, and a control unit that displays a virtual space corresponding to the space in the building on a display unit, and the control unit includes: The virtual space when viewed from the position in the virtual space corresponding to the position of the character structure detected by the position detection unit is displayed on the display unit.

  Further, the virtual space display method according to one aspect of the present invention includes a position detection step for detecting a position of a character structure arranged in a two-dimensional or three-dimensional floor plan structure, which indicates a floor plan of a building, and the building A control step of displaying a virtual space corresponding to the space on the display unit, wherein the control step is viewed from a position in the virtual space corresponding to the position of the character structure detected in the position detection step. The virtual space is displayed on the display unit.

  A program according to an aspect of the present invention is a program for causing a computer to execute the virtual space display method.

  Note that these comprehensive or specific aspects may be realized by a system, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM, and the system, method, integrated circuit, and computer program. Also, any combination of recording media may be realized.

  According to the virtual space display system and the like according to one aspect of the present invention, it is possible to provide a virtual space display system that enables an intuitive operation by a user.

FIG. 1 is a diagram for explaining the configuration of the virtual space display system according to the first embodiment. FIG. 2 is a block diagram showing a functional configuration of the virtual space display system according to the first embodiment. FIG. 3 is a flowchart showing a processing procedure executed by the virtual space display system according to the first embodiment. FIG. 4A is a diagram illustrating a first example of arrangement of character structures on a floor plan structure included in the virtual space display system according to Embodiment 1. FIG. 4B is a diagram illustrating an example of an image corresponding to the position and orientation of the character structure in FIG. 4A. FIG. 5A is a diagram illustrating a second example of the arrangement of the character structures on the floor plan structure included in the virtual space display system according to Embodiment 1. FIG. 5B is a diagram showing an example of an image corresponding to the position and orientation of the character structure in FIG. 5A. FIG. 6A is a diagram illustrating a third example of arrangement of character structures on the floor plan structure included in the virtual space display system according to Embodiment 1. FIG. 6B is a diagram showing an example of an image corresponding to the position and orientation of the character structure in FIG. 6A. FIG. 7 is a diagram illustrating a modification of the floor plan structure. FIG. 8 is a block diagram illustrating a functional configuration of the virtual space display system according to the second embodiment. FIG. 9A is a diagram for explaining an operation of fitting an operation unit and a character structure included in the virtual space display system according to Embodiment 2; FIG. 9B is a diagram for explaining an operation by the user of the character structure included in the virtual space display system according to Embodiment 2. FIG. 9C is a cross-sectional view illustrating a cross section of the operation unit and the character structure included in the virtual space display system according to Embodiment 2 along the line IXC-IXC in FIG. 9B. FIG. 10 is a diagram for explaining a processing procedure when changing the pattern of the structure in the virtual space displayed on the display unit. FIG. 11 is a flowchart illustrating a processing procedure executed by the virtual space display system according to the second embodiment.

  Hereinafter, embodiments of the present invention will be specifically described with reference to the drawings. Note that each of the embodiments described below shows a comprehensive or specific example of the present invention. Numerical values, shapes, materials, components, arrangement positions and connection forms of components, steps, order of steps, and the like shown in the following embodiments are merely examples, and are not intended to limit the present invention. In addition, among the constituent elements in the following embodiments, constituent elements that are not described in the independent claims indicating the highest concept are described as optional constituent elements.

  Each figure is a schematic diagram and is not necessarily shown strictly. Moreover, in each figure, the same code | symbol is attached | subjected to the substantially same structure, The overlapping description may be abbreviate | omitted or simplified.

(Embodiment)
[Constitution]
First, the configuration of the virtual space display system according to Embodiment 1 of the present invention will be described.

  FIG. 1 is a diagram for explaining a configuration of a virtual space display system 100 according to the first embodiment. FIG. 2 is a block diagram showing a functional configuration of the virtual space display system 100 according to the first embodiment.

  The virtual space display system 100 is a system that realizes a virtual walk-through in which a user virtually moves in a virtual space that is an image displayed on the display unit 150. The virtual space display system 100 realizes a virtual tour of a building such as a model house, for example. For example, the user moves the character structure 110 included in the virtual space display system 100 and is displayed on the display unit 150 by moving the character structure 110 included in the virtual space display system 100 arranged on the floor plan structure 120 indicating the floor plan of the building. Move virtually in a virtual space.

  As shown in FIG. 2, the virtual space display system 100 includes a floor plan structure 120, a character structure 110, a position detection unit 130, a control unit 140, a display unit 150, and a storage unit 160.

  The floor plan structure 120 is a structure showing a floor plan of a building such as a house or a building. FIG. 1 shows a two-dimensional floor plan structure 120 having a sheet shape as an example. In addition, the floor plan structure 120 may be a three-dimensional shape having a wall portion imitating a wall or the like instead of a sheet shape.

  The character structure 110 is a structure that is movably disposed at an arbitrary position of the floor plan structure 120. The character structure 110 may be, for example, a structure imitating a living thing or an inanimate model such as a camera. For example, the character structure 110 is a structure imitating a person (that is, a doll).

  The position detection unit 130 detects the position of the character structure 110 arranged in the floor plan structure 120. The position detection unit 130 includes, for example, a magnetic sensor such as a hall sensor. In this case, the character structure 110 includes a magnet 200 such as a permanent magnet as shown in FIG. FIG. 1 illustrates two magnetic sensors 131 and 132 included in the position detection unit 130. The plurality of magnetic sensors are arranged at a plurality of points of the floor plan structure 120 and connected to the control unit 140 by, for example, communication lines (not shown). The number of magnetic sensors is not particularly limited, and may be three or more.

  Note that the position detection unit 130 only needs to be able to detect the position of the character structure 110 in the floor plan structure 120, and may include an image detection device such as a charge coupled device (CCD) and a complementary metal oxide semiconductor (CMOS). Even if the position detection unit 130 detects the position of the character structure 110 in the floor plan structure 120 from the image of the floor plan structure 120 including the character structure 110 obtained by being imaged by such an image detection device. Good.

  The control unit 140 is a control device that causes the display unit 150 to display a virtual space corresponding to the space in the building. Specifically, control unit 140 causes display unit 150 to display a virtual space when viewed from a position in the virtual space corresponding to the position of character structure 110 detected by position detection unit 130. More specifically, the control unit 140 displays an image when the virtual space is virtually viewed from the position in the virtual space corresponding to the position of the character structure 110 detected by the position detection unit 130 on the display unit 150. Let The control unit 140 is realized by, for example, a CPU (Central Processing Unit) and, for example, a control program stored in the storage unit 160 described later and executed by the CPU.

  For example, when the position detection unit 130 includes a plurality of magnetic sensors and the character structure 110 includes a magnet, the control unit 140 detects the position of the magnetic sensor that has detected the strongest magnetic force among the plurality of magnetic sensors. The virtual space when viewed from the position of the virtual space corresponding to is displayed on the display unit 150.

  Moreover, since the user can arbitrarily move the position of the character structure 110 on the floor plan structure 120, the character structure 110 may move unintentionally by colliding with the user. is assumed. For such unintentional movement of the character structure 110, the control unit 140 may not change the virtual space displayed on the display unit 150. Specifically, when the virtual space is displayed on the display unit 150, the control unit 140 displays on the display unit 150 when no magnetic force exceeding a predetermined threshold is detected from any of the plurality of magnetic sensors. The display of the virtual space being made may be maintained on the display unit 150.

  The display unit 150 is a display device that displays a virtual space. The display unit 150 is, for example, a display.

  The storage unit 160 is a memory such as a ROM (Read Only Memory) or a RAM (Random Access Memory) in which a control program executed by the control unit 140 is stored.

  In addition, the storage unit 160 stores virtual space three-dimensional image information, that is, virtual space information 161 that is three-dimensional image information of the virtual space that the control unit 140 displays on the display unit 150. The control unit 140 uses the virtual space information 161 to determine the virtual space viewed from the position of the virtual space corresponding to the position of the character structure 110 detected by the position detection unit 130 in the virtual space corresponding to the space in the building. It is displayed on the display unit 150. That is, the control unit 140 selects an image based on the position of the character structure 110 detected by the position detection unit 130 from the image group included in the virtual space information 161 and causes the display unit 150 to display the image. The control unit 140 calculates a position in the virtual space corresponding to the position of the character structure 110 detected by the position detection unit 130 using the virtual space information 161 including information on the structure of the building, and calculates the position from the calculated position. A virtual space image when viewed may be generated, and the generated image may be displayed on the display unit 150. Further, the control unit 140 may generate an image when an arbitrary direction is viewed from the calculated position in the virtual space, or calculates and calculates a direction in the virtual space corresponding to the orientation of the character structure 110. An image when the direction is viewed may be generated.

  The virtual space display system 100 may further include an orientation detection unit 180.

  The direction detection unit 180 detects the direction of the character structure 110. For example, when the character structure 110 is a doll, the direction detection unit 180 detects the direction in which the face of the character structure 110 is facing (hereinafter referred to as the front direction) as the direction of the character structure. Here, the forward direction is, for example, the normal direction of the face formed in the character structure 110. Further, the forward direction may be the line-of-sight direction when eyes are formed on the character structure 110.

  The direction detection unit 180 includes, for example, a gyro sensor. A gyro sensor is arrange | positioned so that the inside or the outer surface of the character structure 110 may be contacted, for example. The direction detection unit 180 may further include an acceleration sensor such as a triaxial acceleration sensor.

  The control unit 140 may cause the display unit 150 to display a virtual space based on the position of the character structure 110 detected by the position detection unit 130 and the orientation of the character structure 110 detected by the orientation detection unit 180.

  Note that the orientation detection unit 180 only needs to be able to detect the orientation of the character structure 110 in the floor plan structure 120, and may include an image detection device such as a CCD or CMOS. The orientation detection unit 180 may detect the orientation of the character structure 110 from the image of the character structure 110 obtained by being imaged by such an image detection device.

  In the following description, it is assumed that the direction detection unit 180 is a gyro sensor and is arranged inside the character structure 110. The position detection unit 130 is a magnetic sensor, and the character structure 110 is described as including the magnet 200.

[Processing procedure]
Subsequently, a processing procedure of the virtual space display system 100 according to Embodiment 1 will be described.

  FIG. 3 is a flowchart showing a processing procedure executed by the virtual space display system 100 according to the first embodiment.

  First, the position detection unit 130 detects the position of the character structure 110 in the floor plan structure 120 (step S101). Specifically, the position detection unit 130 detects the magnetic force from the magnet 200 included in the floor plan structure 120 in step S101.

  Next, the direction detection unit 180 detects the direction of the character structure 110 (step S102).

  Next, the control unit 140 determines the position of the virtual space displayed on the display unit 150 from the magnetic force detected by the position detection unit 130 in step S101 and the orientation of the character structure 110 detected by the orientation detection unit 180 in step S102. And the direction are calculated (step S103). Specifically, in step S <b> 103, the control unit 140 detects the position in the virtual space corresponding to the position where the strongest magnetic force is detected among the plurality of magnetic sensors included in the position detection unit 130 and the direction detection unit 180 detects. A direction in the virtual space corresponding to the direction of the character structure 110 is calculated.

  Next, the control unit 140 causes the display unit 150 to display the virtual space corresponding to the position and direction in the virtual space calculated in step S103 (step S104). Specifically, in step S104, the direction detection unit 180 detects the control unit 140 from the position in the virtual space corresponding to the position where the strongest magnetic force is detected among the plurality of magnetic sensors provided in the position detection unit 130. A virtual space when the direction corresponding to the direction of the character structure 110 is viewed is displayed on the display unit 150.

[concrete]
Subsequently, an arrangement of the character structure 110 on the floor plan structure 120 included in the virtual space display system 100 according to Embodiment 1 and a specific example of an image corresponding to the arrangement will be described. 4A, FIG. 5A, and FIG. 6A are diagrams showing a case where the sheet-like floor plan structure 120 shown in FIG. 1 is viewed from the normal direction.

<First example>
4A is a diagram illustrating a first example of the arrangement of the character structures 110 on the floor plan structure 120 included in the virtual space display system 100 according to Embodiment 1. FIG. FIG. 4B is a diagram showing an example of an image 151 corresponding to the position and orientation of the character structure 110 in FIG. 4A.

  For example, it is assumed that the user places the character structure 110 on the floor plan structure 120 in the vicinity of the magnetic sensor 131 in the front direction L1 as illustrated in FIG. 4A. In this case, the control unit 140 determines that the character structure 110 has been placed on the magnetic sensor 131 by the user, assuming that the magnetic sensor 131 has detected the strongest magnetic force. Further, the control unit 140 acquires the front direction L1 of the character structure from the orientation detection unit 180 (see FIG. 2) provided in the character structure 110. The control unit 140 displays the virtual space displayed on the display unit 150 from the position and the front direction L1 of the character structure 110 in the floor plan structure 120 acquired in this way and the virtual space information 161 stored in the storage unit 160. And the image 151 showing the determined range of the virtual space is displayed on the display unit 150. The image 151 is an image showing a part of the virtual space.

<Second example>
FIG. 5A is a diagram illustrating a second example of the arrangement of the character structures 110 on the floor plan structure 120 included in the virtual space display system 100 according to Embodiment 1. FIG. 5B is a diagram illustrating an example of an image corresponding to the position and orientation of the character structure 110 in FIG. 5A.

  For example, as shown in FIG. 5A, the user is assumed to place the character structure 110 on the floor plan structure 120 in the vicinity of the magnetic sensor 132 in the front direction L2. In this case, the control unit 140 determines that the character structure 110 is placed on the magnetic sensor 132 by the user, assuming that the magnetic sensor 132 has detected the strongest magnetic force. Further, the control unit 140 acquires the front direction L2 of the character structure from the orientation detection unit 180 (see FIG. 2) provided in the character structure 110. The control unit 140 obtains the virtual space to be displayed on the display unit 150 from the position and the front direction L2 of the character structure 110 in the floor plan structure 120 acquired in this way and the virtual space information 161 stored in the storage unit 160. Is displayed, and an image 152 different from the image 151 shown in FIG. 4B is displayed on the display unit 150. As described above, the user can change the image displayed on the display unit 150, that is, the virtual space only by changing the position of the character structure 110 with respect to the floor plan structure 120. The image 152 is an image showing a part of the virtual space.

<Third example>
FIG. 6A is a diagram illustrating a third example of the arrangement of the character structures 110 on the floor plan structure 120 included in the virtual space display system 100 according to Embodiment 1. FIG. 6B is a diagram showing an example of an image corresponding to the position and orientation of the character structure 110 in FIG. 6A.

  For example, as shown in FIG. 6A, the user is assumed to place the character structure 110 on the floor plan structure 120 in the front direction L3 in the vicinity of the magnetic sensor 132. That is, FIG. 6A shows an example in which the user rotates the character structure so that the arrangement is the same as that of the character structure 110 shown in FIG. 5A but the front direction is different.

  In this case, the control unit 140 determines that the character structure 110 is placed on the magnetic sensor 132 by the user, assuming that the magnetic sensor 132 has detected the strongest magnetic force. Furthermore, the control unit 140 acquires the front direction L3 of the character structure from the orientation detection unit 180 (see FIG. 2) provided in the character structure 110. The control unit 140 acquires the virtual space displayed on the display unit 150 from the position and the front direction L3 of the character structure 110 in the floor plan structure 120 acquired in this way and the virtual space information 161 stored in the storage unit 160. , And an image 153 different from the image 152 shown in FIG. 5B is displayed on the display unit 150. Here, the image 153 includes a window or the like similar to the image 152 at a different position. As described above, the user can change the image displayed on the display unit 150, that is, the virtual space only by changing the orientation of the character structure 110. The image 153 is an image showing a part of the virtual space.

[Modification]
Subsequently, a modification of the floor plan structure will be described.

  For example, as shown in FIG. 1, the floor plan structure 120 may have a two-dimensional shape such as a sheet shape or a plate shape, but a two-dimensional structure body such as a three-dimensional shape, a sheet shape, or a plate shape is arranged in layers. It may be three-dimensional.

  FIG. 7 is a diagram illustrating a modification of the floor plan structure.

  The floor plan structure 121 is formed in a sheet shape, and includes a plurality of structures each showing a part of the floor plan of the building, and the respective structures are arranged in layers. In addition, magnetic sensors 131 to 134 included in the position detection unit 130 are disposed in these structures. By adopting such a configuration, the number of floors such as the first floor and the second floor in the floor plan of the building can be intuitively understood by the user.

  In FIG. 7, the floor plan structure 121 includes two sheet-like structures, but may include three or more sheet-like structures. Moreover, the floor plan structure 121 does not need to be arrange | positioned at layer form, when each is provided with the some sheet-like structure which shows a part of floor plan of a building. For example, each of or a part of the plurality of sheet-like structures may be arranged side by side.

[Summary]
As described above, the virtual space display system 100 according to the first embodiment is movable to any position of the two-dimensional or three-dimensional floor plan structure 120 indicating the floor plan of the building and the floor plan structure 120. The character structure 110 to be arranged, the position detection unit 130 for detecting the position of the character structure 110 arranged in the floor plan structure 120, and the control unit for causing the display unit 150 to display a virtual space corresponding to the space in the building 140. The control unit 140 causes the display unit 150 to display the virtual space when viewed from a position corresponding to the position of the character structure 110 detected by the position detection unit 130.

  According to such a configuration, the user can change the virtual space displayed on the display unit 150 only by moving the character structure 110 on the floor plan structure 120. Therefore, according to the virtual space display system 100, an intuitive operation by the user can be enabled.

  For example, the virtual space display system 100 further includes an orientation detection unit 180 that can detect the orientation of the character structure 110. In this case, for example, the control unit 140 selects a direction corresponding to the direction of the character structure 110 detected by the azimuth detection unit 180 from the position in the virtual space corresponding to the position of the character structure 110 detected by the position detection unit 130. The virtual space when viewed is displayed on the display unit 150.

  According to such a configuration, the user can change the virtual space displayed on the display unit 150 only by rotating the character structure 110 on the floor plan structure 120, for example. Therefore, according to such a configuration, a more intuitive operation by the user can be made possible.

  For example, the direction detection unit 180 includes a gyro sensor.

  According to such a configuration, the orientation of the character structure 110 can be detected with a simple configuration.

  For example, the character structure 110 is a doll. In this case, for example, the direction detection unit 180 detects the direction in which the face of the character structure 110 is facing as the direction of the character structure 110.

  According to such a configuration, the user only has to visually recognize the shape of the character structure 110 to change the virtual space image displayed on the display unit 150 to a desired virtual space image. Thus, it becomes easy to understand whether the character structure 110 should be moved. Therefore, according to the virtual space display system 100, an intuitive operation by the user can be enabled.

  Further, for example, the position detection unit 130 includes a plurality of magnetic sensors. For example, a plurality of magnetic sensors are arranged at a plurality of points of the floor plan structure 120. For example, the character structure 110 includes a magnet. In these cases, the control unit 140 causes the display unit 150 to display the virtual space when viewed from the position in the virtual space corresponding to the position of the magnetic sensor that has detected the strongest magnetic force among the plurality of magnetic sensors.

  According to such a configuration, the position of the character structure 110 in the floor plan structure 120 can be detected with a simple configuration.

  Further, for example, when the virtual space is displayed on the display unit 150, the control unit 140 displays the virtual space on the display unit 150 when no magnetic force exceeding a predetermined threshold is detected from any of the plurality of magnetic sensors. The display unit 150 maintains the display of the virtual space.

  Since the user can arbitrarily move the position of the character structure 110 on the floor plan structure 120, the character structure 110 may be moved unintentionally by colliding with the user. The Even in such a case, by adopting a configuration in which the display of the virtual space displayed on the display unit 150 by the control unit 140 is maintained, changes in the display of the virtual space that are not intended by the user can be suppressed.

  Note that the virtual space display system 100 may not be provided with the display unit 150, but may be realized as an operation system operated by a user to display the virtual space on the display unit 150, or may include the display unit 150.

  In addition, the virtual space display method according to the first embodiment includes a position detection step of detecting the position of the character structure 110 arranged in the two-dimensional or three-dimensional floor plan structure 120, which indicates a floor plan of the building, A control step of causing the display unit 150 to display a virtual space corresponding to the space. In the control step, the virtual space when viewed from the position in the virtual space corresponding to the position of the character structure 110 detected in the position detection step is displayed on the display unit 150.

  According to such a method, the user can change the virtual space displayed on the display unit 150 only by moving the character structure 110 on the floor plan structure 120. Therefore, according to such a method, an intuitive operation by the user can be enabled.

(Embodiment 2)
Hereinafter, the virtual space display system according to Embodiment 2 will be described. In the description of the virtual space display system according to the second embodiment, components that are substantially the same as those of the virtual space display system according to the first embodiment are denoted by the same reference numerals, and description thereof is partially omitted or simplified. There is a case.

[Constitution]
First, the configuration of the virtual space display system according to Embodiment 2 of the present invention will be described.

  FIG. 8 is a block diagram illustrating a functional configuration of the virtual space display system 101 according to the second embodiment.

  Similar to the virtual space display system 100 according to the first embodiment, the virtual space display system 101 according to the second embodiment is a virtual in which a user virtually moves in a virtual space that is an image displayed on the display unit 150. It is a system that realizes walk-through. The virtual space display system 100 realizes a virtual tour of a building such as a model house, for example.

  As shown in FIG. 8, the virtual space display system 101 according to the second embodiment is similar to the virtual space display system 100 according to the first embodiment, in that the floor plan structure 120, the character structure 111, and the position detection unit 130, a control unit 141, a display unit 150, and a storage unit 160. The virtual space display system 101 further includes an operation unit 170 and an imaging unit 190.

  FIG. 9A is a diagram for explaining a user's operation for fitting the operation unit and the character structure 111 included in the virtual space display system 101 according to the second embodiment. FIG. 9B is a diagram for explaining an operation by the user of the character structure 111 included in the virtual space display system 101 according to Embodiment 2. FIG. 9C is a cross-sectional view showing a cross section of the fitting unit 171 and the character structure 111 included in the operation unit 170 included in the virtual space display system 101 according to Embodiment 2 along the IXC-IXC line in FIG. 9B.

  Similar to the character structure 110, the character structure 111 is a structure that is movably arranged at an arbitrary position of the floor plan structure 120. The character structure 110 is, for example, a doll.

  Moreover, the character structure 111 has the to-be-fitted part 201 fitted to the fitting part 171 which the operation part 170 has, for example, as shown to FIG. 9C. The fitted portion 201 is formed with at least one of a concave concave portion or a convex convex portion. For example, FIG. 9C shows an example in which the entire fitted portion 201 is concave.

  For example, as illustrated in FIG. 9A, the operation unit 170 includes an operation unit having a fitting unit 171 for receiving an operation from the user. The fitting portion 171 is fitted with the fitted portion 201, and at least one of a concave concave portion or a convex convex portion is formed. For example, FIG. 9C shows an example in which the entire fitting portion 171 is a convex convex portion. As described above, the operation unit 170 has the fitting portion 171 in which one of the convex portion and the concave portion is formed, and the character structure 111 is formed in the other of the convex portion and the concave portion to be fitted to the fitting portion 171. The fitted portion 201 is provided.

  For example, the user not only changes the display of the virtual space displayed on the display unit 150 by moving the character structure 111, but also displays the display unit 150 by moving the fitting unit 171 of the operation unit 170. Change the displayed virtual space. Specifically, the control unit 141 displays not only information indicating the orientation of the character structure detected by the orientation detection unit 180 but also a display unit based on information received from the user by the fitting unit 171 of the operation unit 170. The display of the virtual space displayed at 150 is changed.

  Similarly to the control unit 140, the control unit 141 is a virtual when viewed from the virtual space position corresponding to the position of the character structure 110 detected by the position detection unit 130 in the virtual space corresponding to the space in the building. It is a control device that displays a space on the display unit 150. The control unit 141 is realized by, for example, a CPU and a control program that is stored in the storage unit 160 and executed by the CPU, for example.

  For example, the control unit 141 displays the display unit based on the operation received by the operation unit 170 when the operation unit 170 receives an operation from the user when the fitted unit 201 is fitted to the fitting unit 171. The virtual space displayed on 150 is changed.

  For example, the user first arranges the character structure 111 at an arbitrary position of the floor plan structure 120 in an arbitrary direction. The control unit 141 causes the display unit 150 to display a virtual space based on the position and orientation of the character structure 111.

  Next, as shown in FIG. 9A, the user places the character structure 111 away from the floor plan structure 120 and places it on the operation unit 170. Specifically, as shown in FIG. 9C, the fitted portion 201 included in the character structure 111 and the fitting portion 171 included in the operation unit 170 are fitted.

  In this case, when the control unit 141 displays the virtual space on the display unit 150, a magnetic force exceeding a predetermined threshold is detected from any of the plurality of magnetic sensors included in the position detection unit 130. When it disappears, you may make the display part 150 maintain the display of the virtual space currently displayed on the display part 150. FIG. Thus, even when the character structure 111 is separated from the floor plan structure 120, the display of the virtual space displayed on the display unit 150 is maintained. In this case, the control unit 141 may cause the display unit 150 to display a virtual space when only the position of the character structure 111 is maintained in the virtual space to be displayed on the display unit 150. A virtual space when the position and orientation of the body 111 are maintained may be displayed.

  Next, as shown in FIG. 9B, the user is displayed on the display unit 150 by, for example, rotating the character structure 111 arranged in the operation unit 170 or tilting the character structure 111 diagonally. Change the virtual space. Specifically, the control unit 141 detects the character structure detected by the azimuth detection unit 180 when it is determined that the fitted portion 201 included in the character structure 111 is fitted into the fitting portion 171 included in the operation unit 170. The virtual space displayed on the display unit 150 is changed based on the orientation of the body 111 and the operation received by the operation unit 170. In order to determine whether or not the fitted portion 201 included in the character structure 111 is fitted into the fitting portion 171 included in the operation unit 170 by the control unit 141, the operation unit 170 includes the position detection unit 130. May be provided. For example, one of a plurality of magnetic sensors included in the position detection unit 130 may be disposed on the operation unit 170. More specifically, the magnetic sensor may be disposed near the fitting portion 171 or the fitting portion 171 of the operation unit 170. In this way, the control unit 141 may determine whether or not the fitted portion 201 included in the character structure 111 is fitted into the fitting portion 171 included in the operation unit 170.

  Further, the control unit 141 may determine the change contents of the virtual space for the operation received by the fitting unit 171 from the user based on the direction of the character structure 111 detected by the direction detection unit 180. For example, when the fitting unit 171 of the operation unit 170 is moved in the same direction as the character structure 111, the control unit 141 may change the display of the virtual space so that the user has virtually moved forward. Good. Further, for example, when the fitting unit 171 of the operation unit 170 is moved in the horizontal direction with respect to the character structure 111, the control unit 141 virtually displays the virtual space in the horizontal direction by the user. You may change it.

  The imaging unit 190 is a camera including an image detection device such as a CCD or CMOS. For example, the control unit 141 changes the pattern of the second structure that is a structure in the virtual space to the pattern of the structure (first structure) captured by the imaging unit 190 and causes the display unit 150 to display the pattern. In other words, the control unit 141 reflects the structure pattern captured by the image capturing unit 190 on the structure pattern in the virtual space.

  FIG. 10 is a diagram for explaining a processing procedure when changing the pattern of the structure in the virtual space displayed on the display unit 150.

  As illustrated in FIG. 10, for example, the user uses the imaging unit 190 to image the structure 210 in real space (that is, an example of the first structure). In this way, the control unit 141 acquires the pattern of the structure 210 from the image obtained by the imaging unit 190 imaging the structure 210.

  Next, for example, the user operates the operation unit 170 to select a part or all of the image 154 indicating the virtual space displayed on the display unit 150 as the selection range 155. The control unit 141 changes the pattern in the selection range 155 to the pattern of the structure 210 captured by the imaging unit 190. That is, the structure in the virtual space in which the selection range 155 shown in FIG. 10 is selected is an example of the second structure.

[Processing procedure]
Subsequently, a processing procedure of the virtual space display system according to the second embodiment will be described.

  FIG. 11 is a flowchart showing a processing procedure executed by the virtual space display system 101 according to the second embodiment.

  First, the position detection unit 130 detects the position of the character structure 111 in the floor plan structure 120 (step S201). Specifically, the position detection unit 130 detects the magnetic force from the magnet 200 included in the floor plan structure 120 in step S201.

  Next, the direction detection unit 180 detects the direction of the character structure 111 (step S202).

  Next, the control unit 141 displays the position of the virtual space displayed on the display unit 150 from the magnetic force detected by the position detection unit 130 in step S201 and the orientation of the character structure 111 detected by the azimuth detection unit 180 in step S202. And the direction are calculated (step S203). Specifically, in step S <b> 203, the control unit 141 detects the position in the virtual space corresponding to the position where the strongest magnetic force is detected among the plurality of magnetic sensors included in the position detection unit 130 and the direction detection unit 180. A direction in the virtual space corresponding to the direction of the character structure 111 is calculated.

  Next, the control unit 141 causes the display unit 150 to display a virtual space corresponding to the position and orientation of the character structure 111 in the virtual space calculated in step S203 (step S204). Specifically, in step S204, the direction detection unit 180 detects the control unit 141 from the position in the virtual space corresponding to the position where the strongest magnetic force is detected among the plurality of magnetic sensors included in the position detection unit 130. A virtual space when the direction corresponding to the direction of the character structure 111 is viewed is displayed on the display unit 150.

  Next, the control part 141 determines whether the to-be-fitted part 201 which the character structure 111 has fitted to the fitting part 171 which the operation part 170 has (step S205).

  When it is determined that the fitted portion 201 included in the character structure 111 has been fitted into the fitting portion 171 included in the operation unit 170 (Yes in step S205), the control unit 141, for example, The operation is accepted from (step S206).

  Next, when the operation unit 170 receives an operation from the user, the control unit 141 causes the display unit 150 to display a virtual space based on the operation received by the operation unit 170 (step S207). When the operation unit 170 receives an operation from the user, the control unit 141 changes the virtual space displayed on the display unit 150 based on the operation received by the operation unit 170.

[Summary]
As described above, the virtual space display system 101 according to the second embodiment has a configuration of the virtual space display system 100 according to the first embodiment, and further includes one of a convex portion and a concave portion for receiving an operation from the user. The operation part 170 which has the fitting part 171 in which is formed is provided. In addition, the character structure 111 has a fitted portion 201 in which the other of the convex portion and the concave portion that fits into the fitting portion 171 is formed. When the operation unit 170 receives an operation from the user when the fitted part 201 is fitted to the fitting part 171, the control unit 141 displays the operation on the display unit 150 based on the operation received by the operation unit 170. Change the virtual space to be displayed.

  According to such a configuration, the same effect as that of the virtual space display system 100 according to Embodiment 1 can be obtained. Further, the user virtually operates the virtual space displayed on the display unit 150 by the operation unit 170. It is possible to perform operations such as proceeding to.

  For example, the virtual space display system 101 further includes an imaging unit 190. In this case, the control unit 141 reflects the pattern of the structure 210 captured by the imaging unit 190 on the pattern of the structure in the virtual space.

  According to such a configuration, the user can confirm, from the pattern of the structure 210, the virtual space when the pattern is applied to a building material or the like.

(Other embodiments)
The virtual space display system and the like according to Embodiment 1 and Embodiment 2 have been described above, but the present invention is not limited to the above embodiment.

  For example, a component of a processing unit such as a control unit provided in the virtual space display system may be configured by one or a plurality of electronic circuits. Each of the one or more electronic circuits may be a general-purpose circuit or a dedicated circuit. The one or more electronic circuits may include, for example, a semiconductor device, an IC (Integrated Circuit), an LSI (Large Scale Integration), or the like. The IC or LSI may be integrated on one chip or may be integrated on a plurality of chips. Here, it is called IC or LSI, but the name changes depending on the degree of integration, and may be called system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration). An FPGA (Field Programmable Gate Array) programmed after manufacturing the LSI can be used for the same purpose.

  The general or specific aspect of the present invention may be realized by a system, an apparatus, a method, an integrated circuit, or a computer program. Alternatively, it may be realized by a computer-readable non-transitory recording medium such as an optical disk, HDD, or semiconductor memory in which the computer program is stored. Further, the present invention may be realized by any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. Here, the software for realizing the virtual space display method of the above embodiment is the following program.

  That is, this program is a program for causing a computer to execute the virtual space display method according to the present invention. Specifically, the program is a two-dimensional or three-dimensional floor plan structure 120 indicating a floor plan of a building. The detection step of detecting the position of the arranged character structure 110 and the virtual space corresponding to the space in the building as viewed from the position of the virtual space corresponding to the position of the character structure 110 detected in the detection step The control step of displaying the virtual space on the display unit 150 is executed.

  In the above embodiment, the position detection unit and the direction detection unit transmit information on the orientation of the character structure to the control unit by wireless communication. However, the information transmission method, that is, the position detection unit and the direction detection unit, The communication method with the control unit is not limited. The position detection unit and the azimuth detection unit may include, for example, a wireless communication module for transmitting information to the control unit. The wireless communication between the position detection unit, the direction detection unit, and the control unit is performed based on a predetermined wireless communication standard such as Bluetooth (registered trademark), Wi-Fi (registered trademark), or ZigBee (registered trademark). Also good. Further, the position detection unit and the direction detection unit may perform wired communication with the control unit. In this case, the position detection unit and the direction detection unit may include a communication adapter for connecting a cable for wired communication with the control unit. The communication method between the operation unit, the imaging unit, and the control unit may be wired communication or wireless communication, similarly to the position detection unit and orientation detection unit.

  In addition, the embodiment can be realized by arbitrarily combining the components and functions in each embodiment without departing from the scope of the present invention, or a form obtained by subjecting each embodiment to various modifications conceived by those skilled in the art. Forms are also included in the present invention.

100, 101 Virtual space display system 110, 111 Character structure 120, 121 Floor plan structure 130 Position detection unit 131-134 Magnetic sensor 140, 141 Control unit 150 Display unit 160 Storage unit 170 Operation unit 171 Fitting unit 180 Direction detection unit 190 Imaging part 200 Magnet 201 Fit part 210 Structure L1, L2, L3 Forward direction

Claims (11)

2D or 3D floor plan structure showing the floor plan of the building;
A character structure movably arranged at an arbitrary position of the floor plan structure;
A position detection unit for detecting the position of the character structure arranged in the floor plan structure;
A control unit that causes a display unit to display a virtual space corresponding to the space in the building,
The said control part displays the said virtual space when it sees from the position in the said virtual space corresponding to the position of the said character structure which the said position detection part detected on the said display part. Virtual space display system. Furthermore, an orientation detection unit capable of detecting the orientation of the character structure is provided,
When the control unit sees a direction corresponding to the direction of the character structure detected by the azimuth detection unit from a position in the virtual space corresponding to the position of the character structure detected by the position detection unit. The virtual space display system according to claim 1, wherein the virtual space is displayed on the display unit. The virtual space display system according to claim 2, wherein the orientation detection unit includes a gyro sensor. The character structure is a doll,
The virtual space display system according to claim 2, wherein the direction detection unit detects a direction in which the face of the character structure is facing as the direction of the character structure. The position detection unit includes a plurality of magnetic sensors,
The plurality of magnetic sensors are disposed at a plurality of points of the floor plan structure,
The character structure includes a magnet,
The said control part displays the said virtual space at the time of seeing from the position in the said virtual space corresponding to the position of the magnetic sensor which detected the strongest magnetic force among these magnetic sensors on the said display part. 5. The virtual space display system according to any one of 4 above. The control unit displays the virtual space on the display unit when no magnetic force exceeding a predetermined threshold is detected from any of the plurality of magnetic sensors when the virtual space is displayed on the display unit. The virtual space display system according to claim 5, wherein the display unit maintains display of the virtual space. Furthermore, an operation part having a fitting part in which one of a convex part and a concave part for receiving an operation from a user is formed,
The character structure has a fitted portion in which the other of a convex portion and a concave portion to be fitted to the fitting portion is formed,
When the operation portion receives an operation from a user when the fitted portion is fitted to the fitting portion, the control portion is configured to change the display portion based on the operation received by the operation portion. The virtual space display system according to any one of claims 1 to 6, wherein the virtual space to be displayed is changed. The virtual space display system according to claim 1, further comprising the display unit. Furthermore, an imaging unit is provided,
The said control part changes the pattern of the 2nd structure which is a structure in the said virtual space to the pattern of the 1st structure imaged by the said imaging part, and displays it on the said display part. The virtual space display system according to any one of the above. A position detecting step for detecting the position of the character structure arranged in the two-dimensional or three-dimensional floor plan structure, which indicates the floor plan of the building;
A control step of displaying a virtual space corresponding to the space in the building on a display unit,
The virtual space display method of displaying the virtual space when viewed from the position in the virtual space corresponding to the position of the character structure detected in the position detecting step in the control step. A program for causing a computer to execute the virtual space display method according to claim 10.

Images