KR100383015B1 - An apparatus and method for displaying three-dimensional virtual space based on real images - Google Patents

Abstract

The present invention includes the steps of (a) photographing the actual space continuously and intermittently while moving the camera in a direction giving perspective; (b) cutting and editing a portion of each of the photographed real spatial images to form a continuous image; (c) generating a plurality of consecutive subframes corresponding to the edited images so as to have a predetermined reduction ratio in and out of the mainframe; (d) inserting the corresponding edited images into the subframes according to the predetermined reduction ratio, respectively, to form a continuous image having a mutual perspective; And (e) moving the subframes and simultaneously applying dynamic changes to the sizes of the subframes and corresponding images. It is about.

Description

An apparatus and method for displaying three-dimensional virtual space based on real images

The present invention relates to a method and apparatus for implementing a 3D virtual reality space, and more particularly, to a method and apparatus for effectively displaying a 3D virtual space using a 2D real image having a perspective. .

Today, the World Wide Web, which consists essentially of servers and browsers, provides various forms of multimedia data, including text, images, and sound. A user may "net surf" the World Wide Web using a browser installed on his or her client terminal to obtain various information sources or purchase desired items in a so-called 'shopping mall'.

Recently, the application of the World Wide Web has been further expanded by the development and development of a description language for representing a three-dimensional virtual space. For example, a user may purchase a product by walking in a virtual space or visiting a store as if in a real world. A detailed description of the so-called virtual reality modeling language (VRML) that enables the realization of such a three-dimensional virtual space is described by Mark Pesce, "Learn About VRML: Building and Browsing Three-Dimensional Computer Space" [1st ed. March 25, 1996, published by Prentis Hall].

So-called VRML, called the "three-dimensional version of Hypertext markup language", has evolved from 1.0 to X3D, some of which are commercially available on the World Wide Web.

However, in order to build a website using VRML, advanced technologies such as 3D rendering technology and texture mapping technology are required. In addition, the VRML content may be displayed through a separate VRML browser or a plug-in program. Moreover, there is still a limit to the low performance of client computers for providing real-time rendering over the web.

In some cases, such as traffic, tourism, and geographic information, the implementation of a 3D virtual reality space needs to be based on real space. The typical way of moving this real space into a 3D virtual reality space is to simply enlarge or reduce the image taken by the optical camera. This does not support the rich dynamics and utilization of 3D virtual space, and brings about the problem of deterioration of image resolution due to enlargement.

Another way of realizing a three-dimensional virtual space based on real space is to synthesize real images taken from all directions and display them in a panorama format. However, this represents a space limited to the optical perspective embedded in the photographed image, and has a problem in that a three-dimensional virtual space having a perspective according to forward and backward cannot be properly implemented.

The present invention has been made in view of the above problems, and an object of the present invention is to provide an apparatus and a method for easily implementing a three-dimensional virtual space using a two-dimensional image photographed by a camera.

According to the present invention, since a three-dimensional virtual space can be implemented without complicated rendering technology or a large amount of data transmission, various applications such as shopping malls and geographic information can be provided through the World Wide Web.

1 is a flowchart schematically illustrating a process of implementing a 3D virtual reality space based on a reality space image according to a preferred embodiment of the present invention.

2A illustrates an example of a photographing area according to a horizontal angle of view of a front camera according to a preferred embodiment of the present invention.

2B and 2C illustrate examples of a photographing area according to a horizontal angle of view of a side camera according to a preferred embodiment of the present invention.

2D illustrates an example of a photographing area according to each horizontal angle of view by combining the front camera and the side camera.

3A is a diagram illustrating an example of continuously and intermittently photographing a real space while the front camera moves forward according to a preferred embodiment of the present invention.

3B is a view showing an example of continuously and intermittently photographing a real space while the side camera moves forward according to a preferred embodiment of the present invention.

4 is a schematic drawing of a corridor with side walls, ceilings, floors and front walls.

5A to 5D are diagrams illustrating side images of a real space photographed continuously and intermittently while the side camera is advanced according to a preferred embodiment of the present invention.

6A to 6G are diagrams illustrating front images of a real space photographed continuously and intermittently while the front camera is advanced according to a preferred embodiment of the present invention.

7A and 7B illustrate an example of generating a side frame image by editing a captured side source image according to a preferred embodiment of the present invention.

8A and 8B illustrate an example of generating a front frame image by editing a photographed front source image according to a preferred embodiment of the present invention.

9 is a diagram schematically showing a configuration of a mainframe and a subframe according to an embodiment of the present invention.

FIG. 10 is a diagram illustrating a correspondence relationship between side frame images and side subframes according to an exemplary embodiment of the present invention. FIG.

11 is a diagram illustrating a correspondence relationship between a front frame image and a front subframe according to a preferred embodiment of the present invention.

12 is a block diagram showing a schematic configuration of an apparatus for implementing a three-dimensional virtual reality space according to an embodiment of the present invention.

FIG. 13 is a diagram schematically illustrating a configuration of a server and a client system implementing a 3D virtual reality space according to an exemplary embodiment of the present invention.

14 shows an example of frame data according to a preferred embodiment of the present invention.

15 illustrates an example of image data according to a preferred embodiment of the present invention.

16 is a flowchart illustrating a method of displaying a 3D virtual reality content file according to a preferred embodiment of the present invention.

17A to 17E are plan views schematically illustrating a composite three-dimensional real space to explain a method of implementing the composite three-dimensional virtual reality space according to another aspect of the present invention.

18A to 18E illustrate examples of subframes and frame images corresponding to FIGS. 17A to 17E, respectively, according to another aspect of the present invention.

In order to achieve the above object, a three-dimensional virtual reality implementation method according to the present invention comprises the steps of: (a) photographing the real space continuously and intermittently while moving the camera in a direction to give a perspective; (b) cutting and editing a portion of each of the photographed real spatial images to form a continuous image; (c) generating a plurality of consecutive subframes corresponding to the edited images so as to have a predetermined reduction ratio in and out of the mainframe; (d) inserting the corresponding edited images into the subframes according to the predetermined reduction ratio, respectively, to form a continuous image having a mutual perspective; And (e) moving the subframes and simultaneously applying a dynamic change to the sizes of the subframes and the corresponding images.

Preferably, in step (a), the actual space is photographed by the front camera photographing the front and the side camera photographing the side.

Preferably, the subframes include: front subframes located inside the main frame and to which images taken by the front camera correspond; Positioned outside the mainframe and includes the side subframes corresponding to the images taken by the side camera.

The front subframes may include a plurality of rod-shaped frames arranged in a longitudinal direction and a transverse direction with a predetermined reduction ratio from the left end, the right end, the upper end, and the lower end of the main frame. The frames are composed of a plurality of rod-shaped frames arranged longitudinally with respect to the main frame with a relation of a predetermined reduction ratio.

According to the present invention, each of the front images of the photographed real space has its left end, right end, top and bottom cut into a bar shape having a constant size in the longitudinal direction and the transverse direction, so that the predetermined reduction ratio in the front subframes. Each of the side images of the photographed real space has a left end cut into a bar shape having a constant size in the longitudinal direction and is reduced to correspond to the side subframes according to the predetermined reduction ratio.

According to an embodiment of the present invention, in step (e), the lower subframes among the front subframes are enlarged to the size of the upper subframe while moving to the position of the upper subframe.

According to another embodiment of the present invention, in the step (e), a portion of one of the front subframes is pushed out of the main frame, whereby the remaining front subframes are moved in the horizontal direction. Next to the other subframe of the front subframe, the side subframe enters into the mainframe.

According to another preferred embodiment of the present invention, the method comprises: (a) generating source images by continuously and intermittently photographing a real space while moving a camera in a direction giving perspective; (b) cutting part of each of the source images to generate frame images constituting a mutually continuous image; (c) generating a plurality of subframes having a predetermined reduction ratio so that object images are given to the frame images so that mutual images are continuous; And (d) moving the subframes and simultaneously applying dynamic sizes of the subframes and the corresponding images to the next higher subframe or the next lower subframe size. A dimensional virtual reality space implementation method is provided.

According to another preferred embodiment of the present invention, the method comprises: (a) generating source images by continuously and intermittently photographing a real space while moving a camera in a direction giving perspective; (b) generating layer images by photographing an area in which the spatial perspective can be ignored in the real space; (c) cutting part of each of the source images to generate frame images constituting a mutually continuous image; (d) generating a plurality of consecutive subframes corresponding to the frame images and layer subframes corresponding to the layer images so as to have a predetermined reduction ratio in and out of the main frame; (e) inserting the frame images into the subframes according to the predetermined reduction ratio, and inserting the layer images into the layer subframes, respectively, to form a continuous image having a mutual perspective; And (f) moving the subframes so that the sizes of the subframes and the frame images are the next higher subframe or the next lower subframe size, and at the same time, the layer subframes are enlarged / reduced or hidden / hidden. A method of implementing a 3D virtual reality space is provided based on a real space image including a step of providing a dynamic change such that they are enlarged / reduced or a part of the image is exposed / hidden.

Preferably, in step (f), the lower subframes among the front subframes are enlarged to the size of the upper subframe while moving to the position of the upper subframe, and the layer subframe and the layer image are enlarged.

More preferably, in step (f), the lower subframes among the front subframes are enlarged to the size of the upper subframe while moving to the position of the upper subframe, and the first layer subframe and the layer image are enlarged. At the same time, a second layer subframe and its layer image appear between at least the subframes and / or the first layer subframe.

Also, more preferably, in step (f), a part of any one of the front subframes is pushed out of the main frame, so that the remaining front subframes and the first layer subframe in the horizontal direction. At the same time, the second layer subframe and the layer image enter the main frame.

According to another aspect of the present invention, a three-dimensional virtual reality space programmed to cut a real image of a continuous and intermittently taken source image to form a continuous image and insert it into a plurality of subframes having a predetermined reduction ratio. An apparatus for implementing a 3D virtual reality space using a file,

Input device; Display device; An analysis unit for interpreting the programmed 3D virtual reality file and interpreting an event signal of a user input through the input device to instruct generation and dynamic conversion of the subframe and its image; And generating a subframe according to the instruction of the analysis unit, providing an image corresponding to the subframe, displaying the image on the display device, and moving the subframes according to the event signal analysis result signal to move the subframes and the image. Provided is a three-dimensional virtual reality implementation apparatus including an execution unit for giving a dynamic transform so that the size of the two sub-frame or the next sub-frame size.

Preferably, the analysis unit, HTML analysis unit for analyzing the three-dimensional virtual space files programmed in the language of the HTML series; And a script interpreter that interprets the JavaScript to execute the JavaScript added in the HTML document.

The execution unit may include: a frame execution unit generating a subframe in a main frame on the display and performing dynamic conversion of the subframe according to an event result signal from the analysis unit; A frame image manager which provides an image for the subframe and converts an image corresponding to the subframe according to the dynamic conversion of the subframe; And a layer image manager inserting the layer image into the subframe and providing a transformation of the layer image according to the subframe transformation.

According to another aspect of the present invention, a three-dimensional virtual reality space programmed to cut a real image of a continuous and intermittently taken source image into a plurality of subframes by cutting them into a continuous image and having a predetermined reduction ratio to each other. A method of implementing a 3D virtual reality space using a file, the method comprising: generating a subframe on a display device by analyzing the programmed 3D virtual reality space file, and providing and displaying an image corresponding to the subframe; Inputting any one of an event including forward, backward, leftward switching, and rightward switching through an input device; And moving the subframes according to the event input and applying a dynamic transformation to adjust the size of the subframes and the images to be the next higher subframe or the next lower subframe size. Is provided.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to this, terms or words used in the specification and claims should not be construed as having a conventional or dictionary meaning, and the inventors should properly explain the concept of terms in order to best explain their own invention. Based on the principle that can be defined, it should be interpreted as meaning and concept corresponding to the technical idea of the present invention. Therefore, the embodiments described in the specification and the drawings shown in the drawings are only the most preferred embodiment of the present invention and do not represent all of the technical idea of the present invention, various modifications that can be replaced at the time of the present application It should be understood that there may be equivalents and variations.

Basic Principle in Simple 3D System

The three-dimensional virtual space according to the present invention has a near-real perspective, which is achieved by photographing the real space with an optical camera, editing the images and giving a digital dynamic size change. Specifically, in the method of implementing the 3D virtual space of the present invention, as shown in FIG. 1, a step of obtaining a source image by photographing a real space (S100), editing a captured source image (S200), an object in the edited image Generating a frame by giving a sex (S300), a programming step for controlling the generated frame and the corresponding image (S400), and displaying a three-dimensional virtual space on a display such as a monitor (S500). In addition, in the present embodiment, the photographing by the optical camera is exemplified, but in general, a digital camera may be used to easily obtain a bitmap (BITMAP) series of images. In this case, the image resolution and the number of pixels of the digital camera should be properly considered.

Then, in order to look at the process in order first looks at the step (S100) for taking a real space with the optical camera in detail.

1. Real space shooting

According to the present invention, the three-dimensional virtual space to be displayed on a display such as a monitor must be photographed by an optical camera, not created by a program such as a graphic creation tool. For example, in order to express a real space with a perspective like a corridor in a 3D virtual space, a corridor is actually photographed using a camera.

According to the present invention, the actual space that becomes the subject to be converted into the three-dimensional virtual space is photographed continuously and intermittently by the camera. Here, 'continuous and intermittent shooting' means that the camera does not stand still in space but moves in a certain direction, that is, in a direction that gives perspective, and shoots the actual space at regular intervals. This is a spatial distinction rather than a temporal distinction, so the camera shoots the same space at different points along a certain direction. Here, the moving direction of the camera is a direction giving perspective, and strictly speaking, it will be the direction in which the observer moves in the real space, that is, the direction moving forward and backward.

2A to 2C show three different cameras for photographing a real space according to a preferred embodiment of the present invention. The camera C1 photographs the front of the real space, the camera C2 is installed to the left, and the camera C3 is photographed to the right. At this time, the horizontal angle of view θ of the front camera C1 is considered to correspond to the horizontal viewing angle when the observer looks forward (although there may be a slight difference). The angle of view θ is about 53 degrees (a vertical angle of view is about 37 degrees). As shown in FIG. 2D, the side cameras C2 and C3 have an angle α between the centerline CL of each of the cameras C1 and C2 with respect to the front camera C1. It is tilted to achieve this, which is the natural angle the observer sees when turning his head left or right. In addition, the cameras C1, C2 and C3 are installed at the same height from the ground, preferably at the eye level of the viewer.

On the other hand, the observer can see the ceiling or the floor by pointing the head up or down, in order to obtain a real picture corresponding to this, a separate camera (not shown) at a predetermined angle upward and downward with the front camera (C1) Will need to be installed more. In general, the three-dimensional virtual space is more important to implement the horizontal space, such as the observer moving forward or backward, or to the left and right, while the implementation of the vertical space such as the ceiling or floor may be relatively ignored. However, when the viewer climbs and descends the stairs or ascends the elevator, a vertical three-dimensional space is required. This is because the methods implemented by the side cameras C2 and C3 may be applied in the same manner. Detailed description will be omitted.

In addition, referring to FIG. 2D, an area A in which the photographing area of the front camera C1 and the photographing area of the side cameras C2 and C3 overlap each other is generated, which is obtained when the viewer's front viewing angle and head are turned. It can be said that the side viewing angles correspond to portions overlapping each other. Since the overlap area A is a region photographed by the front camera C1, it is processed as a front image as will be described later. This secures a wide three-dimensional frontal space appearing on the display, but this embodiment is not limited thereto.

According to the present invention, the cameras C1, C2, and C3 are photographed in the actual space a plurality of times while moving in a direction that gives a perspective, that is, a forward direction. For example, the front camera C1 photographs the front space at a predetermined interval D while moving forward as shown in FIG. 3A. At this time, the interval (D) between the photographing point is not limited by the present invention, but preferably corresponds to one step of the observer's step. The camera C1 photographs the actual space at regular intervals at predetermined time points while moving forward. Alternatively, the camera C1 may photograph the space at a rate of, for example, 10 cuts per second while moving forward at a constant speed. In the same manner, the side continuous shooting by the side camera C2 is performed as shown in FIG. 3B.

Reference is made to the space shown in FIG. 4 to understand the shooting of the real space by the cameras. 4 shows a dead corridor consisting of left and right side walls 100, 110, a floor 200, and a ceiling 210, and shows a frame 1 hanging on the dead wall 220. Reference numerals 400a, 400b, 400c, and 400d denote corner corners at which the side walls 100 and 110 and the floor 200 and the ceiling 210 are bounded, and reference numerals 410a and 420b denote the side walls 100 and 110. ) And a corner edge portion at which the front wall 220 forms a boundary.

The left and right side walls 100 and 110 are drawn with stripes 101 and 102 for convenience, and all the walls 100, 110, 200 and 210 have virtual partition lines at predetermined intervals for convenience of description. (IL) is indicated and each area is appended with 1S-6S and 1F-6F. The solid line denoted by reference numeral 300 indicates a photographing boundary between the front camera C1 and the side cameras C2 and C3, and the inside thereof is an area corresponding to the main frame described later.

2D and 4 together for better understanding, the front region F taken by the front camera C1 in FIG. 2D corresponds to the dead front wall 220 of FIG. 4 and the side camera C2. The side region S taken by) corresponds to the side walls 1S to 6S of FIG. In addition, the area V is the side wall (1F-6F of FIG. 4) image | photographed by the front camera C1, and also the overlapping imaging area | region A with the side camera C2. When the viewer faces the front, the viewer's viewing angle is equal to the horizontal angle of view θ of the front camera C1, so that the viewer eventually sees only the image displayed in the solid line (mainframe 300) of FIG. 4, which appears on the display. It becomes 3D virtual space screen.

1.1 Side shot of real space

For convenience, the side photographing of the actual space will be described first. When the side camera C2 is in the initial position Po of FIG. 3B, the side wall (100 in FIG. 4) to be photographed becomes the area S and the area V of FIG. 2D, and an example of such a photographed image is shown in FIG. 5A. Is shown. In FIG. 5A, only the side wall 100 is shown for convenience and the bottom 200 and the ceiling 210 are omitted. That is, the camera C2 at the first reference position Po includes the side source images (Side Source Images) including the area 1S of the side wall at the shortest distance and the side walls 2S to 6S gradually away from it. Shoot SS1).

Next, when the camera C2 moves to reach the position P1, photographing is performed again. The source image SS2 is as shown in FIG. 5B. Here, for convenience, it is assumed that when the camera C2 moves from the point Po to the point P1, the left view boundary of the camera advances by the distance of the imaginary line (IL in FIG. 4) partitioned on the side wall 100 wall. The image taken by camera C2 at point P1 will include 2S as the closest area. When the side camera C2 moves forward in such a manner and repeats shooting at a predetermined interval D, source images SS3 to SS6 as shown in FIGS. 5C to 5F are obtained. In addition, since the photographing method for the camera C3 is also the same as described above, a description thereof will be omitted to avoid duplication.

1.2 Front view of real space

The front of the real space is photographed by the front camera C1. The basic method of frontal shooting is the same as the side shooting described above. That is, when the front camera C1 is located at the initial point (Po in FIG. 3A), the horizontal angle of view θ includes the side wall area (V in FIG. 2D) and the front area F. Front Source Images FS1 are shown in FIG. 6A. Here, the area closest to the camera becomes the (1F) area.

As described above, when the camera C1 is repeatedly photographed at a predetermined interval D while moving forward, the source images FS2 to FS7 of FIGS. 6B to 6G are obtained continuously. In other words, as the camera C1 moves forward, the side wall 100 changes by the distance between the imaginary lines IL, and at the same time, the dead front wall 220 gradually expands, so that the front camera C1 is When the left and right boundary lines of the horizontal angle of view θ advance to the point where they meet the corner edge portions 410a and 410b formed by the side walls 100 and 110 and the front wall 220, the source image FS7 of FIG. As such, only the front wall 220 will be photographed.

2. Edit source image

According to the present invention, the source images photographed by the cameras C1, C2 and C3 are edited and converted into frame image data. This source image editing is to implement one continuous virtual space by combining the actual photographed images in the manner described above.

2.1 Side source image editing

The editing of the side source image begins with the side camera C2 cutting the sample side source image SS1 of FIG. 5A taken at the reference position Po to an appropriate size. In this case, the sample source image FS1 is cut to an appropriate size in consideration of the resolution of the screen, the average walking distance of the observer in the three-dimensional virtual reality space, the frequency of protrusion of the object. For example, the sample source image FS1 of FIG. 5A is cut to have a horizontal and vertical pixel of a predetermined size from the left end to include the nearest region (1S). In this embodiment, the virtual line IL is provided for convenience. Cutting to have a size as large as the area 1S partitioned by). Cut side frame images are indicated by reference SF1 in FIG. 7A.

Subsequently, the second side source image (SS2 of FIG. 5B) is also cut to generate a second side frame image, where the second side frame image must have a continuity of the image with the first side frame image SF1. Therefore, as shown in FIG. 7A, the first frame image SF1 is arranged in parallel with the second source image SS2 to find a continuous region with the first frame image SF1. In the present embodiment, for convenience, the camera advances by a distance corresponding to the distance between the virtual lines IL, and captures the source images and cuts the frame images according to the size thereof. An image having the same horizontal and vertical size will be exactly the portion corresponding to the area 2S. Alternatively, even if the source images contain portions overlapping each other without being accurately divided by a boundary line unlike the present embodiment, the image information contained in the right end pixel of the first frame image SF1 is identified and the same image information is obtained. The successive images can be found by finding the pixels with the second source image.

As described above, the area 2S of the second source image SS2 subsequent to the first frame image SF1 is cut to have the same size as the first frame image SF1, thereby generating the second frame image SF2. Here, strictly speaking, since the first source image (SS1 of FIG. 5A) and the second source image (SS2 of FIG. 5B) are taken at the same scale, as shown in FIG. 7A, although the first frame image SF1 and the second frame are shown. Even if the image SF2 forms a continuous image, both are the same or different in size, and thus it is difficult to visually confirm the continuity of such an image immediately. Accordingly, it is necessary to reduce the size of the second source image SS2 to the size shown by the dotted line so that the second frame image SS2 has a perspective in a continuous manner. This means that subsequent subframe images that are contiguous to the frame image closest to the observer are scaled down and aligned to have a spatial perspective. For reference, in the present specification, the upper image represents an image closer to the observer and the lower image is defined and used as an image farther from the observer.

As a result, the second frame image SF2 has the same size as the first frame image SF1, but is arranged to be condensed so that the image is continuous with spatial perspective, and the second frame image SF2 is the first frame image SF2. It will have its own reduction ratio for SF1). FIG. 7B illustrates a state in which the second frame image SF2 is reduced according to a unique reduction ratio and continuously arranged with the first frame image SF1. Manipulation of such reduction rates can be accomplished using a variety of known image authoring tools.

In the same manner, the third side frame image SF3 can be obtained from the third side source image SS3, and the third frame image SF3 also has a unique reduction ratio with respect to the second frame image SF2.

2.2 Edit Front Source Image

The editing of the frontal source image starts by cutting the four corner portions of the sample frontal source image FS1 shown in Fig. 6A to a predetermined size. That is, the sample source image FS1 is cut in order of the left end, the right end, the lower end and the upper end in the shape of a bar as shown in FIG. 8A to generate the first front frame images FF1a, FF1b, FF1c, and FF1d. Done. This cutting of the four corners of the source image into a bar shape is difficult to cut the image into a rectangular band with an empty center, and even when cutting into a rectangular band, the blank inside the rectangular band still exists as a transparent image. This is because the storage and transmission still occupy capacity.

In this case, the size of the front frame image is determined in consideration of the resolution of the screen, the stride length of the observer's walking in the three-dimensional virtual reality space, the frequency of protrusion of the object, and the like. The size corresponds to the size of. In the present embodiment, the image is cut by the area 1F corresponding to the interval between the virtual lines IL as in the above-described aspect.

Preferably, the front frame images FF1a, FF1b, FF1c, and FF1d are generated by first cutting the left and right ends of the source image and then cutting the lower and upper ends of the remaining images.

Next, in order to generate a second front frame image from the second source image (FS2 of FIG. 6B), a region having a continuous image with the first front frame image (FF1a) (FF1b) (FF1c) (FF1d) that has already been generated is generated. Find out from image FS2. This is possible by finding in the second source image FS2 an area having the same image information as the image contained in the right end of the frame image FF1a, the left end of FF1b, the upper end of FF1c, and the lower end of FF1d. Do. At this time, since the first source image FS1 and the second source image FS2 are photographed with the same scale, even if the images are continuous, the same size is the same, so it is difficult to visually easily confirm the continuous images. Accordingly, as shown in FIG. 8A, the second source image FS2 is reduced by a predetermined ratio using the authoring tool, so that the continuous images can be easily found.

In this way, a second front frame image FF2a (FF2b) (FF2b) (FF2c) (FF2d) is generated that is continuous with the first front frame image FF1a (FF1b) (FF1c) (FF1d) and is cut to have the same size. 8B shows a state in which the second front frame image FF2a (FF2b) (FF2c) (FF2d) is cut out to have a unique reduction ratio with respect to the first front frame image FF1a (FF1b) (FF1c) (FF1d). It is.

The same method is applied to each source image sequentially to generate front frame images for each source image. These images all form the same sized bar, and certain front frame images have unique reduction rates for the continuity of the next higher front frame image and image.

2.3 Create Layer Images

Looking at the front source images FS1 to FS7 of FIGS. 6A to 6G, which are continuously and intermittently taken while the front camera C1 is moving forward, the dead front wall 220 is only gradually enlarged without change in shape. As such, images that do not have a linear spatial perspective or are relatively negligible, such as the side walls 100, 110, 200, and ceiling 210 of the real space, are processed as layer images.

It is sufficient that such layer images are simply expressed as being enlarged or reduced, or where part of the image appears or is hidden. In addition, the layer image only has a perspective on the photograph itself taken by the camera, and does not need to provide a linear spatial perspective through the editing and reduction alignment of the image as described above.

In this embodiment, the layer image is an image corresponding to the front wall 220, which is an image illustrated in FIG. 6G.

As will be described later, the layer image may be enlarged / reduced or a part of the image may be hidden or hidden due to the enlargement / reduction or hiding / hiding of the layer subframe. In addition, the layer image may be processed so that a part of the image is hidden or exposed by overlapping two or more layer images forming a mutual boundary.

3. Subframe generation

3.1 Subframe Organization

According to a feature of the present invention, the frame images generated as described above are displayed on a monitor by processing each image into a corresponding frame. 9 schematically shows a configuration of a mainframe and a subframe according to an exemplary embodiment of the present invention.

Referring to the drawing, the mainframe 300 corresponds to a boundary border where the observer 10 can visually see the 3D virtual reality space, which is covered by the front camera C1 in lieu of the observer 10. Not only is it an area, it is also a screen area that appears on a display such as a computer monitor (not shown) at the same time.

Subframes are frames that partition inside and outside the boundary of the main frame, which is an area to which the frame images generated previously correspond. The three-dimensional virtual reality space according to the present invention is achieved by the arrangement and dynamic transformation of these subframes.

First, the subframes 1a to 6a, 1b to 6b, 1c to 6c, and 1d to 6d positioned inside the main frame 300 are placed on an image that the viewer 10 looks at when facing the front. Corresponding front frames. These front subframes 1a to 6a, 1b to 6b, 1c to 6c, and 1d to 6d each have a rod shape in the longitudinal direction and the transverse direction, and the main frame 300 is similar to the front frame image described above. Left end, right end, top and bottom of the bar) are generated by dividing each into a bar shape. The front subframes 1a to 6a, 1b to 6b, 1c to 6c, and 1d to 6d are arranged in a continuous rectangular band shape according to a unique reduction ratio as described later.

In addition, the subframe L is a layer subframe corresponding to the layer image.

The subframes 1L to 6L positioned outside the mainframe 300 are left side subframes and correspond to side subframes corresponding to an image viewed when the viewer 10 turns his head to the left.

Subframes 1R to 6R positioned outside the main frame 300 are right side subframes and correspond to side frames corresponding to an image viewed when the observer 10 turns his head to the right.

The positioning of the left and right side subframes 1L to 6L and 1R to 6R outside of the main frame 300 means that the viewer 10 is not visible when facing the 3D virtual reality space. The observer 10 must turn his head left or right to see these left and right subframes 1L-6L (1R-6R) —actually this is done using the input device to turn left or right as described below. It means to choose. The left and right side subframes 1L to 6L (1R to 6R) are created by partitioning in the shape of rods arranged in the longitudinal direction, and these also have inherent reduction ratio relationships.

According to a feature of the present invention, an image region having a perspective, that is, a side, an upper surface, a bottom, and the like is divided into a plurality of subframes and processed.

The relationship with the above-described frame image will be described in order to provide a more detailed understanding of these subframes.

3.2 Subframe and Frame Image Correspondence

FIG. 10 is a diagram for explaining correspondence between side subframes 1L to 6L and side frame images SF1 to SF6. As shown, the highest side frame image SF1 closest to the observer 10 among the frame images edited and generated from the above-described source image corresponds to the highest side subframe 1S. Further, the lower side frame images SF2 to SF6 sequentially correspond to the side subframes 2L to 6L, respectively.

The frame images SF1 to SF6 are all cropped to have the same size. However, in order to provide a linear spatial perspective while they are aligned with each other to form a continuous image, they must be shrunk and arranged at their own reduction ratio. The side subframes 1L to 6L show such a relationship, that is, the top side subframe 1L and the adjacent side subframe 2L have a size reduced to a predetermined reduction rate, and the reduction rate is described above. As described above, the frame image SF2 is equal to the reduced intrinsic reduction factor to form a continuous image with the highest frame image SF1. That is, the subframes 1L to 6L are arranged to have a reduction ratio equal to the reduction ratio between the frame images SF1 to SF6.

11 is a diagram illustrating a correspondence relationship between a front frame image and a front subframe according to the present invention. Referring to the drawings, the topmost front frame images FF1a, FF1b, FF1c, and FF1d correspond to subframes 1a, 1b, 1c, and 1d, respectively. Further, the second front frame images FF2a, FF2b, FF2c, and FF2d correspond to the second subframes 2a, 2b, 2c, and 2d, respectively.

Here too, the sizes of the first frame image FF1a (FF1b) (FF1c) (FF1d) and the second frame image FF2a (FF2b) (FF2c) (FF2d) are the same, but they form a continuous image. In order to have a spatial perspective, the second subframes 2a, 2b, 2c, and 2d are reduced and aligned at a predetermined reduction rate with respect to the first subframes 1a, 1b, 1c, and 1d. The reduction ratio is equal to the intrinsic reduction ratio in which the second frame image FF2a (FF2b) (FF2c) (FF2d) is reduced to form a continuous image with the first frame image FF1a (FF1b) (FF1c) (FF1d).

Referring back to FIG. 9 again, the side subframes 1L-6L (1R-6R) and the front subframes 1a-6a (1b-6b) (1c-6c) (1d-6d) are unique to each other. According to the reduction rate, the further away from the observer 10, the smaller the order is aligned. Among the front subframes, the subframe 1a corresponding to the image of the side wall has a reduced relation with respect to the lowest side subframe 6L at an intrinsic reduction ratio, which is the side subframes 1L to 6L (1R). And -6R mean that the front subframes 1a to 6a, 1b to 6b, 1c to 6c, and 1d to 6d are enlarged relative to each other.

In FIG. 9, the area that the observer 10 can actually see on the display such as a monitor is defined inside the boundary of the mainframe 300, so that the side subframes 1L to 6L and 1R to 6R are actually the observer 10. It is only a diagram showing the relative size of the front subframes displayed in the mainframe 300, rather than the size of the frame seen.

The number and size of the subframes are not limited by this embodiment, and may be appropriately determined in consideration of the resolution of the screen, the continuity of the image, and the spatial perspective.

In addition, it is necessary to determine in which subframe the magnification of the image is 100%. If the subframe 1a closest to the observer 10 is set as the reference subframe in which the magnification of the image is 100%, Although the lower subframes 2a to 6a have an advantage of excellent resolution of the image, they occupy the network because they occupy the same amount of memory as the reference subframe despite the relatively low visual importance away from the observer 10. There is a disadvantage in that the transfer of the content file through the network is not easy. On the other hand, when setting the lower subframe 6a as the reference subframe and setting the image enlargement ratio to 100%, the file size is small, but the resolution decreases when the image is enlarged in the upper subframe 1a. Therefore, the setting of the reference subframe in which the image is set to 100% is appropriately set in consideration of the file capacity and the resolution of the image.

4. Frame Control Programming

The program for controlling the subframe according to the present invention may be written by existing known languages that support GDI (Graphic Device Interface). In particular, when using a vector-based web animation authoring tool such as Macromedia Flash, the dynamic and many functions can be easily and variously implemented. According to a preferred embodiment of the present invention, the frame and image control program is written using JavaScript, which is an HTML-based language and a scripting language, which can be displayed without a separate three-dimensional browser and even no plug-in is required.

Preferably, as described below, when a user inputs an event signal for space movement or direction change using a mouse or the like, a change in a direction and a size in which the subframes move is programmed accordingly. Preferably, the movement speed (number of pixels) and the gradual size change rate of the subframes will be set to prevent sudden movement and size change of the subframes.

As will be described later, the leftmost subframe and the rightmost subframe, which can be provided in the mainframe, must be uniquely determined according to the position of the observer in the virtual reality space.

In addition, the size and insertion position of the layer image to be inserted must be set according to the position of the observer in the virtual reality space. Further, if necessary, the same area needs to be set separately from the case processed by the layer image and the case processed by the subframe and the frame image.

The above program, including the creation of subframes and the insertion of images, can be written by various languages and writing tools. The program list exemplified below by the inventors is based on HTML and JavaScript, and illustrates some program examples for generating subframes and outputting images. It is clear that the above program is not an embodiment representing the present invention and does not cover all possible means of the present invention, and it should be interpreted accordingly as merely illustrating a part of the application of the present invention, and thus the scope of the present invention. It should be understood that it cannot be used as a basis for limiting or limiting this.

<Program Creation Example>

<HTML> <HEAD>

<TITLE> CyberShopping (TestEdit) </ TITLE>

<SCRIPT LANGUAGE = "JavaScript"> <!-

var NN = (document.layers? true: false);

var hideName = (NN? 'hide': 'hidden');

var showName = (NN? 'show': 'visible');

// Reduction rate of the front subframe.

var fred = [fred1, fred2, fred3, fred4, fred5, fred6, fred7, fred8, fred9, fred10];

var fwid = [aw, bw, cw, dw]; // Width value of front subframe.

var fhei = [ah, bh, ch, dh]; // Height value of front subframe.

// Front subframe left, top, right, bottom distinct value.

var diff = ['a', 'b', 'c', 'd'];

var fx =; // Initial x value of the front subframe.

var fy =; // Initial y value of front subframe.

var tempImgs = [];

// Magnification of left subframe to front subframe.

var lred = [lred1, lred2, lred3, lred4, lred5, lred6, lred7, lred8];

// Magnification of the right subframe relative to the front subframe.

var rred = [rred1, rred2, rred3, rred4, rred5, rred6, rred7, rred8];

function subframeLayer () // Create subframe.

for (var i = 0; i <fred.length; i ++) // Create front subframe.

var fixWid = (i == 0? fx: fixWid); /// x coordinate value of each left subframe.

var fixHei = (i == 0? fy: fixHei); /// y coordinate value of each left subframe.

var zIdx = (i == 0? 100: zIdx); // Depth value of each subframe.

for (var j = 0; j <4; j ++)

var tempWid; // The x-coordinate value of the inner subframe.

var tempHei; // The y coordinate value of the inner subframe of the pair.

var fleftTem; // Temporary variable for x position of lower subframe in the column

var ftopTem; // Temporary variable for position y of the lower subframe in the column.

var fwidthTem, fheightTem;

var fwidth = fwid [j] * (fred [i] / 100); // Width of subframe.

var fheight = fhei [j] * (fred [i] / 100); // height of subframe

var fleft = 0; // Upper left x position value of the subframe.

var ftop = 0; // The upper left y position value of the sub frame.

zIdx = zIdx--;

var temp = diff [j]; // Subframe name classification value.

switch (j)

case 0:

fleft = fixWid;

ftop = fixHei;

fleftTem = fleft;

ftopTem = ftop;

fwidthTem = fwidth;

fheightTem = fheight;

tempWid = fleft + fwidth;

break;

case 1:

fleft = tempWid;

ftop = tempHei;

fixWid = fleft;

fixHei = ftop + fheight;

tempWid + = fwidth;

break;

case 2:

fleft = tempWid;

ftop = tempHei;

tempWid = fleftTem-fwidthTem;

tempHei = ftopTem + fheightTem;

break;

case 3:

fleft = tempWid;

ftop = tempHei;

break;

genLayer ("fro" + i + temp, left, ftop, fwidth, fheight,

hideName, zIdx, '<IMG NAME = "froback' + i + temp +

'"SRC =" "WIDTH ="' + fwidth + '"HEIGHT ="' + fheight + '">');

for (var m = 0; m <lred.length; m ++) // create left subframe

var lwidth = fwid [0] * (lred [m] / 100);

var lheight = fhei [0] * (lred [m] / 100);

var lleft = fx-lwidth;

var ltop = fy-(lheight-fhei [0]) / 2;

var zIdx = (m == 0? 101: ++ zIdx);

genLayer ("lef" + m, lleft, ltop, lwidth, lheight,

hideName, zIdx, '<IMG NAME = "lefback' + m +

'"SRC =" "WIDTH ="' + lwidth + '"HEIGHT ="' + lheight + '">');

for (var n = 0; n <rred.lenght; n ++) // Create right side subframe.

var rwidth = fwid [2] * (rred [n] / 100);

var rheight = fhei [2] * (rred [n] / 100);

var rleft = (n == 0? (fx + fwid [0] + fwid [1] + fwid [2]): (rleft + rwidth));

var rtop = fy-(rheight-fhei [2]) / 2;

var zIdx = (n == 0? 101: ++ zIdx);

genLayer ("rig" + n, rleft, rtop, rwidth, rheight,

hideName, zIdx, '<IMG NAME = "rigback' + n +

'"SRC =" "WIDTH ="' + rwidth + '"HEIGHT ="' + rheight + '">');

function subimageView ();

function genLayer (sName, sLeft, sTop, sWdh, sHgt, zIdx, sVis, zIdx, copy) // Create Layer.

if (NN) document.writeln ('<LAYER NAME = "' + sName + '" LEFT =' + sLeft +

'TOP =' + sTop + 'WIDTH =' + sWdh + 'HEIGHT =' + sHgt +

'VISIBILITY = "' + sVis + '" z-Index =' + zIdx + '>' + copy +

'</ LAYER>');

else document.writeln ('<DIV ID = "' + sName +

'"STYLE =" position: absolute; overflow: none; left: '+

sLeft + 'px; top:' + sTop + 'px; width:' + sWdh + 'px; height:' +

sHgt + 'px; visibility:' + sVis + '; z-Index = '+ zIdx +' "> '+

copy + '</ DIV>');

function hideSlide (name) refSlide (name) .visibility = hideName;

function showSlide (name) refSlide (name) .visibility = showName;

function refSlide (name) if (NN) return document.layers [name];

else return eval ('document.all.' + name + '.style');

function subimageView () // Image output of each subframe.

for (var i = 0; i <fred.length; i ++) // Output image of front subframe

for (var j = 0; j <4; j ++)

var imgsName = "froback" + i + diff [j];

var layerName = "fro" + i + diff [j];

if (document.all) tempImgs [j] = new Image ();

tempImgs [j] .src = 'image / back / fro /' + i + diff [j] + '. jpg';

document.imgsName.src = tempImgs [j] .src;

showSlide (layerName);

else tempImgs [j] = new Image ();

tempImgs [j] .src = 'image / back / fro /' + i + diff [j] + '. jpg';

document.layers [layerName] .document.images [0] .src = tempImgs [j] .src;

showSlide (layerName);

for (var m = 0; m <lred.length; m ++) // Image output of the left subframe.

var imgsName = "leftback" + m;

var layerName = "lef" + m;

if (document.all) tempImgs [m] = new Image ();

tempImgs [m] .src = 'image / back / lef /' + m + '. jpg';

document.imgsName.src = tempImgs [m] .src;

showSlide (layerName);

else tempImgs [m] = new Image ();

tempImgs [m] .src = 'image / back / lef /' + m + '. jpg';

document.layers [layerName] .document.images [0] .src =

tempImgs [m] .src;

showSlide (layerName);

for (var n = 0; n <rred.length; n ++) // Image output of the right subframe.

var imgsName = "rigback" + n;

var layerName = "rig" + n;

if (document.all) tempImgs [n] = new Image ();

tempImgs [n] .src = 'image / back / rig /' + n + '. jpg';

document.imgsName.src = tempImgs [n] .src;

showSlide (layerName);

else tempImgs [n] = new Image ();

tempImgs [n] .src = 'image / back / rig /' + n + '. jpg';

document.layers [layerName] .document.images [0] .src =

tempImgs [n] .src;

showSlide (layerName);

//-> </ SCRIPT> </ HEAD> <BODY> <SCRIPT LANGUAGE = "JavaScript"> <!-

function subframeLayer ();

</ SCRIPT> </ BODY> </ HTML>

5. 3D virtual space display

Next, a process of displaying a 3D virtual reality space on a display such as a monitor according to the present invention will be described. 12 is a schematic diagram of an apparatus for implementing a 3D virtual reality space according to a preferred embodiment of the present invention.

Referring to the drawings, the apparatus analyzes the programmed three-dimensional virtual space content file and the analysis unit 30 for instructing dynamic conversion of the three-dimensional virtual space in accordance with the event signal input through the input device 20, and analysis The execution unit 40 generates a subframe according to the result, performs dynamic transformation of the indicated subframe, and loads an image corresponding to each subframe.

The analysis unit 30 includes, for example, an HTML analysis unit 31 for analyzing a three-dimensional virtual space file programmed in an HTML-based language; It may include a; script interpreter 32 for interpreting this to execute the JavaScript added in the HTML document.

The execution unit 40 may further include: a frame execution unit 41 generating a subframe in the main frame 300 and performing dynamic conversion of the subframe according to the event result signal from the analysis unit 30; A frame image manager 42 for linking a frame image with respect to the subframe and converting and providing a frame image corresponding to the subframe according to the dynamic conversion of the subframe; And a layer image manager 43 for inserting the layer image into the subframe and providing a transformation of the layer image according to the subframe transformation.

The execution unit 40 is interlocked with the database and receives frame data and image data therefrom, which are stored in the frame DB 50 and the image DB 60, respectively. A schematic example of the frame data is as shown in FIG. 14, and a schematic example of the image data is as shown in FIG. 15.

The result of the operation of the execution unit 30 is displayed on the display device 80 through the GUI (Graphic User Interface) unit 70.

Implementation of the three-dimensional virtual reality space according to the present invention is more useful for the server and client system based on the Internet. FIG. 13 illustrates a main configuration of a 3D virtual reality realization system based on the Internet according to a preferred embodiment of the present invention.

The server 600 provides a 3D virtual reality content file according to the present invention to the client terminal 500 through the Internet. The three-dimensional virtual reality space file is preferably stored in the file DB 51 as a web page file written in HTML and JavaScript as described above.

The client terminal 500 supports, for example, a browser such as Netscape or Internet Explorer, which supports a graphical user interface for interpreting the 3D virtual reality web page file provided by the server 600 and displaying it on the display device 80. 501 is adopted. According to the present invention, the 3D virtual reality content file can be simply created using HTML and JavaScript, which can be created by a web browser such as Netscape or Internet Explorer without installing a separate browser or client program. It can be interpreted and executed to be displayed.

When the user accesses the server 600 using the client terminal 500, the server 600 provides the 3D virtual reality content web page file from the file DB 51 to the client terminal 500. Then, the client terminal 500 interprets the provided 3D virtual reality file using the browser 501 and displays it on the display device 80.

The following description will be made with reference to FIGS. 12 and 13, wherein the apparatus for implementing a 3D virtual space shown in FIG. 12 may be appropriately achieved by the server and client system of FIG. 13, which is another aspect of the present invention. Should be understood.

5.1 Display of basic three-dimensional virtual space

The basic three-dimensional virtual reality space is displayed in the mainframe 300 shown in FIG. The main frame 300 forms a visual boundary visible to the observer, and the observer views the subject image closest to the front subframes 1a, 1b, 1c, and 1d. Therefore, in the present embodiment, the front subframes 1a, 1b, 1c, and 1d are set as reference subframes so that the image is enlarged 100%. In this case, the remaining front subframes 2a-6a (2b-6b) (2c-6c) (2d-6d) have a relatively reduced size of the image, and the side subframes 1L-6L (1R-1). 6R) will be relatively enlarged in size. In fact, the screen that the user sees through the display device of his PC or the client terminal is a screen inside the boundary of the mainframe 300.

Referring to FIG. 16, when the 3D virtual reality file is loaded from the server 600 to the client terminal 500, the HTML interpreter (see 31 in FIG. 12) and the script interpreter (see 32) of the browser 501 may be used. The file is interpreted and executed (step S510).

Subframes are then generated in accordance with the interpreted program (step S520). First, since the observer is looking at the front, the 3D virtual reality file received from the server 600 to the client terminal 500 will be the front image of the inside of the mainframe 300 in FIG. 9. Thus, the front subframes 1a to 6a (1b to 6b) (1c to 6c) (1d to 6d) and the layer subframe L are generated. At this time, subframes outside the main frame 300 that are not directly viewed by the observer are also generated, such as the left side subframes 1L to 6L and the right side subframes 1R to 6R.

The subframes are generated at the same reduction ratio as the mutual reduction ratio of the corresponding frame images as described above. Therefore, when the front subframes 1a and 1b are set as the reference subframes in which the frame image is enlarged 100%, the left and right subframes 1L-6L and 1R-6R outside the main frame 300 are images. Is enlarged to a size larger than 100%. Although belonging to the front subframe, the subframes 1a-6a and 1b-6b form a continuous side image with the left and right subframes 1L-6L and 1R-6R, respectively.

When the subframes are generated as described above, images are inserted and generated in the respective subframes (step S530). That is, images including the front frame images FF1a and FF2a shown in FIG. 11 are inserted into the front subframes 1a to 6a, and the front frame images FF1b and FF2b to the front subframes 1b to 6b. ), Images including the front frame images FF1c and FF2c are inserted into the front subframes 1c to 6c, and images including the front frame images FF1d to the front subframes 1d to 6d. Images containing FF2d) are inserted.

In addition, the left side frame images SF1 to SF6 as shown in FIG. 10 are inserted into the left side subframes 1L to 6L, and the images are also inserted into the right side subframes 1R to 6R in the same manner. Furthermore, the layer image FS7 shown in FIG. 6G is inserted into the layer subframe L rather than the continuous subframe having the intrinsic reduction rate.

In this state, the three-dimensional virtual reality space is realized with a three-dimensional perspective in the main frame 300 corresponding to the monitor display of the observer. The image in each subframe has its own linear perspective, which is the optical perspective expressed at the time of the first camera shot. The images in the subframes having their own perspectives are continuously displayed while being reduced again with respect to the frame images of the adjacent subframes according to the intrinsic reduction ratio, which is a perspective of the digital size change. Therefore, the three-dimensional virtual reality space according to the present invention is represented by the combination of the two, optical perspective and digital perspective.

5.2 Dynamic transformation display of basic three-dimensional virtual space

With the first three-dimensional virtual reality image displayed, the user can enter an event for teleportation by means of a pointing means such as a mouse, keyboard or joystick. For example, the up and down arrow buttons on the keyboard may be used to select forward and backward movements in space, or the left and right arrow buttons may be used to select a change direction to the left or right. Alternatively, the space movement may be selected by providing an arrow icon for redirection in the screen or by selecting a front, left and right sides of the screen with a mouse. It is to be understood that the method of selecting the redirection and the space movement is not limited by the present embodiment, and various examples may be applied to those skilled in the art.

In step S540 it is determined whether the event of such space movement or direction change from the user. As a result, if there is an input of an event, dynamic conversion of subframes is performed accordingly (step S550).

For example, if the user selects 'forward' in the three-dimensional space, this means that the subframes in the mainframe 300 are relatively transformed in the direction of the observer. Accordingly, the subframes 1a, 1b, 1c, and 1d closest to the observer are pushed out of the mainframe 300, and the remaining subframes are shifted forward by one step from the inside (i.e., the distant). 2a) replaces the subframe 1a, and subframe 3a replaces the subframe 2a. At this time, each subframe moves to the position of the upper subframe and is converted to have the same size as that of the upper subframe. This is from the observer's point of view, with subframes 2a, 2b, 2c and 2d advancing to the boundaries of the mainframe 300 to replace the existing subframes 1a, 1b, 1c and 1d. Its size also means that it becomes a new reference subframe.

Simultaneously with the dynamic conversion of the subframes, respective frame images corresponding thereto are also converted (step S560). That is, as described above, as the subframes are enlarged in size at the same time as the position movement, the respective frame images also have the same position movement and enlargement of the image. For example, when the subframes 2a, 2b, 2c, and 2d move to the positions of the subframes 1a, 1b, 1c, and 1d, the frame images FF2a and FF2b corresponding thereto. ) FF2c and FF2d will be enlarged to 100% to become the reference subframe image.

At the same time, the size of the layer subframe L into which the layer image is inserted is enlarged, so that the layer image SF7 is also digitally enlarged. This will give the viewer a step closer towards the front wall 220.

According to a more preferred embodiment of the present invention, the movement and the size change of the subframe are not made suddenly but suddenly. In detail, the lower subframe may move to the upper subframe position or vice versa, for example, by 1 pixel unit. The size of the subframe is also gradually enlarged with the movement so that the viewer cannot feel the rapid spatial movement and the change in the size of the image.

If the turn to the side is selected in the event input step S540, this corresponds to when the observer 10 is turned to the left or the right, preferably about 45 degrees.

For example, in the case of turning the head to the left side, the right side front subframe 1b on the opposite side is pushed out of the main frame 300, and the left side subframe 6L is instead of the left front subframe. Subsequent to the frame 1a, it enters into the main frame 300. Accordingly, the remaining subframes will be moved in the horizontal direction correspondingly. Unlike the above-described example, the size is not reduced when the left side subframe 6L moves to the front subframe 1a position. That is, the frame image (SF6 of FIG. 10) of the side subframe 6L maintains the relative magnification with respect to the front frame image FF1a, which is to ensure the continuity of the image.

If the user inputs an event for selecting a direction to the left by using a mouse or the like, the left subframes 5L, 4L, etc. are sequentially introduced into the main frame 300 and the front subframes are moved to the right. Some of it will be pushed out of the mainframe 300. At this time, the left subframe 300 is also not reduced, and only its position moves while maintaining a relative magnification. The above operation can be seen as having the same effect as the main frame 300 itself is moved to the left as shown in the dotted line in the subframe diagram of FIG. In this case, for example, in the case of the subframe 1L, only a part of the image will be contained in the mainframe 300 and displayed on the monitor.

Furthermore, when the head is turned to the left or right at a specific point and the direction is changed, the number of left and right subframes 300 displayed in the main frame 300 is different from each other. In other words, in Fig. 9, the leftmost subframe displayed when the observer is in the initial position will be (1L), but if the leftmost subframe that can be displayed in the position where the observer is slightly advanced is the lower subframe. (2L) or (3L) and so on. Preferably, the display range of these subframes is suitably programmed taking into account real space and perspective.

<Application of Complex 3D System>

Next, a description will be given of an embodiment of a more complicated complex 3D virtual reality space.

17A illustrates a preferred composite three-dimensional system in accordance with another aspect of the present invention in plan view. The space consists of four corridors 700, 810, 820, 900 and intersections 800 where they meet orthogonally. For convenience, the corridor 900 is formed with a dead front wall 930 in which the picture frame 1 is formed. The position of the camera and observer gradually advances from the initial point Po.

The frame image corresponding to the subframe when the camera and / or observer is at the initial point Po is shown in FIG. 18A. Referring to these figures, the angle of view boundary of the front camera (C1 in FIG. 2D) meets the points W1 (W2) of the walls 815 and 825, and the side camera C2 rotates about 45 degrees left therefrom. The left boundary of the angle of view meets the wall 710.

In this state, the front camera C1 photographs the front space including the left wall 710 'of the corridor 700 and the image is displayed in the mainframe 300 of FIG. 18A. That is, the front image displayed in the main frame 300 is the left wall 710 'and the right wall to the corners e1 and e2, and the ceiling and the floor therebetween, and between the two points W0 and W0'. Consists of a frontal image. Here, preferably, the left side wall 710 ', the right side wall, and the ceiling and the floor therebetween are divided into the front subframes a' (b ') (c') (d ') as described above, and the remainder is processed. An image between (W0) and (W0 ') can be constructed by inserting the previously photographed layer image LI1.

In addition, the remaining left wall 710 portion except for the portion 710 'overlapping with the front camera is also processed as the left side subframe L' as described above. As a result, the subframe at the point Po The configuration of the image is as shown in Fig. 18A.

A plan view of the observer advanced from point Po to point P1 is shown in FIG. 17B. Here, the point P1 is a point at which the horizontal angle of view boundary line of the front camera or observer is exactly coincident with the corners e1 (e2). As shown in FIG. 18B, the point P1 is a point W3 (W4) in the main frame 300. Only the front layer image LI1 is enlarged and displayed, and the remaining front subframes a ', b', c ', and d' are pushed out of the main frame 300. The maximum horizontal size displayed of the front layer image LI1 is in the range between the points W3 and W4, and thus the front layer image LI1 is preferably photographed and stored in advance as an image between these points.

18A and 18B above, if the observer turns his head to the left to change direction, the front subframe a 'and / or the left side subframe L' are already pushed out as described above. As you enter 300, the left image will be displayed.

Until the camera and observer reach point P2 in FIG. 17C, the front layer image LI1 of the layer subframe within the mainframe 300 is gradually enlarged while its left and right borders are indicated by arrows D1 and D2. It gradually narrows inward to cross the points W5 and W6. Also, at this point, another layer subframe is needed, which is the layer image corresponding to the outer walls 815 and 825 that were covered by the front layer image LI1 (W3) (W4). To display. That is, the sidewalls 815 and 825 outside the (W3) and (W4) regions are unnecessary in the front image, but when the viewer turns the head to the left and right, the field of view is indicated by the arrow D3 (Fig. 17C) ( D4) direction. In the case of the left side wall, the side layer image LI2 which separately photographed the side wall 815 outside (W3) which is the maximum view boundary point of a front camera is provided. Since the layer subframe into which the layer image LI2 is inserted is an area that does not appear when the viewer looks to the front but only turns to the left, as shown in FIG. 18C, the corner e1 and the point outside the main frame 300 are located. It is inserted between (W3). Specifically, when the observer turns from the front left boundary point W5 to the left, the field of view extends from the point W5 to the point W3, wherein the area 815 'of the layer image LI1 is the mainframe ( 300 will be entered and displayed. If the direction continues further to the left side, since the field of view continues to extend beyond the point W3 in the direction of the arrow D3, the layer image LI2 corresponding to the area starts to be displayed in the mainframe 300. . If the direction is further changed to the left, the subframes a 'and L' will be displayed in the main frame 300 eventually.

Note that the left boundary of the layer image LI2 is further enlarged in the direction of the arrow D3 as the viewer moves forward. That is, as shown in FIG. 17D, when the side camera advances and its left field of view line coincides with the corner e1, the observer's left field of view line coincides with the point W7 of the wall 815. Therefore, since the side layer image LI2 is to be displayed up to this area, the left maximum boundary of the side layer image LI2 becomes the point W7.

The configuration of the subframe and the layer image according to this is shown in Fig. 18D. According to the drawing, when the observer selects the left turn, the front layer image LI1 to the point W3 is pushed to the right, and then the side The layer image LI2 will be displayed subsequently successively.

As a result, the size of the inserted layer image LI2 is maximum at point P3 and minimum at point P1 shown in FIG. 17B. Preferably the size of the layer image according to the point is preprogrammed.

If the observer or the camera is further advanced so that the frontal view boundary lines coincide with the corners e3 and e4, the corridor 900 may be displayed in the same subframe as in the above embodiment. If the camera or observer is located at point P4 shown in Fig. 17E, the sidewalls 910 and 920 and the ceiling and floor therebetween are each a new front subframe (a ") (b") (c "). ("D") may be displayed and the remaining front wall 930 may be inserted into the layer image LI3.

The three-dimensional virtual reality space implementation method according to the present invention can be usefully used for shopping malls, etc. If the goods to be sold are set as separate objects and placed in the three-dimensional virtual reality space according to the present invention, for example, You can purchase products by dragging and dropping items you want into the shopping cart. Not only this, of course, it can be applied to various fields such as 3D games, tourism, geographic information provision, and the like.

The three-dimensional virtual reality space according to the present invention is expressed by the optical perspective of the frame image itself and the perspective through the change in the digital size of each subframe. Conventionally, in the method of expressing perspective by reducing and enlarging an image, not only the actual perspective is insufficient but also a problem of deterioration of resolution due to image enlargement has been caused. According to the invention, each frame image has its own optical perspective. In addition, dynamic changes of subframes are made to prevent the resolution from being reduced and enlarged and to provide a realistic image according to the viewer's redirection.

3D virtual reality space according to the present invention has the advantage that can give a realistic sense of space by displaying the image itself photographed the real space, not the generation or recombination of the image using a graphic authoring tool.

In addition, since the movement of the three-dimensional virtual reality space is made through the dynamic change of each subframe, only the data according to the dynamic change of the subframe needs to be transmitted or processed, thereby reducing the burden of transmitting or processing a large amount of data. .

Furthermore, since the present invention only needs to process dynamic conversion of subframe and layer images based on real images, for example, simple program tools such as HTML and JavaScript can realize 3D virtual reality space sufficiently. It is relatively easy to build and users do not need to install or plug in a separate browser.

Claims (22)

(a) photographing the real space continuously and intermittently while moving the camera in a direction giving perspective; (b) cutting and editing a portion of each of the photographed real spatial images to form a continuous image; (c) generating a plurality of consecutive subframes corresponding to the edited images so as to have a predetermined reduction ratio inside and outside the mainframe; (d) inserting the images edited in the step (b) into the subframes according to the predetermined reduction ratio as corresponding to the subframes to form a continuous image having a mutual perspective; And (e) moving the subframes and simultaneously applying dynamic changes to the sizes of the subframes and the corresponding images; and a method of implementing a 3D virtual reality space based on a real space image. The method of claim 1, wherein in the step (a), the actual space is photographed by the front camera photographing the front and the side camera photographing the side. The method of claim 2, wherein the subframes, Front subframes located inside the main frame and corresponding to images captured by the front camera; And side lateral subframes positioned outside the mainframe and corresponding to images captured by the lateral camera. According to claim 3, wherein the front subframes are composed of a plurality of rod-shaped frames arranged in the longitudinal and transverse direction with a relationship of a predetermined reduction ratio from the left end, right end, top and bottom of the main frame and , And said lateral subframes comprise a plurality of rod-shaped frames arranged longitudinally with respect to said mainframe with a mutually reduced reduction ratio. 5. The front subframes of claim 4, wherein each of the front images of the photographed real space is cut in a bar shape having a predetermined size in a longitudinal direction and a transverse direction of a left end, a right end, a top end, and a bottom end thereof. Corresponding to the reduction ratio Each of the side images of the photographed real space has a left end thereof cut into a bar shape having a constant size in the longitudinal direction and is reduced to correspond to the side subframes according to the predetermined reduction ratio. The method of claim 5, wherein in step (e), The lower subframes of the front subframes are enlarged to the size of the upper subframe while moving to the position of the upper subframe. The method of claim 5, wherein in step (e), A portion of one of the front subframes is pushed out of the main frame, and the remaining front subframes are moved in the horizontal direction, and the side subframe is followed by the other subframe of the front subframe. Method of entering into the mainframe. (a) generating source images by continuously and intermittently photographing the actual space while moving the camera in a direction giving perspective; (b) cutting part of each of the source images to generate frame images constituting a mutually continuous image; (c) generating a plurality of subframes having a predetermined reduction ratio so that object images are given to the frame images so that mutual images are continuous; And (d) moving the subframes and simultaneously applying a dynamic change of the subframes and the corresponding images to the next higher subframe or the next lower subframe size; and based on the actual spatial image. 3D virtual reality implementation method. The method of claim 8, wherein in the step (a), the actual space is photographed by the front camera photographing the front side and the side camera photographing the side surface. The method of claim 9, wherein the subframes, Front subframes located inside the main frame and corresponding to images captured by the front camera; And side lateral subframes positioned outside the mainframe and corresponding to images captured by the lateral camera. 11. The method of claim 10, wherein the front subframes are composed of a plurality of rod-shaped frames arranged in the longitudinal and transverse direction with a relationship of a predetermined reduction ratio from the left end, right end, top and bottom of the main frame and , And said lateral subframes comprise a plurality of rod-shaped frames arranged longitudinally with respect to said mainframe with a mutually reduced reduction ratio. 12. The method according to claim 11, wherein each of the front images of the photographed real space has a left end, a right end, an upper end, and a lower end cut in a bar shape having a predetermined size in a longitudinal direction and a transverse direction. Corresponding to the reduction ratio Each of the side images of the photographed real space has a left end thereof cut into a bar shape having a constant size in the longitudinal direction and is reduced to correspond to the side subframes according to the predetermined reduction ratio. (a) generating source images by continuously and intermittently photographing the actual space while moving the camera in a direction giving perspective; (b) generating layer images by photographing an area in which the spatial perspective can be ignored in the real space; (c) cutting part of each of the source images to generate frame images constituting a mutually continuous image; (d) generating a plurality of consecutive subframes corresponding to the frame images and layer subframes corresponding to the layer images so as to have a predetermined reduction ratio in and out of the main frame; (e) inserting the frame images into the subframes according to the predetermined reduction ratio, and inserting the layer images into the layer subframes, respectively, to form a continuous image having a mutual perspective; And (f) moving the subframes so that the size of the subframes and the frame images is the size of the next higher subframe or the next lower subframe, and the layer images are enlarged / reduced or hidden / hidden. And giving a dynamic change to enlarge / reduce or to reveal / hide a part of the image. 3D virtual reality space implementation method based on a real space image comprising a. The method of claim 13, wherein the subframes, Front subframes located inside the main frame and corresponding to images captured by the front camera; And side lateral subframes positioned outside the mainframe and corresponding to images captured by the lateral camera. 15. The apparatus of claim 14, wherein the front subframes comprise a plurality of rod-shaped frames arranged in a longitudinal direction and a transverse direction with a relation of a predetermined reduction ratio from a left end, a right end, an upper end, and a lower end of the main frame. , And said lateral subframes comprise a plurality of rod-shaped frames arranged longitudinally with respect to said mainframe with a mutually reduced reduction ratio. The method of claim 15, wherein in step (f), Among the front subframes, the lower subframes are expanded to the size of the upper subframe while moving to the position of the upper subframe. And the layer subframe and the layer image are enlarged. The method of claim 15, wherein in step (f), Among the front subframes, the lower subframes are expanded to the size of the upper subframe while moving to the position of the upper subframe. The first layer subframe and its layer image are enlarged, And a second layer subframe and its layer image appear between at least the subframes and / or the first layer subframe. The method of claim 15, wherein in step (f), A portion of any one of the front subframes is pushed out of the main frame, whereby the remaining front subframes and the first layer subframe are moved horizontally, and the second layer subframe and its layer Characterized in that the image enters into the mainframe. As a device for implementing a 3D virtual reality space based on a real space image, An input device for inputting an event signal; A display device for displaying an image; Interpret the three-dimensional virtual reality space file programmed to cut the source image taken from the real space continuously and intermittently to form a continuous image, and then insert them into a plurality of subframes with a predetermined reduction ratio. An analysis unit for interpreting an event signal of a user input through a device and instructing generation and dynamic conversion of the subframe and its image; And A subframe is generated according to the instruction of the analysis unit, an image corresponding to the subframe is provided and displayed on the display device, and the subframes are moved according to the event signal analysis result signal to transfer the subframes and images. An apparatus for implementing a three-dimensional virtual reality space based on a real space image, comprising: an execution unit for providing a dynamic transformation so that the size becomes a next higher subframe or a next lower subframe. The method of claim 19, wherein the analysis unit, An HTML interpreter for interpreting a 3D virtual space file programmed in an HTML-based language; And Apparatus comprising a script interpreter for interpreting to execute the JavaScript added in the HTML document. The method of claim 19, wherein the execution unit, A frame execution unit generating a subframe in the mainframe on the display and performing dynamic conversion of the subframe according to an event result signal from the analyzer; A frame image manager which provides an image for the subframe and converts an image corresponding to the dynamic conversion of the subframe; And And a layer image manager inserting the layer image into the subframe and providing a transformation of the layer image according to the subframe transformation. Realization of 3D virtual reality space using 3D virtual reality space files programmed to cut the source images taken from the real space continuously and intermittently to form a continuous image and insert them into a plurality of subframes having a predetermined reduction ratio. As a method, Analyzing the programmed three-dimensional virtual reality space file to generate a subframe on a display device and to provide an image corresponding to the subframe and to display the subframe; Inputting any one of an event including forward, backward, leftward switching, and rightward switching through an input device; And Moving the subframes according to the event input and giving a dynamic transformation so that the sizes of the subframes and the images become the next higher subframe or the next lower subframe size. Implementation method.