KR100403943B1 - System for reconstructing and editing image of object in screen of three dimensions imagination space - Google Patents

Abstract

According to the present invention, a virtual space user (a visitor) is a corresponding object (eg, a virtual space) on a virtual space panoramic screen in a three-dimensional virtual space panoramic screen in which real places such as an exhibition hall / art gallery / cultural site / animal garden are implemented on a computer screen. When a space exhibition car) is selected as a selection means such as a mouse, the user can actively use and use the 3D virtual space by reconfiguring and editing the appearance and color of the 3D video image of the corresponding object. The present invention relates to a system for restructuring and editing an image of a target in a three-dimensional virtual space screen.

The present invention for this purpose, three-dimensional virtual space operating processing means for storing and operating information and data for the three-dimensional virtual space; Panoramic image processing means for implementing a panoramic image in association with said three-dimensional virtual space operating processing means; Object reconstruction editing processing means for enabling the user to reconstruct and use the image shape of the object when the object present in the panoramic video screen is selected by the user; User interface processing to enable the user to use the three-dimensional virtual space through means such as a mouse and achieve movement / enlarge / reduce / edit reconstruction of the panomamara image and object through the use means such as mouse scrolling Means;

Each of the processing means is implemented by being programmed in a server and a general-purpose computer, and the user accesses the server through the Internet and a dedicated network communication network as a user client and provides a 3D virtual space and a panoramic image provided by the server. And using the reconstruction editing of the object, the FlashPix, IIP (Internet Image Protocol), Photo Vista, Object Modeler, Reality Studio technology of Live Picture for the reconstruction editing of the 3D virtual space and panorama image and the object. And a ShapeSnatcher technique and a Cult3D technique.

Description

System for reconstructing and editing image of object in screen of three dimensions imagination space}

The present invention relates to a system for restructuring and editing an image of an object on a three-dimensional virtual space screen, and more particularly, to a three-dimensional virtual space that embodies a real place such as an exhibition hall / art gallery / cultural heritage site / animal garden on a computer screen. When the user of the virtual space (viewer) selects the corresponding object (e.g., the virtual space vehicle) in the virtual space panoramic screen as a selection means such as a mouse, the appearance and color of the 3D image image of the corresponding object is reconstructed. The present invention relates to a system for restructuring and editing an image of an object on a three-dimensional virtual space screen that enables a user of a virtual space to actively utilize and use a three-dimensional virtual space.

Recently, due to the rapid development of digital signal processing technology, image processing technology and Internet technology, a lot of virtual spaces that are achieved on computer screens have emerged. For example, virtual places such as exhibition halls (e.g. automobile exhibition halls, museums), art galleries, cultural sites and zoological gardens can be virtualized on the computer screen to visit places such as actual exhibition halls, art galleries, cultural sites and flora and fauna. Examples of these are virtual spaces that are implemented on the Internet that allow you to see what is on the screen (eg exhibits, cultural heritage, flora and fauna) on your computer screen.

By the way, in the virtual space achieved on the computer as described above, when using (viewing, viewing) the object in the virtual space, for example, the exhibits on the screen, the virtual space user (viewer) is passively present in the virtual space screen. There was a problem that can not only be able to encounter these objects, but also actively reconfigure or edit these objects.

In addition, the virtual space screen achieved on a conventional computer does not provide a three-dimensional panoramic image, but provides only a static two-dimensional planar video image, which does not give a virtual space user a sense of realism, liveliness, and three-dimensional appearance. there was.

The present invention has been created to solve the above problems, for example, a virtual space user (viewers) in a dynamic three-dimensional virtual space panorama screen that implements a real place, such as an exhibition hall / art museum / cultural heritage / flora and fauna on a computer screen When user selects the corresponding object on the virtual space panorama screen (e.g., virtual space exhibition car) as a selection means such as a mouse, the user of the virtual space can reconfigure the appearance and color of the 3D video image of the target object. The purpose of the present invention is to provide a system for restructuring and editing an image of a target in a three-dimensional virtual space screen that enables a user to actively use and use a three-dimensional virtual space.

1 is a block diagram of a system for reconfiguring and editing an image of an object in a three-dimensional virtual space screen according to the present invention;

2 is a flow chart of the operation of the present invention,

3 is a conceptual diagram of an embodiment implemented according to the present invention;

4 illustrates an exemplary embodiment implemented in accordance with the present invention.

5 is a view of the related art applied to the present invention,

5a shows an example of the enlargement of Live Picture technology.

5b is a conceptual diagram of a flashpix image transmission technology;

5c is an example related to Photo Vista,

5d is an example related to Object Modeler,

5e is an example of Reality Studio,

5f and 5g are illustrative examples of ShapeSnatcher,

5h to 5k are exemplary diagrams related to Cult3D,

5l to 5q are exemplary diagrams related to a 3D virtual space manufacturing process.

<Description of the code | symbol about the principal part of drawing>

1: 3D virtual space operation processor 3: Panorama image processor

5: user interface processing unit 7: object reconfiguration editing processing unit

10 server 20 user client

50: internet 100: virtual space screen

105: object 105a, b: reconstituted object

110: Rebuild Edit Screen 120: Rebuild Edit Tool

In order to achieve the above object, a system for reconstructing and editing an image of an object in a three-dimensional virtual space screen according to the present invention,

Three-dimensional virtual space operating processing means for storing and operating information and data for the three-dimensional virtual space; Panoramic image processing means for implementing a panoramic image in association with said three-dimensional virtual space operating processing means; Object reconstruction editing processing means for enabling the user to reconstruct and use the shape of the object when the object present in the panoramic image is selected by the user; User interface processing to enable the user to use the three-dimensional virtual space through means such as a mouse and achieve movement / enlarge / reduce / edit reconstruction of the panomamara image and object through the use means such as mouse scrolling Means;

Each of the processing means is implemented by being programmed in a server and a general-purpose computer, and the user accesses the server through the Internet and a dedicated network communication network as a user client and provides a 3D virtual space and a panoramic image provided by the server. And using the reconstruction editing of the object, the FlashPix, IIP (Internet Image Protocol), Photo Vista, Object Modeler, Reality Studio technology of Live Picture for the reconstruction editing of the 3D virtual space and panorama image and the object. And a ShapeSnatcher technique and a Cult3D technique.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the system for reconstructing and editing the image of the object in the three-dimensional virtual space screen according to the present invention.

1 is a block diagram of a system for reconfiguring and editing an image of an object in a three-dimensional virtual space screen according to the present invention, FIG. 2 is a flowchart of the operation of the present invention, and FIG. 3 is a conceptual diagram of an embodiment implemented according to the present invention. 4 is an exemplary view of an actual embodiment implemented according to the present invention. 5 is an exemplary diagram of embodiments related to the technology applied to the present invention.

1 and 3, a system for reconfiguring and editing an image of a target in a 3D virtual space screen according to the present invention may include a 3D virtual space operating processor for storing and operating information and data for a 3D virtual space. (1); A panoramic image processor 3 for implementing a panoramic image in cooperation with a 3D virtual space operating processor 1; Object reconstruction editing processing unit 7 for allowing the user to reconstruct and use an image of the object 105 when the object 105 present in the panoramic image is selected by a user by selection means such as a mouse click. Wow; A user interface processor for allowing the user to use the three-dimensional virtual space through means such as a mouse and achieve movement / enlarge / reduce / edit reconstruction of the panomamara image and object through a means such as a mouse scroll (5); is configured to include. In the present invention, each of the processing units 1, 3, 5, and 7 described above is operated and built into a server 10 and a general purpose computer. The user connects to the server 10 via the Internet 50 and a dedicated network as the user client 20 or 20a, and provides a three-dimensional virtual space panoramic screen 100 and a reconstruction editing screen 110 provided by the server 10. ). The three-dimensional virtual space panoramic screen 100 is achieved by the three-dimensional virtual space operating processor 1 and the panoramic image processing unit 3, and the reconstruction editing screen 110 is achieved by the object reconstruction editing processing unit 7.

In the construction of the present system, that is, for reconstruction and editing of a three-dimensional virtual space, a panorama screen, and an object, FlashPix, IIP (Internet Image Protocol), Photo Vista, Object Modeler, Reality Studio technologies of Live Picture , ShapeSnatcher technology, and Cult3D technology.

In FIG. 1, the user client shown as the reference numeral 20 is a client using the three-dimensional virtual space panoramic screen 100 and the reconstruction editing screen 110 provided by the server 10 through an Internet 50 connection. The user client shown by reference numeral 20a is a client using the three-dimensional virtual space panoramic screen 100 and the reconstruction editing screen 110 provided by the server 10 of the present invention through a dedicated line network.

Reference numeral m not described in FIG. 1 denotes a mouse used for moving the three-dimensional virtual space panoramic screen 100 and selecting an object 105 according to the processing of the user interface processor 5 of the present invention. Reference numeral 120 not illustrated in FIG. 3 denotes a reconfiguration editing tool according to the object reconfiguration editing processing unit 7 when the reconfiguration editing screen 110 is displayed, and 105a and 105b are objects in a reconfiguration edited state.

An operation of a system for reconfiguring and editing an image of a target in the 3D virtual space screen of the present invention configured as described above will be described with reference to FIGS. 1 to 4.

First, 3D virtual space information data and panoramic screen information data and reconstruction of actual places corresponding to the 3D virtual space of the present invention, for example, housing exhibition halls and objects (such as living items, interior decorations, etc.) therein. The information data for the configuration of the edit screen 110 includes the above-described image processing technology and image control technology, that is, Live Picture, FlashPix, IIP (Internet Image Protocol), Photo Vista, Object Modeler, Reality Studio, ShapeSnatcher, Cult3D The technology is constructed in each of the processing units 1, 3, 5, 7 of the server 10 of the present invention.

When the 3D virtual space information data, the panoramic image information data, and the reconstruction edit screen information data are constructed and operated in the server 10 as described above, the user clients 20 and 20a access the server 10. On the screen 100 of the user client 20 or 20a, as shown in FIGS. 3 and 4, the 3D virtual space panoramic screen 100 on which the target object 105 appears is displayed (S10; FIG. 2). .

In the state where the 3D virtual space panorama screen 100 is displayed, the user clients 20 and 20a look up and down the 3D virtual space while moving the 3D virtual space panorama screen 100 using a mouse scroll. (S20). As described above, when the 3D virtual space panorama screen 100 is moved using the mouse scroll and the selected object 105 is selected and clicked (S30), the object reconstruction editing processing unit 7 displays the reconstruction editing screen in the panorama screen 100. The display 110 displays the 3D virtual space user client 20 and 20a to reconfigure and edit the selected object 105 (S40).

The reconstruction editing screen 110 displayed by the target reconstruction editing processing unit 7 includes a reconstruction editing tool 120, and the user client 20 and 20a utilize the reconstruction editing tool 120. The target object 105 is reconfigured and edited while changing the shape, appearance, color, etc. of the selected target object 105 (S50).

Thus, the user of the 3D virtual space panoramic screen can actively utilize the 3D virtual space by directly reconfiguring and editing the corresponding object in the 3D virtual space.

As described above, technologies for constructing and achieving the present invention include Live Picture, FlashPix, IIP (Internet Image Protocol), Photo Vista, Object Modeler, and Reality Studio. This will be described in detail with reference to FIG. 5.

According to the Live Picture technology, an enlargement of an original picture is ideally illustrated, an embodiment of which is illustrated in FIG. 5A. According to the Live Picture technology, it is possible to implement a high resolution three-dimensional virtual space.

-Virtual reality can be realized by linking 3D panoramas with the drag and drop of a mouse.

-Can accommodate existing multimedia files.

-Use 3D panoramas, 3D objects, multimedia files, etc.

-Depending on how the homepage is composed, Java or plugin-type products can be produced automatically.

-Regardless of the change of homepage, it can be completed in less time.

The features of Live Picture technology, such as providing high resolution images at high speed through the Internet, and providing a server-centric structure, can easily build virtual reality-like spaces with easy production tools. It can support high resolution images better than traditional file formats, support for general-purpose browsers such as Netscape / Internet Explorer, and can also be used on low speed networks.

The base technologies of Live Picture technology for building 3D virtual space as above are FlashPix and IIP. FlashPix is used to implement multi-resolution and divide image into pieces, and IIP is progressive download technology and necessary image. Used as a protocol for sending only operations. Figures related to FlashPix and IIP are shown in Figure 5b. According to the FlashPix technology, it is possible to enlarge the image while maintaining the original image (see FIG. 5A).

Photo Vista automatically edits multiple image files to create 360-degree rotating panoramas that can be used on the Web or a printer, which supports the generic image format and also supports generic cameras. The panorama image generated by the Photo Vista may be stored / printed and generated as a screen saver. Thus, Photo Vista allows users to create virtual spaces that can be saved using a high-performance camera and then zoomed in and out of high resolution panoramic images. An example of this is shown in Figure 5c.

The use and implementation of the Object Modeler are as follows, and the related drawings are shown in FIG. 5D.

Object Modeler can create, edit, preview, save and export objects (objects) by creating 3D objects for use with Reality Studio or Live Picture Viewer Plug-in and applying developer's originality.

-Automatically edit image files taken from various angles to create 3D objects and rotate them 360 degrees.

-Create, edit, preview, save, and export objects by applying the originality of the developer.

-It is possible to enlarge / reduce 3D object of the created Multi-Resolution FlashPix image.

The use of Reality Studio and the implementation thereof are as follows, and the related drawings are shown in FIG. 5E.

-Use Hot-Spot technology on the web by connecting panorama image composed in Photo Vista, 3DObject created in Object Modeler, high resolution FlashPix image, Movies, Sounds, Geometry Image, URL, etc.

-Easily create virtual reality spaces where users can move multiple virtual spaces as if they were actually there.

The characteristics of the ShapeSnatcher technology applied to the present invention, the difference between the ShapeSnatcher technology and the existing technology, the process of processing the 3D model through the ShapeSnatcher, and the application of the 3D data using the ShapeSnatcher technology are as follows. Are shown in FIGS. 5F and 5G.

1. Features;

The modeling of three-dimensional objects to produce conventional three-dimensional VR consumed considerable time and manpower. In addition, there was a disadvantage in that the quality of the work is determined according to the individual skill of the worker, and since the work is produced by manual work, the implementation of a large amount of information in the VRML method has practically involved a problem of time and manpower. However, with the new ShapeSnatcher technology, it is possible to maintain homogeneous qualities in the production of workpieces without the use of expensive 3D scanners and to facilitate mass three-dimensional work.

2. differences from existing technologies;

1) Existing 3D model production method: Using 3D Max or other 3D modeling software, the worker directly creates the model

Advantages: The production cost is low because only the labor cost of the worker is considered.

Disadvantages: Can not work large quantities and can not trust the quality of the workpiece.

2) 3D model creation using 3D scanner; How to modify 3D data obtained by scanning with 3D scanner in other 3D software

Pros: Able to process large amounts of data and obtain homogeneous workpieces.

Disadvantages: The introduction of expensive scanner equipment is a real challenge for businesses.

3) 3D model creation using ShapeSnatcher technology; By modifying the three-dimensional data obtained through ShapeSnatcher in other three-dimensional software, a large amount of data can be processed and a homogeneous work can be obtained. In addition, mapping data can be obtained all at once, reducing the time required for mapping and working consistently.

3. 3D modeling process with ShapeSnatcher (see FIGS. 5F, 5G); Light from beam project emits light through slide-> Special coordinate projection Calbration-> Light from slide is projected on the object, coordinate setting-> Shooting the above with existing digital camera

4. Application of 3D data using ShapeSnatcher technology;

1) 3D raw data obtained using ShapeSnatcher technology can be processed into existing VRML data such as CosmoPlay through VRML conversion in existing 3D software.

2) VRML file can be used in common in VR method such as Live Picture.

3) When used in the higher level Cult3D, the three-dimensional data obtained here can properly highlight real-time rendering and reflection of Cult3D.

4) You can mass produce Cult3D images using ShapeSnatcher.

Looking at the Cult3D for constructing the three-dimensional cyber space of the present invention as follows, and the related drawings are shown in Figures 5h to 5k.

1. Looking at the overview of Cult3D,

1) The existing VRML method using CosmoPlay on the Internet was difficult to use and the surface could not be realistically produced, and it took a long time to see the object. In addition, Live Picture or QuickTime VR, which improved the existing VR system, is not only a real object but a gimmick through compositing a photo image, thus supporting a weakness that cannot provide various virtual reality opportunities.

2) In addition, as the transmission speed of the Internet and the specifications of computers increase day by day, users are expected to achieve the same functions and conditions on the Internet as real objects. However, in some cases, the 3D model using the existing VRML was attempted for differentiation, but the limitation was that the data was too large to be realistic.

3) Cult3D, which was developed to overcome the above drawbacks, has a high speed transfer (HSS) function by excellent compression processing technology, so it can transmit 200 times faster than usual when sending 3D images. It is a technology that enables real-time 3D display by an interactive user environment in a three-dimensional space even in a general operating environment.

4) The biggest advantage of Cult3D technology is its real-time reflection. This improves the object that is not satisfactory in the existing VR and improves the disadvantage that the model is difficult for the user to interact interactively when constructing the VR through the photo, so that the user can manipulate the realistic 3D object mesh like the photo without any inconvenience. It means you can see it.

5) The core of Cult3D is the technology to send complex and large file size 3D data in the form of a simple form to the user first, and then learn the detailed form as the download is completed.

6) Cult3D is a technique for streaming 3D data as if the real player streamed the video.

7) In the case of expressing and showing cultural relics or relics in a virtual space such as the Internet, 3D models can be used to induce user's interest to stay on the site for a long time. It can be converted into an image.

2. Features of Cult3D;

1) Compression ratio is maximized by excellent compression technology. The file size is relatively smaller than that of CosmoPlay.

2) The animation function in Max can be implemented.

3) Various actions can be created in Cult3D.

4) A large amount (up to 20 minutes) of sound / voice can be realized and audio synchronization is possible.

5) Realism can be realized on the web by implementing unique real-time reflection effect.

6) As high speed transmission (HSS) function, it realizes the transmission of 3D image about 200 times faster than usual.

7) Available on various platforms (IBM, Mac, Line, etc.).

Looking at the process of producing a three-dimensional virtual space of the present invention using the above-described techniques are as follows, and the related drawings are shown in Figures 5l to 5q.

1. How to take a panorama

1) panorama production; Photographs are divided by 22.5 degrees (360 degrees, 16cuts) from the main points of the route so that visitors can enjoy the exhibits while moving along one route (e.g., exhibition hall). Implement

2) photographing method; When photographing the memorial hall, No1 and No2 screens overlap about 30%. Lenses (28m / m, 25m / m, 50m / m) are selected to fit the space and characteristics of the space, and 12-16 shots are taken for each exhibition panorama point.

3) A photograph of each side is shown in FIG. 5L, each side is composed in a panorama as shown in FIG. 5M (360 degrees), and each side is 360 degrees synthesized as shown in FIG. 5N.

2. How to photograph the object; For materials or exhibits that are fixed in exhibition halls and outdoors, shoot 8-16 shots around the object at intervals of 22.5-45 degrees, and then create a three-dimensional image by synthesizing the pictures using the Object Modeler.

1) How to shoot

-Use a background over 2.5m in width and 3m in height.

-Use at least 3 sets of lights over 1kw.

Set the target using the turn table.

-Shoot 8-16 frames each 22.5-45 degrees using a digital or analog camera with a lens from 35m / m to 105m / m.

2) The photograph of each side is shown based on 12 cuts as shown in FIG. 5O.

3. The process of synthesizing the panorama and the object is shown in Figs. 5p and 5q. In this case, a panorama image is produced in Photo vista, and a 3D object is produced in Object Modeler.

As described above, the present invention provides a virtual space user (viewer) on a virtual space panorama screen in a three-dimensional virtual space panorama screen that implements a real place, such as an exhibition hall / art gallery / cultural heritage site / animal garden, on a computer screen. When the target object (eg virtual space exhibition vehicle) is selected as a means of selection such as a mouse, the user of the virtual space can actively recreate and edit the appearance and color of the 3D video image of the target object. It offers the advantage of making it available and available.

Although the preferred embodiments of the present invention have been described in detail above, those skilled in the art will appreciate that the present invention may be modified without departing from the spirit and scope of the invention as defined in the appended claims. It will be appreciated that modifications or variations may be made. Therefore, changes in the future embodiments of the present invention will not be able to escape the technology of the present invention.

Claims (1)

In the system for restructuring and editing the image of the object on the three-dimensional virtual space screen, Three-dimensional virtual space operating processing means for storing and operating information and data for the three-dimensional virtual space; Panoramic image processing means for implementing a panoramic image in association with said 3D virtual space operation processing means; Object reconstruction editing processing means for enabling the user to reconstruct and use the image of the object when the object present in the panoramic image is selected by the user; User interface processing to enable the user to use the three-dimensional virtual space through means such as a mouse and achieve movement / enlarge / reduce / edit reconstruction of the panomamara image and object through the use means such as mouse scrolling Means; Each processing means is constructed by operating a server and a general purpose computer, The user accesses the server through the Internet and a dedicated network communication network as a user client and uses the three-dimensional virtual space, panorama image, and reconstruction editing of the object provided by the server. For reconstruction and editing of the 3D virtual space, panorama image, and the object, Live Picture technology implements multi-resolution and divides the image into pieces, FlashPix, progressive download function and transmission of only necessary image pieces. Internet Image Protocol (IIP) with the function, Virtual Space Screening Technology (Photo Vista), which automatically edits multiple image files to create 360-degree rotating panoramas, 3D stereoscopic image production technology (Object Modeler) for generating 3D objects, Virtual space production technology (Reality Studio) that connects the panorama image constructed through the virtual space screen production technology, the 3D object generated through the 3D stereoscopic image production technology, and the high resolution flashfix image, movie, sound, geographic image, and URL )and, ShapeSnatcher technology for creating 3D models, and And Cult3D technology for constructing a 3D virtual space using the raw data obtained through the ShapeSnatcher technology.