KR20010087974A - Method and apparatus for generating a 3 dimension image on a network - Google Patents

Abstract

PURPOSE: A system and method for creating the three-dimensional image based on the network are provided to enable an Internet user to feel like the real product by displaying a virtual image on a screen, and to stimulate the product purchase of the user. CONSTITUTION: A main server takes a picture of the specified object vertically and horizontally(S10). The main server converts the analog image signal into the digital image signal and stores the digital image signal to the first memory in the frame unit(S20). A user computer connects to the web page of a main site(S30). The main server offers the web page of the three-dimensional image service to the user computer(S40). The user computer orders the three-dimensional image service on the web page(S50). The main server outputs the image data and java applet to the user computer(S60). The user computer stores the image data and java applet to the second memory, and runs the java applet(S70). The user computer creates the virtual frame based on two frames by the XY coordinate input, inserts into two frames, and orderly displays realigned frames on the screen(S80).

Description

3D image generation system based on network and method thereof {Method and apparatus for generating a 3 dimension image on a network}

The present invention relates to a network-based three-dimensional image generation system and method thereof.

More specifically, when the main server connected to the user's computer through a network communication network provides a Java applet or a plug-in program to the user's computer with images of a predetermined object taken in various directions, the user's computer may be a Java applet. Or a network-based 3D image generating system and method for executing a plugin program to generate and insert a virtual image based on two adjacent images and then display the rearranged images sequentially on the screen. It is about.

Recently, due to the rapid development of computer systems and communication networks, sites that conduct commerce with users online are emerging in various fields.

In general, electronic commerce is a commerce using information technology such as electronic document exchange, e-mail, electronic bulletin board, fax, electronic funds transfer, etc., without using paper documents.It is used to sell, order, and advertise products and services through network communication networks. Means all economic activity, including

This e-commerce not only supports differentiated services to consumers in accordance with their various needs and consumption tendencies, but also creates a business opportunity for merchants to secure an unlimited sales network worldwide.

Accordingly, the e-commerce business using the Internet cyber space is actively being promoted around the world. An example is the Internet shopping mall.

However, shopping malls that display products through a network communication network such as the Internet generally display only the front of the product. Therefore, when a user wants to purchase a product in an internet shopping mall, the user does not satisfy the desire of the user to see the product in all directions. There was a problem.

Accordingly, the present invention has been made to solve the above problems, the main server connected to the user's computer through a network communication network with a Java applet or a plug-in program to the user's computer with the images of the predetermined object in various directions If provided, a 3D image generation system based on a network that allows a user computer to execute a Java applet or a plug-in program to generate and insert a virtual image based on two adjacent images, and display the rearranged images sequentially on the screen. And to provide a method.

The system according to the present invention for achieving the above object is a network communication network for connecting data between a plurality of unspecified communication network to be made; Access the web page of the main site through the network communication network, upload a 3D image service order on the web page, and download frame data and a Java applet from the main site through the network communication network, A plurality of user computers generating a virtual frame based on two adjacent frames, inserting the virtual frames between the two frames, and sequentially displaying the rearranged frames on the screen; Image data of a certain object shot in various directions is stored in a memory unit in a frame unit, a web page is provided to a user computer connected through the network communication network, and when a 3D image service order is received from the user computer, the memory is stored in the memory. And a main server that outputs the stored frame data and the Java applet to the user computer through the network communication network.

Another system according to the present invention for achieving the above object is a network communication network for making data communication between each other by connecting an unspecified communication line; Access the web page of the main site through the network communication network, upload a 3D image service order on the web page, download the frame data from the main site through the network communication network, and install the plug-in program installed in the web browser. A plurality of user computers that generate a virtual frame based on two adjacent frames by inserting the two frames and insert the virtual frames between the two frames, and sequentially display the rearranged frames on the screen; Store image data of a certain object in various directions in a memory unit in frame unit, provide a web page to a user computer connected through the network communication network, and receive a 3D image service order from the user computer in the memory. And a main server for outputting stored frame data to the user computer through the network communication network.

The method according to the present invention for achieving the above object is a method of generating a three-dimensional image by connecting a plurality of user computers to a main server through a network communication network, in the main server, a predetermined object horizontally and vertically A tenth step of sequentially photographing by moving in the direction; A 20th step of converting the captured analog image signal into a digital image signal in the main server and storing the converted analog image signal in a first memory on a frame basis; A thirtieth step of accessing a web page of a main site from the user computer; In the main server, providing a web page of a 3D image service in response to the access; In the user computer, ordering a three-dimensional image service on the web page; In the main server, when receiving the 3D image service order, outputting image data and a Java applet in units of frames stored in the first memory to the user computer; In the user computer, storing image data and a Java applet on a frame basis in a second memory and accessing and executing the Java applet stored in the second memory; In the user computer, a virtual frame is generated based on two adjacent frames by accessing the corresponding frames stored in the second memory by the user's XY coordinate input, and then inserted between the two frames, and the rearranged frames are sequentially displayed. Characterized in that the eighty step of displaying on the image.

Another method according to the present invention for achieving the above object is a method of generating a three-dimensional image by connecting a plurality of user computers to a main server through a network communication network, in the main server, a predetermined object horizontal A tenth step of sequentially imaging in the vertical direction; A 20th step of converting the captured analog image signal into a digital image signal in the main server and storing the converted analog image signal in a first memory on a frame basis; A thirtieth step of accessing a web page of a main site from the user computer; In the main server, providing a web page of a 3D image service in response to the access; In the user computer, ordering a three-dimensional image service on the web page; A 60th step of outputting image data of frame units stored in the first memory to the user computer when the 3D image service order is received from the main server; In the user computer, storing image data of the frame unit in a second memory and executing a plug-in program installed in a web browser; In the user computer, a virtual frame is generated based on two adjacent frames by accessing the corresponding frames stored in the second memory by the user's XY coordinate input, and then inserted between the two frames, and the rearranged frames are sequentially displayed. Characterized in that the eighty step of displaying on the image.

1 is a block diagram showing a three-dimensional image generation system based on the network in the present invention,

2 is a flowchart illustrating a 3D image generating method based on a network according to the present invention;

3 is a diagram for explaining an imaging method according to the present invention;

4 is a view for explaining a method of aligning images stored in a memory according to the present invention;

5 is a view for explaining a virtual image generated by the synthesis technique according to the present invention,

6 is a view for explaining a virtual image generated by the morphing technique according to the present invention.

* Names of symbols for main parts of the drawings

10: network communication network 20: user computer

30: main server 21: the second network interface

22: input unit 23: display unit

24: second memory 25: second central processing unit

31: imaging means 32: A / D converter

33: first memory 34: first network interface

35: first central processing unit

Hereinafter, a system according to a first embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram schematically showing a three-dimensional image generation system based on a network according to the present invention.

As shown in FIG. 1, a system according to the present invention includes a network communication network 10; A plurality of user computers 20; The main server 30 is configured.

Here, the network communication network 10 connects communication lines between the plurality of user computers 20 and the main server 30 to perform data communication with each other.

In addition, the user computer 20 accesses the web page of the main site through the network communication network 10 to upload a 3D image service order on the web page, and frame-by-frame from the main site through the network communication network 10. The image data and the Java applet are downloaded, a virtual frame is generated based on the two frames adjacent by the Java applet, inserted between the two frames, and the rearranged frames are sequentially displayed on the screen.

Here, the user computer 20 uploads the user's three-dimensional image service order to the main server 30 through the network communication network 10, and frame-by-frame from the main server 30 through the network communication network 10. A second network interface 21 for downloading the image data and the Java applet of the camera; An input unit 22 for outputting XY coordinate data in response to a user's movement; A display unit 23 for displaying image data of a three-dimensional image on a screen; A second memory 24 for storing image data in units of frames; Controls to store the Java applet input from the second network interface 21 and the image signal in a frame unit in the second memory 24, and executes the Java applet to execute XY coordinate data input from the input unit 22. Accesses the frames stored in the corresponding region of the second memory 24 to generate a virtual frame based on two adjacent frames, inserts the virtual frames between the two frames, and sequentially arranges the frames in the display unit 23. And a second central processing unit 25 for displaying.

The second CPU 25 executes the Java applet, synthesizes video data of two adjacent frames by a synthesis method, generates virtual frame video data, and inserts the data between the video data of the two frames, or The image data of two adjacent frames is morphed by a morphing technique to generate virtual frame image data, and then inserted between the image data of the two frames.

In addition, the main server 30 stores image data obtained by capturing a predetermined object in various directions in the first memory 33 in units of frames, and transmits the web to a user computer 20 connected through the network communication network 10. A main server that provides a page and outputs the image data and the Java applet in the frame unit to the user computer 40 through the network communication network 10 when the 3D image service order is input from the user computer 20. 30).

The main server 30 may include: imaging means 31 for outputting analog image data captured while sequentially moving a predetermined object in the horizontal and vertical directions; An A / D converter 32 for converting analog image data input from the image pickup means 31 into digital image data; A first memory 33 for storing Java applets and image data in units of frames; A first 3D image service order received from the user computer 20 through the network communication network 10, and outputting Java applets and image data in frame units to the user computer 20 through the network communication network 10; Network interface 34; Each unit is controlled, and the digital image data output from the A / D converter 22 is arranged in a two-dimensional array and controlled to be stored in the first memory 33 in units of frames, and the first network interface 34 is controlled. When the 3D image service order is inputted from the first memory 33, the first central processing unit 35 accesses the image data and the Java applet in units of frames from the memory 33 and outputs it to the first network interface 34. do.

Next, the operation and effects of the first embodiment according to the present invention will be described in detail with reference to FIGS. 2 to 6.

2 is a flowchart illustrating a three-dimensional image generation method based on a network according to the present invention, FIG. 3 is a diagram for explaining an imaging method according to the present invention, and FIG. 5 is a view for explaining a method of aligning stored images, FIG. 5 is a view for explaining a virtual image generated by a synthesis technique according to the present invention, and FIG. It is a figure for demonstrating.

First, when the main server 30 sequentially photographs a predetermined object in the horizontal and vertical directions in the tenth step S10, the main server 30 captures the captured analog video signal in the twelfth step S20. Is converted into a digital video signal and stored in the first memory 33 in units of frames.

At this time, the first CPU 35 for controlling each unit arranges the digital image data output from the A / D converter 22 into a two-dimensional array and stores the digital image data in the first memory 33 in units of frames.

Also, a Java applet is stored in the first memory 33.

For example, the present invention uses the imaging means 11 as shown in FIG. 3 to image the object in the horizontal and vertical directions, wherein the center of the semicircular rail 4 is located on the central axis of the rotating disk 3. Coincides with the vertical axis of rotation of the object (1). In addition, in the camera 2 attached to the rail 4, the photographing center is directed toward the center of the rail 4, and the rotating semicircle 3 is capable of vertical movement, so that the photographing center is located at an arbitrary point on the vertical axis of rotation of the object. Can be set.

That is, the camera 2 attached to the rail 4 photographs the object while moving vertically at intervals of Φ. At this time, the object is imaged while rotating the rotation disk 3 by one rotation with respect to the angle Φ. As a result, a total of (π / Φ) × (π / θ) frames can be obtained. For example, when the image is captured at a 45 ° interval in both the horizontal and vertical directions, it is "(180/45) x (360/45) = 32". Therefore, all 32 frames can be obtained.

Frames output from the imaging means 11 are stored in the first memory 33 in a two-dimensional array as shown in FIG.

Accordingly, when the user computer 20 accesses the web page of the main site in step 30 (S30), the main server 30 responds to the connection in step 40 (S40) and the web page of the 3D image service. To provide.

At this time, in order for a user to access the main server 30 through a network communication network 10 such as the Internet, a web browser must be installed in the user computer 20.

Accordingly, after the web browser installed on the user computer 30 is executed by the user and the domain of the main site is input, when the communication connection is made to the main server 30 according to the set communication environment, the main server 30 is The 3D image service screen is displayed on the user computer 20.

In operation 50, the user computer 10 orders a 3D image service on the web page.

Accordingly, when a user orders a three-dimensional image service for a specific object (for example, a shopping mall and an exhibition hall) on a web page, the user computer 10 sends the order data to the main server ( 30).

In operation 60 (S60), the main server 30 receives a 3D image service order from the user computer 20 and stores image data and a Java applet in units of frames stored in the first memory 33. The user computer 20 )

That is, when the main server 30 receives the 3D image service order data of a specific object from the user computer 10, the main server 30 accesses the image data of the object stored in the first memory 33 by the input order data. Output to the user computer 10 with the Java applet.

In operation 70, the user computer 20 stores the image data and the Java applet in the frame unit in the second memory 24 and accesses and executes the Java applet stored in the second memory 24.

Accordingly, in operation 80, the user computer 20 generates the virtual frame based on two adjacent frames by accessing the corresponding frames stored in the second memory 24 by the user's XY coordinate input. It inserts between two frames and then displays the rearranged frames sequentially on the screen.

That is, by the Java applet, the second CPU 35 first accesses and displays a frame of a specific position (for example, θ, Φ in FIG. 4) stored in the second memory 24 on the screen. By accessing the corresponding frames stored in the second memory 24 by XY coordinate data input from (22: hereinafter referred to as a mouse), a virtual frame is generated based on two adjacent frames, and then inserted between the two frames. By displaying the rearranged frames sequentially on the screen, it makes you feel as if you are actually returning the product.

Here, the second CPU 25 generates the virtual frame d by synthesizing two adjacent frames a and b by executing the Java applet, as shown in FIG. a) (b), or as shown in Figure 6 or by morphing the two adjacent frames (a) (b) by the Java applet to generate a virtual frame (d) after the two frames (a) (b) Inserted in between.

Here, the morphing technique is an image processing method for generating an image of an intermediate form from two images, and is widely used in broadcasting or advertisement. In the process of calculating the morphing image, a user first designates a feature point corresponding to each other, and calculates a correspondence between all points of the two images through a warping function. The morphing image is then created by interpolating the positions and colors of the two points according to the calculated correspondence.

That is, by using a morphing technique, an intermediate form image is generated from two adjacent images according to XY coordinate data input from the input unit (hereinafter referred to as a mouse), and then inserted between the two images and then rearranged. By sequentially displaying on the screen, the image is rotated in real time, giving the user the feeling of actually turning the product.

However, since the morphing technique requires a large amount of computation to generate an intermediate image from two adjacent images as described above, the processor of the user computer 10 running the applet viewer must be very fast to rotate the image in real time. You can.

If the processing speed of the network is slow and the processor of the user computer 10 that runs the applet viewer is slow, the morphing technique is expensive and it is difficult to rotate the image in real time. By creating a composite image from two adjacent images, inserting them between the two images, and then displaying the rearranged images sequentially on the screen, smoothly rotating the image in real time, giving the user the feeling of actually turning the product. .

That is, since the synthesis technique does not require a large amount of computation to generate a composite image from two adjacent images as described above, even if the processor of the user computer 10 running the applet viewer is somewhat slow, Can be rotated.

In addition, unlike the morphing technique of rotating the image in all directions by the XY coordinate data input from the mouse 22, the synthesis technique compares the X-axis component and the Y-axis component to preserve only the large component and the remaining components. By disregarding, the object is rotated about the vertical axis of rotation if the movement of the mouse 22 is mainly horizontal, and the object is rotated about the axis of horizontal rotation if the movement of the mouse 22 is mainly the vertical direction.

Accordingly, the present invention increases the rate of the frame by generating a virtual frame between two adjacent frames to smooth the rotation of the limited frame downloaded from the main server 30 and inserting it between the two adjacent frames. For example, when the number of frames downloaded from the main server 30 is 32, the second CPU 35 generates 31 virtual frames by the Java applet and displays all 36 frames on the screen.

At this time, the newly inserted frame is not displayed on the screen when the mouse 22 is stopped but is displayed on the screen only when the mouse 22 is moved.

In this case, the virtual frame is obtained by alternately taking a horizontal scan line of a previous frame and a horizontal scan line of a previous frame one by one in two adjacent frames as shown in FIG. 5. Helps optical illusions to rotate images smoothly.

On the other hand, according to the second embodiment of the present invention, instead of downloading the Java applet with the image data from the main server 30 every time the user computer 20 orders the 3D image service, the user computer 20 is not the main computer. The plug-in program is provided from the server 30 and installed in a web browser, and only the video data is downloaded from the main server 40 when the 3D image service is ordered.

Accordingly, the second CPU 25 executes the plug-in program, synthesizes two frames adjacent to each other by a combining technique as described in the first embodiment, generates a virtual frame, and inserts the two frames between the two frames. Alternatively, the two frames adjacent to each other may be morphed by a morphing technique to generate a virtual frame and to insert the two frames between the two frames.

Here, the Java applet and the plugin program are programs for processing and playing image data downloaded from the main server 40, that is, generating and inserting virtual frames based on two adjacent frames. After that, the rearranged frames are sequentially displayed on the screen.

As described above, in the present invention, when a main server connected to a user computer through a network communication network provides a Java applet or a plug-in program to the user computer together with images of a predetermined object taken in various directions, By running an applet or plug-in program to create and insert a virtual image based on two adjacent images, and then display the rearranged images sequentially on the screen, by smoothly rotating the image in real time to actually return the product to the user online. It can give a sense of feeling, not only to satisfy the user's needs, but also helps to buy a lot of products.

Herein, while the present invention has been described with reference to the preferred embodiments, those skilled in the art will variously modify the present invention without departing from the spirit and scope of the invention as set forth in the claims below. And can be changed.

Claims (12)

A network communication network 10 which connects unspecified communication lines so that data communication is performed between them; Access the web page of the main site through the network communication network 10 to upload a 3D image service order on the web page, and download the frame data and Java applet from the main site through the network communication network 10 A plurality of user computers 20 generating a virtual frame based on two frames adjacent to each other by the Java applet, inserting the virtual frames between the two frames, and sequentially displaying the rearranged frames on the screen; Image data obtained by capturing a predetermined object in various directions is stored in a memory unit in a frame unit, and a web page is provided to a user computer 20 connected through the network communication network 10, and three-dimensional from the user computer 20. When receiving the image service order is based on a network comprising a main server 30 for outputting the image data and the Java applet of the frame unit stored in the memory to the user computer 40 through the network communication network 10 3D image generation system. The method of claim 1 wherein the main server 30, Imaging means (31) for outputting analog image data photographed while sequentially moving a predetermined object in the horizontal and vertical directions; An A / D converter 32 for converting analog image data input from the image pickup means 31 into digital image data; A first memory 33 for storing Java applets and image data in units of frames; A first 3D image service order received from the user computer 20 through the network communication network 10, and outputting Java applets and image data in frame units to the user computer 20 through the network communication network 10; Network interface 34; Each unit is controlled, and the digital image data output from the A / D converter 22 is arranged in a two-dimensional array and controlled to be stored in the first memory 33 in units of frames, and the first network interface 34 is controlled. When a 3D image service order is inputted from the first memory 33, the first central processing unit 35 accesses the image data and the Java applet in units of frames from the first memory 33 and outputs it to the first network interface 34. 3D image generation system based on the network characterized in that. The method of claim 1 wherein the user computer 20, Upload the 3D image service order of the user to the main server 30 through the network communication network 10, and download the frame data and Java applet from the main server 30 through the network communication network (10) Second network interface 21; An input unit 22 for outputting XY coordinate data in response to a user's movement; A display unit 23 for displaying image data of a three-dimensional image on a screen; A second memory 24 for storing image data in units of frames; Controls to store the Java applet input from the second network interface 21 and the image signal in the unit of frame in the second memory 24, and executes the Java applet to execute XY coordinate data input from the input unit 22. Accesses the frames stored in the corresponding region of the second memory 24 to generate a virtual frame based on two adjacent frames, inserts the virtual frames between the two frames, and sequentially arranges the frames in the display unit 23. 3D image generation system based on a network, characterized in that the display comprises a second central processing unit (25). The method of claim 3 wherein the second central processing unit 25, 3D based on a network, wherein the Java applet is executed to synthesize image data of two adjacent frames by a synthesis method, to generate virtual frame image data, and to insert the image data between the two frames. How to create an image. The method of claim 4 wherein the second central processing unit 25, When the XY coordinates are input from the input unit 22, the two frames adjacent to each other by accessing the corresponding frames stored in the corresponding region of the second memory 24 by the large coordinate data by comparing the sizes of the X-axis data and the Y-axis data. Generating a virtual frame based on the control and inserting it between the two frames. The method of claim 3 wherein the second central processing unit 25, A network-based three-dimensional image, which executes a Java applet to morph image data of two adjacent frames by morphing to generate virtual frame image data, and to insert the image data between the two frames. How to produce. A network communication network 10 which connects unspecified communication lines so that data communication is performed between them; Access the web page of the main site through the network communication network 10, upload a 3D image service order on the web page, download the frame data from the main site through the network communication network 10, and download the web browser A plurality of user computers 20 generating virtual frames based on two frames adjacent to each other by a plug-in program installed therein, inserting the two frames between the two frames, and sequentially displaying the rearranged frames on the screen; Image data obtained by capturing a predetermined object in various directions is stored in a memory unit in a frame unit, and a web page is provided to a user computer 20 connected through the network communication network 10, and three-dimensional from the user computer 20. When the image service order is received, the network-based network comprising a main server 30 for outputting the frame-by-frame image data stored in the memory to the user computer 40 through the network communication network 10. Dimensional Image Generation System. In the method in which a plurality of user computers 20 are connected to the main server 30 through a network communication network 10 to generate a three-dimensional image, A tenth step (S10) of photographing a predetermined object sequentially moving in the horizontal and vertical directions in the main server (30); A twentieth step (S20) of converting the captured analog video signal into a digital video signal in the main server (30) and storing it in a first memory (33) on a frame-by-frame basis; A thirtieth step (S30) of accessing a web page of a main site from the user computer 20; A 40th step (S40) of providing a web page of a 3D image service in response to the access in the main server (30); A fifty step S50 of ordering a 3D image service on the web page in the user computer 10; When the 3D image service order is input from the main server 30, a 60th step of outputting image data and a Java applet in units of frames stored in the first memory 33 to the user computer 20 (S60). ; A 70th step (S70) of storing, at the user computer (20), the frame data and the Java applet in the second memory (24) and accessing and executing the Java applet stored in the second memory (24); In the user computer 20, a virtual frame is generated based on two adjacent frames by accessing the corresponding frames stored in the second memory 24 by the user's XY coordinate input, and then inserted between the two frames and then rearranged. The method of generating a three-dimensional image based on a network, characterized in that it comprises the eighty step (S80) of sequentially displaying the frames on the screen. The method of claim 8, wherein the Java applet, A method of generating a 3D image based on a network, characterized by synthesizing image data of two adjacent frames by a synthesis technique, generating virtual frame image data, and inserting the image data between the two frames. The method of claim 9 wherein the Java applet, After receiving the XY coordinates from the user, the size of the X-axis data and the Y-axis data are compared to access the corresponding frames stored in the memory 24 by the large coordinate data to generate a virtual frame based on two adjacent frames. 3D image generation method based on a network, characterized in that inserted between the two frames. The method of claim 8, wherein the Java applet, A method of generating a 3D image based on a network, characterized by generating virtual frame image data by morphing image data of two adjacent frames by a morphing technique and inserting the image data between the two frames. In the method in which a plurality of user computers 20 are connected to the main server 30 through a network communication network 10 to generate a three-dimensional image, A tenth step (S10) of photographing a predetermined object sequentially moving in the horizontal and vertical directions in the main server (30); A twentieth step (S20) of converting the captured analog video signal into a digital video signal in the main server (30) and storing it in a first memory (33) on a frame-by-frame basis; A thirtieth step (S30) of accessing a web page of a main site in the user computer (20); A 40th step (S40) of providing a web page of a 3D image service in response to the access in the main server (30); A fifty step S50 of ordering a 3D image service on the web page in the user computer 10; A 60th step (S60) of outputting image data of frame units stored in the first memory 33 to the user computer 20 when the 3D image service order is received from the main server 30; A seventy step (S70) of storing, at the user computer 20, the frame-by-frame image data in a second memory 24 and executing a plug-in program pre-installed in a web browser; In the user computer 20, a virtual frame is generated based on two adjacent frames by accessing the corresponding frames stored in the second memory 24 by the user's XY coordinate input, and then inserted between the two frames and then rearranged. The method of generating a three-dimensional image based on a network, characterized in that it comprises the eighty step (S80) of sequentially displaying the frames on the screen.