KR20090029350A

KR20090029350A - System and method for servicing virtual world in mobile terminal

Info

Publication number: KR20090029350A
Application number: KR1020070094513A
Authority: KR
Inventors: 김진식
Original assignee: 에스케이텔레콤 주식회사
Priority date: 2007-09-18
Filing date: 2007-09-18
Publication date: 2009-03-23

Abstract

A system and a method for servicing a virtual world in a mobile terminal are provided to overlap a virtual image or a virtual object on a current structure, thereby servicing a real feeling virtual world. A virtual image or a virtual object is inserted into a virtual structure. A virtual world DB is constructed. A terminal measures a current location and a direction angle with regard to the current structure photographed through a camera(S402,S404). The measured location and direction angle information are transmitted to a virtual world providing server through a mobile communication network(S406). The virtual world providing server searches a virtual structure corresponding to the location and direction angle in the virtual world DB(S408). The virtual image or the virtual object inserted into the searched virtual structure is extracted (S410). The extracted image or object is transmitted with the insertion location to the terminal in real time(S412). In a real structure image, the virtual image or the virtual object is overlapped in a location corresponding to the insertion location(S414).

Description

Mobile virtual world service system and method {SYSTEM AND METHOD FOR SERVICING VIRTUAL WORLD IN MOBILE TERMINAL}

The present invention relates to a mobile virtual world service system and method, and more particularly, to overlapping a virtual image stored in advance in an image of a real world viewed by a mobile communication terminal connected to a mobile communication network. The present invention relates to a mobile virtual world service system and method for providing a virtual world.

A mobile communication terminal connected to a mobile communication network is a representative mobile communication means for providing a wireless communication service between users through a plurality of base stations communicating with a mobile communication switching center. In order to increase subscribers and diversify services, telecommunications companies provide various additional services such as location information service, multimedia service, virtual world service, and game service through wireless internet, as well as simple call service to mobile communication terminal users. It is true.

In particular, a virtual world service in a mobile communication terminal is to provide a virtual world generated by a content provider that provides virtual world content to a mobile communication terminal for display. An example of such a virtual world is an online game implemented in a mobile communication terminal. The mobile communication terminal accesses the Internet through a mobile communication network and receives a game played in a virtual world from an internet game server.

However, such a conventional virtual world is only a program for operating a game, there is a sense of distance from the real world, and it is possible to move and communicate information through simple keyboard manipulation or mouse manipulation. have. In addition, the conventional virtual world not only repeatedly provides a predetermined background or environment, but also has to be satisfied to visually see an object or an object existing in the virtual world even if it reflects the real world. There is a problem that there is a sense of distance.

Therefore, in the technical field, a virtual world of a part or a specific part of the real world is more realistically realized in a mobile communication terminal, and further, a direct communication and interaction with members moving in a virtual world is carried out through various societies. And there is a demand for a virtual world providing system to experience the world.

The present invention provides a mobile virtual world to provide the mobile communication terminal with a virtual world formed by overlapping a virtual image stored in advance in the image of the real world existing in the position of the mobile communication terminal and the direction viewed from the location. Its purpose is to provide a service system and method.

In addition, another object of the present invention is to form a virtual world by overlapping virtual objects (eg, virtual people, virtual pets, etc.) of the virtual world to the real world image in the mobile communication terminal and directly with the virtual objects of the virtual world. To provide a mobile virtual world service system and method for contacting and interacting.

In the mobile virtual world service method of the present invention for achieving the above object, in the mobile virtual world service method in a mobile communication terminal equipped with a camera,

A first step in which a virtual world providing server inserts a virtual image or a virtual object into a virtual structure that virtually implements a real structure of the real world, stores the virtual structure, the virtual image or a virtual object, and an insertion position thereof and constructs the virtual world DB; step; A second step of measuring, by the terminal, a direction angle of a real structure photographed by a current position and a camera and transmitting the measured position and direction angle information to the virtual world providing server through a mobile communication network; Searching for a virtual structure corresponding to the position and a direction angle in the virtual world DB by the virtual world providing server, extracting a virtual image or a virtual object inserted into the searched virtual structure, and transmitting the same to the terminal in real time with the insertion position; Step 3; And a fourth step of overlapping and displaying the virtual image or the virtual object transmitted from the virtual world providing server at a position corresponding to the insertion position in the real structure image photographed by the camera at the terminal.

In an embodiment of the present disclosure, the first step may include: measuring, by a terminal having the authority to upload the virtual image or the virtual object, its own position information and direction angle information of a real structure photographed through a camera; Uploading, by the terminal, the position and direction angle and a virtual image or a virtual object stored therein to the virtual world providing server through the mobile communication network; Authenticating the upload right of the terminal in the virtual world providing server and retrieving a virtual structure corresponding to the position and direction angle from the virtual world DB; And inserting the uploaded virtual image or virtual object into the selected virtual structure and storing the uploaded virtual image or virtual object in the virtual world DB.

In one embodiment of the present invention, the first step is a real structure displayed on the screen of the wired terminal after connecting to the virtual world providing server through the Internet network from the wired terminal having the right to upload the virtual image or virtual object Selecting a position in the image to insert the virtual image or the virtual object; Uploading the selected location and the virtual image or virtual object stored in the wired terminal to the virtual world providing server through the internet network; Authenticating the upload right of the wired terminal in the virtual world providing server and retrieving a virtual structure corresponding to the location from the virtual world DB; And inserting the uploaded virtual image or virtual object into the searched virtual structure and storing the uploaded virtual image or virtual object in the virtual world DB.

In one embodiment of the present invention, the third step is to extract only the visible part of the virtual image or the virtual object inserted into the searched virtual structure to be transmitted to the terminal in real time to extract only the portion shown Steps.

In an embodiment of the present disclosure, the fourth step includes selecting an insertion position of a virtual image or a virtual object transmitted from the virtual world providing server in a real structure image photographed by a camera at the terminal.

In an embodiment of the present disclosure, after the fourth step, requesting detailed information of the virtual object from the terminal to the virtual world providing server when a signal for selecting a virtual object displayed overlapping with the terminal is input. ; The virtual world providing server extracting detailed information on the selected virtual object from the virtual world DB and transmitting the extracted detailed information to the terminal in real time; The terminal may further include outputting the transmitted detailed information while the virtual object is overlapped and displayed.

In addition, the mobile virtual world service system of the present invention for achieving the above object, in the virtual world service system for providing a virtual world service using a mobile communication terminal equipped with a camera,

After measuring the current position of the person and measuring the direction angle of the real structure photographed through the camera and transmits the position and direction angle information, the virtual image or virtual object transmitted from the outside is being photographed through the camera A mobile communication terminal which overlaps and displays the image of the real structure; Search for a virtual structure corresponding to a position and a direction angle transmitted from the mobile communication terminal in a virtual world DB that inserts and stores a virtual image or a virtual object into a virtual structure that virtually implements a real structure existing in the real world, A virtual world providing server for extracting a virtual image or a virtual object inserted into the searched virtual structure and transmitting the extracted virtual image or virtual object to the mobile communication terminal; And a mobile communication network in charge of communication between the mobile communication terminal and the virtual world providing server.

In one embodiment of the present invention, the mobile communication terminal requests and receives detailed information of the virtual object from the virtual world providing server when the selection signal for the virtual object overlapped and displayed on the screen is received, and the reception is performed. The detailed information is preferably output while the virtual object is overlapped and displayed.

In one embodiment of the present invention, the virtual world DB, a virtual structure storage DB for storing a virtual structure in which a virtual structure or a virtual object is inserted into the virtual real structure existing in the real world; A virtual image / virtual object storage DB storing a virtual image or a virtual object; And an object information storage DB storing detailed information on the virtual image or the virtual object.

In one embodiment of the present invention, the mobile virtual world service system, the image of the real structure of the real world and the coordinates of each position of the real structure image, and the virtual image or virtual object to upload to the virtual world providing server It includes a memory for storing the virtual world providing server to the virtual world through the coordinate information of the specific location selected from the actual structure image and the virtual image or virtual object to be inserted into the specific location to provide the virtual world It may further include a wired terminal to upload to the server.

The present invention also provides a mobile communication terminal for requesting a virtual world service by measuring and transmitting a current angle and a direction angle of a real structure photographed through a camera, and a virtual structure corresponding to a position and a direction angle transmitted from the terminal. In the virtual world service system consisting of a virtual world providing server for transmitting the inserted virtual image or virtual object to the terminal and a mobile communication network for communication between the terminal and the virtual world providing server,

The virtual world providing server includes: a virtual world DB for inserting a virtual image or a virtual object into a virtual structure that virtually embodies a real structure of the real world, and storing the virtual structure, the virtual image or the virtual object, and an insertion position thereof; A data communication unit for transmitting and receiving data with the terminal through the mobile communication network; A virtual world generation unit for retrieving a virtual structure corresponding to a position and a direction angle transmitted from the mobile communication terminal in the virtual world DB and extracting a virtual image or a virtual object inserted into the virtual structure; And a virtual world transmitter for transmitting the extracted virtual image or virtual object to the mobile communication terminal through the mobile communication network so as to overlap the image of the real structure photographed by the camera in the mobile communication terminal.

In one embodiment of the present invention, it is preferable that the virtual world generating unit extracts only a part of the virtual image or the virtual object inserted into the virtual structure found in the virtual world DB, except for the part which is hidden by another virtual structure. .

In one embodiment of the present invention, the virtual world providing server is a virtual image or virtual object uploaded from the mobile communication terminal or a wired terminal connected through the mobile communication network or a wired Internet network to a virtual structure stored in the virtual world DB It may further include a virtual image / virtual object upload unit for inserting and storing.

According to the present invention, a virtual image or a virtual object is overlapped and displayed on a real structure viewed through a camera provided in a mobile communication terminal, thereby serving a realistic virtual world without a separate keyboard manipulation or a mouse manipulation.

According to the present invention, the advertisement image or the advertisement can be virtually displayed at a specific point viewed by the mobile communication terminal without actually installing the advertisement image or the advertisement on the outer wall of the building.

In addition, according to the present invention, rather than simply displaying the virtual objects of the virtual world on the mobile communication terminal, it is possible to directly contact and interact with the virtual objects of the virtual world, thereby providing more intimacy with the virtual objects of the virtual world.

In the following, a detailed description of a preferred embodiment of the present invention will be described with reference to the accompanying drawings. In the following description of the present invention, in the case where it is determined that detailed descriptions of related well-known functions or constructions may unnecessarily obscure the subject matter of the present invention, detailed descriptions thereof will be omitted so as not to obscure the subject matter of the present invention. something to do.

1 is an overall configuration diagram of a mobile virtual world service system according to an embodiment of the present invention.

Referring to FIG. 1, a mobile virtual world service system according to an embodiment of the present invention includes a mobile communication terminal 200, a mobile communication network 300, and a virtual world providing server 400. In another embodiment of the present invention, the virtual world service system may further include a wired internet network 600 and a wired terminal 700, and the virtual world providing server 400 may include a virtual world database (DB) 500. It is preferable to include. However, in another embodiment of the present invention, the virtual world database (DB) 500 may be separately configured outside the virtual world providing server 400 and interworked with the virtual world providing server 400. Meanwhile, in another embodiment of the present invention, the virtual world providing server 400 and the virtual world DB 500 may be included in the mobile communication network 300 or the internet network 600.

The mobile communication terminal (hereinafter referred to as 'terminal' for convenience) 200 is preferably a so-called camera phone equipped with a digital camera. Such a camera phone is a mobile communication terminal having a function of a wireless communication terminal for performing a wireless telephone call and internet communication, and a digital camera function for capturing a subject and storing an image or a video, and then editing, transmitting, and deleting the image if necessary. to be. The terminal 200 displays an image or an image captured by a digital camera on a liquid crystal display.

In addition, the terminal 200 may be equipped with a predetermined positioning program for measuring its position in order to perform the function according to the present invention. Preferably, the positioning program may be mounted in a flash memory embedded in the terminal 200. In the positioning program, a scheduling algorithm that wakes up at regular intervals and searches for a location service request signal is coded.

The terminal 200 of the present invention may position its own position in various ways. For example, a technique for positioning a terminal using wireless communication includes a handset-based method using GPS, a network-based method using a base station reception signal, and a combination of these two methods. There is a hybrid method to improve the accuracy of the.

In the handset-based method using GPS, a GPS module (including a GPS antenna and a GPS receiver) mounted on the terminal 200 receives a GPS signal from a GPS satellite to extract navigation data included in the GPS signal, and includes a built-in GPS. Positioning programs allow you to position your position from GPS signals. Such a positioning method may be implemented through a GPS positioning program by mounting a GPS module to all terminals wirelessly connected to a mobile communication network.

In the network-based method without using GPS, the location of the terminal can be generally determined using communication data between the base station and the terminal. Positioning method of mobile communication terminal using TA (Timing Advance) technology in mobile communication network that does not use GPS, for example, Global System for Mobile communication (GSM) network, Time Difference of Arrival in Wideband Code Division Multiple Access (WCDMA) network ) Positioning methods.

In the positioning method using the TA technology in the GSM network, a TA parameter is transmitted from a base station to a terminal to compensate for a delay of data transmitted and received between the base station and the terminal, and the base station and the terminal are synchronized. Such a TA technique uses timeslot advance information, and TA is applied to corresponding base stations even when handovered to another cell. At this time, if the user handovers the terminal twice, the three time advances can be known. From these three time advances, the position of the terminal can be located by using triangulation.

The TDOA positioning method uses the time information of three or more base stations to locate a terminal without using GPS. The distance between the first base station and the terminal is calculated using the difference between the time T1 at which the first base station transmits a signal to the terminal and the time T1 'responded by the terminal. In this case, the distance is calculated as 'speed / time' and the speed uses the speed of electromagnetic waves. In the same manner, the distance between the second base station and the third base station and the terminal is also calculated. As described above, two hyperbolas are obtained from the positions of the first to third base stations by using the three calculated distance values, and the positions of the corresponding terminals may be located by finding an intersection point of the two hyperbolas.

In addition to the above-described positioning method, various positioning methods may exist, and the terminal 200 according to the present invention may know its position in such various positioning methods. Since the positioning method of the various terminals 200 is well-known technology, detailed description thereof will be omitted.

In addition, the terminal 200 according to the present invention is provided with a gyro function in which an application program for performing functions according to the present invention is embedded. More specifically, the terminal 200 may further include an inertial measurement unit (IMU: IMU) to reduce the positioning error caused by the predetermined positioning program. The inertial measurement device (IMU) preferably includes an acceleration sensor for measuring the acceleration of the object and a gyro sensor for measuring the inclination of the object and the like. By using the functions of the acceleration sensor and the gyro sensor, it is possible to accurately measure the movement and direction change of the terminal 200. The terminal 200 according to the present invention detects the movement of the corresponding terminal 200 by using the functions of the inertial measurement unit (IMU), calculates a direction angle with respect to the direction that the terminal 200 views, and the direction thereof. The angle is transmitted to the virtual world providing server 400 through the mobile communication network (300). When the IMU is connected to a socket of a detailed location information initializer (not shown) installed in various places in the real world, the location of the detailed location information initializer is transmitted to the virtual server 400 as the detailed location of the terminal 200.

In addition, the terminal 200 may be connected to the virtual world providing server 400 through the mobile communication network 300, the wired terminal 700 to the virtual world providing server 400 through the Internet network 600. I can connect it. Accordingly, the terminal 200 and the wired terminal 700 preferably store a plurality of virtual images or virtual objects in the internal memory, and store the stored virtual images or virtual objects for the virtual world service. It can be uploaded to the providing server 400. In this case, the virtual world providing server 400 stores the virtual image and the virtual object uploaded from the mobile communication terminal 200 or the wired terminal 700 in the virtual world DB 500.

In one embodiment according to the invention, the terminal 200 is a PDA (Personal Digital Assistance), cellular (Cellular) phone, PCS (Personal Communication Service) phone, Hand-Held PC (Hand-Held PC), GSM (Global System) for Mobile (CDMA) phones, Code Division Multiple Access (CDMA) phones, Evolution-Data Only (EV-DO) phones, Evolution-Data and Voice (EV-DV) phones, Wideband CDMA (WCDMA) phones, and Mobile Broadband System (MBS) phones It may include a phone.

The mobile communication network 300 is a concept including all mobile communication networks for relaying wireless data between mobile communication terminals. For example, the mobile communication network 300 of the present invention includes a CDMA-2000 network, a GSM network, a WCDMA network, a high speed download packet access (HSDPA) network, a WiBro (Wireless Broadband) network, and a portable Internet network. And it may include the next generation mobile communication network to be applied in the future. For example, in the case of a CDMA-2000 mobile communication network, a base station system (BSS) including a base station transceiver system (BTS), a base station controller (BSC), and a point coordination function (PCF); It may include a Packet Data Service Node (PDSN) in charge of exchange / transmission of packet data. The base station (BTS) may provide a wireless communication service to a subscriber by interfacing with the terminal 200 through a wireless connection according to the IS-2000 standard, and the base station controller (BSC) may include a mobile switching center (MSC) and a base station (BTS). ) To perform a matching function to the Internet network 600 through the PDSN, and to perform a vocoding function for voice. The PDSN is a packet data exchange system for providing a wireless data service in the mobile communication network 300, and is an essential device for providing CDMA2000-1x, 1xEV-DO, and more high-speed wireless Internet service. The PCF follows a non-competitive frame transmission method and performs a call connection of the terminal 200.

The CDMA-2000 mobile communication network is an example of the mobile communication network 300 of the present invention and may be implemented as another mobile communication network, and may perform the same or similar functions as described above for the virtual world service according to the present invention.

As such, in the embodiment of the present invention, the terminal 200 may be connected to the virtual world providing server 400 through the mobile communication network 300, and in another embodiment of the present invention, the other wired terminal 700 may be connected to the Internet network ( 600 may be connected to the virtual world providing server 400. In addition, as described above, in another embodiment of the present invention, the virtual world providing server 400 may exist in the mobile communication network 300 or may exist in the Internet network 600. The wired terminal 700 includes all terminals that can be connected to the Internet network 600, such as a personal PC, PDA, notebook PC.

When the virtual world providing server 400 receives the virtual world service request from the terminal 200, the virtual world providing server 400 periodically receives the current position and direction angle information from the terminal 200 to correspond to the direction angle at the received current position. The virtual structure is extracted from the virtual world DB 500 and the virtual image or virtual object inserted into the virtual structure is transmitted to the terminal 200 together with the inserted location information. As a result, the terminal 200 provides the virtual world server at the corresponding location by referring to the inserted position information on the image of the outer wall of the real structure of the real world or the image of a specific point between the real structures, which are photographed in real time by the current camera. The virtual image or the virtual object transmitted from the 400 is provided by overlapping the virtual image service to the terminal 200. The virtual world DB 500 may exist in the virtual world providing server 400 or may be provided outside the virtual world providing server 400 and interoperate with each other.

In addition, when the virtual world providing server 400 selects a specific virtual object using a pointer on the screen of the terminal 200 during execution of the virtual world service in the terminal 200, related information about the virtual object (for example, , Advertisements, sounds, movements, etc.) are extracted from the virtual world DB 500 and transmitted to the terminal 200 to be displayed on the screen. For example, when a user selects a virtual pet using a pointer or the like in the terminal 200, the virtual world providing server 400 extracts the cry of the virtual pet from the virtual world DB 500. Transmission to the terminal 200 to output the cry of the virtual pet.

As such, when a user requests a virtual world service using the terminal 200 that registers the virtual world service, the user may apply a virtual image or a virtual object to a real structure of the real world, which is viewed at a direction angle viewed from the location of the terminal 200. By overlapping the display, the virtual world may be displayed, and the virtual image or the virtual object existing in the virtual world may be selected or contacted to directly contact and interact with the virtual objects of the virtual world. Here, the overlap according to the present invention means that the virtual image or the virtual object is displayed on the real structure image displayed on the liquid crystal in real time through the camera of the terminal 200.

2 is a configuration diagram of a mobile communication terminal according to an embodiment of the present invention.

Referring to FIG. 2, the mobile communication terminal 200 of the present invention includes an RF module 21, a GPS module 22, an IMU module 23, a voice processing unit 24, a keypad 25, a display unit 26, And a memory 27 and a control unit 28. The control unit 28 may be equipped with a GPS positioning program for positioning its own position from the GPS signal. Here, in another embodiment of the present invention, the GPS module 22 may not be selectively included. That is, the GPS module 22 is a module for positioning the location of the terminal 200 by receiving a satellite signal from a GPS satellite. When the GPS module 22 measures the location of the terminal 200 without using GPS, it is not necessary.

The RF module 21 allows the terminal 200 to connect to the virtual world providing server 400 via the mobile communication network 300 to transmit and receive data using the Point-to-Point Protocol (PPP). The terminal 200 transmits the location information and the direction angle information to the virtual world providing server 400 to receive the virtual world service accordingly. In addition, the terminal 200 transmits a request signal for the virtual world service to the virtual world providing server 400 and receives a service corresponding thereto.

The GPS module 22 receives GPS signals from the GPS satellites 100 and calculates coordinates such as latitude and longitude of the current terminal 200 using the received GPS signals. At this time, the GPS module 22 receives a GPS signal transmitted by the GPS satellite 100 according to a preset period.

The IMU module 23 connects a location information initialization device (which stores its current location) in a real world with a predetermined socket, and the location information initialization device receives an ID of the terminal 200 and virtually The exact location of the terminal 200 is transmitted to the world providing server 400. The IMU 23 is calculated along with the position information by measuring the fine distance moved from the detailed position so as to determine a more accurate position. In addition, the IMU 23 detects the movement, acceleration, inclination, etc. of the terminal 200 by using a gyro sensor included therein, and calculates a direction angle with respect to the direction viewed by the terminal 200. do. Here, the gyro sensor is preferably a micro gyro sensor (micro gyro sensor) that can be mounted on the terminal 200, more preferably implemented in a chip form (chip) may be mounted on the terminal 200. Although not shown in the drawing, the gyro sensor may be implemented as a separate module outside the IMU 23.

The memory 27 stores a virtual image or a virtual object. The virtual image and the virtual object are used for a virtual world service and may be used for overlapping a real structure in the virtual world. That is, the user stores the virtual image or the virtual object that the user wants to overlap in the real structure existing in the real world in the memory 27 in advance and requests the upload to the virtual world providing server 400 through the terminal 200 during the virtual world service. Can be.

The controller 28 controls the overall operation of the terminal 200. In particular, the current location of the terminal 200 is measured by driving a positioning program according to the user's selection of the virtual world service, and the location information and the direction angle information of the terminal 200 are provided through the RF module 21. In operation 400, the virtual world service downloaded from the virtual world providing server 400 is displayed on the display unit 26. In addition, the controller 28 downloads the virtual world service as described above and displays the selected information as the user selects the virtual image or the virtual object displayed on the virtual world service through the keypad 25 while displaying it on the display unit 26. The RF module 21 is transmitted to the virtual world providing server 400, and a virtual world service including data corresponding to the information is downloaded from the virtual world providing server 400 to the display unit 26. To display. In addition, the controller 28 may request an upload by transmitting the virtual image or the virtual object stored in the memory 27 to the virtual world providing server 400 through the RF module 21.

3 is a block diagram of a virtual world providing server according to the present invention.

Referring to FIG. 3, the virtual world providing server 400 of the present invention may be implemented as one component of the mobile communication network 300 or provided as a separate server outside the mobile communication network 300 to interwork. The virtual world DB 500 may be included or the virtual world DB 500 may be provided externally and interworked.

The virtual world providing server 400 receives the position and direction angle information of the current terminal 200 from the terminal 200, and searches the virtual world DB 500 for the virtual structure corresponding to the position and the direction angle. The virtual image or the virtual object inserted in the searched virtual structure is transmitted to the terminal 200 along with the insertion position information, so that the virtual image at the corresponding insertion position in the real structure image of the real world corresponding to the position and orientation angle. Or let virtual objects overlap. To this end, the virtual world providing server 400 according to the present invention includes a data receiver 41, a virtual world transmitter 42, a virtual world generator 43, and a controller 44. In another embodiment of the present invention, the virtual image upload unit 45 may be further included.

The virtual world DB 500 includes a virtual structure storage DB 51, a virtual image / virtual object storage DB 52, and a virtual object information storage DB 53. The virtual structure storage DB 51 is a DB that stores virtual structure data by virtually implementing a real structure in the real world, and preferably stores the position of the virtual structure and 3D (dimension) frame data of the virtual structure. . In addition, the virtual structure storage DB 51 may store a virtual structure updated by inserting a virtual image or a virtual object into the virtual structure. This means that when the terminal 200 requests a virtual world service while looking at a specific direction angle at a specific position, the direction line that the terminal 200 views (more accurately, the camera of the terminal 200) and the virtual structure storage DB ( It is used to overlap the virtual image or virtual object desired by the user at the point where the virtual structure stored in 51) meets. The virtual image / virtual object storage DB 52 is a DB storing a virtual image or a virtual object and location information of the virtual image or the virtual object. Here, the virtual image includes virtual 2D image data such as a banner advertisement attached to an outer wall of a building, and the virtual object is a virtual 3D fixed object (eg, statue, sculpture, advertisement, etc.) mounted on a building or a street. And a virtual 3D moving object (eg, a virtual transport means, a virtual pet, a virtual animal, a virtual person, etc.) moving between 3D buildings and a street. The virtual object information storage DB 53 is a DB that stores detailed information about a virtual image or a virtual object. This detailed information includes information such as text, voice, image, video, etc. related to the virtual image or the virtual object. For example, if the virtual image is a logo of a company, an advertisement for the company may be stored as a text, voice, image, or video. If the virtual object is a virtual pet, the crying, movement, or age of the virtual pet may be stored. Information may be stored including a description of the variety, breed, and feature. Such detailed information may be output from the terminal 200.

The data receiver 41 receives a signal or data transmitted from the terminal 200 through the mobile communication network 300. For example, the terminal 200 performs a function of receiving a signal or data about a virtual world service request, uploading a virtual image or a virtual object, location and orientation angle information, object selection in a virtual world service, and the like. In another embodiment of the present invention, when the terminal 200 includes an inertial measurement unit (IMU), the terminal 200 also performs a function of receiving detailed position information of the terminal 200 transmitted from the inertial measurement unit (IMU).

The virtual world transmitter 42 transmits the virtual world service generated by the virtual world generator 43, which will be described later, to the terminal 200 through the mobile communication network 300. In this case, the virtual world transmitter 42 may transmit the packet data format or the short message (SMS) format.

When the virtual world service request is received from the terminal 200, the virtual world generation unit 43 receives the current location and direction angle information from the terminal 200 and corresponds to a point corresponding to the point viewed by the direction angle at the location. Search for the structure in the virtual structure storage DB (51). Preferably, a virtual image or a virtual object is inserted into the virtual structure. The virtual world generation unit 43 extracts a virtual image or a virtual object inserted into the virtual structure and converts the virtual image or virtual object into a format suitable for display on the display unit 26 of the terminal 200. To perform. In this case, the virtual world generation unit 43 extracts the location information into which the virtual image or the virtual object is inserted and may be transmitted to the terminal 200. The virtual image may be, for example, an image having a format of JPG, BMP, TIFF, GIF, or the like, and the virtual object may be 3D data having a format of 3DS, MAX, MDL, or the like. The resolution and size may be adjusted according to the capacity of the terminal 200.

At this time, in one embodiment of the present invention, the virtual world generation unit 43 extracts only the remaining parts of the virtual image or virtual object inserted into the virtual structure, except for the part which is covered by another virtual structure. By converting the data into a format suitable for display on the display unit 26 of the terminal 200, a function of generating a virtual world may be performed. In this case, the terminal 200 may implement the virtual world service in the terminal 200 by displaying only the visible portion of the virtual image or the virtual object on the real structure image displayed in real time through the camera.

In another embodiment of the present invention, the virtual world generation unit 43 may include information about a portion of the virtual image or the virtual object inserted into the virtual structure by another virtual structure (for example, location information of the portion being hidden, Size information, etc.), and converts the virtual image or virtual object into a format suitable for display on the display unit 26 of the terminal 200 to generate a virtual world together with the extracted information. . In this case, the terminal 200 displays only the visible portion of the virtual image or the virtual object on the real structure image displayed through the camera, except for the portion that is hidden from the virtual image or the virtual object by using the received information. As a result, the virtual world service in the terminal 200 may be implemented.

The virtual image / virtual object uploader 45 stores a virtual image or a virtual object transmitted from a terminal 200 connected to the mobile communication network 300 or a wired terminal 700 connected to the internet network 600. Perform the function of uploading to 500. In particular, the virtual image / virtual object uploading unit 45 stores itself in a virtual structure corresponding to a real structure existing at a position (coordinate) and a direction angle transmitted from the terminal 200 or provides a virtual world providing server 400. You can upload virtual images or virtual objects provided by. In addition, a user (eg, an advertiser or a landlord) in the wired terminal 700 accesses the virtual world providing server 400 through the internet network 600 and selects a real structure of the real world provided in a 3D environment (the Coordinates are already assigned to each location), and when the virtual image or virtual object stored in the wired terminal 700 is transmitted to the virtual world providing server 400, the virtual image / virtual object uploading unit 45 The virtual image or the virtual object is inserted into the virtual structure stored in the virtual structure storage DB 51.

In one embodiment of the present invention, the virtual world DB 500 has already stored a plurality of virtual images or virtual objects. Therefore, the virtual image / virtual object uploader 45 is necessary only when uploading a virtual image or a virtual object desired by the user.

The controller 44 controls the overall operation of the virtual world providing server 400. In particular, the controller 44 controls the operations of the respective functional units (data receiving unit, virtual world transmitting unit, virtual world generating unit and virtual image uploading unit) so that the functions according to the present invention can be smoothly performed.

Each of the functional units may be implemented by a predetermined software or program inside the virtual world providing server 400.

4 is a flowchart illustrating a mobile virtual world service method according to an embodiment of the present invention.

Referring to FIG. 4, the user of the terminal 200 who is to be provided with the mobile virtual world service of the present invention may display the terminal while displaying the real structure of the real world on the screen through a camera mounted on the terminal 200. The mobile virtual world service menu is selected from the menu 200 (S400). When the menu is selected, the terminal 200 positions its position (S402). For example, when the terminal 200 is equipped with a GPS module, the GPS signal transmitted from the GPS satellite 100 may be received and the current position of the terminal 200 may be calculated by using a positioning program. If the module is not provided, the current location of the terminal 200 may be measured by various methods such as TDOA positioning.

Subsequently, the direction angle with respect to the direction viewed by the terminal 200 is measured using a gyro sensor provided in the IMU 23 (S404). Meanwhile, in another embodiment of the present invention, the detailed position information of the terminal 200 may be measured using the inertial measurement unit (IMU) in step S402, and calculated together with the position so that a more precise position may be calculated. The position calculation and the direction angle measurement process may be performed at the same time. Here, the terminal 200 is preferably a camera phone in which a digital camera is integrally mounted, and the direction angle represents an angle with respect to a direction that the camera faces with respect to a specific reference direction. The terminal 200 transmits the calculated position and direction angle to the virtual world providing server 400 through the mobile communication network 300 (S406).

The virtual world providing server 400 receives location and direction angle information from the terminal 200 and corresponds to a real structure of the real world that exists in a direction viewed by the direction angle from the terminal 200. The virtual structure is searched in the virtual world DB 500 (S408). At this time, it is preferable to search for the virtual structure existing in the direction line looking at the direction angle from the position transmitted from the terminal 200. Subsequently, the virtual world providing server 400 extracts a virtual image or a virtual object inserted into the searched virtual structure and an insertion position thereof (S410). In this case, the virtual image or the virtual object is already inserted in the virtual structure, the inserted position information is already stored in the virtual image / virtual object storage DB (52). The process of inserting the virtual image or the virtual object may be implemented by uploading the virtual image or the virtual object desired by the user (eg, the advertiser or the landlord) to the virtual world DB 500.

The virtual world providing server 400 transmits the extracted virtual image or virtual object to the terminal 200 together with the insertion position (S412). The terminal 200 searches for a point corresponding to the insertion position in the real structure image of the real world currently viewed by the camera and overlaps and displays the transmitted virtual image or virtual object at the corresponding position to display the virtual world service. It is provided (S414). In this case, preferably, the virtual image or the virtual object overlaps the outer wall of the real structure or the real structure.

When the user selects a specific virtual object by using a pointer on the screen while receiving the virtual world service in the terminal 200 (S416), the virtual world providing server 400 provides detailed information about the virtual object. The virtual world is extracted from the DB 500 and transmitted to the terminal 200 (S418). As a result, the terminal 200 may output detailed information about the virtual object (S420). For example, when a user selects a restaurant object by using a pointer, the advertisement for the restaurant may be downloaded from the virtual world providing server 400 and displayed. As another example, when a user selects a virtual pet object using a pointer, the user may download and output the cry of the virtual pet from the virtual world providing server 400, or touch the virtual pet using the pointer. The response of the virtual pet may be downloaded from the virtual world providing server 400 and displayed. Such detailed information is preferably stored in the virtual world DB 500 in advance, and the display and movement of the virtual object are performed in the overlapping reality structure so that there is no difference from the reality image, and the virtual object exists in reality. It is desirable to ensure that moving objects are moved only in the space of reality.

In another embodiment of the present invention, a virtual image or a virtual object may be uploaded from the mobile communication terminal 200 and the wired terminal 700 to the virtual world providing server 400. This upload process will be described below with reference to FIG. 5.

5 is a flowchart illustrating a process of uploading a virtual image or a virtual object to a virtual world providing server according to an exemplary embodiment of the present invention.

Referring to FIG. 5, a user of a terminal 200 to upload a virtual image or a virtual object accesses a virtual world providing server 400 through a mobile communication network 300 (S500), and looks through a built-in camera. A specific point (eg, building exterior wall) of the real structure of the real world is selected (S502). Here, the terminal 200 is preferably a mobile communication terminal having the authority to upload the virtual image or the virtual object to the virtual world providing server 400. Subsequently, the terminal 200 periodically calculates a direction angle with respect to a current position and a direction viewed by the terminal 200 by using a built-in positioning program and a gyro sensor (S504), and then provides the virtual world providing server 400. (S506). In this case, when selecting a space other than a street floor or a building outer wall of the realistic structure, the distance between the selected point and the terminal may be displayed by a numerical or graphic bar.

The user selects a virtual image or a virtual object stored in the memory of the terminal 200 and transmits it to the virtual world providing server 400 (S508). In this case, the virtual world providing server 400 selectively selects a plurality of virtual images or virtual objects stored in the virtual world DB 500 and transmits them to the terminal 200 (S510a), thereby allowing the terminal 200 to select them. The selected virtual image or virtual object may be received (S510b). The step S510 may be performed as necessary.

The virtual world providing server 400 checks whether the terminal 200 has a virtual world service right, and if there is a right, performs the procedure of approving the upload of a virtual image or a virtual object (S512). When the approval is completed, the virtual world providing server 400 searches for a virtual structure corresponding to the position and direction angle in the virtual world DB 500 (S514), and at the point selected in step S502 for the virtual structure. After inserting the selected virtual image or virtual object in step S508 and stores in the virtual world DB (500) (S516).

Meanwhile, as described above, in another embodiment of the present invention, the virtual image or the virtual object may be uploaded to the virtual world providing server 400 through the wired terminal 700. The wired terminal 700 is preferably a wired terminal having the authority to upload the virtual image or the virtual object to the virtual world providing server 400. That is, the wired terminal 700 according to the present invention may access the internet network 600, and upload a virtual image or a virtual object stored therein to the virtual world providing server 400 through the internet network 600. can do. To this end, the wired terminal 700 according to the present invention preferably stores a plurality of virtual images or virtual objects in a memory (not shown) provided therein, and the user of the wired terminal 700 is connected to the Internet network 600. A virtual image or a virtual object to be used for a virtual world service may be selected from the memory and transmitted to the virtual world providing server 400.

Referring to the embodiments of the present invention in more detail, when the user of the wired terminal 700 according to the present invention to upload a virtual image or virtual object to the virtual world providing server 400 to the Internet network 600 By accessing the virtual world providing server 400 through (S520), using a pointer or the like in the real world structure in the graphical user interface (GUI) in the feature display provided in a 3D environment on the screen of the wired terminal 700 A specific position is selected (S522). In this case, the real structure displayed through the feature display GUI may be implemented by digital mapping, and corresponding position coordinates are predetermined for each position in the real structure. That is, the real structure data of the real world is stored in the memory of the wired terminal 700, and such data is displayed through the feature display GUI, and the coordinates of the real structure data are stored in the memory. It is. Therefore, when the user selects a specific position of the real structure displayed on the GUI through a keyboard or a pointer, the position coordinate corresponding to the specific position is searched and extracted from the memory. This process can be implemented in the CPU of the wired terminal 700. Through this process, the wired terminal 700 according to the present invention transmits the position of the selected specific structure to the virtual world providing server 400 (S524).

The user transmits the virtual image or the virtual object stored in the wired terminal 700 to the virtual world providing server 400 (S526). Here, the virtual world providing server 400 selectively selects a plurality of virtual images or virtual objects stored in the virtual world DB 500 and transmits them to the wired terminal 700 (S528a), and selects them from the wired terminal 700. By doing so, the selected virtual image or virtual object may be received (S528b).

The virtual world providing server 400 checks whether the wired terminal 700 has a virtual world service right, and if there is a right, performs the procedure of approving the upload of the virtual image or the virtual object (S530). When the approval is completed, the virtual world providing server 400 searches for a virtual structure corresponding to the position and direction angle in the virtual world DB 500 (S532), and the virtual image at the selected specific position with respect to the virtual structure. Alternatively, the virtual object is inserted and stored in the virtual world DB 500 (S534).

6 is a view showing an example of a user interface screen when providing a mobile virtual world service according to an embodiment of the present invention, Figure 6 (a) is an illustration of a screen overlapping the virtual image 62, Figure 6 (b) is an illustration of a screen overlapping the virtual object 64.

Referring to FIG. 6 (a), the virtual world service is requested by photographing a real structure (building) 61 viewed at a specific direction from a specific location through a camera of the terminal 200. A virtual image 62 (eg, a logo) overlaps a specific point (eg, a building exterior wall) and is displayed. When a specific point is selected from the real structure (building) 61 displayed on the terminal 200 as described above, the virtual world providing server 400 selects a virtual structure corresponding to the position and the direction angle of the terminal 200. Search in the virtual world DB 500, extract the virtual image (corporation logo) 62 inserted into the virtual structure and transmit it to the terminal 200, the company on the outer wall of the real building 61 displayed through the real camera The logo 62 overlaps and is displayed.

Referring to FIG. 6B, the virtual object 64 (eg, a virtual pet) is overlapped and displayed on the real structure (distance) 63 in the same manner as above. When a user touches the virtual object (virtual pet) 64 using a pointer or the like displayed on the screen of the terminal 200, a cry or a corresponding response is displayed.

The drawings and detailed description of the invention are merely exemplary of the invention, which are used for the purpose of illustrating the invention only and are not intended to limit the scope of the invention as defined in the appended claims or claims. Therefore, those skilled in the art will understand that various modifications and equivalent other embodiments are possible from this. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

In general, advertising images or advertisements are attached to the exterior walls of buildings to advertise specific companies or products, and virtual images such as advertisement images or advertisements are displayed on real world images through virtual world services provided by mobile communication terminals. By overlapping display, a good advertising effect can be obtained at a low cost.

In addition, by using a mobile communication terminal that has already become a necessity of the individual, it is possible to display the virtual world and obtain necessary information from it, and furthermore, to contact a pet or play a game in the virtual world reflecting the real surroundings. You can experience a much more realistic virtual world in your daily life.

1 is a block diagram of a mobile virtual world service system according to the present invention.

3 is a block diagram of a virtual world providing server according to an embodiment of the present invention.

6 is a diagram illustrating an example of a user interface screen when providing a mobile virtual world service according to an embodiment of the present invention.

* Description of the symbols for the main parts of the drawings *

21: RF module 22: GPS module

23: IMU module 27: memory

41: data receiver 42: virtual world transmitter

43: virtual world generation unit 45: virtual image / virtual object upload unit

51: virtual structure storage DB 52: virtual image / virtual object storage DB

53: virtual object information storage DB 100: GPS satellites

200: mobile communication terminal 300: mobile communication network

400: virtual world providing server 500: virtual world DB

600: internet network 700: wired terminal

Claims

In the mobile virtual world service method in a mobile communication terminal equipped with a camera,

A first step of inserting a virtual image or a virtual object into a virtual structure that virtually implements a real structure of the real world in a virtual world providing server and storing the virtual structure, the virtual image or the virtual object, and an insertion position thereof and constructing the virtual world DB; step;

A second step of measuring, by the terminal, a direction angle of a real structure photographed by a current position and a camera and transmitting the measured position and direction angle information to the virtual world providing server through a mobile communication network;

Searching for a virtual structure corresponding to the position and orientation angle in a virtual world DB by the virtual world providing server, extracting a virtual image or a virtual object inserted into the searched virtual structure, and transmitting the virtual image or virtual object to the terminal together with the insertion position in real time; Step 3; And

A fourth step of overlapping and displaying the virtual image or the virtual object transmitted from the virtual world providing server at a position corresponding to the insertion position in the reality structure image photographed by the camera at the terminal; Mobile virtual world service method comprising a.

The method of claim 1, wherein the first step,

Measuring direction angle information of a real structure photographed through a camera and location information of the virtual image or a virtual object by a terminal having the authority to upload the virtual object;

Uploading, by the terminal, the position and direction angle and a virtual image or a virtual object stored therein to the virtual world providing server through the mobile communication network;

Authenticating the upload right of the terminal in the virtual world providing server and retrieving a virtual structure corresponding to the position and direction angle from the virtual world DB; And

Inserting the uploaded virtual image or virtual object into the selected virtual structure and storing the uploaded virtual image or virtual object in the virtual world DB; Mobile virtual world service method comprising a.

The method of claim 1, wherein the first step,

After connecting to the virtual world providing server through the Internet from the wired terminal having the right to upload the virtual image or the virtual object, selecting a position to insert the virtual image or the virtual object in the real structure image displayed on the screen of the wired terminal. step;

Uploading the selected location and the virtual image or virtual object stored in the wired terminal to the virtual world providing server through the internet network;

Authenticating the upload right of the wired terminal in the virtual world providing server and retrieving a virtual structure corresponding to the location from the virtual world DB; And

Inserting the uploaded virtual image or virtual object into the searched virtual structure and storing the uploaded virtual image or virtual object in the virtual world DB; Mobile virtual world service method comprising a.

The method of claim 1, wherein the third step,

Mobile virtual world service method comprising the step of extracting only the visible part of the virtual image or the virtual object inserted into the searched virtual structure, except for the part that is covered by another virtual structure and transmitting to the terminal in real time. .

The method of claim 1, wherein the fourth step,

And selecting an insertion position of the virtual image or the virtual object transmitted from the virtual world providing server in the real structure image photographed by the camera at the terminal.

The method of claim 1, wherein after the fourth step,

Requesting detailed information of the virtual object from the terminal to the virtual world providing server when a signal for selecting a virtual object displayed overlapping with the terminal is input;

The virtual world providing server extracting detailed information on the selected virtual object from the virtual world DB and transmitting the extracted detailed information to the terminal in real time; And

Outputting, by the terminal, the transmitted detailed information while the virtual object is overlapped and displayed; Mobile virtual world service method characterized in that it further comprises.

A virtual world service system for providing a virtual world service using a mobile communication terminal equipped with a camera,

Positioning one's current location and measuring the direction angle of the real structure photographed by the camera and transmitting the position and direction angle information, and the reality of the virtual image or the virtual object transmitted from the outside being photographed through the camera A mobile communication terminal overlapping and displaying the image of the structure;

Search for a virtual structure corresponding to a position and a direction angle transmitted from the mobile communication terminal in a virtual world DB that inserts and stores a virtual image or a virtual object into a virtual structure that virtually implements a real structure existing in the real world, A virtual world providing server for extracting a virtual image or a virtual object inserted into the searched virtual structure and transmitting the extracted virtual image or virtual object to the mobile communication terminal; And

A mobile communication network in charge of communication between the mobile communication terminal and a virtual world providing server; Mobile virtual world service system comprising a.

The method of claim 7, wherein the mobile communication terminal,

When a selection signal for a virtual object overlapped and displayed on the screen is input, the virtual object providing server receives and receives detailed information of the virtual object, and the received detailed information is displayed while overlapping the virtual object. Mobile virtual world service system, characterized in that the output.

The method of claim 7, wherein the virtual world DB,

A virtual structure storage DB configured to store a virtual structure in which a virtual image or a virtual object is inserted by realizing a real structure existing in the real world;

A virtual image / virtual object storage DB storing a virtual image or a virtual object; And

An object information storage DB for storing detailed information about the virtual image or the virtual object; Mobile virtual world service system comprising a.

The system of claim 7, wherein the mobile virtual world service system,

An image of the real structure of the real world and coordinates of each position of the real structure image, and a memory storing a virtual image or a virtual object to be uploaded to the virtual world providing server, and the internet network to the virtual world providing server. The mobile virtual world further comprising a wired terminal for uploading the virtual information or the virtual object to be inserted into the specific location and the coordinate information of the specific location selected from the real structure image to be connected to the virtual world providing server. Service system.

Inserts a virtual image or a virtual object into a virtual structure that virtually implements a real structure of the real world, and a mobile communication terminal that requests a virtual world service by measuring and transmitting a current position and a direction angle of a real structure photographed by a camera. A virtual world DB for storing the insertion position together with the insertion position, a virtual world providing server for transmitting a virtual image or a virtual object inserted into a virtual structure corresponding to a position and a direction angle transmitted from the terminal to the terminal, and the terminal and the virtual world In the virtual world service system consisting of a mobile communication network in charge of communication between the providing server, the virtual world providing server,

A data communication unit for transmitting and receiving data with the terminal through the mobile communication network;

A virtual world generation unit for retrieving a virtual structure corresponding to a position and a direction angle transmitted from the mobile communication terminal in the virtual world DB and extracting a virtual image or a virtual object inserted into the virtual structure; And

A virtual world transmitter for transmitting the extracted virtual image or virtual object to the mobile communication terminal through the mobile communication network such that the extracted virtual image or virtual object is overlapped on an image of a real structure photographed by a camera in the mobile communication terminal; Virtual world providing server in a mobile virtual world service system comprising a.

The method of claim 11, wherein the virtual world generating unit,

The virtual world providing server in a mobile virtual world service system, characterized in that the extraction of the virtual image or the virtual object inserted into the virtual structure retrieved from the virtual world DB, except for the part that is hidden by the other virtual structure.

The method of claim 11, wherein the virtual world providing server,

And a virtual image / virtual object upload unit for inserting and storing a virtual image or a virtual object uploaded from the mobile communication terminal or a wired terminal connected through the mobile communication network or a wired internet network into a virtual structure stored in the virtual world DB. Virtual world providing server in a mobile virtual world service system, characterized in that.