KR102193630B1 - Real time VR service device, method and system through avatar - Google Patents

Abstract

The present invention relates to a method for providing a real-time VR service. The method includes: a step in which a client device registers a client profile on an application management server, wherein the client profile includes information on a VR video to be requested by the client device; a step in which avatar devices register avatar profiles on the application management server, wherein the avatar profiles include information on a VR video to be requested in relation to the avatar device; a step in which the application management server searches for an avatar profile matching the client profile in at least one piece of information by comparison between the client profile and the avatar profiles and provides a first searching result for the client device; a step in which the application management server receives the input of the client device selecting a specific avatar device in the first searching result; a step in which the application management server performs matching between the client device and the specific avatar device; and a step in which the client device receives a VR video from the matched avatar device.

Description

Real time VR service device, method and system through avatar}

The present specification proposes a method of matching an avatar device that will transmit a virtual reality (VR) image desired by a client in real time and receiving a VR image in real time through the matched avatar device, and an apparatus, method, and system for the same.

Recently, each telecommunications company is offering various functions and services using 5G (5th Generation). As a result, it became possible to connect to big data, which was not possible due to the limitation of communication speed, so that it is possible to broadcast without delay anywhere in the world as well as remote control. Moreover, there is a trend of introducing next-generation communication technologies worldwide, and attempts to transcend time and space with new technologies such as Telepresence, a virtual remote video conferencing, are continuing.

Therefore, the industry predicts that domestic 5G communications and services such as 360-degree VR can grow dozens of times over the next 10 years. In addition, life-based platform services and travel services are currently in the stabilization stage of the market, so they are in demand every year. And sales are soaring. In recent years, local governments and governments as well as general companies are trying to discover new business projects in connection with new services using VR.

An object of the present specification is to propose a service apparatus, method, and system capable of receiving or providing a VR image desired by a client in real time based on a faster communication speed.

In the present specification, a more realistic real avatar service (REAL AVATAR SERVICE; RAS) is provided. Here, RAS refers to a service performed/performed by an avatar far away from the site that the client wants to experience. RAS basically provides a service that registers the tasks that the client wants to experience and matches/connects with a real avatar that performs on behalf of the registered task, and the matched real avatar provides a VR video to the client based on high-speed communication. In real time.

According to an embodiment of the present invention, in a method for providing a real-time VR service, the step of registering a client profile in an application management server by a client device, wherein the client profile includes information on a VR image that the client device wants to request. ; Registering avatar profiles in the application management server by a plurality of avatar devices, wherein the avatar profiles include information on a VR image requested by the avatar device; Searching, by the application management server, an avatar profile matching the client profile and at least one piece of information by comparing the client profile with the avatar profiles, and providing a first search result to the client device; Receiving, by the application management server, an input of the client device for selecting a specific avatar device from within the first search result; Matching, by the application management server, the client device and the specific avatar device; And receiving, by the client device, a VR image from the matched avatar device. It may include.

In addition, as information about the VR image, the client profile includes information on a shooting location, a shooting time, a language used, and/or a shooting request cost of the VR image to be requested, and the avatar profile is to be requested. It may include information on the shooting location of the VR image, the shooting time, the language used, and/or the shooting request cost.

In addition, the step of receiving, by the client device, the VR image from the matched avatar device may include: receiving, from the avatar device, a VR image captured at a shooting time and a shooting location registered in the client profile by the client device; It may include.

In addition, the VR image may be transmitted from the avatar device to the client device in real time, or stored in the avatar device or the application management server and then transmitted to the client device after a preset time.

In addition, the providing of the first search result to the client device may include, when a plurality of avatar devices are included in the first search result, the application management server includes the client device and a profile among the plurality of avatar devices. Providing an avatar device with a higher information matching degree to a higher rank and providing it to the client; It may include.

In addition, the receiving of the VR image may include providing, by the application management server, a real-time voice chat or text chat function between the client device and the matched avatar device; It may include.

In addition, the providing of the real-time voice chat or text chat function may include, when a language registered by the client device in the client profile and a language used by the matched avatar device registered in the avatar profile are different, the application management server A may be a step of providing the voice chat or text chat function by automatically translating according to the language used of each device.

In addition, the method for providing a real-time VR service includes: searching for a photographing location of a VR image that the client device currently requests; And providing a second search result of searching for an avatar device located at the photographing location to the client device. It may further include.

In addition, the second search result includes information on at least one avatar device located within a preset distance from the shooting location, information on the current location of the at least one avatar device, and/or information on the avatar profile of the at least one avatar device. can do.

In the real-time VR service providing method, when a plurality of avatar devices are included in the second search result, the application management server receives a selection input from the client device to select a specific avatar device from among the plurality of avatar devices. Receiving and matching the selected specific avatar device with the client device; And receiving, by the client device, a VR image from the matched avatar device. It may further include.

According to an embodiment of the present invention, even if the client does not go directly, the client can experience indirectly through VR images in a more realistic way of various environments such as scenery, objects, exhibits, etc. in a specific area (particularly, a distance) that the client wants to experience. It has the effect of being able to.

In addition, according to an embodiment of the present invention, since the client can communicate with the avatar in real time, the client can more actively and flexibly experience a desired experience through the avatar.

In addition, according to an embodiment of the present invention, since it is possible to derive new VR services such as VR travel/experience, which does not exist, economic effects such as creation of new jobs are generated.

1 is a flow chart illustrating a real-time VR service method through a real avatar according to an embodiment of the present invention.
2 is a block diagram illustrating a real-time VR service system according to an embodiment of the present invention.
3 and 4 are diagrams illustrating an embodiment in which a real-time VR service system according to an embodiment of the present invention is implemented.
5 is a diagram illustrating a location-based real-time VR image providing system according to an embodiment of the present invention.

The technology to be described below may be modified in various ways and may have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail. However, this is not intended to limit the technology to be described below with respect to a specific embodiment, and it should be understood to include all changes, equivalents, and substitutes included in the spirit and scope of the technology described below.

Terms such as 1st, 2nd, A, B, etc. may be used to describe various components, but the components are not limited by the above terms, only for the purpose of distinguishing one component from other components. Is only used. For example, without departing from the scope of the rights of the technology described below, a first component may be referred to as a second component, and similarly, a second component may be referred to as a first component. The term and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

In terms of the terms used in the present specification, expressions in the singular should be understood as including plural expressions unless clearly interpreted differently in context, and terms such as "includes" are specified features, numbers, steps, actions, and components. It is to be understood that the presence or addition of one or more other features or numbers, step-acting components, parts or combinations thereof is not meant to imply the presence of, parts, or combinations thereof.

Prior to the detailed description of the drawings, it is intended to clarify that the division of the constituent parts in the present specification is merely divided by the main function that each constituent part is responsible for. That is, two or more constituent parts to be described below may be combined into one constituent part, or one constituent part may be divided into two or more according to more subdivided functions. In addition, each of the constituent units to be described below may additionally perform some or all of the functions of other constituent units in addition to its own main function, and some of the main functions of each constituent unit are different. It goes without saying that it may be performed exclusively by.

In addition, in performing the method or operation method, each of the processes constituting the method may occur differently from the specified order unless a specific order is clearly stated in the context. That is, each process may occur in the same order as the specified order, may be performed substantially simultaneously, or may be performed in the reverse order.

This specification basically proposes a real avatar/accompaniment/advice service (REAL AVATAR/ACCOMPANY/ADVICE SERVICE; RAS) system. RAS refers to a service in which the avatar performs/experiences the tasks the client wants to experience on behalf of the client, and accompanies others. This service aims to be a platform through which various people can communicate with each other, and accordingly, various video information can be shared and communicated through this service. In accordance with the present invention, what the client wants to experience using real-time VR and location-based services using high-speed communication services such as 5G (e.g., travel to a distant destination, visit an exhibition, visit an overseas concert, attend a class Etc.), the avatar can experience this on behalf of the client and broadcast/transmit the experience situation in real time as a VR image. This is also referred to as a technical field called teleexistence, and it is possible to create new service products by combining with VR devices and high-speed mobile communication. Through the service product created in this way, the client can feel the presence of a remote object or person as if they are nearby, and can directly build an experience environment through real-time communication/communication with an avatar.

For example, a child who is struggling with illness or wishes to climb Kilimanjaro, a child in Vietnam but wants to go to a certain singer performance in South Korea, a 90-year-old grandfather who wants to see his hometown in North Korea before he dies, and is held at Times Square in Yeongdeungpo. At a discount shopping event, a housewife who wants to see and purchase products with their own eyes but does not have time to visit for child care, a father who wants to attend a business trip or a commemorative event for her daughter, etc. There may be cases. Those with such limitations can become clients and directly request things they want to experience directly through the service system, and the service system can match an avatar to perform the request with a client. The matched avatar can satisfy the client by performing tasks requested by the client instead, and the client can pay a certain cost to the avatar.

The implementation method and various embodiments of the present service system will be described later in detail with reference to each drawing.

1 is a flowchart briefly illustrating a real-time VR service method through a real avatar according to an embodiment of the present invention. In this flowchart, the order of each step may be changed, and at least one step may be newly added or deleted. In addition, in this flow chart, the client device refers to a device of a client requesting a VR image, and the avatar device refers to a device of an avatar that provides/transmits the requested VR image to the client device in real time. The real-time VR service of the present specification may be implemented through a specific application, and the client device and the avatar device of the present specification may correspond to electronic devices in which such a specific application/program (hereinafter, collectively referred to as an application) is installed.

Referring to FIG. 1, first, the client device 101 and/or the avatar device 102 may register a profile (S101). Here, the profile is basic information required for avatar matching/connection. In the case of a client, the content type of the VR video to be requested, the shooting location, the shooting time, the shooting request cost, the interests, the work to do, the to-do, the schedule, and / Or it may include information such as the language used, and in the case of an avatar, the content type of the VR video to be requested, the shooting location, the shooting time, the shooting request cost, interests, what to do, what to do, the schedule and/or use Information such as language may be included. Such a profile may be registered in the application management server 103 that manages/operates a real-time VR service. The registered profile can be set to be disclosed or not, and if it is set to be disclosed, it can be disclosed to others through an application.

Next, matching may be performed between the client device 101 and the avatar device 102 based on the registered profile (S102). For example, the application management server 103 has a profile registered by the client device 101 (eg, place/time/to do/wanted to do) and a profile registered by the avatar device 102 (eg, Place/time/to do/want to do) may be compared with each other to match/connect devices with high matching degree to each other (S103). In this case, the degree of matching may be evaluated differently for each matched condition/category (ie, priority is different for each matched condition/category). For example, when matching the client device and the avatar device, the application management server 103 determines whether to match the to-do (or to-do) of the client device profile and the to-do (or to-do) of the avatar device profile. It can be judged, and when matching, it can be evaluated as having the highest matching degree.

In this case, the application management server 103 may provide the plurality of avatar devices 102 as matching/connection candidate groups to the client device 101, and the avatar device 102 having many matching conditions (or high matching degree) The higher the rank, the higher the rank and may be provided to the client device 101 together with simple profile summary information. The client selects the avatar device 102 to be matched/connected from among the plurality of avatar devices 102 based on the provided profile summary information, so that the matching/connection may be established/completed.

Finally, the client device 101 and the avatar device 102 matched with each other may be connected to each other at a predetermined experience time, and the client device 101 provides a VR image requested in real time from the avatar device 102. It is received (S103). To this end, the application management server 103 may provide a function of mutually negotiating the experience time to both devices through an application, and a real-time shooting/display/broadcasting function of a VR image may also be provided to both devices through the application. have.

In addition, although not shown in the flowchart, there may be an embodiment in which the image captured by the client device 101 is transmitted to the matched avatar device 102 in step S103. Through this embodiment, a companion service such as a companion service with a visually impaired person and a female safe return home companion service may be derived.

For example, a visually impaired client may register his or her own profile through the client device 101, and at this time, he or she may register “accompaniment/travel” as a desired task in the profile. The application management server 103 may perform matching with a specific avatar device 102 based on the profile of the client device 101 (ie, performing steps S101 to S102). The matched avatar device 102 may receive an image captured by the client device 101 in real time and at the same time receive a real-time chat/chat function with the client device 101. Through this, the avatar can feel the client traveling/accompaniing. In particular, the avatar can inform you of dangers/obstacles that may threaten the client on the road/trip through a real-time chat function while receiving the video taken from the client's perspective in real time.In addition, various information about the destination is also available. Can be provided to clients.

Similarly, for example, a female client returning home late at a time can register her profile through the client device 101, and at this time, register'late homecoming' as a to-do (or want to do) in the profile. can do. The application management server 103 may perform matching with a specific avatar device 102 based on the profile of the client device 101 (ie, performing steps S101 to S102). The matched avatar device 102 may receive an image captured by the client device 101 in real time and at the same time receive a real-time chat/chat function with the client device 101. Through this, the avatar can feel the client return home together. In particular, the avatar can inform the client of whether there are any dangers/persons that may threaten the client through a real-time chat function while receiving the video taken from the client's perspective in real time. Can be provided.

2 is a block diagram illustrating a real-time VR service system according to an embodiment of the present invention.

Referring to FIG. 2, a real-time VR service system may include a client device 101, an avatar device 102, and an application management server 103. The application management server 103 may correspond to a device/server that manages/generates/operates the entire real-time VR service system, and communicates with the client device 101 and the avatar device 102 and manages/controls them. have. The application management server 103, the client device 101, and the avatar device 102 may include at least one component/unit for performing various functions/methods described herein.

For example, the application management server 103/client device 101/avatar device 102 is a processor 201, a memory unit 202, a VR display unit 203, a communication unit 204, and/or It may include a wide-angle camera unit 205. Hereinafter, each component/unit will be described, and the following description may be commonly applied to the application management server 103, the client device 101, and the avatar device 102.

The processor 201 may implement the functions, processes and/or methods proposed in the present specification, and may perform communication with at least one other unit/configuration included in each device. Accordingly, the processor 201 may be described by being identified with each device.

The memory unit 202 may store various types of information/data/programs/applications/images/images. The memory unit 202 may transmit the stored information/data/image/image to the processor 202 or may receive it from the processor 201. Also, a program/application stored in the memory unit 202 may be executed/executed by the processor 202. In particular, the memory unit 202 according to the present invention may store an application designed to implement a real-time VR service system, and the application may be executed by the processor 201. The memory unit 202 may be inside or outside the processor 201.

The VR display unit 203 may output/display an image/video/screen. For example, the VR display unit 203 may correspond to a Head Mounted Display (HMD). In addition, the VR display unit 203 may include at least one touch/pressure/proximity/motion/camera sensor to sense a user's touch input. When the VR display unit 203 is an HMD, at least one It is equipped with a direction / gyro / angle / acceleration sensor of the user's head / gaze direction / angle can be sensed. When tracking/sensing the user's gaze, gaze tracking technology that only shows the user's view clearly and blurs the rest due to the weakness of the current 5G (5th Generation) network can be used. In Term Evolution) network, gaze tracking/sensing is possible.

The VR display unit 203 may transmit the sensing result to the processor. In particular, the VR display unit 203 of the present specification may display various VR images/videos/screens transmitted in real time through the communication unit 204 in real time.

The communication unit 204 is connected to the processor 201 and may transmit and/or receive an internal/external device/server and a wired/wireless signal.

The wide-angle camera unit 205 may input/acquire/recognize/sens an image/video/screen using at least one (wide-angle) camera sensor (eg, a 360-degree camera (sensor)). In particular, in the case of the wide-angle camera unit 205 according to the present invention, a wide-angle image/video/screen can be photographed/acquired/recognized/sensed in real time, and the photographed/acquired/recognized/sensed image is a VR image. It can be transmitted in real time to the client device 101 through the communication unit 204. However, in the present specification, the wide-angle camera unit is not limited to the 360-degree camera exemplified above, and all camera units having a photographing angle of less than 360 degrees are meant/included. Accordingly, a general person who does not own a 360-degree camera may become an avatar, and in this case, the image provided to the client device may be a general 2D image.

3 and 4 are diagrams illustrating an embodiment in which a real-time VR service system according to an embodiment of the present invention is implemented. In more detail, FIG. 3 is a diagram illustrating an avatar device providing a real-time VR service, and FIG. 4 is a diagram illustrating a client device receiving a real-time VR service.

Referring to FIG. 3, the avatar device 301 matched according to FIG. 1 may photograph a place requested by the client device through a wide-angle camera unit and transmit the photographed image to the client device. In this case, the avatar device 301 may transmit the captured VR image 302 in real time at a time promised to the client device, or may store the captured VR image 302 at a time promised to the client device and transmit it at a later time.

The avatar device 301 is moved to a specific place requested by the client and/or at a specific time by a worker hired or engaged in a real-time VR service system (especially, an avatar device), or the movement is automated. It is implemented as a robotic device and can be moved directly to a specific place at an appointment. In the latter case, in addition to the configuration/unit shown in FIG. 2, the avatar device 301 may further include a movement/flight unit equipped with at least one engine/motor for movement.

Referring to FIG. 4, the client device 401 may receive an image captured through the wide-angle camera unit of the avatar device 301 as a VR image as shown in FIG. 3. When receiving the 360-degree image 402, the client is the angle/direction of the client device 401 (if the VR display unit is an HMD, the angle/direction of the head wearing the HMD) or the gaze angle/direction/position of the client By adjusting, you can directly experience the VR image 403 of a desired angle/direction.

In addition, the client device 401 may search for information on a recognized specific object among the VR image 403 being displayed and provide it to the client. For example, the client device 401 automatically searches for a specific image/text recognized among the displayed VR images 403 (for example, using an image/text search function provided by an application or portal site), and the search result Can also be provided to the client.

In this case, the client may perform real-time communication with the avatar or the avatar device 301 while experiencing the VR image provided by the avatar device 301. For example, when a worker is shooting and providing a real-time VR image through the avatar device 301, the application management server may provide a voice/text chat function through the application to provide a real-time communication function between the avatar and the client. . Through this, the client actively asks the avatar about the environment they want to experience (for example, please go to the shop in front of you. Climb the mountain. Get closer to the artwork in front, etc.) The avatar can actively accept the client's request and create an environment that the client wants to experience. Through this communication function, the effect is that clients can increase their satisfaction by actively creating the environment they want to experience.

In addition, the avatar can directly explain the feelings/impressions of the field being experienced through the communication function, and can provide additional information about the field knowledge/background/news, etc. to the client.

If the language used between the client and the avatar is different, the application management server may also provide an automatic translation function. In this case, the application management server may provide the automatic translation function to both sides in real time through an automatic translation application stored in the memory unit in advance or a real-time Internet search.

The matching/connection between the client device 401 and the avatar device 301 is based on 1:1 matching, but a 1:N or N:1 matching/connection is also possible according to an embodiment. This can also be performed by the application management server based on the profile registered by the client/avatar device (401, 301) as described above.

After receiving the VR image, the client may evaluate the avatar that provided the VR image. For example, a client may score an evaluation score for a corresponding avatar through an application, which may be stored and managed in an application management server. The application management server may provide a function of recommending an avatar device 301 having a high possibility of matching with a client device through an application according to an embodiment. In this case, an average evaluation score for the recommended avatar device 301 may also be provided, and the higher the score, the higher the frequency of recommendation.

In the above, a real-time VR service system that provides a method of performing matching/connection between the client device 401 and the avatar device 301 based on the registered profile has been described above. However, in addition to this, the real-time VR service system of the present specification can also provide a real-time matching/connection method based on the location of the avatar device 301, which will be described later with reference to FIG. 5.

5 is a diagram illustrating a location-based real-time VR image providing system according to an embodiment of the present invention.

Referring to FIG. 5, the client device 401 may directly search in real time for a current experience/place to be experienced. In this case, the application management server may provide information on at least one avatar device that is currently providing/transmitting/broadcasting VR images in a corresponding region to the client device. For example, when a client searches for France and Paris, the application management server displays the locations of avatar devices that are currently transmitting/broadcasting/providing VR images in Paris, France, as shown in FIG. I can. In this case, the application management server may also provide information about brief information about each avatar device (eg, profile summary information, average evaluation score, etc.) to the client device 401 together. In this case, the searched avatar device may correspond to an avatar device that has previously agreed to share its location information and VR service among avatar devices located in a place searched by the client device 401. Such avatar devices may be electronic devices carried by workers, tourists, and tour guides, or may correspond to CCTVs located in specific areas or black boxes/CCTVs and/or drones installed in public transport.

The client may select the avatar device 301-1 to which the experience is requested based on the information provided for each avatar device, and in this case, matching/connection with the selected avatar device 301-1 may be completed. For example, as illustrated in FIG. 5, the client may select any one of the avatar devices displayed on the Paris map, France, and a guide phrase “Would you like to accompany you?” may be displayed for this. If, in the case of requesting an experience through the corresponding avatar device 301-1, the client may touch the'YES' button in the displayed guidance text, and as a result, matching/connection with the corresponding avatar device 301-1 It can be done.

In this way, the avatar device 301-1, which has successfully matched, transmits/provides the VR image currently being photographed to the client device 401 in real time.

It goes without saying that in this embodiment, as in the above-described embodiment, various additional functions (communication function, automatic translation function, etc. described above) may be provided during VR image provision.

In addition to the above-described embodiments, various additional functions that can be provided by a real-time VR service system (especially, an application management server) are listed below. At least one of the listed functions may be mainly provided by an application management server, and each function may be performed by a client device and/or an avatar device:

1. Login function

-Individual login function and membership registration function

-Simple login through existing email

2. Personal page provision function

-Profile activation function through personal page setting

-This service can be executed after general form of consent such as personal information consent

-Registration function such as personal profile, housing information sheet, and interests

3. Avatar setting function

-Personal avatar setting and decoration function

-Avatar display function set in profile

4. Subject setting function

-Ability to set and register subjects of interest among various categories

5. Topic search function

-Search function to find topics of interest in detailed categories

6. Experiential agency fee payment function

-Proceed by watching the advertisement in the first 15 seconds

-Intermediate pop-up advertisement function or AR advertisement processing function

-Personal payment system function

-Point payment function (e.g., the client device/account pays for the reserve, and when performing an experience agency, the reserve is deducted by the agency cost, and the deducted cost is credited to the avatar device/account)

-How to accumulate mileage for each account according to the frequency/frequency of use

-Card/cash payment function

7. Save function

-Personal video storage function using application management server, simultaneous or individual storage function for client devices and avatar devices

-To solve server problems, save the video in the cloud and set it to download for a certain period of time, and use the saved video to create additional processed content.

-Video storage and individual storage functions can be combined using the integrated cloud

8. Wide-angle camera function (especially for avatar devices)

-VR camera interlocking function through various wearable devices (eg, smart watch, link flow neck type smart wearable device, etc.).

-In addition, various cameras can be linked to expand the camera's extended range

9. Video mode VR

-VR normal mode and goggles wearing mode selectable

10. Video Mode General

-General 2D video call function

11. Location service function

-Allows the client device to check the location of the avatar device that has consented to the location exposure. View the location, find an avatar device close to the place you want, and match it with the client device

12. Recommended function

-Remind each device of the main itinerary or travel destination plan of the avatar/client device

13. Message/comment conversation function

-Chat function through message/comment between client device and avatar device

14. Photo/video upload function in personal page

-A function that allows you to post individual photos on your personal page to reveal your PR or interests

15. To-do and daily matching function

-Matching is performed between the tasks you want to do in the profile of the client device and the days you need to do in the profile of the avatar device, so that other users can view them and perform detailed searches.

16. Interest composition function

-Ability to set your own interests such as travel, medical care, welfare, car, etc. When recommending avatar devices to client devices, it can be linked with priority or automatic recommendation system

The biggest difference between the above-described real-time VR service system is that travel and exploration programs using existing VR use recorded images, but this service can transmit VR images in real time. To make a recorded video, it takes a lot of time to go through pre-shooting and editing, and there is a disadvantage in that the timeliness is poor and the experience of experiencing the site directly is inferior in that the video from the past period is played. Also, VR contents using other graphics have a long production period and are expensive to create. However, the biggest advantage of this service is that it is possible to operate at a low cost in terms of service as it does not incur real-time realism because it allows the client to view the videos they want in real time. can do.

The embodiment according to the present invention may be implemented by various means, for example, hardware, firmware, software, or a combination thereof. In the case of implementation by hardware, an embodiment of the present invention is one or more ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs ( field programmable gate arrays), processors, controllers, microcontrollers, microprocessors, etc.

In addition, in the case of implementation by firmware or software, an embodiment of the present invention is implemented in the form of modules, procedures, functions, etc. that perform the functions or operations described above, and is stored in a recording medium that can be read through various computer means. Can be recorded. Here, the recording medium may include a program command, a data file, a data structure, or the like alone or in combination. The program instructions recorded on the recording medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. For example, the recording medium is a magnetic medium such as a hard disk, a floppy disk, and a magnetic tape, an optical medium such as a compact disk read only memory (CD-ROM), a digital video disk (DVD), and a floppy disk. Magnetic-Optical Media such as a floptical disk, and a hardware device specially configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of the program instructions may include not only machine language codes such as those produced by a compiler but also high-level language codes that can be executed by a computer using an interpreter or the like. Such a hardware device may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.

In addition, the device or terminal according to the present invention may be driven by a command that causes one or more processors to perform the functions and processes described above. For example, such instructions may include interpreted instructions such as script instructions such as JavaScript or ECMAScript instructions, executable code, or other instructions stored in a computer-readable medium. Furthermore, the device according to the present invention may be implemented in a distributed manner over a network, such as a server farm, or may be implemented in a single computer device.

In addition, a computer program (also known as a program, software, software application, script or code) mounted on the device according to the present invention and executing the method according to the present invention includes a compiled or interpreted language or a priori or procedural language. It can be written in any form of programming language, and can be deployed in any form, including standalone programs, modules, components, subroutines, or other units suitable for use in a computer environment. Computer programs do not necessarily correspond to files in the file system. A program may be in a single file provided to the requested program, or in multiple interactive files (e.g., files that store one or more modules, subprograms, or portions of code), or part of a file that holds other programs or data. (Eg, one or more scripts stored within a markup language document). A computer program may be deployed to run on a single computer or multiple computers located at one site or distributed across a plurality of sites and interconnected by a communication network.

For convenience of explanation, each drawing has been described separately, but it is also possible to design a new embodiment by merging the embodiments described in each drawing. In addition, the present invention is not limitedly applicable to the configuration and method of the embodiments described as described above, but the above-described embodiments are configured by selectively combining all or part of each embodiment so that various modifications can be made. It could be.

In addition, although preferred embodiments have been illustrated and described above, the present specification is not limited to the specific embodiments described above, and without departing from the subject matter claimed in the claims, those having ordinary knowledge in the technical field to which the specification belongs. Various modifications are possible by the person, as well as these modifications should not be individually understood from the technical idea or perspective of the present specification.

101: client device
102: avatar device
103: application management server

Claims (10)

In a method for providing a real-time VR (Virtual Reality) service using an avatar device that is implemented as a robot device that is moved through a flight unit and moves directly to a specific place at an appointment time,
A client profile including at least one of information on a shooting location, a shooting time, a language used, and a shooting request cost of a VR image requested by a client device including a VR display unit implemented in the form of an HMD is sent to the application management server. Registering;
Registering avatar profiles including at least one of information on a shooting location, a shooting time, a language used, and a shooting request cost of a VR image requested by the avatar device in the application management server;
Searching, by the application management server, an avatar profile matching the client profile and at least one piece of information by comparing the client profile with the avatar profiles, and providing a first search result to the client device;
Receiving, by the application management server, an input of the client device for selecting a specific avatar device from within the first search result;
Matching, by the application management server, the client device and the specific avatar device;
Receiving, by the client device, a VR image captured at a shooting time and a shooting location registered in the client profile from a matched avatar device; And
Displaying, by the client device, the VR image corresponding to the angle and direction of the user's head,
Providing the first search result to the client device,
When a plurality of avatar devices are included in the first search result, the application management server ranks and provides the avatar devices with higher profile information matching degree among the plurality of avatar devices to the client. Including steps,
The VR image is a 360-degree image generated by the avatar device using a 360-degree camera sensor. delete delete delete delete delete delete delete delete delete

Images