WO2021006648A1 - 아바타를 통한 실시간 vr 서비스 제공 방법 - Google Patents
아바타를 통한 실시간 vr 서비스 제공 방법 Download PDFInfo
- Publication number
- WO2021006648A1 WO2021006648A1 PCT/KR2020/008978 KR2020008978W WO2021006648A1 WO 2021006648 A1 WO2021006648 A1 WO 2021006648A1 KR 2020008978 W KR2020008978 W KR 2020008978W WO 2021006648 A1 WO2021006648 A1 WO 2021006648A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- avatar
- client
- client device
- time
- image
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000006870 function Effects 0.000 claims description 66
- 230000033001 locomotion Effects 0.000 claims description 55
- 230000001360 synchronised effect Effects 0.000 claims description 6
- 238000007726 management method Methods 0.000 description 39
- 238000004891 communication Methods 0.000 description 23
- 238000010586 diagram Methods 0.000 description 10
- 230000000694 effects Effects 0.000 description 6
- 238000013519 translation Methods 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000001771 impaired effect Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000005034 decoration Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
- 238000001454 recorded image Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000006641 stabilisation Effects 0.000 description 1
- 238000011105 stabilization Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/5854—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using shape and object relationship
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/587—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/40—Business processes related to the transportation industry
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
Definitions
- the present invention provides a method for matching an avatar device that will transmit a virtual reality (VR) image desired by a client in real time, and receiving a VR image in real time through the matched avatar device, and an apparatus, method, and system therefor. About.
- VR virtual reality
- An object of the present invention is to provide a service apparatus, method, and system capable of receiving or providing a VR image desired by a client in real time based on a faster communication speed.
- the present invention is a step of registering a client profile in an application management server by a client device, wherein the client profile includes information on a VR image requested by the client device, and a plurality of Avatar devices registering avatar profiles with the application management server, wherein the avatar profiles include information on a VR image that the avatar device is requesting, and the application management server includes the client profile and the avatar profile Searching for an avatar profile in which the client profile and at least one information are matched by comparing them with each other, and providing a first search result to the client device, and the application management server using a specific avatar device within the first search result Receiving an input of the client device for selecting, and matching the client device with the specific avatar device by the application management server, and receiving, by the client device, a VR image from the matched avatar device. It provides a method for providing a real-time VR service including a.
- the client profile includes information on a shooting location, a shooting time, a language used, and/or a shooting request cost of the VR image to be requested, and the The avatar profile may include information on a photographing location, a photographing time, a language used, and/or a photographing request cost of a VR image to be requested.
- the receiving of the VR image from the matched avatar device by the client device includes the matched VR image taken at a shooting time and a shooting location registered by the client device in the client profile. It may include receiving from the avatar device.
- the providing of the first search result to the client device may include, when a plurality of avatar devices are included in the first search result, the application management server comprises the plurality of avatar devices.
- the avatar device having a higher degree of matching the client device with the profile information may rank higher and provide it to the client.
- the receiving of the VR image may include providing, by the application management server, a real-time voice chat or text chat function between the client device and the matched avatar device; Further, wherein the providing of the real-time voice chat or text chat function comprises: when the language used by the client device registered in the client profile and the language used by the matched avatar device registered in the avatar profile are different, the The application management server may be a step of providing the voice chat or text chat function by automatically translating according to the language used of each device.
- the second search result includes information on at least one avatar device located within a preset distance from the shooting location, information on a current location of the at least one avatar device, and/or an avatar profile of the at least one avatar device. May contain information.
- the application management server when a plurality of avatar devices are included in the second search result, receives a selection input for selecting a specific avatar device from among the plurality of avatar devices from the client device.
- the method may further include matching the selected specific avatar device and the client device, and receiving, by the client device, a VR image from the matched avatar device.
- the client device transmits the first control signal for controlling the moving direction, angle and/or speed of the matched avatar device. Transmitting to a matched avatar device, and moving the matched avatar device according to the first control signal; Further comprising, the first control signal may be generated in synchronization with the user's movement input signal for the client device.
- the first control signal is synchronized with a movement control signal received by the client device from the other device.
- the movement of the matched avatar device may be synchronized with the movement of the other device.
- the shooting direction of the camera unit is the user wearing the client device Is synchronized with the head or gaze direction of the camera unit, and the shooting angle of the camera unit is controlled by a second control signal transmitted from the client device, and the second signal is the sensing of the head or gaze direction of the user wearing the client device It can be created in synchronization with the results.
- a client can indirectly view various environments such as scenery, objects, exhibits, etc. in a specific area (particularly, a distance) that the client wants to experience through VR images in a more realistic way, even if the client does not go directly. You can experience it.
- the client since the client can directly manipulate the movement/motion of the robot avatar, it has the effect that the client can more actively and flexibly provide the desired experience through the robot avatar.
- FIG. 1 is a flow chart illustrating a real-time VR service method through a real avatar according to an embodiment of the present invention.
- FIG. 2 is a block diagram illustrating a real-time VR service system according to an embodiment of the present invention.
- 3 and 4 are diagrams illustrating an embodiment in which a real-time VR service system according to an embodiment of the present invention is implemented.
- FIG. 5 is a diagram illustrating a location-based real-time VR image providing system according to an embodiment of the present invention.
- FIG. 6 is a diagram illustrating a method of controlling an avatar device of a client device according to an embodiment of the present invention.
- each of the processes constituting the method may occur differently from the specified order unless a specific order is clearly stated in the context. That is, each process may occur in the same order as the specified order, may be performed substantially simultaneously, or may be performed in the reverse order.
- RAS refers to a service in which the avatar performs/experiences the tasks the client wants to experience on behalf of the client, and accompanies others.
- This service aims to be a platform through which various people can communicate with each other, and accordingly, various video information can be shared and communicated through this service.
- the avatar can experience this on behalf of the client and broadcast/transmit the experience situation in real time as a VR image.
- 5G e.g., travel to a distant destination, visit an exhibition, visit an overseas concert, attend a class Etc.
- the client can feel the presence of a remote object or person as if they are nearby, and can directly build an experience environment through real-time communication/communication with an avatar.
- Those with such limitations can become clients and directly request things they want to experience directly through the service system, and the service system can match an avatar to perform the request with a client.
- the matched avatar can satisfy the client by performing tasks requested by the client instead, and the client can pay a certain cost to the avatar.
- FIG. 1 is a flowchart briefly illustrating a real-time VR service method through a real avatar according to an embodiment of the present invention.
- the order of each step may be changed, and at least one step may be newly added or deleted.
- the client device refers to a device of a client requesting a VR image
- the avatar device refers to a device of an avatar that provides/transmits the requested VR image to the client device in real time.
- the real-time VR service of the present specification may be implemented through a specific application, and the client device and the avatar device of the present specification may correspond to electronic devices in which such a specific application/program (hereinafter, collectively referred to as an application) is installed.
- the client device 101 and/or the avatar device 102 may register a profile (S101).
- the profile is basic information required for avatar matching/connection.
- the content type of the VR video to be requested, the shooting location, the shooting time, the shooting request cost, the interests, the work to do, the to-do, the schedule, and / Or it may include information such as the language used, and in the case of an avatar, the content type of the VR video to be requested, the shooting location, the shooting time, the shooting request cost, interests, what to do, what to do, the schedule and/or use Information such as language may be included.
- Such a profile may be registered in the application management server 103 that manages/operates a real-time VR service. The registered profile can be set to be disclosed or not, and if it is set to be disclosed, it can be disclosed to others through an application.
- matching may be performed between the client device 101 and the avatar device 102 based on the registered profile (S102).
- the application management server 103 has a profile registered by the client device 101 (eg, place/time/to do/wanted to do) and a profile registered by the avatar device 102 (eg, Place/time/to do/want to do) may be compared with each other to match/connect devices with high matching degree to each other (S103).
- the degree of matching may be evaluated differently for each matched condition/category (ie, priority is different for each matched condition/category).
- the application management server 103 determines whether to match the to-do (or to-do) of the client device profile and the to-do (or to-do) of the avatar device profile. It can be judged, and it can be evaluated as having the highest matching degree when matching.
- pairing connection refers not only to direct connection between two devices, but also to indirect pairing connection through an application management server.
- the client device 101 and the avatar device 102 can perform communication by directly exchanging wireless/wired control signals with each other, and in the case of indirect pairing connection, the client device 101
- the avatar device 102 and the avatar device 102 may exchange wireless/wired control signals through the application management server 103, and the application management server 103 may serve to transmit a control signal between the two devices in the middle.
- the application management server 103 may provide the plurality of avatar devices 102 as matching/connection candidate groups to the client device 101, and the avatar device 102 having many matching conditions (or high matching degree) The higher the rank, the higher the rank and may be provided to the client device 101 together with simple profile summary information.
- the client selects the avatar device 102 to be matched/connected from among the plurality of avatar devices 102 based on the provided profile summary information, so that the matching/connection may be established/completed.
- the client device 101 and the avatar device 102 matched with each other may be connected to each other at a predetermined experience time, and the client device 101 provides a VR image requested in real time from the avatar device 102. It is received (S103).
- the application management server 103 may provide a function of mutually negotiating the experience time to both devices through an application, and a real-time shooting/display/broadcasting function of a VR image may also be provided to both devices through the application. have.
- a companion service such as a companion service with a visually impaired person and a female safe return home companion service may be derived.
- a visually impaired client may register his or her own profile through the client device 101, and at this time, he or she may register “accompaniment/travel” as the desired task of the profile.
- the application management server 103 may perform matching with a specific avatar device 102 based on the profile of the client device 101 (ie, performing steps S101 to S102).
- the matched avatar device 102 may receive an image captured by the client device 101 in real time and at the same time receive a real-time chat/chat function with the client device 101. Through this, the avatar can feel the client traveling/accompaniing.
- the avatar can inform you of dangers/obstacles that may threaten the client on the road/trip through a real-time chat function while receiving the video taken from the client's perspective in real time.
- various information about the destination is also available. Can be provided to clients.
- a female client returning home late at a time can register her profile through the client device 101, and at this time, register'late homecoming' as a to-do (or want to do) in the profile. can do.
- the application management server 103 may perform matching with a specific avatar device 102 based on the profile of the client device 101 (ie, performing steps S101 to S102).
- the matched avatar device 102 may receive an image captured by the client device 101 in real time and at the same time receive a real-time chat/chat function with the client device 101. Through this, the avatar can feel the client return home together.
- the avatar can inform the client of whether there are any dangers/persons that may threaten the client through a real-time chat function while receiving the video taken from the client's perspective in real time. Can be provided.
- the client device 101 may receive a VR image requested by the client device 101 from the paired/connected avatar device 102 at a predetermined experience time in real time.
- the client device 101 may directly manipulate the avatar device 102 to actively build an environment that it wants to experience.
- the client device 101 directly transmits a control signal for manipulating the movement/motion/motion/flight direction/speed, camera angle of the avatar device 102 to the avatar device 102 (or a real-time VR service system).
- the avatar device 102 may transmit a VR image in real time by controlling movement/motion/motion/flight according to a control signal received from the client device.
- avatar devices 102 are pre-equipped/arranged/installed/located in various places (for example, tourist attractions, exhibitions, shopping malls, etc.), or avatar devices 102 are located near the corresponding places.
- a service point may be located.
- the avatar device delivery person employed to perform the service system may place the avatar device 102 at the appointed place before the preset time, and the client device 101 and the avatar device 102
- a real-time VR image transmission service may be initiated by pairing/connecting.
- such an avatar device delivery person may not only deliver the avatar device, but may also accompany the experience of the avatar device (that is, the role of a robot companion can also be performed).
- the companion may perform a real-time/two-way conversation with the client through a real-time communication function with the client device provided through the avatar device while walking with the avatar device.
- the companion can be a guide or a conversation partner of the client, such as providing various advice/information on the travel destination to the client.
- FIG. 2 is a block diagram illustrating a real-time VR service system according to an embodiment of the present invention.
- a real-time VR service system may include a client device 101, an avatar device 102, and an application management server 103.
- the application management server 103 may correspond to a device/server that manages/generates/operates the entire real-time VR service system, and communicates with the client device 101 and the avatar device 102 and manages/controls them. have.
- the application management server 103, the client device 101, and the avatar device 102 may include at least one component/unit for performing various functions/methods described herein.
- the application management server 103/client device 101/avatar device 102 is a processor 201, a memory unit 202, a VR display unit 203, a communication unit 204, and/or It may include a wide-angle camera unit 205.
- each component/unit will be described, and the following description may be commonly applied to the application management server 103, the client device 101, and the avatar device 102.
- the processor 201 may implement the functions, processes and/or methods proposed in the present specification, and may perform communication with at least one other unit/configuration included in each device. Accordingly, the processor 201 may be described by being identified with each device.
- the memory unit 202 may store various types of information/data/programs/applications/images/images.
- the memory unit 202 may transmit the stored information/data/image/image to the processor 202 or may receive it from the processor 201.
- a program/application stored in the memory unit 202 may be executed/executed by the processor 202.
- the memory unit 202 according to the present invention may store an application designed to implement a real-time VR service system, and the application may be executed by the processor 201.
- the memory unit 202 may be inside or outside the processor 201.
- the VR display unit 203 may output/display an image/video/screen.
- the VR display unit 203 may correspond to a Head Mounted Display (HMD).
- the VR display unit 203 may include at least one touch/pressure/proximity/motion/camera sensor to sense a user's touch input.
- the VR display unit 203 is an HMD, at least one It is equipped with a direction / gyro / angle / acceleration sensor of the user's head / gaze direction / angle can be sensed.
- gaze tracking technology that only shows the user's view clearly and blurs the rest due to the weakness of the current 5G (5th Generation) network can be used. In Term Evolution) network, gaze tracking/sensing is possible.
- the VR display unit 203 may transmit the sensing result to the processor.
- the VR display unit 203 of the present specification may display various VR images/videos/screens transmitted in real time through the communication unit 204 in real time.
- the communication unit 204 is connected to the processor 201 and may transmit and/or receive an internal/external device/server and a wired/wireless signal.
- the wide-angle camera unit 205 may input/acquire/recognize/sens an image/video/screen using at least one (wide-angle) camera sensor (eg, a 360-degree camera (sensor)).
- a wide-angle image/video/screen can be photographed/acquired/recognized/sensed in real time, and the photographed/acquired/recognized/sensed image is a VR image. It can be transmitted in real time to the client device 101 through the communication unit 204.
- the wide-angle camera unit is not limited to the 360-degree camera exemplified above, and all camera units having a photographing angle of less than 360 degrees are meant/included. Accordingly, a general person who does not own a 360-degree camera may become an avatar, and in this case, the image provided to the client device may be a general 2D image.
- the motion unit 206 may include at least one motor/engine to control the movement of the robot avatar device 102 (eg, movement/motion/flying direction/speed/angle, etc.).
- the motion unit 206 may control the movement of the robot avatar device 102 based on the control signal received from the processor 201 and/or the communication unit 204, and the received control signal is the client device 101 ) And/or a control signal transmitted from the application management server 103.
- the input unit 207 may be provided with at least one sensor/module to sense various inputs of a user (especially a client) and transmit the sensed input to the processor 201.
- the input unit 207 is a proximity sensor, a touch sensor, a pressure sensor, a camera sensor, a motion sensor, an infrared sensor, a microphone sensor, a gyro sensor, and/or a stick module (up/down/left/right direction).
- a module that detects stick movement may be provided.
- An embodiment of controlling a robot avatar device using a stick module will be described later with reference to FIG. 6.
- FIG. 3 and 4 are diagrams illustrating an embodiment in which a real-time VR service system according to an embodiment of the present invention is implemented.
- FIG. 3 is a diagram illustrating an avatar device providing a real-time VR service
- FIG. 4 is a diagram illustrating a client device receiving a real-time VR service.
- the avatar device 301 matched according to FIG. 1 may photograph a place requested by the client device through a wide-angle camera unit and transmit the photographed to the client device.
- the avatar device 301 may transmit the captured VR image 302 in real time at a time promised to the client device, or may store the captured VR image 302 at a time promised to the client device and transmit it at a later time.
- the avatar device 301 is moved to a specific place requested by the client and/or at a specific time by a worker hired or engaged in a real-time VR service system (especially, an avatar device), or the movement is automated. It is implemented as a robotic device and can be moved directly to a specific place at an appointment. In the latter case, in addition to the configuration/unit shown in FIG. 2, the avatar device 301 may further include a movement/flight unit equipped with at least one engine/motor for movement.
- the client device 401 may receive an image captured through the wide-angle camera unit of the avatar device 301 as a VR image as shown in FIG. 3.
- the client is the angle/direction of the client device 401 (if the VR display unit is an HMD, the angle/direction of the head wearing the HMD) or the gaze angle/direction/position It is possible to directly experience the VR image 403 of a desired angle/direction by adjusting.
- the client device 401 may search for information on a recognized specific object among the VR image 403 being displayed and provide it to the client. For example, the client device 401 automatically searches for a specific image/text recognized among the displayed VR images 403 (for example, using an image/text search function provided by an application or portal site), and the search result Can also be provided to the client.
- the client may perform real-time communication with the avatar or the avatar device 301 while experiencing the VR image provided by the avatar device 301.
- the application management server may provide a voice/text chat function through the application to provide a real-time communication function between the avatar and the client. .
- the client actively asks the avatar about the environment they want to experience (for example, please go to the shop in front of you. Climb the mountain. Get closer to the artwork in front, etc.)
- the avatar can actively accept the client's request and create an environment that the client wants to experience.
- the effect is that clients can increase their satisfaction by actively creating the environment they want to experience.
- the avatar can directly explain the feelings/impressions of the field being experienced through the communication function, and can provide additional information about the field knowledge/background/news, etc. to the client.
- the application management server may also provide an automatic translation function.
- the application management server may provide the automatic translation function to both sides in real time through an automatic translation application stored in the memory unit in advance or a real-time Internet search.
- the matching/connection between the client device 401 and the avatar device 301 is based on 1:1 matching, but a 1:N or N:1 matching/connection is also possible according to an embodiment. This can also be performed by the application management server based on the profile registered by the client/avatar device (401, 301) as described above.
- the client may evaluate the avatar that provided the VR image. For example, a client may score an evaluation score for a corresponding avatar through an application, which may be stored and managed in an application management server.
- the application management server may provide a function of recommending an avatar device 301 having a high possibility of matching with a client device through an application according to an embodiment.
- an average evaluation score for the recommended avatar device 301 may also be provided, and the higher the score, the higher the frequency of recommendation.
- the real-time VR service system of the present specification can also provide a real-time matching/connection method based on the location of the avatar device 301, which will be described later with reference to FIG. 5.
- FIG. 5 is a diagram illustrating a location-based real-time VR image providing system according to an embodiment of the present invention.
- the client device 401 may directly search in real time for a current experience/place to be experienced.
- the application management server may provide information on at least one avatar device that is currently providing/transmitting/broadcasting VR images in a corresponding region to the client device. For example, when a client searches for France and Paris, the application management server displays the locations of avatar devices that are currently transmitting/broadcasting/providing VR images in Paris, France, as shown in FIG. I can.
- the application management server may also provide information about brief information about each avatar device (eg, profile summary information, average evaluation score, etc.) to the client device 401 together.
- the searched avatar device may correspond to an avatar device that has previously agreed to share its location information and VR service among avatar devices located in a place searched by the client device 401.
- avatar devices may be electronic devices carried by workers, tourists, and tour guides, or may correspond to CCTVs located in specific areas or black boxes/CCTVs and/or drones installed in public transport.
- the client may select the avatar device 301-1 to which the experience is requested based on the information provided for each avatar device, and in this case, matching/connection with the selected avatar device 301-1 may be completed. For example, as illustrated in FIG. 5, the client may select any one of the avatar devices displayed on the Paris map, France, and a guide phrase “Would you like to accompany you?” may be displayed for this.
- the client may touch the'YES' button in the displayed guidance text, and as a result, matching/connection with the corresponding avatar device 301-1 It can be done.
- the avatar device 301-1 which has successfully matched, transmits/provides the VR image currently being photographed to the client device 401 in real time.
- FIG. 6 is a diagram illustrating a method of controlling an avatar device of a client device according to an embodiment of the present invention.
- the client device corresponds to an HMD device worn by the client
- the avatar device corresponds to a drone device, but the embodiment is not limited thereto.
- the client may apply an input for controlling the movement of the avatar device 504, which is a robot avatar device, to the client device 501.
- the client may apply a touch input for controlling the movement of the avatar device 504 through an input unit provided in the client device 501, and the client device 501 sensing the touch input is the sensed input. It is possible to generate a control signal corresponding to.
- the client device 501 is an icon/image/UI (User Interface) for controlling the avatar device 504 to facilitate the input of the client (for example, a joy stick or an arrow icon/image/UI in four directions). ) May be provided through an application, and the client may perform a drag input for the corresponding icon/image/UI in a direction in which the avatar device 504 wants to move.
- icon/image/UI User Interface
- the client may perform a drag input for the corresponding icon/image/UI in a direction in which the avatar device 504 wants to move.
- a control signal generated through such an input is transmitted to the avatar device 504 to control movement/motion/flight/motion of the avatar device 504.
- Such a control signal may be directly transmitted from the client device 501 to the avatar device 504 or may be transmitted to the avatar device 504 through an application management server.
- the above-described embodiment is an embodiment in which the client controls the avatar device 504 through the client device 501, and in addition, the client device 501 controls the avatar device 504 through another device to which it is paired/connected.
- the client device 501 may be in a state of being paired/connected with the other device 502 in advance through wireless/wired communication.
- the other device 502 may include at least one component/unit described in FIG. 2 to perform the functions/operations described herein.
- client control for example, an electric wheelchair, a car, a motorcycle, a bicycle, etc.
- an avatar device A control signal for controlling the movement/movement of the 504 may be generated corresponding to/synchronized with the movement state of the other device 502.
- the control signal is a movement direction/speed of the electric wheelchair (or a movement input input through the control stick 503 provided for the user to control the movement of the electric wheelchair) Signal), and the generated control signal may be transmitted to the avatar device 504.
- a control signal may also be directly transmitted from the client device 501 to the avatar device 504 or may be transmitted to the avatar device 504 through an application management server.
- a control signal for controlling the shooting angle of the wide-angle camera unit 505 is also from the client device 501. Can be transmitted.
- the transmitted control signal may be generated in response to the client's gaze/head direction/angle/speed/acceleration, etc., sensed by the client device 501, and a wide angle such as shooting direction/angle/speed/acceleration, etc.
- the movement of the camera unit 505 can be controlled. Through this, there is an effect that the client can actively experience/experience the angle/direction he or she desires.
- the movement/motion/flight/motion of the avatar device 504 is controlled by another device paired/connected to the client device 501 as in the above-described embodiment, the movement/motion/of the avatar device 504 Flight/motion is controlled by a first control signal generated by the other device 502, and the shooting angle/speed/direction of the wide-angle camera unit 505 of the avatar device 504 is generated by the client device 501 Each is independently controlled by the second control signal.
- a personalized experience service that allows the avatar device to look like a client by displaying the client's face/avatar/emoticon on the (VR) display unit of the avatar device during flight may be provided.
- a real-time VR service system especially, an application management server
- At least one of the listed functions may be mainly provided by an application management server, and each function may be performed by a client device and/or an avatar device:
- the client device/account pays for the reserve, and when performing an experience agency, the reserve is deducted by the agency cost, and the deducted cost is credited to the avatar device/account
- -VR camera interlocking function through various wearable devices (eg, smart watch, link flow neck type smart wearable device, etc.).
- wearable devices eg, smart watch, link flow neck type smart wearable device, etc.
- -Matching is performed between the tasks you want to do in the profile of the client device and the days you need to do in the profile of the avatar device, so that other users can view them and perform detailed searches.
- the biggest difference between the above-described real-time VR service system is that travel and exploration programs using existing VR use recorded images, but this service can transmit VR images in real time.
- this service In order to make a recorded video, it takes a lot of time to go through pre-shooting and editing, and there is a disadvantage in that the timeliness of playing the video of the past period is poor, and the experience of experiencing the site directly is inferior.
- VR contents using other graphics have a long production period and are expensive to create.
- the biggest advantage of this service is that it is possible to operate at a low cost in terms of service as it does not incur real-time realism because it allows the client to view the videos they want in real time. can do.
- an embodiment of the present invention may be implemented by various means, for example, hardware, firmware, software, or a combination thereof.
- an embodiment of the present invention is one or more ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs ( field programmable gate arrays), processors, controllers, microcontrollers, microprocessors, etc.
- ASICs application specific integrated circuits
- DSPs digital signal processors
- DSPDs digital signal processing devices
- PLDs programmable logic devices
- FPGAs field programmable gate arrays
- processors controllers, microcontrollers, microprocessors, etc.
- an embodiment of the present invention is implemented in the form of modules, procedures, functions, etc. that perform the functions or operations described above, and is stored in a recording medium that can be read through various computer means.
- the recording medium may include a program command, a data file, a data structure, or the like alone or in combination.
- the program instructions recorded on the recording medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software.
- the recording medium is a magnetic medium such as a hard disk, a floppy disk, and a magnetic tape, an optical medium such as a compact disk read only memory (CD-ROM), a digital video disk (DVD), and a floppy disk.
- Magnetic-Optical Media such as a floptical disk, and a hardware device specially configured to store and execute program instructions such as ROM, RAM, flash memory, and the like.
- the client can indirectly experience various environments such as scenery, objects, exhibits, etc. in a specific area (especially in a distance) that the client wants to experience through VR images, even if they do not go directly, and avatars Since communication with and real-time is possible, the client can more actively and flexibly experience the experience they want through the avatar.
- new VR services such as VR travel/experience can be derived, and since the client can directly manipulate avatar movement/motion, the client can obtain the desired experience more actively and flexibly. I can.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Library & Information Science (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Tourism & Hospitality (AREA)
- Human Resources & Organizations (AREA)
- General Health & Medical Sciences (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Economics (AREA)
- Health & Medical Sciences (AREA)
- Optics & Photonics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
Claims (10)
- 실시간 VR(Virtual Reality) 서비스 제공 방법에 있어서,클라이언트 기기가 어플리케이션 관리 서버에 클라이언트 프로필을 등록하는 단계로서, 상기 클라이언트 프로필에는 상기 클라이언트 기기가 의뢰하고자 하는 VR 영상에 관한 정보가 포함됨;복수의 아바타 기기들이 상기 어플리케이션 관리 서버에 아바타 프로필들을 등록하는 단계로서, 상기 아바타 프로필들에는 상기 아바타 기기가 의뢰받고자 하는 VR 영상에 관한 정보가 포함됨;상기 어플리케이션 관리 서버가 상기 클라이언트 프로필과 상기 아바타 프로필들을 상호 비교하여 상기 클라이언트 프로필과 적어도 하나의 정보가 매칭되는 아바타 프로필을 서칭하고, 제1 서칭 결과를 상기 클라이언트 기기에 제공하는 단계;상기 어플리케이션 관리 서버가 상기 제1 서칭 결과 내에서 특정 아바타 기기를 선택하는 상기 클라이언트 기기의 입력을 수신하는 단계;상기 어플리케이션 관리 서버가 상기 클라이언트 기기와 상기 특정 아바타 기기를 상호 매칭시키는 단계; 및상기 클라이언트 기기가 상기 매칭된 아바타 기기로부터 VR 영상을 수신하는 단계; 를 포함하는, 실시간 VR 서비스 제공 방법.
- 제 1 항에 있어서,상기 VR 영상에 관한 정보로서,상기 클라이언트 프로필은, 의뢰하고자 하는 VR 영상의 촬영 위치, 촬영 시간, 사용 언어, 및/또는 촬영 의뢰 비용에 관한 정보를 포함하고,상기 아바타 프로필은, 의뢰받고자 하는 VR 영상의 촬영 위치, 촬영 시간, 사용 언어, 및/또는 촬영 의뢰 비용에 관한 정보를 포함하는, 실시간 VR 서비스 제공 방법.
- 제 2 항에 있어서,상기 클라이언트 기기가 상기 매칭된 아바타 기기로부터 상기 VR 영상을 수신하는 단계는,상기 클라이언트 기기가 상기 클라이언트 프로필에 등록한 촬영 시간 및 촬영 위치에서 촬영된 VR 영상을 상기 매칭된 아바타 기기로부터 수신하는 단계; 를 포함하는, 실시간 VR 서비스 제공 방법.
- 제 2 항에 있어서,상기 제1 서칭 결과를 상기 클라이언트 기기에 제공하는 단계는,상기 제1 서칭 결과에 복수의 아바타 기기들이 포함된 경우, 상기 어플리케이션관리 서버는, 상기 복수의 아바타 기기들 중 상기 클라이언트 기기와 프로필 정보 매칭 정도가 높은 아바타 기기일수록 상위에 랭크하여 상기 클라이언트에 제공하는 단계; 를 포함하는, 실시간 VR 서비스 제공 방법.
- 제 2 항에 있어서,상기 VR 영상을 수신하는 단계는,상기 어플리케이션 관리 서버가 상기 클라이언트 기기 및 상기 매칭된 아바타 기기간의 실시간 음성 채팅 또는 문자 채팅 기능을 제공하는 단계; 를 더 포함하고,상기 실시간 음성 채팅 또는 문자 채팅 기능을 제공하는 단계는,상기 클라이언트 기기가 상기 클라이언트 프로필에 등록한 사용 언어와, 상기 매칭된 아바타 기기가 상기 아바타 프로필에 등록한 사용 언어가 다른 경우,상기 어플리케이션 관리 서버가 각 기기의 사용 언어에 맞게 자동 번역하여 상기 음성 채팅 또는 상기 문자 채팅 기능을 제공하는 단계인, 실시간 VR 서비스 제공 방법.
- 제 1 항에 있어서,상기 클라이언트 기기가 현재 의뢰하고 싶은 VR 영상의 촬영 위치를 검색하는 단계; 및상기 촬영 위치에 위치한 아바타 기기를 서칭한 제2 서칭 결과를 상기 클라이언트 기기에 제공하는 단계; 를 더 포함하고,상기 제2 서칭 결과는,상기 촬영 위치로부터 기설정된 거리 내에 위치한 적어도 하나의 아바타 기기 정보, 상기 적어도 하나의 아바타 기기의 현재 위치 정보 및/또는 상기 적어도 하나의 아바타 기기의 아바타 프로필 정보를 포함하는, 실시간 VR 서비스 제공 방법.
- 제 6 항에 있어서,상기 제2 서칭 결과에 복수의 아바타 기기들이 포함된 경우,상기 어플리케이션 관리 서버가 상기 클라이언트 기기로부터 상기 복수의 아바타 기기들 중 특정 아바타 기기를 선택하는 선택 입력을 수신하고, 상기 선택된 특정 아바타 기기와 상기 클라이언트 기기를 매칭시키는 단계; 및상기 클라이언트 기기가 상기 매칭된 아바타 기기로부터 VR 영상을 수신하는 단계; 를 더 포함하는, 실시간 VR 서비스 제공 방법.
- 제 1 항에 있어서,상기 매칭된 아바타 기기가 로봇 아바타 기기인 경우, 상기 클라이언트 기기가 상기 매칭된 아바타 기기의 이동 방향, 각도 및/또는 속도를 제어하기 위한 상기 제1 제어 신호를 상기 매칭된 아바타 기기로 전송하는 단계; 및상기 매칭된 아바타 기기가 상기 제1 제어 신호에 따라 이동하는 단계; 를 더 포함하고,상기 제1 제어 신호는, 상기 클라이언트 기기에 대한 사용자의 이동 입력 신호에 동기화되어 생성되는, 실시간 VR 서비스 제공 방법.
- 제 8 항에 있어서,상기 클라이언트 기기가 사용자에 의해 이동 제어가 가능한 타 기기와 페어링되어 있는 경우, 상기 제1 제어 신호는 상기 타 기기로부터 상기 클라이언트 기기가 수신한 이동 제어 신호에 동기화되어 생성되고, 상기 매칭된 아바타 기기의 이동은 상기 타 기기의 이동과 동기화되는, 실시간 VR 서비스 제공 방법.
- 제 8 항에 있어서,상기 VR 영상 촬영을 위해 상기 매칭된 아바타 기기에 구비된 카메라 유닛의 최대 촬영 각도가 360도 미만인 경우, 상기 카메라 유닛의 촬영 방향은, 상기 클라이언트 기기를 착용한 사용자의 머리 또는 시선 방향에 동기화되고,상기 카메라 유닛의 촬영 각도는 상기 클라이언트 기기로부터 전송된 제2 제어 신호에 의해 제어되며,상기 제2 신호는 상기 클라이언트 기기를 착용한 사용자의 머리 또는 시선 방향의 센싱 결과에 동기화되어 생성되는, 실시간 VR 서비스 제공 방법.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/626,028 US11847297B2 (en) | 2019-07-10 | 2020-07-09 | Method of providing real-time VR service through avatar |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020190083097A KR102193630B1 (ko) | 2019-07-10 | 2019-07-10 | 아바타를 통한 실시간 vr 서비스 장치, 방법 및 시스템 |
KR10-2019-0083098 | 2019-07-10 | ||
KR10-2019-0083097 | 2019-07-10 | ||
KR1020190083098 | 2019-07-10 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021006648A1 true WO2021006648A1 (ko) | 2021-01-14 |
Family
ID=74113785
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2020/008978 WO2021006648A1 (ko) | 2019-07-10 | 2020-07-09 | 아바타를 통한 실시간 vr 서비스 제공 방법 |
Country Status (2)
Country | Link |
---|---|
US (1) | US11847297B2 (ko) |
WO (1) | WO2021006648A1 (ko) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021163418A1 (en) * | 2020-02-12 | 2021-08-19 | University Of Florida Research Foundation | Human eyes design: first person vr characters for testing inclusive design solutions |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20030086326A (ko) * | 2001-03-27 | 2003-11-07 | 가부시키가이샤 니콘 | 디지털 데이터의 중개방법 |
JP2004054877A (ja) * | 2002-07-22 | 2004-02-19 | Santekku Keiso:Kk | 画像仲介システム。 |
KR20130082718A (ko) * | 2011-12-15 | 2013-07-22 | (주)에스디시스템 | 실시간 영상전송을 이용한 아바타 용역서비스 제공시스템 및 제공방법 |
KR101343860B1 (ko) * | 2013-01-03 | 2013-12-20 | 재단법인대구경북과학기술원 | 하이브리드 인터페이스를 사용하는 로봇 아바타 시스템과 로봇 아바타 시스템에서 사용되는 명령 서버, 학습 서버 및 지각 서버 |
KR101990428B1 (ko) * | 2018-06-12 | 2019-06-19 | 한길씨앤씨 주식회사 | 다수의 사용자에 대하여 실시간 동기화가 가능한 vr 시스템 및 이를 이용한 vr 시스템의 실시간 동기화 방법 |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140164129A1 (en) * | 2012-07-30 | 2014-06-12 | Sanjaykumar Joshi | System and methods for providing targeted messages |
US10366511B2 (en) * | 2014-05-28 | 2019-07-30 | Elbit Systems Land And C4I Ltd. | Method and system for image georegistration |
JP7187446B2 (ja) * | 2016-05-27 | 2022-12-12 | ホロビルダー インコーポレイテッド | 拡張された仮想現実 |
WO2019147815A1 (en) * | 2018-01-24 | 2019-08-01 | Nike Innovate C.V. | System, platform and method for personalized shopping using a virtual shopping assistant |
US11004269B2 (en) * | 2019-04-22 | 2021-05-11 | Microsoft Technology Licensing, Llc | Blending virtual environments with situated physical reality |
-
2020
- 2020-07-09 US US17/626,028 patent/US11847297B2/en active Active
- 2020-07-09 WO PCT/KR2020/008978 patent/WO2021006648A1/ko active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20030086326A (ko) * | 2001-03-27 | 2003-11-07 | 가부시키가이샤 니콘 | 디지털 데이터의 중개방법 |
JP2004054877A (ja) * | 2002-07-22 | 2004-02-19 | Santekku Keiso:Kk | 画像仲介システム。 |
KR20130082718A (ko) * | 2011-12-15 | 2013-07-22 | (주)에스디시스템 | 실시간 영상전송을 이용한 아바타 용역서비스 제공시스템 및 제공방법 |
KR101343860B1 (ko) * | 2013-01-03 | 2013-12-20 | 재단법인대구경북과학기술원 | 하이브리드 인터페이스를 사용하는 로봇 아바타 시스템과 로봇 아바타 시스템에서 사용되는 명령 서버, 학습 서버 및 지각 서버 |
KR101990428B1 (ko) * | 2018-06-12 | 2019-06-19 | 한길씨앤씨 주식회사 | 다수의 사용자에 대하여 실시간 동기화가 가능한 vr 시스템 및 이를 이용한 vr 시스템의 실시간 동기화 방법 |
Also Published As
Publication number | Publication date |
---|---|
US11847297B2 (en) | 2023-12-19 |
US20220253197A1 (en) | 2022-08-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019124726A1 (ko) | 혼합 현실 서비스 제공 방법 및 시스템 | |
WO2018128472A1 (en) | Virtual reality experience sharing | |
WO2016171363A1 (ko) | 서버, 사용자 단말 장치 및 그 제어 방법 | |
WO2014106977A1 (en) | Head mounted display and method for controlling the same | |
WO2020013519A1 (en) | Method and system of displaying multimedia content on glass window of vehicle | |
KR20170096042A (ko) | 공유된 관심사를 갖는 메시지들의 갤러리 | |
WO2014204239A1 (en) | Electronic device for displaying lock screen and method of controlling the same | |
WO2011059243A2 (en) | Server, user terminal, and service providing method, and control method thereof | |
WO2020054978A1 (ko) | 이미지 생성 장치 및 그 방법 | |
WO2018074618A1 (ko) | 영상을 위한 효과 공유 방법 및 시스템 | |
WO2016200141A1 (ko) | 가족 문화 컨텐츠 서비스 방법 및 시스템 | |
WO2019226001A1 (en) | Method and apparatus for managing content in augmented reality system | |
WO2016111470A1 (ko) | 마스터 기기, 슬레이브 기기 및 그 제어 방법 | |
EP3366038A1 (en) | Method for synthesizing image and an electronic device using the same | |
WO2021006648A1 (ko) | 아바타를 통한 실시간 vr 서비스 제공 방법 | |
WO2015041417A1 (ko) | 이동통신단말기의 앱을 이용한 가상의 실제 생활 체험 및 정보 습득 방법 | |
US20220272164A1 (en) | Experience sharing system and experience sharing method | |
WO2020106082A1 (ko) | Vr 영상 기반의 여행 가이드 매칭 서비스 제공 장치 및 그 방법 | |
KR102325048B1 (ko) | 로봇 아바타를 통한 실시간 vr 서비스 제공방법 | |
CN114371904B (zh) | 数据显示方法、装置、移动终端及存储介质 | |
KR102193630B1 (ko) | 아바타를 통한 실시간 vr 서비스 장치, 방법 및 시스템 | |
WO2015046739A1 (en) | Display device and server device for providing service to event winner, and methods thereof | |
WO2016108431A1 (ko) | 화면 공유 시스템 및 화면 공유 방법과 관리서버 및 관리서버의 운영방법 | |
WO2020138696A1 (ko) | 가상 이미지를 중개하는 시스템, 가상 이미지를 삽입하는 장치 및 그것들의 동작방법 | |
WO2023195659A1 (ko) | 증강현실을 이용한 행사장 인테리어 솔루션 제공 시스템 및 방법 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20836153 Country of ref document: EP Kind code of ref document: A1 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20836153 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 28/06/2022) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20836153 Country of ref document: EP Kind code of ref document: A1 |