KR20230162186A - Handicapped Tourist Support System through Digital Twin-linked Augmented Reality Metaverse - Google Patents

Abstract

The present invention relates to a system and method for supporting tourism for the underprivileged and providing an augmented tourism experience through a digital twin based on spatial data, and more specifically, through DT, augmented reality devices connected thereto, and augmented reality space. By placing remote participants connected to the DT in the same DT space as the user and connecting them in real time, we implement a metaverse service that connects the virtual space to the real space. Through this, we support the tourism of the tourism vulnerable in remote locations and enable tourism together. It is about the metaverse system and method that can be experienced.

Description

Digital twin-based tourism support system for the underprivileged and support method using the same {Handicapped Tourist Support System through Digital Twin-linked Augmented Reality Metaverse}

The present invention relates to a travel support system and method that forms a metaverse space through a digital twin-linked augmented reality device and utilizes the augmented reality device to provide safety and tourist convenience to the tourist vulnerable, such as the disabled, while traveling. recognizes the user's pose through the augmented reality space and 6DoF vector formed by the augmented reality device linked to the DT, matches the traveler's location to the DT space corresponding to the real space, and detects the user's pose through CCTV and IoT devices connected to the DT. By understanding the situation around the traveler three-dimensionally, DT can provide appropriate information and help so that the traveler can solve the problem themselves. Additionally, if necessary, remote participants who can provide assistance to the traveler can use the DT-linked augmented reality space. It relates to an augmented reality metaverse service and its operating system and method that can provide practical help to travelers.

There are various difficulties that people traveling to unfamiliar places, such as tourist destinations, may experience, and location-based methods are being proposed to specifically resolve safety risks. If we limit ourselves to the tourism industry, we can traditionally use the offline approach of setting up tourist support facilities such as tourist information centers in various tourist areas and providing necessary services directly to tourists visiting the area, and the offline approach where tourists visit websites to collect necessary information. A widely used method is to help people solve problems on their own and ultimately to resolve them through communication, such as by phone, with service branches that provide tourist information services.

However, tourism vulnerable groups, including the disabled, the elderly, etc., and foreigners who have difficulty communicating in the local language, visit a tourist information center located in a random location to resolve the difficulties and inconveniences they experience while traveling. Paying the price and moving there itself presents another challenge and difficulty.

Even if you are not a traveler in an unfamiliar space, being isolated from a familiar space for various reasons such as a disaster or accident and having to wait for help on the spot is a difficult situation that anyone can experience at any time.

However, in a difficult situation, it would be nice if someone who can help is on site and help solve the problem, but if not, a system that can quickly and effectively provide help from a remote location is required as an alternative. However, for travelers traveling in unfamiliar places, especially vulnerable tourists who have difficulty moving and communicating, requesting appropriate help in such a situation presents another challenge.

To solve this problem, technology is being used to share the user's location using GPS installed on smartphones, etc. by using location-based services and to support various communication through text, voice, and video. However, the GPS positioning error is approximately the user's approximate level. It can only estimate the location of the traveler, and especially if the traveler has a physical disability or language barrier, it is complicated and difficult to accurately determine the traveler's exact location and current situation through location-based services alone, and the geographical characteristics of the space Unless you have experience with the environment, it is difficult to accurately understand the situation and decide on the appropriate response based on information delivered piecemeal from a distance.

Meanwhile, augmented reality technology and digital twin (DT) technology have been developing as separate technologies, but with the development of network speed and computational processing power of portable devices, it has become possible for augmented reality devices and DT to interoperate in real time. Through this, it becomes possible for the augmented reality device to recognize the surrounding space in three dimensions, reconstruct it, and share the augmented reality space with other people in real time through spatial registration with DT. In a shared augmented reality-DT space, augmented reality users in the real world and virtual reality participants accessing the space through the DT space are physically in different spaces, but they can recognize each other's presence in the accessed DT-augmented reality space. It can recognize, communicate and interact with, and can be defined as an augmented reality metaverse service.

In this metaverse space, virtual space participants can immediately or intuitively recognize the current situation that real space travelers are experiencing and provide appropriate advice or assistance remotely. Existing augmented reality technology is limited to sharing situations using 2D space as a medium, such as transmitting and sharing video images remotely and communicating with users through GUI elements such as indicators on augmented reality devices. However, augmented reality meta The bus space not only provides remote support to on-site users through a 3D space created by augmented reality and aligned with DT, but also enables virtual space participants to share travel experiences in real time with local travelers in the augmented reality space.

The present invention was made to solve the above problems, by matching the augmented reality space created by an augmented reality device such as a smartphone carried by a traveler to a digital twin (hereinafter referred to as DT), including the user's exact location, and surrounding areas. Identify the space, utilize CCTV and various IoT device information connected to the captured user location, create a 3D virtual space in DT of the situation around the traveler, and allow appropriate participants to remotely access this virtual space to monitor the traveler's situation. It is about a way to understand the situation three-dimensionally and provide three-dimensional help through 3D augmented reality space.

In order to solve the above problem, the present invention includes an augmented reality device comprising a 6DoF camera or an augmented reality camera and a control module for controlling the same; Includes GPS, WiFi, geomagnetic machine, and gyroscope modules that can identify the user's current location and posture information mounted in the augmented reality device, and 6DoF (Degrees of Freedom) information obtained by summing the resultant data of the modules Identify which point and direction the user is currently facing, use additional sensor data from the augmented reality device to form a 3D augmented reality space around the user, and upload it to DT along with posture information. The camera's direction vector extracted from the 6DoF value is projected (raycasting) to the corresponding point in DT space and compared with landmarks such as buildings that are detected (hit), and the user's current location and posture are calculated.

The DT includes data on buildings and terrain information, and the augmented reality spatial information created by the user is projected onto the DT. The DT uses the user's 6DoF vector to display the user's current location and the received augmented reality. Space can be matched to DT. After matching the user's augmented reality space with the DT space, it is shared with participants connected to the DT, allowing them to know what situation the user is in.

The DT shares the matched user space with other users and assigns a unique identifier in an easy-to-recognize form. Unlike a normal geographic coordinate system, in addition to spatial information, in order to distinguish it from the space created by other nearby users, the DT provides additional information in addition to spatial information. An identification system can be used based on the current time, user and participant information, purpose of the created virtual space and required functions, etc.

In addition, the DT can connect to IoT devices located in the field, such as network-connected CCTV, and receive and interpret data in real time. DT can more accurately understand the situation in the space through the real-time data they transmit.

In this completed metaverse space, a helper can participate from a remote location through virtual space, communicate with the user in real time through DT, and take necessary actions for the user. These actions could include remote control of IoT devices located in the space around the user via DT, or DT could discover the on-site personnel who can reach the user most quickly and share the user's space with them to provide fast and accurate on-site control. Action can be requested.

In the present invention, which is accomplished as described above, when a user takes pictures with an augmented reality device, the uploaded 6DoF information, the image combined therewith, and 3D spatial information such as the floor or wall of the space where the user is located are aligned with the location identified after spatial registration on the DT. By combining with related IoT data, it is possible to not only understand the situation of the space three-dimensionally, but also express visual effects that are appropriately harmonized with these spaces to perform three-dimensional communication.

For example, you can visually understand the space through real-time footage from CCTV in the area, and by combining other IoT data, you can intuitively understand the situation the user is in in the space, providing appropriate information to the user and responding to requests. Actions are expressed in 3D graphics in an augmented reality space, and if necessary, anthropomorphic 3D avatars help users understand intuitively and immediately implement them. In many cases, shortening the time required for this process can be expected to result in saving users from serious worsening of their condition.

Additionally, the present invention can increase the operational efficiency of tourism support services by relocating service personnel who had to be deployed on site to a space accessible to DT.

In a reality where it is difficult to deploy personnel who can communicate in foreign languages or have medical expertise to all sites, service capacity and resource efficiency can be increased by placing these personnel in centers equipped with facilities that enable smooth activities in the DT virtual space. .

Additionally, in addition to safety services for travelers, the present invention can provide the experience of enjoying sightseeing while receiving guidance from metaverse participants regarding POIs of tourist attractions scattered across a wide space. These participants may be guardians of vulnerable tourists visiting from remote locations, and natives of the travel destination may act as virtual guides.

In addition, the present invention provides a new tourism experience in which participants and travelers connected from remote locations can enjoy sightseeing together beyond spatial constraints through the metaverse created by DT combined with various data in addition to visual information about the space where the traveler is located. You can.

Figure 1 is a diagram showing the overall configuration of a tourism support system for the underprivileged based on a digital twin according to an embodiment of the present invention.
Figure 2 is a diagram showing the detailed configuration of a tourism support system for the underprivileged based on a digital twin according to an embodiment of the present invention.
Figure 3 is a diagram showing a method of supporting tourism for the underprivileged based on a digital twin according to an embodiment of the present invention.
Figure 4 is a diagram showing metaverse participants interacting with 6DoF data according to an embodiment of the present invention.
Figure 5 is a diagram showing the matching of real space users and metaverse participants together in the digital twin space according to an embodiment of the present invention.
Figure 6 is a diagram showing the projected areas of global space and local space according to an embodiment of the present invention.

As shown in FIG. 1, the present invention includes an augmented reality device 100 including a 6DoF camera or an augmented reality camera and a control module for controlling the same; The control module 200 mounted in the augmented reality device includes a GPS module 201, a WiFi module 202, a geomagnetic machine module 203, and a gyroscope module 204 that can identify the user's current location and posture information. ; Includes a space detection sensor 205, etc.

6 Degrees of Freedom (6DoF: location information x, y, z or longitude, Latitude, altitude + POSE information (Roll, Yaw, Pitch) information is used to identify which point and direction the user is currently facing.

Using 6DoF information obtained by adding up data from the relevant sensors of the smartphone, it is possible to identify which point and which direction the user is currently facing.

The 6DoF includes x, y, z or longitude, latitude, and altitude information as location information, and Roll, Yaw, and Pitch information as POSE information.

The space detection sensor 205 detects obstacles and calculates distances through light or sound reflected by surrounding obstacles, and the augmented reality device combines this information with other sensor data and camera images to recognize the 3D space around the user. , forming an augmented reality space.

As shown in Figure 1b, the present invention receives 3D spatial information of the traveler's location from DT (Digital twin) through the control module, generates a 3D augmented reality space, and provides tourist information (POI) information, road width, Spatial information provision module 211 that provides wheelchair passage-related data, including slope and pavement condition, and surrounding obstacle data, including the location and size of obstacles recognized in real time through an augmented reality sensor, through an augmented reality device. And transmitting the created 3D augmented reality space to the corresponding space in the metaverse corresponding to the DT, users of the metaverse space participate from a remote location, and real-time communication with the user through voice, video, and 3D characters and objects is provided through the DT. Perform communication and interaction, thereby taking appropriate remote actions, including providing necessary information to remote users, detecting on-site personnel whose location is at a minimum distance from the user through the DT, and communicating with users and on-site personnel. It includes a metaverse tourism support module 212 that shares this user space to request on-site actions.

As shown in FIG. 2, according to an embodiment of the present invention, the DT 300 includes spatial information 301 about buildings and terrain information, and POI information 302 existing in these spaces; It also includes IoT device data (303), including CCTV, which provides real-time data in these spaces.

In order to project the augmented reality space formed by the augmented reality device into the DT space, the augmented reality device 6DoF includes location information x, y, z or POSE information including longitude, latitude, altitude, and roll, yaw, and pitch, Spatial registration is performed on the DT together with the surrounding 3D spatial information collected by the augmented reality device.

At this time, by using IoT device information 303, various IoT sensor data, such as CCTV images around the user, are visualized and matched to the corresponding space, and the metaverse space is completed with a DT that simulates the real situation in real time.

Now, the space on the DT that has been matched with the user space is given an identifiable code, and the presence manager 305 synchronizes the presence of the space and the user.

A certain area centered on the location of the user registered in the presence server is now given a unique space identifier to be distinguished from other DT spaces, and a number of other participants 500 can participate in the corresponding DT space through the identifier.

The presence manager provides coordinate system conversion and context sharing services so that the identifier can be converted between the geographical space coordinate system used in real space and the various 3D coordinate systems of applications used by individual metaverse participants.

Figure 3a is a diagram illustrating the steps of (a) creating a matched DT space, and (b) allowing other participants to participate in the corresponding DT space, according to an embodiment of the present invention.

At this stage, the participant's location is spatially aligned to a specific location in DT space and can move freely within that space. In order to reproduce the current situation in this space, data transmitted by IoT devices in the area, including CCTV, is transmitted in real time and provided to the metaverse as an appropriate form of physical stimulation or visual expression to participants.

Afterwards, the surrounding space (real world) that the user sees using the augmented reality device can be tracked in the same way in DT, and Metaverse participants experience changes in the space due to differences in network delay speed.

As shown in Figure 3b, the present invention controls a 6DoF camera or augmented reality camera (S21), identifies the user's current location and posture information (S22), and uses 6DoF (Degrees of Freedom) information to determine the user's current position. Identify which point and which direction the user is looking at (S23), form a 3D augmented reality space around the user, upload it to DT along with the posture information (S24), and store the camera's direction vector extracted from the 6DoF value in the DT space. It is compared with landmarks such as buildings that are detected (hit) by projecting (raycasting) to the point, and calculates the user's current location and posture (S25).

As shown in Figure 3c, the present invention identifies what situation the traveler (user) is in (S31), allows participants to participate in the metaverse space from a remote location, communicates with the user in real time through DT, and provides the necessary information to the user. Take action (S32), remotely control IoT devices located in the space around the user through DT (S33), and DT searches for field personnel who can reach the user the fastest and shares the user space with them to quickly and Request accurate on-site action (S34).

Figure 4 shows the process by which a 3D object provided by Metaverse is expressed as an augmented reality object on the user's augmented reality device. The augmented reality device can convert the 6DoF data of the received object into values of the augmented reality space and then render the object in the augmented reality space. For objects created in DT space, their 3D shape and 6DoF information are transmitted to the user's augmented reality device along with a code that defines the possible interactions of the object.

At this time, in DT space, spatial and virtual object expression techniques through 3D graphics are applied to the object in DT space, such as appropriate perspective depending on the distance or direction between surrounding objects and the camera, and occlusion where part of the object is obscured by the object in front. It shows that the same processing can be done by augmented reality devices.

That is, in the DT space on the right side of Figure 4, the yellow dragon is placed behind the wall of the building in the DT space, so that the lower part of the dragon is hidden and only the upper body on the wall is visible.

This DT's 3D spatial information is transmitted to the augmented reality device in real time, showing that it can be expressed realistically in the augmented reality space through the same series of processes such as object placement, occlusion culling processing, and rendering.

Here, occlusion culling refers to a 3D graphics technique that disables rendering of an object when it is obscured by another object and is not visible to the camera. This technology not only provides performance and efficiency advantages by not drawing objects that are currently invisible through the camera, but also increases immersion by expressing whether a virtual object is in front or behind an object in the background real space in the augmented reality space. There will be.

In order to maintain a sense of immersion as if the virtual object provided by DT is real, if other objects exist in the space between the virtual object and the viewer, occlusion culling is performed to properly obscure the virtual object so as not to harm the perspective of the 3D space perceived by the user. (Occlusion Culling) must be handled.

At this time, DT provides 3D information about major facilities in the DT space around the user and can provide information on which buildings and other facilities around the virtual object should be occluded for occlusion culling.

Then, the user's augmented reality device can utilize the DT spatial information around the virtual object and the surrounding 3D space and pass-through image recognized by the augmented reality device, minimizing the occlusion culling work area and increasing work processing speed and quality of results. Efficiency is secured.

To explain in more detail, DT provides the location and shape of fixed objects, such as buildings around the user, to the augmented reality device as 3D spatial information, and the augmented reality device matches the registered augmented reality space and the pass-through image and displays the 2D image. By projecting the approximate location and posture of the building, it is possible to perform recognition processing to quickly and accurately find the boundary of the building within a complex image space. By separating moving objects around the user from the background space, the object itself can be recognized and specified. This increases the efficiency of 3D recognition.

Afterwards, through changes in the 6DoF value of the object transmitted in real time from DT and interaction with the user, the object feels like a real object to the user.

Through this, the user can be informed in real time of the actions to be taken in that situation. In some cases, this 3D object can be delivered as a digitized 3D representation of the participant, which can reduce user resistance and increase understanding of the message being delivered.

Figure 5 shows that users access the DT through an augmented reality device and participants access the DT through a virtual reality device. Users (real space users, tourism vulnerable people) and participants (virtual space users, tourism activity support experts) access the augmented reality device through DT. It shows the tourism metaverse service, in which participants experience tourism experiences and are provided with virtual tourism experiences.

Participants will receive the tourist space through the DT space created based on the user's augmented reality device and real-time data transmitted through DT, and the user will receive the participant's response through the participant's metaverse avatar that appears on the augmented reality device. Through communication and interaction between users and participants, a consensus is formed and an enhanced tourism experience is provided on site.

The DT exchanges 6DoF transmission and interaction in real time as if the user and participant exist in the space together, forming a metaverse space where augmented reality and virtual reality are combined into one.

Figure 6 shows the characteristics of each 3D augmented reality metaverse space of different participants created in the DT space.

Here, when dealing with 3D space such as 3D GIS, a coordinate system consisting of three axes is used, which is identified with symbols such as latitude, longitude, altitude, or z, x, y, and the distance from the reference point determined in each coordinate system is Measuring axes and expressing them in degrees, minutes, and seconds, and especially in the case of altitude, expressing the vertical height above sea level or the earth's surface in meters (m), are common ways to identify arbitrary points in a geospatial coordinate system.

However, in everyday life, it is inconvenient to deal with space using latitude, longitude, and altitude values, so it is common to identify buildings and roads and share their locations through an address system combined with administrative districts determined by the administration.

However, this address system cannot refer to places where addresses are not assigned because there are no buildings or roads such as mountains, fields, or water surfaces such as rivers or lakes, and depending on the country, there may be vast areas that do not have an organized address system. You can.

To complement this address system, a grid coordinate system is being proposed as an alternative, and Korea is also implementing a national branch number system.

However, although the traditional spatial coordinate system is suitable for the purpose of referring to and sharing static locations, it is difficult to identify and share space with others by temporarily forming it in augmented reality, metaverse, digital twin, etc. .

When different people in close proximity create augmented reality spaces for their own purposes and use them with designated participants, adjacent or overlapping spaces are distinguished in the process of identifying digital twin or metaverse spaces using a traditional spatial coordinate system. Difficulties may arise, and in addition, unlike real space, the life cycle of an augmented reality space is that it only exists for a few minutes to a few hours and then disappears, so the space may no longer exist as time passes. .

Therefore, as specified in Figure 3, the digital twin requires a geographical location, the owner of the space, a space identification system that is valid only for the time the space exists, and a metaverse space identifier generated according to this system.

As an example, the metaverse space identifier for Local Space a in FIG. 6 needs to be mathematically defined as follows.

When a user (U) is currently (T) in a specific space (S), the space and time of that user can be expressed as a relationship of (S, U, T), and the identifier generated to easily recognize this is called a space identifier. It can be called (SID, Space Identifier).

Additionally, Enc has an inverse function Dec() and is an encoder that can decode S and U again.

The function H used to generate the space identifier in Equation 1 above can be defined as a general hash function, and is used by the Presence Manager, which manages the augmented reality space and digital twin space, and augmented reality and virtual reality devices and systems. The integrity of the function must be guaranteed so that it can be interpreted and created identically.

The function H is a function that generates an identifier that can identify the space created by the user if there is a space created by the user in a specific time zone and a specific space. It does not specifically authorize only the user in question to create an identifier, and Even if a third party submits a space identifier created in anticipation of the user in a specific space to the presence manager, if the user did not create a virtual space at that time in the space, the identifier is not hit and is meaningless.

In other words, the relationship between space S and user U can create an identifier with an encoder and separate S and U with a decoder, but even if a specific time T is attempted to be specified together, it is difficult to implement an encoder and decoder that can handle the flowing time T. , it is possible to designate a space that exists at a specific time by hashing this with an appropriate range of time using the hash function. This operation is mainly performed by the presence manager, making it possible to specify which spaces exist in the current time zone and which spaces existed in the past time zone.

However, the above function H does not deal with the qualifications of participants in the space, but it is sufficient to apply existing technologies related to credentials and data security, and the purpose of this function H is to identify the space around the user in a specific time and space. This is because the purpose is to share it.

In particular, considering that it will be used to support tourist convenience and safety for the tourist vulnerable, even in situations where the user device must appropriately judge a given situation, create a metaverse space, and request attention from someone due to reasons such as the user being unconscious, It can be applied.

100: Smartphone
200: Control module
201: GPS module
202: Wireless N/W communication module such as WiFi
203: Geomagnetic machine module
204: Inertial sensor module
205: Spatial recognition sensor module
300: Digital twin
301: Real world spatial information
302: Real space POI information
303: IoT device information
304: Presence manager (virtual object and connected user location and status management in DT)

Claims (8)

An augmented reality device comprising a 6DoF camera or an augmented reality camera and a control module for controlling the same;
A control that receives, stores, and controls the current location and posture information by connecting to GPS, WiFi, geomagnetic machine, gyroscope module, and surrounding space recognition sensor that can identify the user's current location and posture information installed in the augmented reality device. module;
A spatial information provision module that receives 3D spatial information of the traveler's location from DT (Digital twin) through the control module, creates a 3D augmented reality space and provides it through an augmented reality device; and
A metaverse tourism support module that searches for on-site personnel whose location is captured at the minimum distance from the user through the DT and requests on-site actions through an augmented reality device by sharing the user space with the users and on-site personnel; a digital twin including A tourism support system for the underprivileged based on tourism.
In claim 1,
The control module uses 6DoF (Degrees of Freedom) information obtained by summing the current location and posture information of GPS, WiFi, geomagnetic machine, gyroscope module, and surrounding space recognition sensors to determine which point and direction the user is currently facing. identify whether there is a
The control module forms an augmented reality space with photos taken by the user through the smartphone, uploads the augmented reality space to DT, and matches it to the corresponding point in the DT space to use the augmented reality space as a medium. By organically connecting the real world space and the digital twin space, real-time interaction is carried out between users of the augmented reality space and participants in the digital twin space.
The DT includes data on buildings and terrain information, the augmented reality space created by the user is matched to the DT, and the DT stores the pass-through image and 3D augmented reality space information transmitted by the augmented reality device in the DT space. A tourism support system for the underprivileged based on digital twin, which is characterized by being able to intuitively recognize the augmented reality space and the real-time situation of the user by combining with information.
In claim 1,
The DT includes data on buildings and terrain information, the augmented reality space created by the user is matched to the DT, and the DT combines real-time data from IoT devices around the identified augmented reality space to create an augmented reality space. and a tourism support system for the underprivileged based on digital twins, which is characterized by intuitive recognition of the user's real-time situation.
In claim 1,
Meta that can uniquely identify multiple individual augmented reality spaces in the area by using the space, administrative information, augmented reality user information, and visual information for creating the augmented reality space for the building included in the digital twin. By creating a bus space identifier and interpreting the space identifier submitted by other participants of the digital twin who want to participate in the space, the user-virtual space-real space can be recognized to allow participation in the metaverse space. A tourism support system for the underprivileged based on digital twins, which allows presence managers to share space through presence.
[Equation 1]
Spatial identifier (SID) = H ( S, U, T) = H( Enc(S, U), T)
(In this case, S = spatial information (location), U is the user, T is defined as time, and Enc has an inverse function Dec(), an encoder that can decode S and U again)
In claim 1,
By placing a virtual 3D object on a building object in the DT space and operating it, this object information can be expressed visually identically in the augmented reality space, and augmented reality users and digital twin participants can interact in real time through the 3D object. A tourism support system for the underprivileged based on digital twins, which is characterized by:
In claim 1,
When a digital twin participant places a virtual avatar representing himself or herself on a building object in the DT space and operates it, this avatar can be visually expressed identically in the augmented reality space, and the augmented reality user and digital twin participant can interact through the avatar. A tourism support system for the underprivileged based on digital twins that allows them to feel as if they exist, communicate, and act in the same space and time by interacting in real time.
Controlling a 6DoF camera or augmented reality camera to extract current location and posture information;
Identifying the user's current location and posture information through a control module;
Identifying which point and which direction the user is currently facing using 6DoF (Degrees of Freedom) information through the control module;
Forming a 3D augmented reality space around the user through the control module and uploading it to DT along with posture information;
Through the control module, the direction vector of the camera extracted from the 6DoF value is projected (raycast) to the corresponding point in DT space and compared with geographical features including a building that is detected (hit), and calculates the user's current location and posture. Method of supporting tourism for the underprivileged based on digital twin, including steps.
In claim 7,
Identifying what situation the traveler is in through the control module;
A step where a participant remotely participates in the metaverse space through the control module, communicates with the user in real time through DT, and takes necessary actions for the user;
It includes the step of remotely controlling an IoT device located in a space around the user through the DT,
The DT is a digital twin-based tourism support method for the underprivileged, characterized in that it searches for on-site personnel whose positions are captured at a minimum distance to the user and requests on-site action by sharing the user space with the users and on-site personnel.