KR20220095787A - Method and system for customzing network transmssion prameter - Google Patents

Abstract

A customized network transmission information quality adjustment method, according to an embodiment, which is a customized network transmission information quality adjustment method performed by a processor of a computing device of a first user by executing a first extended reality application, comprises the steps of: executing an extended reality communication service for transmitting and receiving extended reality image content to and from at least one another computing device; detecting a network environment with the other computing device; setting at least one image parameter of the extended reality image content according to the detected network environment; generating the extended reality image content according to the set image parameter; and transmitting communication data including the generated extended reality image content to the other user computing device.

Description

Method and system for adjusting the quality of customized network transmission information

The present invention relates to a method and system for adjusting the quality of customized network transmission information. More particularly, it relates to a method of customizing a parameter of content transmitted through a network according to a network transmission environment.

Recently, with interest in Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR) rapidly increasing, XR (eXtended Reality: XR) is also on the rise. The market for services and devices that provide users with an immersive experience is developing day by day.

Here, extended reality (XR) is a term that encompasses both virtual reality, augmented reality, and mixed reality technology, and its concept is through the process of convergence into a new type of device that can support both augmented reality, virtual reality and mixed reality. this was born

Extended reality (XR) technology is jointly utilizing many element technologies based on VR, AR, and MR, and various new experiences are possible as these technologies are applied to innovative and new types of devices that can be used. For example, extended reality (XR) technology is being applied to various industries ranging from manufacturing, architecture, games, imaging, medical care, education, shopping, marketing, tourism, automobiles or healthcare.

Meanwhile, as information and communication technology (ICT) develops, data communication based on a network is being actively performed.

Here, communication refers to a process of exchanging information expressed in data according to a set rule, that is, a communication protocol, between two or more communication devices using a transmission medium including a copper wire, an optical fiber, or a wireless link.

Recently, with the growth of extended reality (XR) technology, various activities of exchanging data related to extended reality (XR) based on networks are being conducted, but the communication device or network itself, communication environment, and/or between different communication devices Due to various reasons such as compatibility, it is difficult to transmit and receive data smoothly between communication devices performing communication, that is, communication.

10-1354133 B1

It is an object of the present invention to provide a customized method and system for adjusting the quality of network transmission information for transmitting/receiving by adjusting the quality of communication data based on extended reality customized to a user according to a network environment.

Another object of the present invention is to provide a customized method and system for adjusting the quality of network transmission information for generating and communicating communication data according to a measured network environment.

The customized network transmission information quality adjustment method according to the embodiment is a customized network transmission information quality adjustment method performed by executing a first extended reality application in a processor of a computing device of a first user, and includes at least one or more other computing devices and extended reality executing an extended reality communication service for transmitting and receiving video content; detecting a network environment with another computing device; setting at least one image parameter of the augmented reality image content according to the sensed network environment; generating extended reality image content according to the set image parameters; and transmitting communication data including the generated extended reality image content to the other user computing device.

In this case, the sensing of the network environment with the other computing device may include measuring bandwidths with a plurality of computing devices, respectively, and determining a smallest bandwidth among the measured bandwidths as a common bandwidth. .

In addition, the step of setting at least one image parameter of the extended reality image content according to the sensed network environment may include determining an extended reality image output mode, and the detected network environment in the determined extended reality image output mode. The method may include determining the image parameter based on .

In addition, the determining of the extended reality image output mode includes outputting a plurality of images of different image parameters, determining one image according to a user selection among the plurality of output images, and the determined It may include determining the image parameter with an image.

In addition, the determining of the image parameter based on the sensed network environment in the determined extended reality image output mode includes determining a network transmission parameter according to the sensed network environment, and according to the determined network transmission parameter The method may include determining a first image parameter and determining the remaining image parameters according to the determined first image parameter.

In addition, the determining of the image parameter based on the sensed network environment in the determined extended reality image output mode includes: fixing a second image parameter to a first value; determining an image parameter by calculating a third image parameter value when the second image parameter is a first value; and determining by recalculating the third image parameter when the first image parameter is changed have.

In addition, the generating of the extended reality image content according to the set image parameter may include: acquiring an image; providing a user interface for inputting a virtual object augmented in the acquired image; The method may include including the generated virtual object in the extended reality image content.

In addition, providing a user interface for inputting the augmented virtual object to the acquired image may include changing the acquired image according to the set image parameter, and inputting the virtual object according to the set image parameter. It may include the step of changing the type or shape of the pointer.

In addition, the providing of the user interface for inputting the augmented virtual object to the obtained image may include changing at least one of a type, shape, size, or color of the virtual object according to the set image parameter. have.

The method may further include determining meta information for the set image parameter, and matching the determined meta information with the set image parameter and storing the matched meta information.

The method and system for adjusting the quality of customized network transmission information according to an embodiment of the present invention process and transmit and receive data to be exchanged based on a network environment used for data communication, so that the customized generated with speed and quality optimized for the network use environment By exchanging data, it is possible to provide an optimal communication service within the extended reality environment.

In addition, the method and system for adjusting the quality of customized network transmission information according to an embodiment of the present invention generates and provides customized data based on a network environment used for data communication, so that even when exchanging data based on extended reality (XR) technology There is an effect that can minimize communication problems such as network communication load, buffering, or deterioration of data quality.

However, the effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood from the description below.

1 is a conceptual diagram of a customized network transmission information quality adjustment system according to an embodiment of the present invention.
2 is a conceptual diagram of providing an extended reality environment through a wearable type computing device according to an embodiment of the present invention.
3 is an internal block diagram of a wearable type computing device according to an embodiment of the present invention.
4 is a conceptual diagram of providing an extended reality environment through a mobile type computing device according to an embodiment of the present invention.
5 is an internal block diagram of a mobile type computing device according to an embodiment of the present invention.
6 is an internal block diagram of a desktop type computing device according to an embodiment of the present invention.
7 is a conceptual diagram of providing extended reality communication through a table-top type computing device according to an embodiment of the present invention.
8 is an internal block diagram of a table top type computing device according to an embodiment of the present invention.
9 is a flowchart illustrating a method for adjusting the quality of customized network transmission information according to an embodiment of the present invention.
10 is an example of a user interface for adjusting network transmission information quality according to an embodiment of the present invention.
11 is a flowchart illustrating a process of adjusting network transmission information quality in a normal mode according to an embodiment of the present invention.
12 is a flowchart illustrating a process of adjusting network transmission information quality in a sharpness mode according to an embodiment of the present invention.
13 is an example of a user interface for adjusting network transmission information quality in a custom mode according to an embodiment of the present invention.
14 is an example of a state of providing extended reality communication according to the network transmission information quality adjusted according to an embodiment of the present invention.

Since the present invention can apply various transformations and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail in the detailed description. Effects and features of the present invention, and a method for achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various forms. In the following embodiments, terms such as first, second, etc. are used for the purpose of distinguishing one component from another, not in a limiting sense. Also, the singular expression includes the plural expression unless the context clearly dictates otherwise. In addition, terms such as include or have means that the features or components described in the specification are present, and do not preclude the possibility that one or more other features or components will be added. In addition, in the drawings, the size of the components may be exaggerated or reduced for convenience of description. For example, since the size and thickness of each component shown in the drawings are arbitrarily indicated for convenience of description, the present invention is not necessarily limited to the illustrated bar.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, and when described with reference to the drawings, the same or corresponding components are given the same reference numerals, and the overlapping description thereof will be omitted. .

A customized network transmission information quality adjustment system (hereinafter, “communication system”) according to an embodiment of the present invention is a system in which users communicate with each other based on extended reality content through an extended reality application of a computing device.

Here, the extended reality environment refers to an environment created by inserting an image of a physical space around a user or a communication partner, users' voices, and related virtual content, and includes an augmented reality (AR) environment and a mixed reality (MR) environment. may include

The virtual content is virtual content generated by a computing device, and includes a label, text information, an image, a drawing object, and a three-dimensional entity, and is augmented/mixed generated in response to the physical space or an image obtained by photographing the physical space. it's content

And the extended reality communication (XR Communication) is a communication data (Communication data) including immersive media (eg, video, voice) including the virtual content for mutual communication between different users through a computing device. means activity.

That is, the communication system according to the embodiment communicates virtual content related to a physical space or a photographed image as an additional medium along with voice and image, which are communication media of general communication, to support multi-party communication in an extended reality environment.

In this case, the communication data may include voice, image, and/or virtual content exchanged by computing devices of different users (eg, remote administrators and field workers) through a network, and the extended reality image content is It may include an image of at least one of the users in the surrounding space and virtual content matched to the image. In an embodiment, communication data may be transmitted/received based on a network by a computing device and/or a server or the like.

In an embodiment, the communication system may provide an extended reality communication environment optimized for the communication environment by providing different communication data communication methods according to the communication environment of the user's computing device.

In addition, the communication system according to the embodiment may provide an optimal communication environment by customizing transmission-related parameters of extended reality image content, which is the main content in the communication data, according to the network environment.

For example, one user creates virtual content based on an image captured around at least one user among a plurality of users to create extended reality image content, and parameters of extended reality image content customized to the user according to the network environment After adjusting, it can be transmitted.

Hereinafter, for convenience of description, an example in which roles are divided according to a subject, environment, and/or purpose of using the computing device will be described.

In an embodiment, the computing device may be divided into a first user computing device and a second user computing device. In more detail, the first user computing device is a computing device of a remote manager located remotely from a work site, and may transmit/receive communication data to and from the second user computing device based on a wired/wireless network. In addition, the third user computing device may be a computing device of another remote manager, and may be a device that receives communication data for the extended reality environment provided by the first user computing device and outputs the extended reality environment. According to circumstances, the third user computing device may also generate and provide virtual content with respect to the image of the work site.

In the following description, the first user computing device provides an extended reality environment based on the captured image received from the computing device of the field worker, and in the provided extended reality interface environment, in order to deliver a message to the field worker according to the first user input It will be described based on the computing device of the task manager that generates communication data.

Here, the remote manager may be a person who creates virtual content and provides work guidance to the field worker instructing or assisting the work of the field worker at a location remote from the site where the work is being performed.

In addition, the field worker may be a person who performs an actual job based on the extended reality environment provided through the job guidance received at the job site.

In another embodiment, an embodiment in which the field worker transmits the expanded reality image content generated by generating the work guidance as virtual content in the surrounding photographed image to the remote manager will also be possible.

In the following description, the first user and the third user are remote administrators, and the second user is a field worker.

Hereinafter, the detailed configuration of such a communication system will be described in detail.

<Customized network transmission information quality adjustment system>

1 is a conceptual diagram of a customized network transmission information quality adjustment system according to an embodiment of the present invention.

Referring to FIG. 1 , a customized network transmission information quality adjustment system according to an embodiment of the present invention includes computing devices 100 , 101 , 200 , 300 , 400 providing an extended reality environment, and computing devices 100 , 101 , 200, 300, and 400) may include a communication data relay computing system system 500 (hereinafter, “server system”) for relaying communication data to and from each other.

The computing device and the server system 500 may measure the speed of a network used for data communication by interworking, and may perform extended reality (XR) communication in which data is processed and communicated based on the measured network environment. have.

Each of these components of FIG. 1 may be connected through a network. The network refers to a connection structure capable of exchanging information between each node, such as a computing device and a data relay computing system system 500 , and an example of such a network includes a 3rd Generation Partnership Project (3GPP) network, a Long Term (LTE) network, and the like. Evolution) network, WIMAX (World Interoperability for Microwave Access) network, Internet (Internet), LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), Bluetooth (Bluetooth)

networks, satellite broadcast networks, analog broadcast networks, Digital Multimedia Broadcasting (DMB) networks, and the like are included, but are not limited thereto.

- Server system (500)

In an embodiment, the server system 500 may perform a series of processes for providing an extended reality (XR) communication service.

In detail, the server system 500 may relay exchange of communication data transmitted/received based on a network between user computing devices and a communication repeater.

The server system 500 may include a data relay computing system, a data processing computing system, a virtual content database, and a spatial information database.

In detail, the data relay computing system may include a communication facility for data relay, a server, a computing device, and the like, and relay communication data to/from the computing devices through a wired/wireless communication network. For example, the data relay computing system may perform a relay role of transferring communication data transmitted/received between the computing device of the first user and the computing device of the second user.

In addition, the data processing server may perform a role of processing the extended reality image content in the communication data with image parameters set according to the network environment.

However, in the embodiment, it will be described that the role of processing communication data according to the communication mode according to the network environment is performed by the computing device of the user who produces the extended reality image content.

In addition, virtual content data for implementing an augmented reality environment or a mixed reality environment may be stored in the virtual content database. The virtual content database may store the virtual content as virtual content by matching the virtual content with a real object (eg, a marker) or spatial coordinates.

In addition, the virtual content database may serve as a virtual content source for delivering virtual content matched to the surrounding physical space of the computing device upon request of the computing device.

In addition, the spatial information database may store information data on the physical space by scanning the physical space of a specific area or modeling the three-dimensional space. In addition, characteristic information obtained by image-learning a real object, a marker, etc. in a physical space may be further stored, the characteristic information may be matched with spatial information and stored, and such information may be stored as meta information.

In addition, the spatial information database may additionally store image parameters set according to the network environment by matching the meta information. Through this, when performing extended reality communication with respect to specific meta information, the user can communicate through the extended reality image adjusted according to preset image parameters.

That is, the server system 500 may provide an augmented reality environment or an extended reality environment through the computing device by transmitting virtual content data and spatial information data about the surrounding physical space of the computing device together.

The server system 500 may include at least one computing server and a database server, and may include processors for data processing and memories for storing instructions for providing a communication relay service.

- Computing device

The computing device may provide an extended reality environment to the user and execute an extended reality application capable of communicating with other users using virtual content corresponding to voice, image, and real objects within the extended reality environment.

The computing device may include various types of computing devices (eg, wearable type, mobile type, desktop type, or table top type) in which the extended reality application is installed.

1. Wearable type computing device (100, 101)

2 is a conceptual diagram of experiencing an extended reality environment through a wearable-type computing device according to an embodiment of the present invention, and FIG. 3 is an internal block diagram of the wearable-type computing device according to an embodiment of the present invention.

The computing devices 100 and 101 according to the embodiment may include a wearable type computing device such as a smart glasses display or a head mounted display (HMD).

The smart glass type computing device 100 is a display system including glasses that display virtual content (eg, virtual object image) on the user's field of vision while transmitting light so that the user can see the surrounding physical space while worn. may include

Specifically, the computing device 100 of an embodiment may include a transparent glass display that transmits light from the surrounding physical space to reach the user's eyes, while at the same time reflecting the virtual content displayed by the display system towards the user's eyes. can

For example, referring to FIG. 2 , the extended reality application of the computing device 100 may recognize an image of a real object (RO) and a marker (MK) within the real object in the surrounding physical space 20 , and recognize It is possible to control to display the virtual content VC1 in the user's field of view corresponding to the displayed marker MK.

In addition, the extended reality application can recognize the learned real object, and control to display the virtual content VC2 in the user's field of view corresponding to the position of the recognized real object, thereby providing the extended reality image content. .

In addition, the extended reality application can recognize a physical space through a learned real object or marker (MK), and display virtual content matched to a specific location in the recognized space so as to correspond to the user's field of view, thereby providing an extended reality image content can be provided.

Such virtual content may include visual content, such as an image or video, that may be displayed in a portion of the user's field of view on the computing device. For example, the virtual content may include virtual object images overlaying various parts of the physical space. This virtual object image may be rendered as a 2D image or a 3D image.

According to an embodiment, the head-mounted display type computing device 101 may provide extended reality image content by displaying an augmented reality image in which a virtual object is augmented with respect to a captured image in an area of a user's field of view. have.

The head mounted display type computing device 101 may block light to the surrounding physical space so that the displayed image can be viewed only by the display system. The head-mounted display type computing device may output a 3D image by outputting different images with an offset in parallax to each of the left and right eye displays in order to recognize the 3D scene.

In addition, the head-mounted display type computing device 101 may provide an extended reality environment by outputting an image of the surrounding physical space and virtual content generated based on the captured image as a 3D image.

In addition, the head-mounted display type computing device 101 may provide a user interface for generating extended reality image content by generating a virtual object according to a user input based on an image captured in the surrounding physical space or physical space. .

In addition, the head-mounted display type computing device 101 provides extended reality image content by outputting an extended reality image augmented with virtual content generated based on a captured image of a user or another user on an area. may be

Hereinafter, specific components will be described focusing on a smart glass type computing device among these wearable type devices.

Referring to FIG. 3 , a computing device 100 according to an exemplary implementation includes a memory 110 including an extended reality application, a processor assembly 120 , a communication module 130 , an interface module 140 , and an input system ( 150 ), a sensor system 160 , and a display system 170 . In addition, the components may be implemented to be included in the housing of the computing device 100 .

The memory 110 stores the extended reality application 111 , and the extended reality application 111 may include virtual content for providing an extended reality environment, an image buffer, a location engine, a virtual content display engine, and the like. That is, the memory 110 may store commands and data that can be used to create an extended reality environment.

In an embodiment, the extended reality application 111 may include a communication application for performing communication based on the extended reality environment. The communication application may include various applications, engines, data, and commands for providing a network environment responsive extended reality communication service.

Also, the memory 110 may include at least one or more non-transitory computer-readable storage media and a temporary computer-readable storage medium. For example, the memory 110 may be various storage devices such as ROM, EPROM, flash drive, hard drive, and the like, and web storage that performs a storage function of the memory 110 on the Internet. may include

The processor assembly 120 may include at least one processor capable of executing instructions of the extended reality application 111 stored in the memory 110 to perform various tasks for generating the extended reality environment.

In an embodiment, the processor assembly 120 may control overall operations of components through the extended reality application 111 of the memory 110 in order to provide an extended reality (XR) communication service.

For example, the processor assembly 120 may recognize a real object from an image obtained based on the image sensor, and generate and display an augmented reality image matching the recognized real object with virtual content. ) can be controlled.

The processor assembly 120 may include a central processing unit (CPU) and/or a graphics processor unit (GPU). In addition, the processor assembly 120, ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), controllers (controllers) ), micro-controllers, microprocessors, and other electrical units for performing other functions.

Communication module 130 may include one or more devices for communicating with other computing devices (eg, server system 500 ). The communication module 130 may communicate through a wireless network.

In detail, the communication module 130 may communicate with a computing device storing a virtual content source for implementing an extended reality environment, and may communicate with various user input components such as a controller that has received a user input.

In an embodiment, the communication module 130 may transmit and receive communication data related to an extended reality (XR) communication service with the server system 500 and/or other computing device 100 .

Such a communication module 130, the technical standards or communication methods for mobile communication (eg, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), 5G NR (New Radio), WIFI) Alternatively, data may be wirelessly transmitted/received with at least one of a base station, an external terminal, and an arbitrary server on a mobile communication network constructed through a communication device capable of performing a short-range communication method.

The sensor system 160 may include various sensors such as an image sensor 161 , a position sensor IMU 163 , an audio sensor, a distance sensor, a proximity sensor, and a contact sensor.

The image sensor 161 may capture an image and/or an image of a physical space around the computing device 100 .

In an embodiment, the image sensor 161 may capture and acquire an image related to an extended reality (XR) communication service.

In addition, the image sensor 161 is disposed on the front or / and rear of the computing device 100 to obtain an image by photographing the disposed direction side, and a camera disposed toward the outside of the computing device 100 . Through this, it is possible to photograph a physical space such as a work site.

The image sensor 161 may include an image sensor 161 and an image processing module. Specifically, the image sensor 161 may process a still image or a moving image obtained by the image sensor 161 (eg, CMOS or CCD).

Also, the image sensor 161 may process a still image or a moving image obtained through the image sensor 161 using an image processing module to extract necessary information, and transmit the extracted information to the processor.

The image sensor 161 may be a camera assembly including at least one camera. The camera assembly may include a general camera that captures a visible light band, and may further include a special camera such as an infrared camera or a stereo camera.

The IMU 163 may sense at least one of a motion and an acceleration of the computing device 100 . For example, it may consist of a combination of various position sensors such as an accelerometer, a gyroscope, and a magnetometer. In addition, by interworking with the location communication module 130 such as GPS of the communication module 130 , spatial information about the physical space around the computing device 100 may be recognized.

In addition, the IMU 163 may detect information for detecting and tracking the user's gaze direction and head movement based on the detected position and direction.

Also, in some implementations, the augmented reality application 111 may use such an IMU 163 and the image sensor 161 to determine the location and orientation of a user in the physical space or to recognize a feature or object in the physical space. .

The audio sensor 165 may recognize a sound around the computing device 100 .

In detail, the audio sensor 165 may include a microphone capable of detecting a voice input of a user of the computing device 100 .

In an embodiment, the audio sensor 165 may receive voice data of communication data to be transmitted through the extended reality communication service from the user.

The interface module 140 may communicatively connect the computing device 100 with one or more other devices. Specifically, the interface module 140 may include wired and/or wireless communication devices compatible with one or more different communication protocols.

The computing device 100 may be connected to various input/output devices through the interface module 140 .

For example, the interface module 140 may be connected to an audio output device such as a headset port or a speaker to output audio.

For example, although it has been described that the audio output device is connected through the interface module 140 , an embodiment in which the audio output device is installed inside the computing device 100 may also be included.

Such an interface module 140, a wired / wireless headset port (port), an external charger port (port), a wired / wireless data port (port), a memory 110 card (memory card) port, a device equipped with an identification module port, audio I/O (Input/Output) port, video I/O (Input/Output) port, earphone port, power amplifier, RF circuit, transceiver and It may be configured to include at least one of other communication circuits.

The input system 150 may detect a user's input (eg, a gesture, a voice command, operation of a button, or other type of input) related to an extended reality (XR) communication service.

Specifically, the input system 150 may include a button, a touch sensor, and an image sensor 161 that receives user motion input.

Also, the input system 150 may be connected to an external controller through the interface module 140 to receive a user's input.

A virtual object for the surrounding physical space may be generated according to a user input input through the input system 150 , and the processor assembly may provide a user interface for generating extended reality image content through the input system 150 as described above. can

The display system 170 is a transparent glass that transmits light from the physical space surrounding the computing device 100 to reach the user's eyes while reflecting the virtual content displayed by the display system 170 towards the user's eyes. It may include a display.

The display system 170 may include a left display 171 corresponding to the left eye of the user wearing the computing device 100 and a right display 172 corresponding to the right eye of the user wearing the computing device 100 , and the left display 171 and The right display 172 outputs different images with an offset to the parallax as virtual content, so that the user may recognize the virtual content as a 3D image.

In an embodiment, the display system 170 may output various information related to an extended reality (XR) communication service as a graphic image.

Such displays include a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display. , a three-dimensional display (3D display), may include at least one of an electronic ink display (e-ink display).

The wearable type computing device 100 may be advantageous for use by field workers located in a physical space such as a work site.

2. Mobile type computing device 200

4 is a conceptual diagram of experiencing an extended reality environment through a mobile-type computing device according to an embodiment of the present invention, and FIG. 5 is an internal block diagram of a mobile-type computing device according to an embodiment of the present invention.

In another example, the computing device 200 may be a mobile device such as a smart phone or a tablet PC on which an extended reality application is installed. The mobile type computing device 200 provides an extended reality environment to the user by capturing an image of the surrounding physical space with an image sensor, and displaying the image captured through the display system and virtual content displayed by matching the physical space. can

For example, the computing device may include a smart phone, a mobile phone, a digital broadcasting terminal, personal digital assistants (PDA), a portable multimedia player (PMP), a tablet PC, and the like.

Referring to FIG. 4 , the extended reality application of the mobile type computing device 200 may capture images of real objects (RO) and markers (MK) in the surrounding physical space 20 and display them by controlling the display system. . In addition, the extended reality application may control to display the virtual content VC1 at a position corresponding to the recognized marker MK. In addition, the augmented reality application may learn and recognize a specific real object, and may control to display the virtual content VC2 in the user's field of view corresponding to the recognized location of the specific real object.

Referring to FIG. 5 , a mobile type computing device 200 according to an exemplary implementation includes a memory 210 , a processor assembly 220 , a communication module 230 , an interface module 240 , an input system 250 , and a sensor. may include a system 260 and a display system 270 . These components may be configured to be included within a housing of the computing device 200 .

The overlapping contents among the descriptions of the components of the mobile type computing device 200 will be replaced with the descriptions of the components of the wearable type computing device 100, and below, the differences with the wearable type computing device 100 will be described. explained in the center.

The above components may be disposed within the housing of the mobile type computing device 200 , and the user interface may include a touch sensor 273 on a display 271 configured to receive user touch input.

In detail, the display system 270 may include a display 271 that outputs an image, and a touch sensor 273 that detects a user's touch input.

For example, the display 271 may be implemented as a touch screen by forming a layer structure with each other or integrally formed with the touch sensor 273 . Such a touch screen may function as a user input unit that provides an input interface between the computing device 200 and the user, and may provide an output interface between the computing device 200 and the user.

The display system 270 can provide an extended reality environment by outputting extended reality image content, and also provides an input/output interface for generating virtual objects by receiving a user input for a displayed captured image. may provide.

Also, the sensor system 260 includes an image sensor 261 , and for example, the image sensor 261 may be disposed on one side and the other side of the housing of the computing device 200 .

In this case, the image sensor on one side may be oriented toward the physical space to capture an image photographed in the physical space, and the image sensor on the other side may be oriented toward the user side to capture the user's view, gesture, and the like.

The mobile type computing device 200 may be suitable for a field worker located in a physical space, such as a job site.

3. Desktop type computing device (300)

6 is an internal block diagram of a desktop type computing device according to an embodiment of the present invention.

In the description of the above components of the desktop type computing device, the overlapping contents will be replaced with the description of the components of the wearable type computing device 100 . Hereinafter, the difference with the wearable type computing device 100 will be mainly Explain.

Referring to FIG. 6 , in another example, the computing device 300 is wired/wireless, such as a personal computer such as a fixed desktop PC, a notebook computer, and an ultrabook, in which the extended reality application 311 is installed. A device in which a program for executing an extended reality (XR) communication service based on communication is installed may be further included.

The desktop-type computing device 300 receives an image photographed in the surrounding physical space from the computing device 300 of another user, and augments and displays the received image and virtual content matched to the physical space, thereby expanding A real environment may be provided to the user.

In addition, the desktop type computing device 300 may receive communication data from another user and output extended reality image content from the received communication data to provide an extended reality environment to the user.

In addition, the desktop type computing device 300 includes the user interface system 350 to receive user input (eg, touch input, mouse input, keyboard input, gesture input, motion input using a guide tool, etc.). can

Illustratively, the computing device 300 includes a mouse 351 , a keyboard 352 , a gesture input controller, an image sensor 361 (eg, a camera) and an audio sensor (eg, a camera) using the user interface system 350 with various communication protocols. 365), etc., may be connected to at least one device to obtain a user input.

In addition, the desktop type computing device 300 may be connected to an external output device through the user interface system 350 , for example, the display device 370 , an audio output device, or the like.

In an exemplary implementation, the extended reality application 311 of the desktop computing device 300 may obtain and output an image of the computing device 300 of another user through the display device 370 , and correspond to the image. A user input may be received and virtual content corresponding to an image may be generated according to the received user input.

Also, the extended reality application 311 may receive data from the sensor system 260 or a previously matched virtual content source in the physical space of the image, and may generate the received data as virtual content matched with the image.

In addition, the extended reality application 311 may provide an extended reality environment to the user by overlaying the generated virtual content on an image output from the display device and outputting it.

In addition, the augmented reality application 311 may transmit the virtual content generated through the communication module 330 as communication data, and use the virtual content corresponding to the physical space as well as voice and image as a communication medium. .

The desktop type computing device 300 according to the example implementation may include a memory 310 , a processor assembly 320 , a communication module 330 , a user interface system 350 , and an input system 340 . These components may be configured to be included within a housing of the computing device 300 .

In the description of the above components of the desktop type computing device 300 , the overlapping contents will be replaced with the description of the components of the wearable type computing device 300 .

Such a desktop type computing device 300 may be advantageous for use by a remote manager that remotely transmits instructions or necessary information in conjunction with the computing device 300 of a field worker.

4. Table Top Type Computing Device 400

According to an exemplary implementation, the tabletop type computing device 400 may be implemented in a new shape and structure different from that of the existing desktop type computing device 300 , and in this case, the tabletop type computing device 400 may be An extended reality environment can be provided through the included system.

In the description of the components of the table-top type computing device 400 , the overlapping contents will be replaced with the description of the components of the desktop type computing device 300 . Hereinafter, the desktop type computing device 300 . The difference between and will be explained.

7 is a conceptual diagram of experiencing extended reality communication through a table-top type computing device according to an embodiment of the present invention, and FIG. 8 is an internal block diagram of the table-top type computing device according to an embodiment of the present invention.

The tabletop type computing device 400 means that a remote administrator can easily check an image received from a computing device of a field worker, and easily input operation guidance for an object displayed on the image based on virtual content It may be a device that provides an interface system for

That is, the tabletop type computing device 400 generates an augmented/mixed reality image in which virtual content generated based on a real object of an image acquired at a current location is displayed on an image acquired from a computing device of another user. And it may be a system that provides.

7 and 8 , an exemplary table top type computing device 400 includes a memory 410 , a processor assembly 420 , a communication module 430 , an interface module 440 , an input system 450 , It may include a sensor system 460 and a display system 470 .

These components may be configured to be included within a housing of computing device 400 . In the description of the components of the table-top type computing device 400, the overlapping contents will be replaced with the description of the above-described components, and the following description will focus on the differences.

Referring to FIG. 7 , an exemplary table-top type computing device 400 outputs a captured image captured by another computing device through a display system 470 and virtual content related to the captured image to provide an extended reality environment to the user. can provide

In addition, the table-top type computing device 400 provides an input/output interface for receiving a touch input such as pointing and dragging a user for a captured image through a touch sensor 473 on the display 471 of the display system 470 . can do.

In addition, the table top type computing device 400 may receive a gesture input of the user's hands LH and RH through the sensor system 460 (eg, the image sensor 461 ) disposed on the display system 470 . and may receive a motion input according to a guide tool (GT). The gesture input and the motion input of the guide tool may also be input to the display 471 in response to the captured image, and the computing device 300 may detect the user input by matching the real object image displayed on the captured image.

That is, the extended reality application 411 of the tabletop type computing device 400 according to the embodiment is a series for implementing a service provided by visualizing virtual content based on a user input obtained through the sensor system 460 . process can be executed. In this case, since the user input is performed in response to the captured image displayed on the display, by providing the input/output interface together, the user may more intuitively allow the user to input the captured image.

<How to adjust the quality of customized network transmission information>

Hereinafter, with reference to the accompanying drawings, a method of providing an extended reality (XR) communication service by adjusting the quality of customized network transmission information between a computing device of a first user, a computing device of a second user, and a computing device of a third user will be described in detail. I would like to explain

For convenience of description, the second user computing device will be described with reference to the mobile type computing device 200 , and the first user computing device and the third user computing device will be described with reference to the desk type computing device 300 .

In addition, the extended reality application of the first user computing device will be referred to as a first extended reality application, the extended reality application of the second user computing device will be referred to as a second extended reality application, and the extension of the third user computing device will be referred to as an extended reality application. The reality application is referred to as a third extended reality application.

9 is a flowchart illustrating a method for adjusting the quality of customized network transmission information according to an embodiment of the present invention.

Referring to FIG. 9 , in an embodiment of the present invention, a first user computing device may execute a first extended reality application for extended reality (XR) communication with at least one or more second user computing devices. In addition, the third user computing device may participate in extended reality communication through the third extended reality application.

The executed first augmented reality application may determine an extended reality image output mode. (S101)

The extended reality image output mode may provide extended reality image content according to the extended reality image parameter set by setting the extended reality image parameter according to the network environment.

Here, the extended reality image parameters may include resolution (PPI), frames per second (FPS), and data rate per second (hereinafter, bit rate (bps)).

This extended reality image output mode may be determined as a previously set output mode. That is, it can be automatically determined upon re-execution to the output mode set during previous execution.

In addition, in the extended reality image output mode, when meta information is included in the communication data and the output mode is set by matching the meta information, the extended reality image output mode may be determined as the output mode.

Here, the meta information may include information about at least one of a work type, a work target object, a location, and a user account.

For example, when the first equipment that requires precise work is included in the captured image, and the meta information includes the first equipment and the first output mode for the first equipment, the first output mode is set to the extended reality image output mode can be decided with

In addition, the extended reality image output mode may be set according to user selection. For example, the first user may directly change the extended reality image output mode, or the second or third user requests to change the extended reality image output mode and the output mode is changed according to the acceptance of the first user. may be

There is a user who shoots a captured image, which is the basis of the extended reality image content, and a user who creates virtual content for realizing the extended reality for the captured image, and the two users may be the same person or different people.

Here, since the user who creates the virtual content and creates the extended reality image content performs the extended reality image content creation task, the extended reality image output mode is finally determined among the users who participated in a plurality of communication and is applied to the determined extended reality image output mode. Therefore, it may be a user who creates and shares extended reality video content.

Hereinafter, in the description, the first user is described as a user who creates the extended reality video content, and the description is based on the generation of the extended reality video content from the captured image taken by the second user, but the roles are different or one person Examples such as performing all roles may be included.

Next, the first extended reality application may detect a network environment for communication data transmission and reception. (S102)

In detail, the first extended reality application may detect a network environment between the first user and the server system 500 or/and a network environment with other users through the server system 500 .

For example, the first extended reality application can measure the network environment for exchanging communication data with the extended reality application of the second and third users with network transmission parameters such as bandwidth and transmission rate per second. have.

In addition, the first augmented reality application may determine a network transmission parameter for communication data transmission/reception according to the sensed network environment. (S103)

In general, the first augmented reality application may individually determine network transmission parameters according to a network environment with each other user.

In an embodiment, the network transmission parameter may be a bandwidth for sending and receiving communication data with other computing devices, transmitting and receiving communication data with a commonly preset bandwidth for all computing devices, or in a network environment measured for each computing device. Therefore, communication data can be transmitted and received with different bandwidths.

However, when the network transmission parameters are individually set differently, the data processing load of the first computing device may increase because the augmented reality image content must also be generated (eg, encoded) differently according to the differently set network transmission parameters.

Accordingly, in an embodiment, the first augmented reality application may set the network transmission parameter of a user having the smallest network transmission parameter among at least one or more users participating in communication in common to a plurality of other computing devices.

When the network transmission parameter is determined, the extended video content parameter may be determined based on the network transmission parameter determined in the shooting mode of the extended reality video content. (S105)

The extended reality image output mode according to the embodiment may include a plurality of output modes, and the plurality of output modes may include a custom mode in which the user can set each extended reality image parameter.

For example, referring to FIG. 10 , the extended reality image output mode may include a normal mode 61i and a sharpness mode 62i, and includes a custom mode, an easy mode 63i and an expert mode 64i. can do.

In an embodiment, the expert mode may be a custom mode that provides a user interface for setting each parameter of the image parameter numerically.

For example, referring to FIG. 10 , a user interface for setting by inputting at least one of resolution, FPS, and bit rate through the scroll bars 71i, 72i, and 73i may be provided.

In this case, at least one of the image parameters, for example, a bit rate, may be automatically set according to the determined network transmission parameter.

The first user may determine the resolution and FPS of the extended reality video content according to the set bit rate through the expert mode user interface of the first augmented reality application.

In an embodiment, when one value of resolution or FPS is designated, the first augmented reality application may calculate and automatically set the other value according to a preset bit rate. For example, if the bit rate is automatically set to 2Mbps according to the determined bandwidth and the first user sets the resolution to 720PPi, the pointer P1 for setting the FPS may move the automatically calculated FPS value to 24.

In this case, the expert mode user interface may designate an image parameter to be changed and an image parameter to be fixed according to a change in the network environment and increase or decrease in bandwidth and corresponding bit rate.

For example, the expert mode user interface can set the resolution as a fixed video parameter, and set the FPS as a variable video parameter. Depending on the network environment, if the bitrate increases, the FPS increases, and if the bitrate decreases, the FPS is set. can be reduced

Also, the expert user interface may set one parameter among the image parameters as a priority parameter. For example, when the resolution is set as a priority parameter in the expert user interface, it is possible to set the resolution to increase if the bit rate increases according to the network environment, and to decrease the FPS if the bit rate decreases.

Through this custom mode setting, the user can create customized extended reality video content according to the network environment. However, if you are not an expert, your understanding of image parameters may be low, so it may be difficult to set the desired image content.

To this end, the first extended reality application may provide the easy mode as another custom mode.

Here, in the easy mode, the first user sets a parameter for generating the augmented reality image content through a user input through the first augmented reality application.

In an embodiment, the easy mode provides a user interface that is set through a user's voice input, so that a field worker or a user using a wearable device can easily set an image parameter.

The easy mode user interface may automatically set a bit rate, which is at least one of the extended reality image parameters, according to the determined network transmission parameter.

In addition, a plurality of extended reality images having different extended reality image parameter values within a set bit rate may be output to be selectable.

For example, referring to FIG. 13 , as a plurality of extended reality images transmittable at a set bit rate, a first extended reality image 21i having a first resolution and a first FPS, and a second resolution and a second FPS are displayed. A second extended reality image 22i having a second extended reality image 22i, a third extended reality image 23i having a third resolution and a third FPS, and a fourth extended reality image 24i having a fourth resolution and a fourth FPS are separated from each other. You can print to the area. Here, the extended reality image may be a pre-produced sample image or an extended reality image to be provided actually encoded with different parameters.

According to an embodiment, the resolution value may decrease from the first resolution to the fourth resolution, and the FPS value may increase from the first FPS to the fourth FPS.

The first user may select one image from the first augmented reality image to the fourth augmented reality image through voice input, etc., and the parameter of the selected extended reality image is set as the extended reality image parameter value, thereby expanding according to the network environment Real image parameters can be easily customized to the user.

In another embodiment, the first augmented reality application may provide a user interface for setting step-by-step settings according to image parameters in the easy mode.

For example, the first extended reality application provides to select a plurality of extended reality images with different resolutions and fixed FPS primarily to set the resolution of the extended reality image content, and secondarily to change the FPS and It is possible to set the FPS of the extended reality image content by providing a plurality of extended reality images with a fixed resolution to be selectable.

At this time, the first augmented reality application calculates the maximum value of the second parameter that can be transmitted within the preset bit rate according to the first parameter selected primarily, and a plurality of extended reality images generated within the maximum value of the second parameter. Content can also be provided so that it can be selected.

Meanwhile, the first augmented reality application may provide a general mode and a sharpness mode in which a fixed parameter is designated in an image parameter and the remaining parameters other than the fixed parameter are changed according to a bit rate that is changed according to a network environment.

In detail, referring to FIG. 11 , the normal mode according to the embodiment may provide extended reality video content in which the resolution is changed within a bit rate determined according to a network environment in a mode in which the FPS is fixed.

In detail, when the normal mode is set, the first augmented reality application may set the first image parameter to a fixed value. (S201)

For example, the first augmented reality application may set a parameter of the extended reality image content to 30 FPS as a fixed value.

And when remote collaboration access is made, the first augmented reality application may detect the computing devices and network environments of a plurality of participating users. (S202, S203)

For example, the first augmented reality application may detect network environments of the second computing device and the third computing device, and determine a minimum network transmission parameter among the second computing device and the third computing device as the network transmission parameter. . (S204)

In addition, in a state in which the first image parameter is fixed according to the determined network transmission parameter, the remaining image parameters may be calculated and determined. (S205)

For example, when the minimum network transmission parameter exceeds 3 Mbps, the first extended reality application may determine a preset maximum value of 2.5 Mbps as the bit rate. And if it is 30 FPS within a bit rate of 2.5 Mbps, the maximum resolution of the image can be calculated as 720 ppi.

Through this, in the normal mode, image parameters according to the network environment may be determined to have a resolution of 720 ppi, frames per second of 30 FPS, and a bit rate of 2.5 Mbps.

In addition, if the minimum network transmission parameter is a first section between 3Mbps and 1Mbps, the first extended reality application may determine a bit rate of 1Mbps, which is a preset value, within the first section. And if it is 30 FPS within the bit rate of 1 Mbps, the maximum resolution of the image can be calculated as 360 ppi.

Through this, the image parameters according to the network environment in the normal mode may be determined to have a resolution of 360 ppi, a frame per second of 30 FPS, and a bit rate of 1 Mbps.

Also, if the minimum network transmission parameter is a second section between 1Mbps and 0.5Mbps, the first extended reality application may determine a bit rate of 0.75Mbps, which is a preset value, within the second section. And if it is 30 FPS within a bit rate of 0.75 Mbps, 240 ppi, which is the maximum resolution value of the image, can be calculated so that it can be transmitted.

Through this, the image parameters according to the network environment in the normal mode may be determined to have a resolution of 240 ppi, a frame per second of 30 FPS, and a bit rate of 0.75 Mbps.

In addition, the first augmented reality application may generate an extended reality image according to the determined image parameter and transmit it to the computing devices of the participating users according to the minimum network transmission parameter. (S208)

That is, in the general mode, by providing a frame at a constant speed regardless of the network environment, real-time job information sharing can be utilized as a mode for important collaboration.

Also, referring to FIG. 12 , the sharpness mode according to the embodiment may provide extended reality video content in which the FPS is changed within a bit rate determined according to a network environment in a mode in which a resolution is fixed.

In detail, when the sharpness mode is set, the first augmented reality application may set the second image parameter to a fixed value. (S301)

For example, the first augmented reality application may set a parameter of the extended reality video content to 720ppi as a fixed resolution value.

And when remote collaboration access is made, the first augmented reality application may detect the computing devices and network environments of a plurality of participating users. (S302, S303)

For example, the first augmented reality application may detect network environments of the second computing device and the third computing device, and determine a minimum network transmission parameter among the second computing device and the third computing device as the network transmission parameter. . (S304)

In addition, in a state in which the second image parameter is fixed according to the determined network transmission parameter, the remaining image parameters may be calculated and determined. (S305)

For example, when the minimum network transmission parameter exceeds 3 Mbps, the first extended reality application may determine a preset maximum value of 2.5 Mbps as the bit rate. And if the resolution is 720ppi within the bitrate of 2.5Mbps, the maximum FPS value of the image can be calculated as 30 so that it can be transmitted.

Through this, the image parameter according to the network environment in the sharpness mode may be determined as a resolution of 720 ppi, a frame per second of 30 FPS, and a bit rate of 2.5 Mbps.

In addition, if the minimum network transmission parameter is a first section between 3 Mbps and 1 Mbps, the first extended reality application may determine a bit rate of 2 Mbps, which is a preset value, within the first section. And if the resolution is 720ppi within the bitrate of 2Mbps, the maximum FPS of the video can be calculated as 24 so that it can be transmitted.

Through this, the image parameters according to the network environment in the sharpness mode may be determined to have a resolution of 720 ppi, frames per second of 24 FPS, and a bit rate of 2 Mbps.

Also, if the minimum network transmission parameter is a second section between 1Mbps and 0.5Mbps, the first extended reality application may determine a bit rate of 1Mbps, which is a preset value, within the second section. And if the resolution is 720ppi within the bitrate of 1Mbps, the maximum FPS value of the transmittable image can be calculated as 10.

Through this, the image parameters according to the network environment in the sharpness mode may be determined to have a resolution of 720 ppi, frames per second of 10 FPS, and a bit rate of 1 Mbps.

In addition, the first augmented reality application may generate an extended reality image according to the determined image parameter and transmit it to the computing devices of the participating users according to the minimum network transmission parameter. (S308)

That is, in the sharpness mode, it can be used as a mode for collaboration in which precise sharing of work information is important by providing an image with a constant quality regardless of the network environment.

Returning to the description of FIG. 9 , in this embodiment, the first augmented reality application may generate and transmit communication data according to the finally determined image parameter of the output mode. (S107)

In detail, the first augmented reality application may generate communication data including voice data to be transmitted to the first user, extended reality image content, and the like.

Here, the first augmented reality application may generate extended reality image content according to the determined image parameter and include it in the communication data.

In an embodiment, the extended reality image content may include an augmented reality image in which a virtual object generated according to a first user input is augmented in a captured image.

To this end, the first augmented reality application may provide a user interface for generating a virtual object for an image.

In detail, the first extended reality application outputs the captured image received from the second computing device, determines the type, shape, and location of the object according to the user's input on the output captured image, and the virtual augmented image on the captured image. object can be created.

In this case, the captured image may be an image encoded and transmitted by the second computing device according to the image parameter set by the second user.

The first augmented reality image application may change the captured image according to a currently set image parameter in order to provide a virtual object input interface for the captured image. For example, it is possible to change and output the captured image according to the preset resolution and FPS of the captured image.

In addition, the first augmented reality image application may provide a pointer 40i that determines a position to display a preset type of virtual object on the captured image 30i as shown in FIG. 14 .

In this case, the first augmented reality image application may change the type and shape of the pointer 40i according to the image parameters of the displayed captured image 30i.

For example, in the first augmented reality image application, when the resolution is lowered to a predetermined value or less, the size of the pointer 40i is reduced or increased or the color is changed, so that the position of the pointer 40i at a low resolution is lowered. can be provided to accurately recognize

In addition, the first augmented reality image application may change the type, shape, or color of the displayed virtual object according to the set image parameter.

For example, in the first extended reality image application, when the FPS is lowered to a predetermined value or less, the shape of the virtual object having a relatively simple structure is changed, the size of the virtual object is reduced, or the color is changed. By changing it, it can be provided so that the virtual object can be clearly displayed in real time as much as possible at low FPS.

In addition, the first augmented reality application may generate an extended reality image including information on the virtual object generated as described above and include it in the communication data.

The extended reality image content may include a virtual object generated according to a first user input in a captured image and virtual content including display location information of the virtual object.

In an embodiment, when the determined image parameter is less than or equal to a predetermined value, the first augmented reality application generates information about a shooting area of a captured image, a virtual object, and display location information of a captured image when creating a virtual object as extended reality image content and includes communication data can do it

That is, when the network environment is poor, instead of transmitting the entire extended reality image, information on virtual content is shared, and virtual objects stored in each user's computing device are uploaded and augmented in each computing device according to the virtual content information. to provide an extended reality environment.

For example, if the resolution is less than or equal to a predetermined resolution, the first augmented reality application provides virtual object type information that the virtual object is pointing, coordinates in a three-dimensional space in which the pointer is displayed, or a positional relationship between the pointer and a specific object in the captured image. Virtual content including information as virtual object display position information may be transmitted.

The second augmented reality application of the second user computing device may provide communication of the extended reality environment to the first user by receiving the virtual content, augmenting and displaying the virtual object in the photographing area according to the virtual content.

In addition, the third augmented reality application of the third user computing device receives the virtual content, receives the captured image from the second user, and augments the virtual object according to the virtual content in the captured image, thereby providing the extended reality for the first user. Environmental communication can be provided.

In addition, the first augmented reality application may reset the image parameter by receiving user feedback after the collaborative communication is finished. (S109)

For example, the first extended reality application may receive an evaluation for each of the resolution and FPS according to the network environment, and change the numerical values of the resolution and the FPS according to the feedback according to the evaluation.

Finally, the first augmented reality application may provide an interface for setting meta information for a set image parameter, and store the set image parameter information according to the meta information. (S111)

Here, the image parameter information means an extended reality image output mode and an image parameter setting state set according to the network environment in the output mode.

In addition, the meta information may include at least one or more information of a work type, a work target object, a location, and a communication counterpart user account.

Such meta information may be determined by input by a user through the first extended reality application, or may be automatically determined based on a location at which a captured image is captured or a work target object detected in the captured image.

When the meta information is determined, the first augmented reality application may store image parameter information set by matching the determined meta information.

Thereafter, when the first extended reality application detects meta information while providing the communication service, it may set the image parameter information set according to the meta information.

For example, if the first extended reality application detects a first work target object from a captured image and image parameter information for the first work target object is pre-stored, the output mode and parameters according to the output mode according to the information can be set.

In addition, in the first extended reality application, if the shooting position of the captured image is within a predetermined radius of the first position and image parameter information for the first position is pre-stored, the output mode and parameters according to the output mode according to the information can be set.

As described above, the method and system for adjusting the quality of customized network transmission information according to an embodiment of the present invention process and transmit/receive data to be exchanged based on a network environment used for data communication, so that it is implemented with speed and quality optimized for a network use environment There is an effect that data exchange using customized data can be performed.

In addition, the method and system for adjusting the quality of customized network transmission information according to an embodiment of the present invention generates and provides customized data based on a network environment used for data communication, so that even when exchanging data based on extended reality (XR) technology There is an effect that can minimize communication problems such as network communication load, buffering, or deterioration of data quality.

In addition, the method and system for adjusting the quality of customized network transmission information according to an embodiment of the present invention provides an extended reality (XR) communication technology that implements multi-party remote communication, so that a remote manager can use at least one field There is an effect that data communication can be performed simultaneously with the operator.

The embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the computer software field. Examples of computer-readable recording media include hard disks, magnetic media such as floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floppy disks. medium), and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. A hardware device may be converted into one or more software modules to perform processing in accordance with the present invention, and vice versa.

The specific implementations described in the present invention are only examples, and do not limit the scope of the present invention in any way. For brevity of the specification, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connection or connection members of lines between the components shown in the drawings illustratively represent functional connections and/or physical or circuit connections, and in an actual device, various functional connections, physical connections that are replaceable or additional may be referred to as connections, or circuit connections. In addition, unless there is a specific reference such as “essential” or “importantly”, it may not be a necessary component for the application of the present invention.

In addition, although the detailed description of the present invention has been described with reference to a preferred embodiment of the present invention, those skilled in the art or those having ordinary knowledge in the art will have the spirit of the present invention described in the claims to be described later. And it will be understood that various modifications and variations of the present invention can be made without departing from the technical scope. Accordingly, the technical scope of the present invention should not be limited to the content described in the detailed description of the specification, but should be defined by the claims.

Claims (10)

As a method for adjusting the quality of customized network transmission information performed by executing a first extended reality application in a processor of a computing device of a first user, the method comprising:
executing an extended reality communication service for transmitting and receiving extended reality image content with at least one or more other computing devices;
detecting a network environment with another computing device;
setting at least one image parameter of the augmented reality image content according to the sensed network environment;
generating extended reality image content according to the set image parameters; and
Transmitting communication data including the generated extended reality image content to the other user computing device
How to adjust the quality of a custom network transmission information. The method of claim 1,
The step of detecting a network environment with the other computing device comprises:
Measuring each bandwidth with a plurality of computing devices;
Determining a smallest bandwidth among the measured bandwidths as a common bandwidth
How to adjust the quality of a custom network transmission information. The method of claim 1,
The step of setting at least one image parameter of the extended reality image content according to the sensed network environment includes:
determining an extended reality image output mode;
Determining the image parameter based on the sensed network environment in the determined extended reality image output mode
How to adjust the quality of a custom network transmission information. 4. The method of claim 3,
The step of determining the extended reality image output mode comprises:
Outputting a plurality of images of different image parameters, determining one image according to a user selection among the plurality of output images, and determining the image parameter based on the determined image
How to adjust the quality of a custom network transmission information. 4. The method of claim 3,
Determining the image parameter based on the sensed network environment in the determined extended reality image output mode includes:
determining a network transmission parameter according to the sensed network environment; determining a first video parameter according to the determined network transmission parameter; and determining the remaining video parameters according to the determined first video parameter. doing
How to adjust the quality of a custom network transmission information. 6. The method of claim 5,
Determining the image parameter based on the sensed network environment in the determined extended reality image output mode includes:
fixing a second image parameter to a first value; determining an image parameter by calculating a value of a third image parameter when the second image parameter is a first value within the determined first image parameter; Comprising the step of re-calculating and determining the third image parameter when the first image parameter is changed
How to adjust the quality of a custom network transmission information. The method of claim 1,
The step of generating the extended reality image content according to the set image parameter comprises:
Acquiring an image, providing a user interface for inputting a virtual object augmented in the obtained image, and including the virtual object generated according to the user interface in the extended reality image content
How to adjust the quality of a custom network transmission information. 8. The method of claim 7,
The step of providing a user interface for inputting the augmented virtual object to the obtained image comprises:
changing the acquired image according to the set image parameter;
changing the type or shape of a pointer for inputting the virtual object according to the set image parameter
How to adjust the quality of a custom network transmission information. 8. The method of claim 7,
The step of providing a user interface for inputting the augmented virtual object to the obtained image comprises:
changing at least one of a type, shape, size, or color of the virtual object according to the set image parameter;
How to adjust the quality of a custom network transmission information. The method of claim 1,
determining meta information for the set image parameter; and storing the determined meta information by matching the set image parameter with the set image parameter
How to adjust the quality of a custom network transmission information.

Images