KR102562420B1 - slim type XR device having 5G communication function - Google Patents

Abstract

The present invention is a technology for performing 5G communication by combining a 5G communication module with an XR device, and a separate 5G communication module is embedded in a slim XR device regardless of existing wireless communication modules (eg, Wi-Fi, Bluetooth) or USB type , it is a technology that maintains the slimness or light weight of slim XR devices by combining them into a PCI-e type. In particular, as the slim XR device is provided with a thin-film PCB member, it is easy to connect the board-type circuit board on the side with the 5G communication module and the PCB member, so the design of the slim XR device can be more freely. According to the present invention, since the PCB member mounted in the form of a thin film on the front of the frame front member is provided, the position of various chips (eg 5G communication module) connected to the PCB member can be freely selected, so that the design of the XR device can be effectively It has the potential to improve.

Description

Slim type XR device having 5G communication function {slim type XR device having 5G communication function}

The present invention relates to a technology for performing 5G communication by combining a 5G communication module with an XR device.

More specifically, the present invention is a separate 5G communication module embedded in a slim XR device, regardless of existing wireless communication modules (eg, Wi-Fi, Bluetooth), USB type, or PCI-e (peripheral component interconnect-express) type. By combining them, it is a technology that maintains the slimness or light weight of slim-type XR devices.

In particular, the present invention provides a thin-film PCB member to the slim XR device, so that it is easy to connect the board-type circuit board on the side with the 5G communication module and the PCB member, so that various designs of the slim XR device can be made more It's a skill that can be done freely.

Virtual Reality (VR) technology provides objects or backgrounds realized through a screen or lens only as computer graphic (CG) images created virtually.

In addition, augmented reality (AR) technology adds a computer graphic image made virtually to a real image and provides it together.

In addition, mixed reality (MR) technology is a computer graphic technology that independently combines or mixes computer graphic images created virtually with respect to the real world and provides them.

Here, VR, AR, MR, etc. mentioned above are all simply referred to as extended reality (XR) technologies.

AR technology is a method of overlaying virtual digital images on real images. In addition, MR technology is a method of overlaying a virtual digital image on the real world, and it is different from VR technology that shows only virtual computer graphic images while blindfolded in that the user can see the real world through the eyes of the user.

In addition, unlike VR and AR devices that can only be used indoors, MR devices can be used while walking in the real world while wearing them like glasses, so their uses (e.g. counter-terrorism operations, fire suppression operations, etc.) are much more diverse.

However, an XR device, which collectively refers to a VR device, an AR device, and an MR device, must basically have a side board (eg, PCB) on which a plurality of control chips are mounted depending on the purpose of use.

As a result, since the existing XR device must have a side board on which a plurality of control chips are mounted, there is a limit to reducing the device thickness in the front and rear directions and wide device specifications in the vertical and horizontal directions while worn on the user's face. Of course, there was a limit to considering the elegant design of the device.

On the other hand, since most of the existing XR devices were HMD-based VR technology that performed short-distance wireless communication, there were various limitations for users to wear them for anti-terrorism operations or fire suppression operations.

Here, in order for a user wearing an MR technology-based HMD to perform a corresponding mission while obtaining information provided from a remote control unit, a remote wireless communication (e.g., 5G) module must be provided. If a separate long-distance wireless communication (eg, 5G) module is installed in the standard, the XR device becomes heavier, and there is a problem that it is disadvantageous in terms of design (eg, increased thickness of the device, foreign body feeling on the outer surface of the device).

Accordingly, a plurality of conventional side boards on which a plurality of control chips are mounted are excluded, and a thin film-type PCB member is placed in front of the XR device to drastically reduce the thickness and size of the device, and the slim type XR device It is required to implement a technology capable of solving the problems of the prior art as described above by adopting an embedded type 5G communication module.

The present invention has been proposed in view of the above points, and an object of the present invention is to provide a slim type XR device capable of performing 5G communication while maintaining the weight and design of the slim type XR device.

In order to achieve the above object, the slim XR device having a 5G communication function according to the present invention includes one or more lens members 110 disposed on the user's eyes to guide the user's field of view; a display member that displays information on the lens member; a frame front member 130 for fixing the lens members in a form surrounding an edge of one or more lens members; one or more frame-side members 140 for holding the lens member on the user's face in cooperation with the frame front member as it extends backward while being fixed to both sides of the frame front member; A PCB member 150 disposed on the front surface of the frame front member in the form of a thin film and connected to the display member to control the operation of the display member; A 5G communication module 160 disposed between the PCB member and the frame front member in a connected state to the PCB member and responsible for 5G communication; may be configured to include.

In addition, the frame front member 130 may include a communication module accommodating member 131 that is recessed backward to a predetermined depth on its front surface corresponding to the 5G communication module and accommodates the 5G communication module.

Here, the lens member 110 may be made of a transparent material capable of seeing through with the user's naked eye, and the display member may be configured to display MR information in a partial area of the lens member by operating under external control as an MR display member.

Meanwhile, the display member may be configured to display VR information on the lens member by operating under external control as a VR display member. At this time, the lens member 110 is preferably made of an opaque material that blocks the user's naked eyes.

On the other hand, the present invention is a control method of a slim XR device having a 5G communication function providing a MR (Mixed Reality) mode and a VR (Virtual Reality) mode, comprising: (a) executing the MR mode; (b) displaying the MR mode screen; (c) accessing a memory and extracting additional information related to the VR mode when a preset trigger condition is satisfied while the MR mode is running; (d) displaying a virtual object at a specific location within the screen of the VR mode on the screen of the MR mode based on the extracted additional information related to the VR mode;

Here, the screen of the MR mode may include an object photographed by a camera of the XR device, and the screen of the VR mode may include at least one virtual object mapped to each location.

In addition, at least one virtual object mapped for each location on the screen in the VR mode may be configured to be changed for each user recognized by the XR device.

On the other hand, tracking the gaze of the user of the XR device or a specific device; may be configured to further include.

In this case, the trigger condition may include a case in which the gaze of the tracked user or a specific device is recognized within a specific area of the screen in the MR mode for a predetermined time.

In addition, the trigger conditions include a first condition in which a specific physical key button of the XR device or a corresponding remote control is pushed, a second condition in which a specific motion of the XR device or a corresponding remote control is detected, and a specific gesture by the camera of the XR device. may be configured to include at least one of the detected third conditions.

Here, if the trigger condition corresponds to the third condition, changing the virtual object at a specific position within the VR mode screen displayed within the MR mode screen according to the size or location of the region formed by the specific gesture; further comprising can be configured.

And, step (d) may include displaying an indicator for guiding at least one virtual object within the VR mode screen while the MR mode is running.

In addition, the indicator may include first graphic data displaying the type of at least one virtual object on the VR mode screen, second graphic data displaying the location of the at least one virtual object on the VR mode screen, and VR mode display data. It may be configured to include at least one of the third graphic data displaying the number of at least one virtual object on the screen.

On the other hand, the computer program according to the present invention is combined with hardware and stored in a medium to execute the control method of the slim XR device having the above 5G communication function.

The present invention provides a PCB member mounted in the form of a thin film on the front of the frame front member and a 5G communication module connected to the PCB member in an embedded type, thereby making the XR device worn on the user's face lighter and slimmer than before. It shows the advantage of being able to perform 5G communication while being manufactured.

In addition, the present invention also shows the advantage of improving the activity of the user wearing the XR device as the overall slim implementation of the front end of the XR device.

In addition, since the present invention has a PCB member mounted in the form of a thin film on the front of the frame front member, it is free to select the position of various chips (eg 5G communication module) connected to the PCB member, so that the design of the XR device can be effectively It also shows the potential for improvement.

[Figure 1] is an exemplary view showing a slim XR device having a 5G communication function according to a first embodiment of the present invention;
[Figure 2] is a view in which the configuration of [Figure 1] is separated;
[Figure 3] is a plan view of a state wearing a slim XR device having a 5G communication function according to the first embodiment of the present invention;
[Figure 4] is an exemplary view showing a slim XR device having a 5G communication function according to a second embodiment of the present invention;
[Figure 5] is a view in which the configuration of [Figure 4] is separated;
[Figure 6] is an exemplary diagram showing another embodiment of a 5G communication module, which is a configuration of the present invention,
[Fig. 7] is an exemplary diagram showing an excerpt from another embodiment of a 5G communication module, which is a configuration of the present invention;
[Figure 8] is a flow chart showing a control method of a slim XR device having a 5G communication function according to the present invention;
9 is a diagram showing an example of a memory data structure in which a slim XR device having a 5G communication function according to the present invention stores parameters for providing MR/VR service.

Hereinafter, the present invention will be described in detail with reference to the drawings.

[FIG. 1] is an exemplary view showing a slim XR device having a 5G communication function according to the first embodiment of the present invention, [FIG. 2] is a diagram in which the configuration of [FIG. 1] is separated, and [FIG. 3] is a plan view of a wearing state of the slim XR device having a 5G communication function according to the first embodiment of the present invention.

1 to 3, the slim XR device having a 5G communication function according to the present invention includes a lens member 110, a display member (not shown), a frame front member 130, a frame side member ( 140), a PCB member 150, and a 5G communication module 160.

The lens member 110 may be disposed on the user's face and guide the user's field of view. To this end, the lens member 110 may be configured as a pair as shown in FIG. 2 corresponding to the position of the user's two eyes, but one lens member 110 may be configured to be left and right long.

The display member (not shown) may be configured to display any one of MR information, AR information, and VR information on the inner surface of the lens member 110 .

Here, the definition of MR information, AR information, and VR information in this specification is as follows. First, the MR information is preferably a so-called MR (MR) displaying a virtually created computer graphics (CG) image on the inner surface of the lens member 110 while the user is actually viewing the real world through the lens member 110. Mixed Reality) mode.

In addition, the AR information is preferably created virtually on the inner surface of the lens member 110 while the user is viewing a real image (eg, professional baseball relay) captured through the lens member 110 rather than the real world. It means a so-called AR (Augmented Reality) mode that displays computer graphics (CG) images.

In addition, the VR information refers to a so-called Virtual Reality (VR) mode in which a computer graphic (CG) image created in advance is displayed by a user through the lens member 110 .

The frame front member 130 fixes the lens member 110 in a form that surrounds an edge of one or more lens members 110, as shown in [FIG. 1] and [FIG. 2].

As shown in [Figs. 1] and [Fig. 2], the frame side member 140 extends backward while being fixed to both sides of the frame front member 130, so that the lens member 110 cooperates with the frame front member 130. ) is mounted on the user's face.

Here, the frame side members 140 may be configured as a pair to correspond to both ears of the user as shown in [Figs. 1] and [Fig. 2], or may be connected to both ends of the frame front member 130 in a ring form. .

As shown in FIG. 2, the PCB member 150 is disposed in the form of a thin film on the front of the frame front member 130 and is connected to a display member (not shown) to control the operation of the display member (not shown).

To this end, the PCB member 150 may preferably be composed of a loose and thin FPCB as shown in FIG. 2 .

As shown in FIGS. 1 to 3, the 5G communication module 160 is disposed between the PCB member 150 and the frame front member 130 in a state connected to the PCB member 150 and is responsible for 5G communication. .

Here, even when the 5G communication module 160 is employed in the XR device, the frame front member 130 is provided with a communication module accommodating member 131 as shown in FIG. 2 so that the XR device can maintain the sleep type. can

As shown in FIG. 2 , the communication module accommodating member 131 is recessed backward to a predetermined depth on its front surface corresponding to the 5G communication module 160 to accommodate the 5G communication module 160 .

To this end, the 5G communication module 160 may be mounted on the PCB member 150 in an embedded manner.

On the other hand, the lens member 110 may be made of a transparent material that is transparent to the user's naked eye. In this case, the display member (not shown) may be configured to display MR information on a partial area of the lens member 110 by operating as an MR display member (not shown) under external control.

On the other hand, the lens member 110 may be made of an opaque material that blocks the user's naked eyes. In this case, the display member (not shown) may be configured to display VR information on the lens member 110 as it operates under external control as a VR display member (not shown).

On the other hand, [Fig. 4] is an exemplary diagram showing a slim XR device having a 5G communication function according to the second embodiment of the present invention, and [Fig. 5] shows a diagram in which the configuration of [Fig. 4] is separated.

Referring to [Fig. 4] and [Fig. 5], the second embodiment of the present invention may be configured to further include a reinforcement film member 160.

Here, as in [Fig. 1], in the state where the PCB member 150 in the form of a thin film is bonded to the front of the frame front member 130, the reinforcing film member 160 is as shown in [Figs. 4] and [Fig. 5]. As it is bonded to the front of the PCB member 150, the boundary between the frame front member 130 and the PCB member 150 into which the lens member 110 is inserted is finished as shown in FIG. 4, as well as external force It also serves to protect the front surface of the PCB member 150 from.

[Fig. 6] is an exemplary diagram illustrating another embodiment of a 5G communication module, which is a configuration of the present invention.

The 5G communication module 160 is in charge of 5G communication while being connected to the PCB member 150. To this end, the 5G communication module 160 may also be configured as a USB type as shown in FIG. 6.

For example, the 5G communication module 160 is mounted on the circuit board 170 of the side board type as shown in FIG. 6, and the circuit board ( 170) may have a USB terminal 171 at its end.

[Fig. 7] is an exemplary diagram illustrating another embodiment of a 5G communication module, which is a configuration of the present invention.

The 5G communication module 160 is in charge of 5G communication while being connected to the PCB member 150. To this end, the 5G communication module 160 may also be configured as a PCI-e type as shown in FIG. 7 .

For example, the 5G communication module 160 is mounted on a side board type circuit board 180 as shown in FIG. 7 and the circuit board ( 180) may have a connection terminal 181 at an end thereof.

8 is a flowchart illustrating a control method of a slim XR device having a 5G communication function according to the present invention.

Step (S110): The slim XR device having a 5G communication function according to the present invention may first execute the MR mode to provide a Mixed Reality (MR) mode and a Virtual Reality (VR) mode.

Steps S120 and S130: Further, the screen of the MR mode is displayed, and it is determined whether or not a preset trigger condition is satisfied while the MR mode is running.

Steps S140 and S150: When it is determined that the trigger condition is satisfied, additional information related to the VR mode is extracted by accessing the memory.

Subsequently, a virtual object corresponding to a specific position within the VR mode screen is displayed on the MR mode screen based on the extracted VR mode related additional information.

The screen of the MR mode includes, for example, an object photographed by a camera of the slim XR device, and the screen of the VR mode includes at least one virtual object mapped to each location.

At least one virtual object mapped for each location on the screen in the VR mode may be changed for each user recognized by, for example, the slim XR device.

Although not shown in [FIG. 8], it may be configured to further include the step of tracking the user's gaze or a specific device of the slim XR device having a 5G communication function.

In this case, the trigger condition may include, for example, a case in which the gaze of the tracked user or a specific device is recognized within a specific region of the screen in the MR mode for a predetermined time.

The trigger condition is, for example, a first condition in which a specific physical key button of a slim type XR device having a 5G communication function or a corresponding remote control is pushed, a slim type XR device having a 5G communication function or a specific motion of a remote control corresponding thereto It may include at least one of a detected second condition and a third condition in which a specific gesture is detected by a camera of a slim XR device having a 5G communication function.

If the trigger condition corresponds to the third condition, the method further includes changing a virtual object at a specific position within the VR mode screen displayed within the MR mode screen according to the size or position of the region formed by the specific gesture. .

Step S150 may further include displaying an indicator for guiding at least one virtual object in the VR mode screen while the MR mode is running.

Here, the indicator may be, for example, first graphic data displaying the type of at least one virtual object within the VR mode screen, second graphic data displaying the position of at least one virtual object within the VR mode screen, and within the VR mode screen. It may include at least one of third graphic data indicating the number of at least one virtual object.

Similar to the control method of the present invention, from a device point of view, a slim XR device having a 5G communication function that provides a plurality of XR (extended reality) related modes, memory, and executing a first mode of at least one mode It may include a controller and a display member displaying a screen of the first mode. Here, the characteristics of the memory will be reviewed in [Fig. 9].

When a predetermined trigger condition is satisfied during execution of the first mode, the controller accesses the memory to extract additional information related to the second mode, and based on the extracted additional information related to the second mode, the first mode The display member is controlled to display a virtual object at a specific position within the screen in the second mode.

The first mode corresponds to, for example, the previously described MR mode, and the second mode corresponds to, for example, the previously described VR mode.

9 is a diagram showing an example of a memory data structure in which a slim XR device having a 5G communication function according to the present invention stores parameters for providing MR/VR service.

In order to implement the embodiment of the present invention as described above, as shown in [Fig. 9], specific parameters for MR/VR service can be defined in advance in the memory of the slim XR device.

Conventionally, after executing the MR mode, there was a problem in that the entire MR mode had to be converted to the VR mode in order to load the personalized VR mode information. On the other hand, according to the present invention, it is possible to call only some of the virtual objects of the VR mode while the MR mode is running.

As shown in [Fig. 9], the same screen is provided in MR mode regardless of ID. However, in order to call only a specific virtual object within the screen of the VR mode when a trigger condition is satisfied during execution of the MR mode, an arbitrary virtual object and location are defined differently for each ID.

Meanwhile, an ID for distinguishing a user may be arbitrarily input by a user or may be automatically identified through a camera or the like. More specifically, for example, Mr Kim accesses the database shown in [Fig. 8] when the trigger condition is satisfied while the XR device is running in the MR mode, and the location of the additional information (virtual object) A and B in the screen of the VR mode After confirming the location of the additional information (virtual object), a GUI indicating it may be displayed.

On the other hand, Ms Lee accesses the database shown in [Fig. 9] when the trigger condition is satisfied while the MR mode of the slim-type XR device with 5G communication function is running, and the position of A additional information (virtual object) in the VR mode screen and After confirming the location of the C additional information (virtual object), a GUI indicating it may be displayed.

Finally, when Ms Park is executing the MR mode of the slim-type XR device with 5G communication function, and the trigger condition is satisfied, accesses the database shown in [Fig. , After confirming the locations of E additional information (virtual object) and F additional information (virtual object), a GUI indicating them may be displayed.

That is, since the VR mode screen is personalized, it is possible to set it differently for each user.

On the other hand, the present invention can be implemented in the form of computer readable codes on a computer readable non-volatile recording medium. As such non-volatile recording media, there are various types of storage devices, such as hard disks, SSDs, CD-ROMs, NAS, magnetic tapes, web disks, and cloud disks. and can be implemented in a form that is executed. In addition, the present invention may be implemented in the form of a computer program stored in a medium in order to execute a specific procedure in combination with hardware.

110: lens member
130: frame front member
131: communication module accommodating member
140: frame side member
150: PCB member
160: 5G communication module
170: circuit board
171: USB terminal
180: circuit board
181: connection terminal
200: member of reinforcing film

Claims (10)

One or more lens members 110 disposed on the user's eyes to guide the user's field of view;
a display member displaying information on the lens member 110;
a frame front member 130 fixing the lens member 110 in a form surrounding an edge of the at least one lens member 110;
At least one frame side member 140 for holding the lens member 110 on the user's face in cooperation with the frame front member 130 as it extends backward while being fixed to both sides of the frame front member 130 ;
It is disposed in the form of a thin film on the front surface of the frame front member 130 to cover the front surface of the frame front member 130 and is connected to the display member to control the operation of the display member, and the frame front member 130 or A PCB member 150 formed of a flexible thin type to be able to connect to one or more chips mounted on the frame side member 140;
A 5G communication module 160 connected to the PCB member 150 and disposed between the PCB member 150 and the frame front member 130 and responsible for 5G communication;
It is composed of,
The frame front member 130 has a communication module accommodating member 131 that is recessed backward to a predetermined depth on its front surface corresponding to the 5G communication module 160 and accommodates the 5G communication module 160, ,
The 5G communication module 160 is embedded in a position corresponding to the communication module accommodating member 131 of the PCB member 150, and the frame front member 130 and the PCB member 150 are coupled. In the case, the slim XR device having a 5G communication function, characterized in that configured to be accommodated in the inner space of the communication module accommodating member 131 in a state mounted on the PCB member 150.
delete The method of claim 1,
The lens member 110 is made of a transparent material that can be seen through the user's naked eye,
The display member is a slim XR device having a 5G communication function, characterized in that as an MR display member, it operates under external control to display MR information in a partial area of the lens member.
The method of claim 1,
The lens member 110 is made of an opaque material that blocks the user's visual perspective,
The display member is a slim XR device having a 5G communication function, characterized in that for displaying VR information on the lens member by operating under external control as a VR display member. delete delete delete delete delete delete

Images