KR102486890B1 - Apparatus and method for providing augmented reality interface of e-sports game - Google Patents

Abstract

An apparatus and method for providing an augmented reality interface related to an e-sports game according to an embodiment of the present invention are provided. An apparatus for providing an augmented reality interface related to an e-sports game according to an embodiment of the present invention includes a camera unit configured to capture an image; a communication unit configured to transmit and receive data; a display unit configured to display data; and a control unit operably connected to the camera unit, the communication unit, and the display unit, wherein the control unit recognizes a marker from an image captured through the camera unit and relates to the recognized marker through the communication unit to e-sports. An augmented reality interface screen that requests immersive content related to a game to a service providing server, receives the immersive content from the service providing server through the communication unit, and maps the received immersive content to the recognized marker. It is configured to display through the display unit.

Description

Apparatus and method for providing augmented reality interface for electronic sports games

The present invention relates to an apparatus and method for providing an augmented reality interface related to an e-sports game.

Recently, with the development of various game engines, the development of graphic processing technology, and the diversification of game genres, electronic sports or e-sports (hereinafter referred to as 'e-sports') using network-based games are in the limelight. are receiving As a result, as the range of game genres covered in the field of e-sports expands, broadcasting services that professionally relay game play by game experts (ie, game players or participants) in addition to simple participation in games are also increasing.

In general, for e-sports games, booths where game players can participate in game games in e-sports stadiums, relay booths for relaying e-sports games, seats for spectators to watch e-sports games, and broadcasting images related to game play are displayed. A display device is disposed. A viewer can sit on a seat in an e-sports stadium and watch a broadcasting image played on a display device or watch a broadcasting image through a user device capable of viewing a broadcast, such as a smartphone.

However, this viewing method has a problem in that the viewer's immersion for watching the e-sports game is lowered and the viewer's satisfaction is low.

Therefore, there is a need for a method for increasing the degree of immersion and satisfaction of spectators watching an e-sports game.

An object to be solved by the present invention is to provide an apparatus and method for providing an augmented reality interface related to an e-sports game.

Specifically, an object to be solved by the present invention is to provide an apparatus and method for providing an augmented reality interface related to an e-sports game that can increase the immersion and satisfaction of spectators watching the e-sports game.

The tasks of the present invention are not limited to the tasks mentioned above, and other tasks not mentioned will be clearly understood by those skilled in the art from the following description.

In order to solve the above problems, an apparatus and method for providing an augmented reality interface related to an e-sports game are provided.

An apparatus for providing an augmented reality interface related to an e-sports game according to an embodiment of the present invention includes a camera unit configured to capture an image; a communication unit configured to transmit and receive data; a display unit configured to display data; and a processor operably connected to the camera unit, the communication unit, and the display unit, wherein the processor recognizes a marker from an image captured through the camera unit, and associates the recognized marker with the e-sports through the communication unit. An augmented reality interface screen that requests immersive content related to a game to a service providing server, receives the immersive content from the service providing server through the communication unit, and maps the received immersive content to the recognized marker. It is configured to display through the display unit.

A method for providing an augmented reality interface performed by an apparatus for providing an augmented reality interface related to an e-sports game according to an embodiment of the present invention includes: capturing an image through a camera unit and recognizing a marker from the captured image; requesting immersive content related to an e-sports game to a service providing server in relation to the recognized marker; receiving the immersive content from the service providing server; and displaying an augmented reality interface screen in which the received immersive content corresponds to the recognized marker.

Other embodiment specifics are included in the detailed description and drawings.

The present invention provides immersive content related to an e-sports game using markers placed in an e-sports stadium, thereby increasing the level of immersion and satisfaction of watching an e-sports game to users who visit an e-sports stadium to watch an e-sports game. there is.

In addition, the present invention can experience the atmosphere of the e-sports stadium and feel the game play of each game player regardless of the distance between the seats in the e-sports stadium.

In addition, the present invention can provide more fun and interest in game play to viewers who watch e-sports game broadcasts in other places as well as e-sports stadiums.

Effects according to the present invention are not limited by the contents exemplified above, and more various effects are included in the present specification.

1 is a schematic diagram illustrating a system for providing an augmented reality based broadcasting service according to an embodiment of the present invention.
2 is a schematic block diagram of an observer device according to an embodiment of the present invention.
3 is a schematic block diagram of a service providing server according to an embodiment of the present invention.
4 is a schematic block diagram of a user device according to an embodiment of the present invention.
5 is a flowchart illustrating a method of providing an augmented reality interface related to an e-sports game in a user device according to an embodiment of the present invention.
6 is a flowchart illustrating a method of providing an augmented reality interface related to an e-sports game in a user device according to an embodiment of the present invention.
7, 8, 9a and 9b are exemplary views illustrating various augmented reality interface screens related to an e-sports game according to an embodiment of the present invention.
10 is an exemplary diagram illustrating an augmented reality interface screen related to augmented reality glasses (hereinafter referred to as AR glasses) according to an embodiment of the present invention.

Advantages and features of the present invention, and methods of achieving them, will become clear with reference to the detailed description of the following embodiments taken in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and will be implemented in various forms different from each other, only these embodiments make the disclosure of the present invention complete, and common knowledge in the art to which the present invention pertains. It is provided to completely inform the person who has the scope of the invention, and the present invention is only defined by the scope of the claims. In connection with the description of the drawings, like reference numerals may be used for like elements.

In this document, expressions such as "has," "may have," "includes," or "may include" indicate the existence of a corresponding feature (eg, numerical value, function, operation, or component such as a part). , which does not preclude the existence of additional features.

In this document, expressions such as “A or B,” “at least one of A and/and B,” or “one or more of A or/and B” may include all possible combinations of the items listed together. . For example, “A or B,” “at least one of A and B,” or “at least one of A or B” (1) includes at least one A, (2) includes at least one B, Or (3) may refer to all cases including at least one A and at least one B.

Expressions such as “first,” “second,” “first,” or “second,” used in this document may modify various elements, regardless of order and/or importance, and refer to one element as It is used only to distinguish it from other components and does not limit the corresponding components. For example, a first user device and a second user device may represent different user devices regardless of order or importance. For example, without departing from the scope of rights described in this document, a first element may be named a second element, and similarly, a second element may also be renamed to a first element.

A component (e.g., a first component) is "(operatively or communicatively) coupled with/to" another component (e.g., a second component); When referred to as "connected to", it should be understood that the certain component may be directly connected to the other component or connected through another component (eg, a third component). On the other hand, when an element (eg, a first element) is referred to as being “directly connected” or “directly connected” to another element (eg, a second element), the element and the above It may be understood that other components (eg, a third component) do not exist between the other components.

As used in this document, the expression "configured to" means "suitable for," "having the capacity to," depending on the circumstances. ," "designed to," "adapted to," "made to," or "capable of." The term "configured (or set) to" may not necessarily mean only "specifically designed to" hardware. Instead, in some contexts, the phrase "device configured to" may mean that the device is "capable of" in conjunction with other devices or components. For example, the control unit 230 configured (or configured) to perform the phrases “A, B, and C” may include a dedicated processor (eg, embedded processor) or one or more software programs stored in a memory device to perform the corresponding operation. By executing, it may mean a general-purpose processor (eg, CPU or application processor) capable of performing corresponding operations.

Terms used in this document are only used to describe a specific embodiment, and may not be intended to limit the scope of other embodiments. Singular expressions may include plural expressions unless the context clearly dictates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by a person of ordinary skill in the art described in this document. Among the terms used in this document, terms defined in a general dictionary may be interpreted as having the same or similar meaning as the meaning in the context of the related art, and unless explicitly defined in this document, an ideal or excessively formal meaning. not be interpreted as In some cases, even terms defined in this document cannot be interpreted to exclude the embodiments of this document.

Each feature of the various embodiments of the present invention can be partially or entirely combined or combined with each other, and as those skilled in the art can fully understand, various interlocking and driving operations are possible, and each embodiment can be implemented independently of each other. It may be possible to implement together in an association relationship.

In the present specification, 'observer' may refer to an object that selects at least some space corresponding to a participant's point of view and/or a desired point of view among the entire game space in which game play is performed. Alternatively, in various embodiments, the 'observer' may refer to an object for acquiring an object for the in-game character by fixing the gaze to the in-game character in a game space where game play is performed.

In this specification, 'game space' may be composed of a 2-dimensional or 3-dimensional space.

In this specification, a 'participant' may mean a target who plays a game.

In this specification, a 'game control command' may refer to a game operation command made by a participant for game play.

In this specification, 'game play data' refers to in-game screen data related to game play, and may be game screen data from a first-person view or a third-person view.

In this specification, an 'augmented reality object' may refer to a graphic object displayed to be overlapped in a real space corresponding to a marker.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic diagram for explaining a system for providing an augmented reality-based broadcasting service (hereinafter, referred to as a 'broadcasting service system') according to an embodiment of the present invention.

Referring to FIG. 1 , a broadcast service system 100 is a system that provides an augmented reality-based broadcast service for an e-sports game, and includes a game client device 110 of a participant playing a game, a game server 120, a game play An observer device 130 for watching a game space to relay a broadcast, a service providing server 140 for providing a game-related broadcast service, and a viewer's user device 150 for watching a broadcast (eg, e-sports game broadcast) includes In addition, the broadcast service system 100 may further include a photographing device 160 for capturing images of participants.

First, the game client device 110 is an electronic device that provides a user interface for game play, and for this purpose, among a smartphone, a tablet PC (Personal Computer), a laptop and/or a PC, etc. in which a game client distributed by a game company is installed. may contain at least one. Such game client devices 110 may be provided as many as the number of participants.

The game client device 110 executes the game client according to a participant's request to provide a game interface screen, through which the participant can play the game. A participant may proceed with game play by manipulating the game client device 110 .

Specifically, the game client device 110 may acquire a participant's game control command, transmit the obtained game control command to the game server 120, and receive game play data according to the game control command from the game server 120. Here, the game play data according to the game control command may refer to screen data of a game played by a participant's manipulation. For example, game play data according to a game control command may represent movement of a character within a game made in response to a request for a character movement command within a game by a participant.

The game client device 110 may provide an interface screen displaying the received game play data. The game client device 110 may perform bi-directional communication with the game server 120 to exchange various data used for game play.

According to various embodiments, the game client device 110 may generate game screen data by capturing the in-game screen of each participant, and transmit the generated game screen data to the service providing server 140 . Such game screen data may be 2D image data, but is not limited thereto, and may also be 3D image data. In various embodiments, game screen data may be transmitted through the game server 120 .

Next, the game server 120 may include a general-purpose computer, a laptop, and/or a cloud server that performs various calculations to provide game services.

The game server 120 may receive a game control command from the game client device 110 and transfer game play data according to the game control command to the game client device 110 .

The game server 120 generates participant viewpoint-based game play data for each participant and/or observer viewpoint-based game play data observed by the game observer according to the request of the observer device 130, and transmits the generated game play data to It can be delivered to the observer device 130.

Here, the participant viewpoint-based game play data may indicate at least some space corresponding to each participant's viewpoint within the game space where the game play is performed. The participant's point of view may mean at least a part of the game space viewed by the participant.

In addition, the game play data based on the observer's point of view may indicate at least some space corresponding to the point of view of the observer in the game space where the game is played. The viewpoint of the observer may refer to at least a part of the game space viewed by the observer. The observer's point of view can be selected by the observer.

In other words, the game server 120 may deliver game play data corresponding to a part of the space requested by the observer device 130 to the observer device 130 among the entire game space where game play is performed. As described above, the game play data may correspond to a participant's point of view and/or an observer's desired point of view, but is not limited thereto. For example, when an observer selects a viewpoint of each participant, game play data in at least a part of space corresponding to each participant's viewpoint may be provided.

In various embodiments, the game server 120 may transmit game element data related to game play of participants to the observer device 130 at the request of the observer device 130 . Here, the game element data is a graphic object used to render at least one of a game character played by a participant in the game, a game item owned or used, a game map being played, a skill effect being used, an item effect being used, and the like. can include

Next, the observer device 130 is an electronic device for observing at least a part of the game space where game play is performed, and includes at least one of a smartphone, a tablet PC, a laptop computer, and/or a PC having an observer client installed therefor. can do. Such an observer device 130 may be provided as many as the number of observers.

Specifically, the observer device 130 may provide a user interface for selecting at least a part of the game space to watch and requesting game play data corresponding to the selected at least part of the space from the game server 120 .

When game play data is received from the game server 120, the observer device 130 may transfer the received game play data to the service providing server 140. In various embodiments, the above-described operation may be performed according to a request of the service providing server 140 . In various embodiments, game play data obtained by the observer device 130 may be transmitted through the game server 120 .

In various embodiments, the observer device 130 may convert the received game play data into virtual reality (VR) content and provide the same to the service providing server 140 . Here, the virtual reality content may be virtual reality image data. For example, the virtual reality image data may be image data obtained by rendering a game play screen as a 3D graphic in a horizontal and 360-degree exhibition line direction centering on the user.

In various embodiments, the observer device 130 requests game element data related to game play from the game server 120 according to a request of the service providing server 140, and when the game element data is received from the game server, the received game element Data may be transmitted to the service providing server 140 .

Next, the service providing server 140 may include a general-purpose computer, a laptop, and/or a cloud server that performs various calculations to provide a broadcasting service for an e-sports game.

The service providing server 140 may provide various broadcast contents related to an e-sports game according to a request of the user device 150 . Here, the broadcasting content is augmented reality (or mixed reality (MR), hybrid reality (HR))-based immersive content designed to immerse in e-sports game and broadcasting video data related to e-sports game (hereinafter referred to as 'immersive content').

The service providing server 140 may store marker data for at least one marker used to provide viewers (or spectators) with immersive content for an e-sports game.

The marker may be implemented as a QR (Quick Response) code or barcode, and is placed at a predetermined location (eg, wall, pillar, chair, monitor, etc.) of an e-sports stadium, or a marker such as a projector placed in an e-sports stadium. It may be displayed at a preset location by a display device or may be displayed at a preset location on an e-sports game broadcasting screen displayed through a display device disposed in an e-sports stadium. In various embodiments, a plurality of markers may be disposed.

The marker data may include an image of the marker (or a location where the marker is placed) and a type of immersive content to be implemented in correspondence with the marker.

In detail, the service providing server 140 requests game play data and game element data from the observer device 130 or the game server 120 according to the request of the user device 150, and provides game data to the game client device 110. At least one of requesting screen data and requesting captured image data from the photographing device 160 may be performed. Here, the request of the user device 150 may include a marker image recognized by the user device or a location where the recognized marker is placed.

The service providing server 140 may check the type of immersive content to be implemented through a received marker image or marker data corresponding to a marker position among previously stored marker data for at least one marker.

When game play data and game element data are received from the observer device 130 or game server 120, game screen data is received from the game client device 110, and captured image data is received from the capture device 160, the service The providing server 140 extracts resource data used to implement immersive content from at least one of the received game play data, game element data, game screen data, and captured image data, and uses the extracted resource data to immerse yourself in the game. You can create type content.

Immersive content is the interface component data that makes up each participant's interface screen displayed as an in-game screen (e.g., team composition (e.g., team name, and/or team member names), rank, score, spec, status bar). (HP (Health Point), SP (Skill Point), damage, etc.), skill bar, game map, character position on the map, and/or remaining time, etc.), in-game character data (e.g. Character shape, character state, shape of a character using a skill, shape of an item used or worn by a character, skill or item effect that appears when a character uses a skill or item, and/or damage effect that appears when a character takes damage from an opponent, etc. ), the captured image data of each participant, and the resource data extracted from at least one of each participant's game screen data. These augmented reality objects may be 3D graphic objects, but are not limited thereto.

The captured image data is image data corresponding to various viewpoints of an e-sports stadium, and may be image data related to at least one of participants participating in the game, the inside of the stadium, and the image of spectators watching.

Meanwhile, in order to provide broadcasting data related to an e-sports game, the service providing server 140 transmits the captured image data received from the photographing device 160 at the request of the user device 150, the game client device 110, or the game. Generates broadcast image data based on at least one of the game screen data received from the server 120 and the virtual reality content received from the observer device 130 or the game server 120, and provides it to the user device 150 can do. Game screen data received from the game client device 110 as described above may at least match game play data based on a participant's view received from the observer device 130 or the game server 120 .

In various embodiments, a plurality of service providing servers 140 may be implemented, so that one server may generate and provide immersive content, and another server may generate and provide broadcasting image data.

In various embodiments, the service providing server 140 may generate markers used to provide immersive content, and generate broadcasting image data so that the generated markers are displayed on a preset area of a broadcasting video screen.

In various embodiments, the service providing server 140 may provide broadcast content including preset graphic objects (eg, images and/or video) to provide immersive content. Here, the preset graphic object may be at least one of at least a portion of an e-sports stadium and at least a portion of a game game shown through broadcasting, but is not limited thereto.

For example, when a pillar image of an e-sports stadium is set as a graphic object for providing immersive content, the user device 150 recognizes the pillar image and receives a request for immersive content, the service providing server 140 Requests game play data and game element data to the observer device 130 according to the request of the user device 150, requests game screen data to the game client device 110, and captures image data to the photographing device 160 At least one of the requested operations may be performed.

When game play data and game element data are received from the observer device 130, game screen data is received from the game client device 110, and captured image data is received from the photographing device 160, the service providing server 140 Resource data used to implement immersive content may be extracted from at least one of received game play data, game element data, game screen data, and captured image data, and immersive content may be generated using the extracted resource data. there is.

The service providing server 140 may deliver the generated immersive content to the user device 150 .

Finally, the user device 150 is an electronic device that provides a user interface for watching an e-sports game or watching a broadcast related to an e-sports game. To this end, a broadcast viewing client distributed by a broadcasting company is installed to provide immersive content. and/or at least one of a smart phone, a tablet PC, a head mounted display (HMD) device, and/or augmented reality (AR) glasses capable of displaying broadcasting image data.

The user device 150 requests immersive content or broadcasting video data, receives the immersive content or broadcasting video data from the service providing server 140, and displays an interface screen displaying the received immersive content or broadcasting video data. can do.

Specifically, the user device 150 displays an interface screen for requesting immersive content, and when an immersive content request is made through the corresponding interface screen, the user device 150 recognizes a marker used to display an interface screen related to immersive content. You can display an interface screen to do this.

The interface screen for recognizing the marker may be a shooting interface screen for capturing at least a part of the real space where the marker is placed, or an interface screen for recognizing a QR code or barcode when the marker is present.

The user device 150 may include a camera unit, capture a real space where a marker is located through the camera unit, and recognize the marker in the captured image.

When the marker is recognized, the user device 150 may transmit a request for immersive content to the service providing server 140 . Here, the request for immersive content may include an image of a recognized marker or a location of the recognized marker.

When immersive content is received from the service providing server 140, the user device 150 may display an augmented reality interface screen in which the received immersive content corresponds to the recognized marker.

For example, when a user visits an e-sports stadium to watch an e-sports game, the user device 150 recognizes a marker placed or displayed at a predetermined location in the e-sports stadium by the user, and responds to the recognized marker to become immersed. type content can be provided.

In various embodiments, the marker may be provided to be displayed on at least a part of the video screen through a display unit of an electronic device such as a monitor or TV that transmits broadcast video of an e-sports game. In various embodiments, when the user device 150 is an HMD device or AR glasses including a projector module, the marker may be displayed in a real space through a projector module included in the HMD device or AR glasses worn by the user.

In various embodiments, the user device 150 may recognize a preset graphic object to provide immersive content among e-sports game broadcasting images displayed through the display unit of the electronic device. When a graphic object is recognized in this way, the user device 150 may transmit a request for immersive content to the service providing server 140 . When immersive content is received from the service providing server 140, the user device 150 may display an augmented reality interface screen related to the received immersive content.

As such, the present invention provides immersive content related to e-sports events using markers placed in e-sports stadiums, thereby increasing the level of immersion and satisfaction of watching e-sports events to users who visit e-sports stadiums to watch e-sports events. can be raised

In the following, the observer device 130 will be described in more detail with reference to FIG. 2 .

2 is a schematic block diagram of an observer device according to an embodiment of the present invention.

Referring to FIG. 2 , the observer device 200 includes a communication unit 210, a display unit 220, a storage unit 230, and a control unit 240. In the presented embodiment, the observer device 200 may mean the observer device 130 of FIG. 1 .

The communication unit 210 connects the observer device 200 to enable communication with an external device. The communication unit 210 is connected to the game server 120 and the service providing server 140 using wired/wireless communication to transmit/receive various data. Specifically, the communication unit 210 may receive game play data from the game server 120 and transfer the received game play data to the service providing server 140 directly or through the game server 120 . In various embodiments, the communication unit 210 may transmit virtual reality content to the service providing server 140 .

The display unit 220 may display various contents (eg, text, images, videos, icons, banners, or symbols) to the user. Specifically, the display unit 220 may display an interface screen related to an observer client for watching at least a part of a game space in which game play is performed. For example, the interface screen for the observer client may include a function for selecting at least a portion of the game space for spectation, a function for observing game play from the viewpoint of at least one participant, and a function for observing the entire game play. It may include graphic objects corresponding to at least one, but is not limited thereto.

In various embodiments, the display unit 220 may include a touch screen, and for example, a touch using an electronic pen or a part of the user's body, a gesture, a proximity, a drag, or a swipe A swipe or hovering input may be received.

The storage unit 230 may store various data used to observe at least a part of the game space in which the game is played. In various embodiments, the storage unit 230 may be a flash memory type, a hard disk type, a multimedia card micro type, or a card type memory (eg SD or XD). memory, etc.), RAM (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) , a magnetic memory, a magnetic disk, and an optical disk may include at least one type of storage medium. The observer device 200 may operate in relation to a web storage that performs the storage function of the storage unit 230 on the Internet.

The control unit 240 is operatively connected to the communication unit 210, the display unit 220, and the storage unit 230, and can perform various commands for observing at least a part of the game space where the game play takes place.

Specifically, the controller 240 transmits to the game server 120 a request for selecting at least a part of the game space for watching, watching the game play from the viewpoint of at least one participant, or watching the entire game play, , Game play data related to the request may be received from the game server 120 .

In other words, the controller 240 performs at least one of a function for selecting at least a part of the game space for spectation, a function for observing game play from the viewpoint of at least one participant, and a function for watching the entire game play. An observer client interface screen including a corresponding graphic object is displayed, and if one is selected through this, a request corresponding to the selected graphic object may be transmitted to the game server 120 .

In response to a request for selecting at least a portion of the game space for watching a game, the controller 240 may receive game play data indicating at least the selected portion of the game space from the game server 120 .

In response to a request for watching a game play from the viewpoint of at least one participant, the controller 240 may receive game play data corresponding to the viewpoint of at least one participant from the game server 120 .

In response to a request to watch the entire game play, the controller 240 may receive game play data corresponding to a point in time at which the game play of all participants can be watched from the game server 120 .

In various embodiments, the controller 240 requests game element data (ie, at least one of interface element data and in-game character data) from the game server 120 according to the request of the service providing server 140, and the game server ( After receiving game element data from 120 , the received game element data may be delivered to the service providing server 140 directly or through the game server 120 .

In various embodiments, the control unit 240 generates virtual reality image data based on game play data and/or broadcasting image data at the request of the service providing server 140, and converts the generated virtual reality image data to the service providing server ( 140) can be transmitted.

In the following, the service providing server 140 will be described in more detail with reference to FIG. 3 .

3 is a schematic block diagram of a service providing server according to an embodiment of the present invention.

Referring to FIG. 3 , the service providing server 300 includes a communication unit 310 , a storage unit 320 and a control unit 330 . In the presented embodiment, the service providing server 300 may mean the service providing server 140 of FIG. 1 .

The communication unit 310 connects the service providing server 300 to enable communication with an external device. The communication unit 310 is connected to the observer device 130, the user device 150, and the photographing device 160 using wired/wireless communication to transmit and receive various data.

Specifically, the communication unit 310 requests game play data, game element data, and/or virtual reality content from the observer device 130, and transmits game play data, game element data, and/or virtual reality content from the observer device 130. can receive The communication unit 310 receives a request for immersive content, broadcast image data, and/or virtual reality content from the user device 150, and transmits the request for immersive content, broadcast image data, and/or virtual reality content to the user device 150. can deliver.

The storage unit 320 may store various data used to provide various broadcast contents related to an e-sports game. For example, the storage unit 320 may store marker data used to implement immersive content.

In various embodiments, the storage unit 320 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg SD or XD memory, etc.), RAM, SRAM, ROM, EEPROM, PROM, magnetic memory. , a magnetic disk, and an optical disk may include at least one type of storage medium. The service providing server 300 may operate in relation to web storage that performs the storage function of the storage unit 320 on the Internet.

The control unit 330 is operably connected to the communication unit 310 and the storage unit 320, and can execute various commands to provide various broadcast contents related to e-sports games.

Specifically, when a request for immersive content including an image of a marker recognized by the user device 150 or a location of the marker is received from the user device 150, the controller 330 controls the marker stored in the storage 320. Among the data, the received marker image or marker data corresponding to the position of the marker may be checked, and the type of immersive content to be implemented may be checked based on the checked marker data.

The controller 330 is implemented from at least one of game play data received from the observer device 130, game element data, game screen data received from the game client device 110, and captured image data received from the photographing device 160. Resource data used to generate desired immersive content may be extracted, and immersive content may be created using the extracted resource data. The controller 330 may deliver the generated immersive content to the user device 150 .

The immersive content created in this way is the character shape expressed as a 3D object, character status (eg HP, SP, etc.), team information (eg team name, participant name, etc.), individual scores, team scores, acquired items, An augmented reality object representing at least one of used items, used skills, item effects, skill effects, damage effects, a game map, the location of each team member on the game map, and the game screen of each participant may be included, but is not limited thereto.

In various embodiments, when a request for immersive content of a specific participant is received from the user device 150, the controller 330 transmits at least one of interface component data, in-game character data, captured image data, and game screen data of the specific participant. Based on this, immersive content may be generated, and the generated immersive content may be delivered to the user device 150 . For example, a specific participant's request for immersive content may be performed when an image of a recognized marker on a marker recognition interface screen is selected. In this case, the controller 330 may generate immersive content for a specific participant upon request.

When a request for broadcasting video data is received from the user device 150, the controller 330 converts the broadcasting video data based on the game play data received from the observer device 130 and the captured video data received from the photographing device 160. generated, and the generated broadcasting image data may be transmitted to the user device 150 . For example, the broadcasting image data may be image data composed of a combination of at least one of an in-game participant screen, an in-game observer screen, and an e-sports stadium screen from various viewpoints.

In various embodiments, the controller 330 generates broadcasting image data based on the captured image data received from the photographing device 160 and the game screen data received from the game client device 110, and transmits the generated broadcasting image data to the user. It can also be delivered to the device 150.

In various embodiments, when a request for virtual reality content is received from the user device 150, the controller 330 requests the virtual reality content from the observer device 130, and receives the virtual reality content from the observer device 130. The virtual reality content may be transmitted to the user device 150 .

In various embodiments, when a request for immersive content related to an event and/or advertisement is received from the user device 150, the control unit 330 generates immersive content related to the event and/or advertisement, and generates event and/or advertisement related immersive content. Related immersive content may be delivered to the user device 150 .

In various embodiments, a request for immersive content related to an event and/or advertisement may be received from a user device by recognizing a marker disposed at a characteristic location of an e-sports stadium or broadcast video screen. In this case, the marker data for the corresponding marker may further include immersive content related to events and/or advertisements. The controller 330 may deliver immersive content related to an event and/or an advertisement related to a corresponding marker to the user device 150 .

In various embodiments, the controller 330 may transmit resource data used to implement immersive content to the user device 150 and allow the user device 150 to generate immersive content.

In the following, the user device 150 will be described in more detail with reference to FIG. 4 .

4 is a schematic block diagram of a user device according to an embodiment of the present invention.

Referring to FIG. 4 , the user device 400 includes a camera unit 410, a communication unit 420, a display unit 430, a storage unit 440, and a control unit 450. In the presented embodiment, the user device 400 may mean the user device 150 of FIG. 1 .

The camera unit 410 may capture a real space and generate image data for the real space.

The communication unit 420 connects the user device 400 to enable communication with an external device. The communication unit 420 is connected to the service providing server 140 using wired/wireless communication to transmit/receive various data. Specifically, the communication unit 420 may transmit a request for at least one of broadcasting image data, immersive content, and virtual reality content to the service providing server 140 . Also, the communication unit 420 may receive at least one of broadcasting image data, immersive content, and virtual reality content from the service providing server 140 .

The display unit 430 may display various contents (eg, text, images, videos, icons, banners, or symbols) to the user. In detail, the display unit 430 may display various interface screens for viewing e-sports games or broadcasting of e-sports games.

In various embodiments, the display unit 430 may include a touch screen, and may receive, for example, a touch, gesture, proximity, drag, swipe, or hovering input using an electronic pen or a part of the user's body. .

The storage unit 440 may store various data used to watch an e-sports game or watch a broadcast related to an e-sports game. In various embodiments, the storage unit 440 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg SD or XD memory, etc.), RAM, SRAM, ROM, EEPROM, PROM, magnetic memory. , a magnetic disk, and an optical disk may include at least one type of storage medium. The user device 400 may operate in relation to web storage that performs the storage function of the storage unit 440 on the Internet.

The controller 450 is operatively connected to the camera unit 410, the communication unit 420, the display unit 430, and the storage unit 440, and various functions for watching e-sports games or watching broadcasts related to e-sports games are provided. commands can be executed.

Specifically, the controller 450 may display various interface screens for viewing e-sports games or broadcasting related to e-sports games through the display unit 430 .

The controller 450 may provide an interface screen for requesting immersive content related to an e-sports game, and display an interface screen for recognizing markers upon request through the corresponding interface screen. For example, the marker recognition interface screen may be a camera capture screen, a QR code recognition screen, and/or a barcode recognition screen, but is not limited thereto, and various recognition screens for recognizing markers may be used. In various embodiments, the controller 450 may display an interface screen for recognizing a preset graphic object to provide immersive content.

The controller 450 may capture a marker disposed at a preset location of the e-sports stadium or a marker displayed on a display device disposed in the e-sports stadium to display broadcasting image data through the camera unit 410 . These markers may be projected at a predetermined location in the real space by a marker display device of an e-sports stadium, or broadcast image data including markers may be generated by the service providing server 140 and displayed through the display device.

The controller 450 may recognize a marker from a captured image and transmit a request for immersive content including an image or location of the recognized marker to the service providing server 140 . In various embodiments, the control unit 450 may transmit a request for immersive content to the service providing server 140 and recognize a marker from a captured image, but is not limited thereto. Requests can be performed in various orders.

When immersive content is received from the service providing server 140 , the controller 450 may display an augmented reality interface screen in which the received immersive content corresponds to the recognized marker through the display unit 430 . For example, an augmented reality interface screen may include an augmented reality object representing a team name, an augmented reality object representing each participant's character state, an augmented reality object representing a game ranking, an augmented reality object representing each participant's game screen data, and each It may include at least one of an augmented reality object representing a game map indicating a location of a participant.

In various embodiments, the controller 450 may request a request for broadcasting video data to the service providing server 140 according to a viewer's request, and may receive the broadcasting video data from the service providing server 140 . The controller 450 may display an interface screen representing the received broadcasting image data through the display unit 430 .

In various embodiments, the controller 450 may request a request for virtual reality content to the service providing server 140 and receive the virtual reality content from the service providing server 140 according to a viewer's request. The controller 450 may display an interface screen representing the received virtual reality content through the display unit 430 .

In various embodiments, when a request for immersive content from a specific participant is obtained, the controller 450 transmits the request to the service providing server 140 and receives immersive content related to the specific participant from the service providing server 140. can do. For example, a request for immersive content from a specific participant is determined by recognizing a marker related to the immersive content of the specific participant from image data captured through the camera unit 410 or among graphic objects disposed on the augmented reality interface screen. It can be performed when a graphic object for requesting immersive content for a specific participant is selected. Here, the immersive content related to a specific participant may be an augmented reality object generated based on at least one of interface component data, in-game character data, captured image data, and game screen data of the specific participant.

The controller 450 may display an augmented reality interface screen in which the received immersive content corresponds to the recognized marker of a specific participant.

In various embodiments, the user device 400 requests a marker from the service providing server 140 according to a viewer's request, and when the marker is received from the service providing server 140, a projector for projecting the received marker into a real space, etc. The same marker display module (not shown) may be further included.

In various embodiments, the controller 450 may receive resource data used to implement immersive content from the service providing server 140 and generate immersive content using the received resource data.

In various embodiments, the controller 450 may recognize a preset graphic object in order to provide immersive content among e-sports game broadcasting images through the camera unit 410 . Here, a broadcast video of an e-sports game may be displayed through a display unit of an electronic device that reproduces the broadcast video, and a preset graphic object may be included in the broadcast video. For example, the controller 450 may recognize a preset graphic object corresponding to at least a part of a broadcasting image displayed through a display unit of an electronic device through a camera unit. When a graphic object is recognized, the controller 450 may transmit a request for immersive content corresponding to the recognized graphic object to the service providing server 140 .

When immersive content is received from the service providing server 140 , the controller 450 may display an augmented reality interface screen related to the received immersive content through the display unit 430 .

As described above, the present invention can give viewers a more vivid sense of immersion by providing an effect as if they are watching an e-sports game in a game space.

In the following, a method of providing immersive content related to an e-sports game from the service providing server 140 will be described with reference to FIG. 5 .

5 is a flowchart illustrating a method of providing an augmented reality interface related to an e-sports game in a user device according to an embodiment of the present invention. Operations described below may be performed by the control unit 330 of the service providing server 300 of FIG. 3 .

Referring to FIG. 5 , the service providing server 300 receives a request for immersive content from the user device 150 in response to the marker recognized by the user device 150 (S500). The request for immersive content may include an image of a marker recognized by the user device 150 or a location of the marker.

The service providing server 300 receives game play data received directly from the observer device 130 or through the game server 120, game element data, and directly from the game client device 110 or through the game server 120. Based on at least one of the received game screen data and the captured image data received from the photographing device 160, immersive content is generated (S510), and the generated immersive content is delivered to the user device 150 (S520). ).

Specifically, the service providing server 300 can check the received marker image or marker data corresponding to the location of the marker among the marker data stored in the storage unit, and check the type of immersive content to be implemented through the checked marker data. there is. Based on this, the service providing server 300 extracts resource data used to implement immersive content from at least one of the received game play data, game element data, game screen data, and captured image data, and extracts the extracted resource data. Immersive content can be created using data. The service providing server 300 may deliver the immersive content generated in this way to the user device 150 .

In the following, a method of providing an augmented reality interface related to an e-sports game in the user device 150 will be described with reference to FIG. 6 .

6 is a flowchart illustrating a method of providing an augmented reality interface related to an e-sports game in a user device according to an embodiment of the present invention. Operations described below may be performed by the controller 450 of the user device 400 of FIG. 4 .

Referring to FIG. 6 , the user device 400 captures an image through the camera unit 410, recognizes a marker in the captured image (S600), and displays immersive content related to an e-sports game in relation to the recognized marker. A request is made to the service providing server 140 (S610). Specifically, the user device 400 may transmit a request for immersive content including an image or location of a recognized marker to the service providing server 140 .

The user device 400 receives immersive content from the service providing server 140 (S620), and displays an augmented reality interface screen corresponding to the received immersive content to a marker (S630).

In the following, various augmented reality interface screens related to an e-sports game will be described with reference to FIGS. 7, 8, 9a and 9b.

7, 8, 9a and 9b are exemplary views illustrating various augmented reality interface screens related to an e-sports game according to an embodiment of the present invention. In the presented embodiment, various augmented reality interface screens may be displayed through the display unit 430 of the user device 400 .

Referring to FIG. 7 , the user device 400 captures an image including a marker 715 disposed in at least a part 700 of a real space through a camera unit 410, and recognizes the marker in the captured image. Afterwards, immersive content related to the recognized marker may be requested from the service providing server 140 . For example, at least a portion 700 of the real space may be at least a portion of an e-sports arena consisting of three walls and a floor, and game play devices 720, 725, 730 and 735) may be arranged. The marker 715 may be disposed at a specific position on the first wall surface 740 of the three walls of the e-sports arena.

When a request for immersive content is received, the service providing server 140 receives game play data directly from the observer device 130 or from the game server 120, game element data, and either directly from the game client device 110 or the game Based on at least one of the game screen data received from the server 120 and the captured image data received from the photographing device 160, immersive content related to the marker is generated, and the generated immersive content is transmitted to the user device 400. can be forwarded to For example, the generated immersive content includes the names of the teams in the game match (e.g. Team A, Team B), remaining game time (e.g. 02:35), each team's score (e.g. 79, 59), each participant's Augmented reality showing the items used, the state of each participant's character, each participant's game screen (e.g. P1 game screen, P2 game screen, P3 game screen, P4 game screen) and the game map showing the location of each participant's game character. Can contain objects (e.g. graphic objects).

When such immersive content is received, the user device 400 displays an augmented reality interface screen 745 in which the received immersive content corresponds to the recognized marker 715 through the display unit 430 as shown in FIG. 7 . can be displayed

The augmented reality interface screen 745 includes augmented reality objects 750 and 755 indicating team names of game matches, augmented reality objects 760 indicating remaining game time, augmented reality objects 765 and 770 indicating scores of each team, It may include augmented reality objects 775, 780, 785, and 790 representing each participant's used item, character state, and game screen, and an augmented reality object 795 representing a game map on which each participant's character location is displayed.

In the following, a case in which a marker is displayed on a part of a broadcasting screen of a display device disposed in an e-sports stadium will be described with reference to FIG. 8 .

Referring to FIG. 8 , the user device 400 displays a marker 810 disposed on at least a part of a broadcasting screen 805 displayed by a display device disposed on a wall of an e-sports arena 800 through a camera unit 410. After capturing an image including , and recognizing a marker in the captured image, immersive content related to the recognized marker may be requested from the service providing server 140 .

When a request for immersive content is received, the service providing server 140 receives game play data directly from the observer device 130 or from the game server 120, game element data, and either directly from the game client device 110 or the game Based on at least one of the game screen data received from the server 120 and the captured image data received from the photographing device 160, immersive content related to the marker is generated, and the generated immersive content is transmitted to the user device 400. can be forwarded to For example, the immersive content created can include the emblem of each team, the remaining game time, the number of live team members, the dead team members, the character currently attacking, the item effect used by that character, the opponent character image attacked, the opponent It may include an augmented reality object representing a game map in which the damage effect received by the character, the character state, and the character position of each participant are displayed.

When such immersive content is received, the user device 400 displays an augmented reality interface screen 815 in which the received immersive content corresponds to the position of the recognized marker 810, as shown in FIG. 8 , on the display unit 430. can be displayed through

The augmented reality interface screen 815 includes augmented reality objects 820 and 825 representing the emblem of each team, an augmented reality object 830 representing the remaining game time, an augmented reality object 835 and 840 representing the number of live team members, and a dead team member. Augmented reality objects (845, 850, 855) representing team members, augmented reality objects (860) representing character shapes currently under attack, augmented reality objects (865) representing item effects used by the character, and attacking opponent character shapes An augmented reality object 870 indicating an augmented reality object 870, an augmented reality object 875 indicating a damage effect received by an opponent character, an augmented reality object 880, 885 indicating a character state, and an augmented reality object indicating a game map displaying each participant's character location. (890).

In the following, a case in which a plurality of markers are disposed in an e-sports stadium will be described with reference to FIGS. 9A and 9B.

Referring to FIG. 9A , the user device 400 displays markers disposed at specific positions of game play devices 902, 904, 906, and 908 used by a plurality of participants in an e-sports arena 900 through a camera unit 410. 910 , 912 , 914 , and 916 may be recognized, and a request for immersive content related to each of the plurality of recognized markers may be transmitted to the service providing server 140 . For example, a first marker 910 is disposed at a specific location of a first game play device 902 used by a first participant, and a second marker 910 is placed at a specific location of a second game play device 904 used by a second participant. A marker 912 is placed, a third marker 914 is placed at a specific location of a third game play device 906 used by a third participant, and a fourth game play device 908 used by a fourth participant is specified. A fourth marker 914 may be disposed at the location.

Upon receiving the request for immersive content, the service providing server 140 requests game play data and game element data of the first participant, the second participant, the third participant, and the fourth participant from the observer device 130, and Game screen data of each of the first participant, the second participant, the third participant, and the fourth participant may be requested from user devices of the first participant, the second participant, the third participant, and the fourth participant.

Game play data and game element data of the first participant, the second participant, the third participant, and the fourth participant are received from the observer device 130, and each of the first participant, the second participant, the third participant, and the fourth participant is received. When game screen data of each of the first, second, third, and fourth participants is received from the user device, the service providing server 140 determines the first, second, and third participants based on the received data. And immersive content for each of the fourth participants may be generated, and the generated immersive content may be delivered to the user device 400 .

The user device 400 receiving the immersive content for each of the first participant, the second participant, the third participant, and the fourth participant shows the first participant, the second participant, the third participant, and the fourth participant, as shown in FIG. An augmented reality interface screen 918 in which immersive content for each of the four participants is corresponded to the recognized first marker, second marker, third marker, and fourth marker may be displayed through the display unit 430 .

The augmented reality interface screen 918 includes augmented reality objects 920 and 922 representing the team names (eg, team A and team B) of the first participant, the second participant, the third participant, and the fourth participant, and the augmented reality object representing the type of game. A reality object 924, an augmented reality object 926 representing the character shape, character state, and game screen of the first participant, an augmented reality object 928 representing the character shape, character state, and game screen of the second participant, An augmented reality object 930 representing the character shape, character state, and game screen of the third participant, an augmented reality object 932 representing the character shape, character state, and game screen of the fourth participant, and the character position of each participant may include an augmented reality object 934 representing the game map shown.

In various embodiments, when the character of the fourth participant is attacked by another participant in the game, the augmented reality interface screen 918 may further include an augmented reality object 936 representing a damage effect received by the character of the fourth participant. there is.

In various embodiments, when an augmented reality object 938 representing a character shape of a third participant is selected by a viewer, the user device 400 may transmit a request for a detailed specification of the character of the third participant to the service providing server 140. there is. Upon receiving this request, the service providing server 140 creates an augmented reality object representing the detailed specifications of the character of the third participant based on the game element data received from the observer device 130, and sends the generated augmented reality object to the user device. (400).

Upon receiving this, the user device 400 may further display an augmented reality object 940 indicating detailed specifications of the character of the third participant on the augmented reality interface screen 918 as shown in FIG. 9A .

In various embodiments, as shown in FIG. 9B , an image including a marker 944 disposed on the floor 942 of an e-sports stadium is captured through the camera unit 410, and the marker 944 is recognized from the captured image. If so, the user device 400 may transmit a request for immersive content corresponding to the recognized marker 944 to the service providing server 140 .

The user device 400 may receive immersive content representing information about the participants of Team A and Team B from the service providing server 140 . As shown in FIG. 9B , the user device 400 may display an augmented reality interface screen 946 in which the received immersive content corresponds to the position of the recognized marker 944 .

Referring to FIG. 9B , an augmented reality interface screen 946 is an augmented reality object 948 representing the image, affiliation, name, and win rate of the participants of team A and the image, affiliation, name, and and the odds ratio may include an augmented reality object 950 .

Hereinafter, an augmented reality screen related to AR glasses will be described with reference to FIG. 10 .

10 is an exemplary diagram illustrating an augmented reality interface screen related to AR glasses according to an embodiment of the present invention. In the presented embodiment, a case in which the user device 400 is AR glasses will be described.

Referring to FIG. 10 , when a user wears the AR glasses 400 and there is a request to use a service related to immersive content, the AR glasses 400 use a camera (not shown) provided in the AR glasses 400. At least a part (1000) of the e-sports stadium is photographed through the camera, and at least a part (1000) of the e-sports stadium is recognized from the captured image to provide immersive content related to the at least part (1000) of the e-sports stadium. ) can be requested.

To this end, when at least a part 1000 of the e-sports arena is recognized, the AR glasses 400 may be set in advance to request immersive content. When immersive content is received from the service providing server 140, the AR glasses 400, as shown in FIG. (1005) may be displayed through the display unit 430.

The augmented reality interface screen 1005 includes augmented reality objects 1010 and 1015 representing the emblem of each team, augmented reality objects 1020 representing the remaining game time, augmented reality objects 1025 and 1030 representing the number of live team members, and dead Augmented reality objects (1035, 1040, 1045) representing team members, augmented reality objects (1045) representing character shapes currently under attack, augmented reality objects (1050) representing item effects used by the character, and attacking opponent character shapes Augmented reality object 1055 representing, augmented reality object 1060 representing the damage effect received by the opponent character, augmented reality object 1065, 1070 representing the character state, and augmented reality object representing the game map where each participant's character location is displayed (1075).

The configuration of the augmented reality interface screen, augmented reality object, and immersive content described in the present embodiment is not limited to the above, and the graphic objects included or configured in each augmented reality interface screen, augmented reality object, and immersive content are It can be configured in various ways.

As described above, the present invention provides immersive content to spectators watching e-sports events, thereby providing viewers with a vivid sense of immersion as if directly experiencing game play, thereby maximizing satisfaction with watching e-sports events.

Devices and methods according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in computer readable media. Computer readable media may include program instructions, data files, data structures, etc. alone or in combination.

Program instructions recorded on a computer readable medium may be specially designed and configured for the present invention or may be known and usable to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. - Includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media and ROM, RAM, flash memory, etc. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler.

The hardware device described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

Although the embodiments of the present invention have been described in more detail with reference to the accompanying drawings, the present invention is not necessarily limited to these embodiments, and may be variously modified and implemented without departing from the technical spirit of the present invention. . Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain, and the scope of the technical idea of the present invention is not limited by these embodiments. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. The protection scope of the present invention should be construed according to the claims below, and all technical ideas within the equivalent range should be construed as being included in the scope of the present invention.

100: broadcast service system
110: game client device
120: game server
130: observer device
140: service providing server
150: user device
160: shooting device

Claims (14)

a camera unit configured to capture an image;
a communication unit configured to transmit and receive data;
a display unit configured to display data; and
A control unit operably connected to the camera unit, the communication unit, and the display unit;
The control unit,
Displaying an interface screen for requesting immersive content related to an e-sports game through the display unit;
According to a user request through the interface screen, a marker is projected onto at least a part of the space of the e-sports arena where the e-sports game takes place;
recognizing a marker from an image captured through the camera unit;
By transmitting marker data including the image and position of the recognized marker through the communication unit, any one immersive content to be implemented corresponding to the marker data among several types of immersive content related to the e-sports game is displayed. Make a request to the service providing server,
Through the communication unit, at least one of game element data related to the e-sports game, game play data, game screen data of each participant participating in the e-sports game, and video data taken by each participant receives the immersive content of any one of the above. Receiving resource data used to implement from the service providing server in real time,
generating one of the immersive contents including an augmented reality object displayed to be overlapped with the e-sports stadium in correspondence to the recognized marker using the resource data;
An apparatus for providing an augmented reality interface related to an e-sports game, configured to display the generated immersive content through the display unit through an augmented reality interface screen including the augmented reality object. delete delete delete The method of claim 1, wherein the game element data,
Includes at least one of interface component data constituting at least a part of the in-game interface screen of each participant, and in-game character data;
The in-game character data includes at least one of a game character, an item in use, a skill in use, an item effect, a skill effect, and a damage effect. The method of claim 1, wherein the game play data,
An apparatus for providing an augmented reality interface related to an e-sports event, wherein the in-game screen data is acquired by at least one observer device configured to watch at least a portion of a game space where the game play is performed, and is related to the game play of each participant. The method of claim 1, wherein the marker,
Arranged at a predetermined location in a part of the space of the e-sports stadium where the e-sports game takes place, or displayed at a predetermined position on a broadcast video screen related to the e-sports game displayed on a display device disposed in a part of the space of the e-sports stadium. A further configured device for providing an augmented reality interface related to an e-sports game. A method for providing an augmented reality interface performed in an apparatus for providing an augmented reality interface related to an e-sports game,
displaying an interface screen for requesting immersive content related to an e-sports game;
projecting a marker on at least a part of space of an e-sports arena where the e-sports game is held according to a user request through the interface screen;
Recognizing a marker from the photographed image by photographing an image through a camera unit;
Marker data including the image and position of the recognized marker is delivered, and any one immersive content to be implemented in response to the marker data among several types of immersive content related to the e-sports game to the service providing server. making a request;
Used to implement any one of the immersive content from at least one of game element data, game play data, game screen data of each participant participating in the e-sports game, and video data taken by each participant of the e-sports game receiving resource data from the service providing server in real time;
generating any one of the immersive contents including an augmented reality object displayed to be overlapped with the e-sports venue in correspondence with the recognized marker using the resource data; and
and displaying the generated immersive content on an augmented reality interface screen including the augmented reality object. delete delete delete The method of claim 8, wherein the game element data,
Includes at least one of interface component data constituting at least a part of the in-game interface screen of each participant, and in-game character data;
The in-game character data includes at least one of a game character, an item in use, a skill in use, an item effect, a skill effect, and a damage effect. The method of claim 8, wherein the game play data,
A method of providing an augmented reality interface for an e-sports game, wherein the in-game screen data is acquired by at least one observer device configured to watch at least a portion of a game space where the game play is performed, and the game screen data is related to each participant's game play. The method of claim 8, wherein the marker,
Arranged at a predetermined location in a part of the space of the e-sports stadium where the e-sports game takes place, or displayed at a predetermined position on a broadcast video screen related to the e-sports game displayed on a display device disposed in a part of the space of the e-sports stadium. A further configured method of providing an augmented reality interface related to an e-sports event.

Images