KR102654097B1 - Immersive system for sports contents relay transmission and hmd-based viewing method thereof and recording medium storing program for executing the same, and computer program stored in recording medium for executing the same - Google Patents

Abstract

The present invention relates to a technology that allows sports content viewers to watch realistic broadcasts using virtual reality (VR) technology. Specifically, a small camera is attached to the body of a person participating in a sports game, and the An immersive sports broadcast transmission and viewing system and method, and a program to implement the same, that allow viewers wearing HMDs to watch the sports broadcast from the perspective of a person participating in a sports game by transmitting video signals in real time It provides a stored recording medium and a computer program stored on the medium to implement it.

Description

Realistic sports broadcast transmission and viewing system and method, recording medium storing a program for implementing the same, and computer program stored on the medium to implement the same PROGRAM FOR EXECUTING THE SAME, AND COMPUTER PROGRAM STORED IN RECORDING MEDIUM FOR EXECUTING THE SAME}

The present invention relates to a technology that allows sports content viewers to watch realistic broadcasts using virtual reality (VR) technology. Specifically, a small camera is attached to the body of a person participating in a sports game, and the When video signals are transmitted in real time, a realistic sports broadcast transmission and viewing system and method that allows viewers wearing HMDs to directly watch the sports broadcast from the perspective of a person participating in a sports game, and a program to implement the same are provided. It relates to stored recording media and computer programs stored on the media to implement them.

Virtual reality does not only mean a virtual world created by a computer, but also includes the world of content realized by live-action video.

The virtual world created by a computer is a narrow concept.

As a broad concept, virtual reality includes all types of media experiences.

For example, in the case of live sports broadcasts, viewers do not watch directly at the actual stadium, but experience the audio-visual experience indirectly through the medium of television from a remote location, and a slight time difference may occur during the video signal transmission process.

In other words, since the sports game is experienced indirectly through the medium of television rather than directly experienced in the real world where the viewer's body is located, the general definition of the concept in academia is to include it in the category of virtual world as a concept relative to the real world. .

In particular, recently, the term 'realistic media' has been added to the concept of virtual reality, and it is also called 'virtual reality immersive media', and the academic definition of it is as follows.

'With the commercialization of 5G technology and the spread of smart devices, immersion and 'Media that maximizes the sense of presence and provides the feeling of actually experiencing it' (Kyeong-ah Lee. (2021). Research on realistic media technology in the world of Metaverse. Journal of the Korea Computer and Information Society, Vol. 26 No. 9, pp. 73- 79, September 2021.)

‘Media that is personal, subjective, and relative rather than objective and allows users to experience media content in a way that makes it feel real’ (Kim Se-woong, Cho Yun-seong. (2019). A case study of realistic media services using virtual reality technology. Korea Design Research. , 4(2), 29-38.)

‘It aims to stimulate the user’s five senses by maximizing the two elements of immersion and realism, and is a media that allows users to gain a variety of experiences that cannot be experienced in the real world.’ It is ‘to give users a sense of realism and immersion. 'Media that makes you see, hear, and feel through the five senses and is expressed beyond the constraints of time and space' (Wan-gyu Jeong. (2015). How to prepare realistic media?, Hallym ICT Policy Journal.)

‘It is a next-generation media that seeks to reproduce the real world as closely as possible, and can provide significantly better expressive power, clarity, and a sense of reality than the media currently used through the five senses’ (Hyun-cheol Lee, Im-cheol Kang, Eun-seok Kim, Gi-taek Heo. (2011) . Development status and development prospects of realistic media services using IPTV. Journal of the Korean Multimedia Society, 15(3·4), 39-47.)

Virtual Reality not only presents fictional situations, but also presents real situations.

The conceptual/theoretical foundation of virtual reality starts from the concept of presence related to immersion, and Minsky (Minsky, M.. (1980). Telepresence. Omni. quoted in Sheridan, T. B. (1992), Musings on telepresence and virtual presence. Presence: Teleoperators and Virtual Environments.

For example, in ocean exploration, the operator of a remote control system is operating a deep-sea submersible on an exploration vessel, but feels that he or she is directly on board (being) operating the deep-sea submersible. The phenomenon of causing an internal sensation in the operator (user) to feel that his or her presence is located far away is called ‘tele-presence.’

In this regard, the International Telecommunication Union (ITU), which regulates international technical standards for HDTV and UHDTV as recommendations, defines them as follows.

The International Technical Standard Recommendation ITU-R BT.2020-2 standard defines UHDTV properties as follows.

UHDTV will provide viewers with an enhanced visual experience primarily by having a wide field of view...(UHDTV provides viewers with an enhanced visual experience with a wider viewing angle)

...they will provide viewers with an increased sense of "being there" and increased sense of reality... (Through this, viewers experience an increased sense of 'presence' and 'sense of reality'.)

Technical report ITU-R BT.2246-7 (10/2020) defines UHDTV as follows.

Television has built its history on the fundamental desire of human beings to extend their audiovisual senses spatially and temporally. (Television was built from humans' fundamental desire to expand their audiovisual senses spatially and temporally.)

UHDTV is a television application that is intended to provide viewers with an enhanced visual experience primarily by offering a wide field of view that virtually covers all of the human visual field with appropriate sizes of screens relevant to usage at home and in public places.(UHDTV is a television method that provides an improved visual experience to viewers by providing a viewing angle that virtually fills the entire human viewing range with an appropriately sized screen at home or in public places.)

Compared with current HDTV, the UHDTV application should bring significantly improved benefits to its viewers. (Compared with existing HDTV, UHDTV provides significantly improved benefits to viewers.)

a. stronger sensation of reality or presence

b. higher transparency to the real world

c. more information

It will provide a stronger sensation of reality and a stronger immersive feeling to viewers by offering a much wider field of view than current systems can offer. provides.)

Meanwhile, technology that combines virtual reality (VR) and augmented reality (AR), a technology that adds virtual information to the real world, is called mixed reality (MR).

However, AR is a method of adding virtual information to actual reality.

MR combines AR and VR to provide a mix of real and virtual information in a realistic background, and requires technology that can process large amounts of data.

HMD (Head Mount Display) is commonly used to experience virtual reality. It is a display device that is mounted on the user's head to experience VR. It blocks the user's gaze from the outside and then displays the virtual world from the user's perspective. Do it. It is worn on the face so that the display is in front of the eyes, and can be equipped with a microphone, stereo speakers, and various sensors.

VR, which has been mainly used in the area of games, is expected to change the existing media form as it is also used to watch movies, dramas, and sports broadcasts.

In order to convert sports game videos to VR, high-speed and large-capacity data are essential. VR requires a total of 720 million pixel information, consisting of at least 30,000 horizontal and 24,000 vertical pixels based on a still screen, and considering left and right rotation, it must handle about 2.5 billion pixel information. . Therefore, VR videos generally require at least four times more data than existing videos, and a transmission speed of 800Mbps or more is required. In order to realistically experience various sports games in VR, it is necessary to provide not only high-definition video but also high FPS-based video.

In order to implement VR video at 60FPS (Frame Per Second), transmission within 16.67ms is required between end-to-end video frames.

In conventional sports broadcasting, multiple cameras are installed so that the stadium is visible, and images captured by any one of the multiple cameras are transmitted.

However, with this method, you generally only see the screen that the broadcasting station wants to show, so you only passively watch the broadcast.

Usually, when watching a sports game, there is a limitation in that scenes outside the camera's field of view cannot be seen.

In addition to these limitations, when watching a typical sporting event, spectators are located outside the stadium and cannot enter the area where the players are playing.

Since the camera must be located outside the stadium area so as not to interfere with the players' game, there is a problem that even when watching a sports game on television, it has no choice but to experience it indirectly in the virtual world rather than the real world.

Additionally, there is a problem that viewers cannot select and view the screen they want to view.

Additionally, there is a problem that the game cannot be viewed from the perspective of those directly participating in the game.

Korea Patent Publication [10-2021-0084248] discloses a method and device for providing a VR content relay platform.

Korean published patent [10-2021-0084248] (Publication date: July 7, 2021)

Therefore, the present invention was created to solve the problems described above, and the purpose of the present invention is to attach a small camera to the body of a person participating in a sports game, and relay and transmit the video signal in real time to use the HMD. A realistic sports broadcast transmission and viewing system and method that allows viewers wearing the sport to watch the sports broadcast from the perspective of a person directly participating in a sports game, a recording medium storing a program for implementing the same, and a recording medium stored in the medium for implementing the same. It provides computer programs.

The purposes of the embodiments of the present invention are not limited to the purposes mentioned above, and other purposes not mentioned will be clearly understood by those skilled in the art from the description below. .

An realistic sports broadcast transmission and viewing system according to an embodiment of the present invention for achieving the above-described object includes a mobile camera 100 attached to the body or equipment of a person participating in a sports game; An image collection unit 200 that receives image data captured from the mobile camera 100; A data conversion unit 300 that converts the image data collected from the image collection unit 200 into a designated standard; a video transmission unit 400 that transmits the video data converted from the data conversion unit 300 to the video relay unit 500; a video relay unit 500 that stores and manages video data collected from the video transmission unit 400; a video receiving unit 600 that receives required video data from the video relay unit 500; And an image playback unit 700 that is connected to the image receiver 600 and plays a 3D (Three Dimensions) image on an HMD (Head Mount Display), wherein the data conversion unit 300 or the image relay unit 500 ) is characterized by transmitting 3D images by applying 3D conversion technology.

In addition, the video relay unit 500 provides an option to follow the viewpoint of the player who appears on the main screen in the main broadcast, an option to follow the viewpoint of the player in possession of the ball, an option to follow the attacker's viewpoint, and an option to follow the defender's viewpoint. Provides the ability to select one of a plurality of options, including at least one option selected among options, an option to select the screen viewed by the most viewers, and a random option, and transmits the screen corresponding to the selected option. Do it as

In addition, the video relay unit 500 is characterized in that when the viewer selects the AI reception mode through the video receiver 600, the video from a specific mobile camera 100 is automatically transmitted based on machine learning. .

In addition, the video relay unit 500 is characterized in that it displays the profile of the main character matching the mobile camera 100 of the screen currently being viewed on one side of the screen.

A method of transmitting and viewing realistic sports broadcasting according to an embodiment of the present invention is a method of transmitting and viewing realistic sports broadcasting in the form of a program executed by an operation processing means including a computer, comprising: an image collection unit 200; An image collection step (S10) of receiving image data captured from the mobile camera 100; A data conversion step (S20) in which the data conversion unit 300 converts the image data collected from the image collection unit 200 into a specified standard; A video transmission step (S30) in which the video transmission unit 400 transmits the video data converted from the data conversion unit 300 to the video relay unit 500; A video relaying step (S40) in which the video relay unit 500 stores and manages video data collected from the video transmission unit 400; A video receiving step (S50) in which the video receiving unit 600 receives required video data from the video relay unit 500; And a video playback step (S60) in which the video playback unit 700 is connected to the video receiver 600 and plays a 3D (Three Dimensions) image on an HMD, wherein the data conversion step (S20) or the video relay step (S40) is characterized by transmitting 3D images by applying 3D conversion technology.

In addition, the video broadcasting step (S40) includes an option to follow the viewpoint of the player who appears on the main screen in the main broadcast, an option to follow the viewpoint of the player in possession of the ball, an option to follow the attacker's viewpoint, and an option to follow the defender's viewpoint. Provides the ability to select one of a plurality of options, including at least one option selected among options, an option to select the screen viewed by the most viewers, and a random option, and transmits the screen corresponding to the selected option. Do it as

In addition, the video relay step (S40) is characterized in that when the viewer selects the AI reception mode through the video receiver 600, the video from a specific mobile camera 100 is automatically transmitted based on machine learning. .

In addition, the video broadcasting step (S40) is characterized by displaying the protagonist's profile matching the mobile camera 100 of the currently viewed screen on one side of the screen.

In addition, according to one embodiment of the present invention, a computer-readable recording medium storing a program for implementing the method of transmitting and viewing realistic sports broadcasts is provided.

In addition, according to one embodiment of the present invention, in order to implement the method of transmitting and viewing realistic sports broadcasts, a program stored in a computer-readable recording medium is provided.

According to an embodiment of the present invention, an realistic sports broadcast transmission and viewing system and method, a recording medium storing a program for implementing the same, and a computer program stored in the medium for implementing the same, the body of a person participating in a sports game By attaching a small camera to the screen and transmitting the video signal in real time, viewers wearing HMDs can watch the sports broadcast from the perspective of a person participating in the sports game, allowing viewers of sports content to experience realistic broadcasting. There is an effect of being able to watch broadcasts.

In addition, conventionally, all sports broadcasts were installed outside the stadium, but there is an effect of broadcasting a realistic immersion feeling by installing small portable (wearable) cameras to people inside the stadium, such as players or referees.

In addition, by selecting a specific option, the viewpoint (channel) is automatically changed according to the option, which has the effect of allowing the viewer to automatically select the video he or she wants among several videos, making viewing more convenient.

In addition, by automatically changing the viewpoint (channel) based on machine learning, the video according to the viewer's taste can be automatically selected, making viewing more convenient.

In addition, by showing the profile of the main character of the currently displayed screen on one side of the screen, it is possible to confirm that the video was filmed from whose perspective, which has the effect of further increasing immersion in the game.

1 is a block diagram of an realistic sports broadcasting transmission and viewing system according to an embodiment of the present invention.
Figure 2 is a flowchart of a method for transmitting and viewing realistic sports broadcasts according to an embodiment of the present invention.

Since the present invention can make various changes and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all changes, equivalents, and substitutes included in the spirit and technical scope of the present invention.

When a component is said to be "connected" or "connected" to another component, it is understood that it may be directly connected to or connected to the other component, but that other components may exist in between. It should be.

On the other hand, when it is mentioned that a component is “directly connected” or “directly connected” to another component, it should be understood that there are no other components in between.

The terms used herein are merely used to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, processes, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, processes, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by a person of ordinary skill in the technical field to which the present invention pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and should not be interpreted as having an ideal or excessively formal meaning unless explicitly defined in the present application. No.

Hereinafter, the present invention will be described in more detail with reference to the attached drawings. Prior to this, the terms or words used in this specification and claims should not be construed as limited to their usual or dictionary meanings, and the inventor should appropriately define the concept of terms in order to explain his or her invention in the best way. Based on the principle of definability, it must be interpreted with meaning and concept consistent with the technical idea of the present invention. In addition, if there is no other definition in the technical and scientific terms used, they have meanings commonly understood by those skilled in the art to which this invention pertains, and the gist of the present invention is summarized in the following description and accompanying drawings. Descriptions of known functions and configurations that may be unnecessarily obscure are omitted. The drawings introduced below are provided as examples so that the idea of the present invention can be sufficiently conveyed to those skilled in the art. Accordingly, the present invention is not limited to the drawings presented below and may be embodied in other forms. Additionally, like reference numerals refer to like elements throughout the specification. It should be noted that like elements in the drawings are represented by like symbols wherever possible.

Figure 1 is a block diagram of a realistic sports broadcast transmission and viewing system according to an embodiment of the present invention, and Figure 2 is a flowchart of an realistic sports broadcast transmission and viewing method according to an embodiment of the present invention.

As shown in FIG. 1, the realistic sports broadcast transmission and viewing system according to an embodiment of the present invention includes a mobile camera 100, an image collection unit 200, a data conversion unit 300, and an image transmission unit 400. , includes a video relay unit 500, a video receiver 600, and a video playback unit 700, and the data conversion unit 300 or video relay unit 500 applies 3D conversion technology to display 3D It is characterized by transmitting video.

Parallax, caused by the difference in human eye distance (average 6.5 cm), transmits two different two-dimensional images to the brain.

The left and right images transmitted in this way are recognized as one three-dimensional image through the brain.

Just like two eyes, two cameras are placed left and right, and left and right images are captured simultaneously through the camera lens.

By screening the left and right images captured in this way using specific equipment, a three-dimensional effect is acquired.

A difference called binocular parallax occurs in the captured left and right images due to the distance between the two cameras.

3D conversions technology can be broadly divided into two types. The first is to film by installing two cameras on equipment called a rig at the filming site, similar to the method used in movie shooting, and the second is to film and produce 3D stereoscopic images using a virtual camera in the software. This is how to do it.

The method of shooting by installing two cameras is divided into the horizontal rig method and the vertical rig method depending on the way the cameras are placed.

The horizontal rig is a method of shooting by arranging two cameras horizontally, like the human eye.

The characteristics of the horizontal rig are that there is no reduction in exposure, no color difference between the left and right images, and that it is easy to use grip equipment. However, if the volume of the two cameras is large, the two lenses can be placed smaller than the average human eye distance of 6.5cm. Since there is no such thing, close-up photography is difficult due to limitations in controlling the distance between axes.

Vertical rigs have the advantage of being able to minimize the distance between axes, which is a disadvantage of horizontal rigs, allowing close-up photography and mounting various cameras and lenses. However, there is light loss due to the half mirror, and there is color difference between the left and right images due to mirror quality.

When humans look at an object, both eyeballs rotate and focus on the intersection of the two eyes. This intersection becomes a point where binocular disparity does not occur.

In the process of shooting 3D stereoscopic images, the focus is adjusted by rotating the two cameras.

Like this, the point where the viewpoints of the two cameras intersect is called the zero point (Zero Parallax Point), and there are three convergence angle configuration methods to adjust the zero point (Zero Parallax Point) when shooting 3D stereoscopic images using a rig. Use .

The three main angle composition methods are parallel, complex, and convergence, and the convergence method is mainly used.

When using the 3D conversion method in 2D to 3D stereoscopic conversion,

In terms of the result, the three-dimensional effect of space and characters is expressed like a paper puppet show (card-board effect).

Considering these issues with the quality of the results, it is possible to properly express the sense of volume by adopting a method of shooting by installing two cameras on equipment called a rig at the shooting site, which is useful in virtual reality realistic video. It can be said to be desirable because it is a very important element.

The software method of using a virtual camera is a method of using a virtual camera supported by software.

By using a stereo camera consisting of two virtual cameras placed on the monitor screen, it is possible to shoot 3D stereoscopic images by easily adjusting the inter-axial distance and zero point of the two cameras just by controlling the mouse.

This virtual 3D stereoscopic camera uses a horizontal rig arrangement and uses a convergence method as the viewing angle control method.

This is because in live-action shooting, it is difficult to shoot while adjusting the distance between axes to the minimum due to the volume of the camera, while software cameras have no restrictions on adjusting the camera gap.

Additionally, the runaway method used in live-action shooting causes keystone distortion in the captured left and right images.

Therefore, post-production work to correct keystone distortion is necessary during the post-shooting process, but the stereo camera consisting of two virtual cameras in 3D software supports the function of outputting without keystone distortion.

The mobile camera 100 is attached to the body or equipment of a person participating in a sports game.

For example, in the case of baseball, a player or umpire can install a mobile camera 100 on protective equipment such as a helmet, and when playing a game while wearing protective equipment with the mobile camera 100 installed, the viewpoint of the player or umpire is recorded. You can collect game video from .

People participating in a sports game are anyone who can be inside the stadium, such as players and referees.

The format of the mobile camera 100 can be a single lens type or a dual lens type, and the specifications are 2K (1920*1080) or 4K (3840*2160), 8K, 60P (59.94P), H.265 codec. Various applications are possible.

The image collection unit 200 receives image data captured from the mobile camera 100.

The image collection unit 200 includes an antenna, receives image data captured from the mobile camera 100, and stores it in a designated storage space.

At this time, the image collection unit 200 can receive image data wirelessly.

The data conversion unit 300 converts the image data collected from the image collection unit 200 into a designated standard.

The data conversion unit 300 converts the video signal into a form that is advantageous for transmission through a designated communication network such as a 5G dedicated communication network.

The data conversion unit 300 can convert image data into a designated standard such as 8-bit, 10-bit, or 4:2:0 YUV sampling conversion.

The video transmission unit 400 transmits the video data converted from the data conversion unit 300 to the video relay unit 500.

At this time, the video transmission unit 400 can transmit the converted video data to the video relay unit 500 by wire.

The video relay unit 500 stores and manages video data collected from the video transmission unit 400.

The video relay unit 500 is capable of transmitting the collected video data to the Internet (online) upon external request.

For example, it can be possible to watch live streaming or replay through a website.

The video receiver 600 receives the necessary video data from the video relay unit 500.

The video receiver 600 refers to a terminal that requests video to watch video, such as a computer, set-top box, or smart device.

For example, the video receiving unit 600 can access a website managed by the video relay unit 500 and request a channel that the viewer wants to view, or request a change in resolution, etc.

The image playback unit 700 is connected to the image receiver 600 and plays a 3D (Three Dimensions) image through a HMD (Head Mount Display).

Here, the connection may be an electrical connection (connection capable of communication) or a mechanical connection.

The HMD may have a built-in processing device for processing and reproducing virtual reality images, and may be connected to the image receiving unit 600 to output image information received from the image receiving unit 600 using a display.

The image receiving unit 600 may be a user terminal or a computing device connected to a server. Depending on the embodiment, the HMD may output a virtual reality image based on information received from the server.

Depending on the embodiment, the HMD may not have a built-in processing device or display, but may be configured to accommodate a user terminal (smart device, etc.) and utilize the display of the user terminal.

The core concept of the realistic sports broadcast transmission and viewing system according to an embodiment of the present invention is to attach a small camera to the body of a player (or referee) located inside the stadium, which has been an inviolable area so far, and the user views the transmitted video as a virtual reality. The key is to have the effect of watching the game directly from the ‘player’s perspective’ by viewing it through HMD, a real-life tool.

This is the presence theory of immersion based on the ITU international technical standards, for example, Heeter (Heeter, C. (1992). Being There: The subjective experience of presence. Presence: Teleoperators and Virtual Environments. MIT Press.) 'The sense of being there' defined by Lombard & Ditton (Lombard, M., & Ditton, T. (1997). At the Heart of It All: The Concept of Presence. Journal of Computer Mediated Communication, 3(2).), Biocca(Biocca, F. (1997). The cyborg's dilemma: Progressive embodiment in virtual environments. Journal of computer-mediated communication, 3(2), JCMC324.), etc. as defined by the ‘viewer himself. The key is to actually implement theoretical concepts related to immersion in virtual reality, such as 'you are there' or 'it is here'.

For example, in the case of a baseball broadcast, a realistic sports broadcast transmission and viewing system according to an embodiment of the present invention, a small camera is attached to the catcher's face shield and the video signal is transmitted in real time, and the viewer wearing the HMD You can watch the baseball game from the catcher's perspective. Viewers can change the channel of the video signal, which allows them to watch realistic sports games from the perspectives of players in various positions, such as umpires, pitchers, and first basemen.

In the case of existing sports games, the broadcasting camera is located outside the stadium, so the viewer is positioned from the perspective of a spectator outside the stadium. However, by using the realistic sports broadcast transmission and viewing system according to an embodiment of the present invention, the viewer can directly watch the players inside the stadium. It is possible to have a realistic experience and viewing experience similar to watching a movie.

Applicable sports events include baseball, ice hockey, American football, fencing, bobsleigh (VR), car racing, cycling, snowboarding, ski jumping, skating (speed skating, short track), horseback riding, yachting, taekwondo, etc. It can be applied to a variety of sports games, including wearing games, games using equipment, games using balls, and competitive games.

In competitive matches such as fencing, you can watch the main screen on the broadcast, and when a score is scored, it switches to the scorer's perspective so you can watch the highlights again from the scorer's perspective, or you watch it as a two-shot from each player's perspective, and when a score occurs, the scorer's perspective is displayed. It is also possible to switch to a viewpoint so that highlights can be viewed again from the scorer's viewpoint.

Similarly, in other sports games, when a point is scored, it is possible to automatically play a video from the point of view of the player who scored the point so that the point can be viewed again from the point of view of the player who scored the point.

The realistic sports broadcast transmission and viewing system according to an embodiment of the present invention applies MEC (Multi-access Edge Computing) technology to data transmission and processing from the mobile camera 100 to the video relay unit 500. It can be characterized as:

Multi-Access Edge Computing (MEC) has the advantage of moving traffic and service computing from the centralized cloud to the network edge, closer to customers. Instead of sending all data to the cloud for processing, it analyzes, processes, and stores data at the edge of the network. Therefore, collecting and processing data close to the customer reduces latency and provides real-time performance for high-bandwidth applications.

Wireless communication is used from the mobile camera 100 to the video relay unit 500. Therefore, there is a need to convert data into a form that is advantageous for transmission through a designated communication network and transmit it.

In other words, rather than storing and processing the original image captured from the mobile camera 100 in the image relay unit 500, the original image storage and processing can be performed on the data conversion unit 300 side.

Here, processing may include not only conversion to specified standards, but also processing of 3D conversions.

That is, the image data provided to the image receiving unit 600 may be processed in the data conversion unit 300.

At this time, MEC technology for 5G network interoperability can be applied.

MEC (Multi-access Edge Computing) technology for 5G network interconnection is an edge computing technology applied to 5G.

The core standard specifications were created by the ETSI (European Telecommunication Standards Institute) ISG (Industry Specification Group).

MEC enables the deployment of data center-class compute, storage, and network resources at locations in the edge network, close to users and endpoint devices.

MEC provides communications service providers the ability to offer new real-time services with reduced latency.

Additionally, MEC can reduce costs for enterprises and operators by minimizing the amount of data transferred to the centralized cloud and using network bandwidth and resources more efficiently.

The video broadcasting unit 500 of the realistic sports broadcasting transmission and viewing system according to an embodiment of the present invention provides an option to follow the viewpoint of the player who appears on the main screen in the main broadcast, and an option to follow the viewpoint of the player in possession of the ball. , the ability to select any one of a plurality of options, including at least one option selected among the option to follow the attacker's viewpoint, the option to follow the defender's viewpoint, the option to select the screen viewed by the most viewers, and the random option. It may be characterized by providing and transmitting a screen corresponding to the selected option.

That is, the video relay unit 500 can provide an automatic reception mode, and the automatic reception mode includes an option to follow the viewpoint of the player who appears on the main screen of the main broadcast, and an option to follow the viewpoint of the player who owns the ball. , you can choose one of various options, such as the option to follow the attacker's perspective, the option to follow the defender's perspective, the option to select the screen viewed by the most viewers, and the random option.

Although various options are listed above, the present invention is not limited to these, and it is of course possible to apply various options including any one of these options.

The video relay unit 500 can provide a manual reception mode in which the viewer directly selects a channel and an automatic reception mode in which the video relay unit 500 automatically switches channels according to options.

The video broadcasting unit 500 of the realistic sports broadcasting transmission and viewing system according to an embodiment of the present invention, when the viewer selects the AI reception mode through the video receiving unit 600, based on machine learning, a specific mobile camera ( 100) It may be characterized by automatically transmitting the video at the point in time.

The machine learning performs primary machine learning to calculate feature values regarding preset sports characteristic information on the video data collected by the video relay unit 500, collects user information, and collects the collected user information. And using the results of the first machine learning, secondary machine learning can be performed to extract one of the plurality of video data as user-preferred sports video data, and the extracted user-preferred sports video data can be transmitted. .

Here, the first machine learning is performed by applying the video data collected in the video relay unit 500 to a learning module learned based on a plurality of video data containing preset sports characteristic information to the video relay unit ( 500), it is possible to perform primary machine learning to calculate feature values to determine whether the image data collected includes sports characteristic information,

The secondary machine learning performs secondary machine learning using the collected user information and the results of the first machine learning as input, and the images collected by the video relay unit 500 through the secondary machine learning Extract any one of the data as user preferred sports video data,

The preset sports characteristic information includes information related to the sports player's preference, information related to ball possession, information related to the game viewing terminal, information related to the player attempting to score the ball, information related to the foul player, information related to the player when a goal is scored, and information related to the ball when a goal is scored. It may contain at least one piece of information.

Primary machine learning can use artificial neural network algorithms. Additionally, the artificial neural network may be a deep learning neural network, but is not limited to this, and various neural network systems that have been developed or will be developed in the future can be applied.

In the image data analysis described below, algorithms for image recognition, image analysis, and object tracking can be used. The algorithm used in this case is a convolutional neural network, a type of neural network mainly used in voice recognition or image recognition. Neural Networks) may be used, but are not limited to this and various embodiments may exist.

For example, the video relay unit 500 can calculate feature values of sports video data from a plurality of video data using a learning module learned with preset sports characteristic information as input. In other words, the video relay unit 500 constructs a learning module learned by inputting a large amount of video data classified as containing preset sports characteristic information, and uses a plurality of video data captured by a plurality of mobile cameras 100. Feature values of sports video data can be calculated from video data.

As a larger amount of preset sports characteristic information is acquired, the accuracy of the learning module can increase.

The video relay unit 500 may calculate a feature value of 1 for video data that includes preset sports characteristic information, and may calculate a feature value of 0 for video data that does not include preset sports feature information.

In the above, for convenience of explanation, the feature values were calculated by dividing them into 1 or 0, but this is not limited to the method described above. Feature values may be expressed as specific values depending on the degree of inclusion and similarity of preset sports characteristic information.

The preset sports characteristic information may include a plurality of characteristics selected as important in sports games.

For example, sports characteristic information may be arbitrarily selected by the user. In addition, sports characteristic information can be extracted through big data analysis of the characteristics transmitted on broadcast for each major event (e.g., foul, goal scoring, etc.) in a sports game.

The secondary machine learning can use the SVM (Support Vector Machine) algorithm.

The SVM (Support Vector Machine) algorithm is one of the fields of machine learning and is a supervised learning model for pattern recognition and data analysis. It can be an algorithm mainly used for classification and regression analysis.

The video broadcasting unit 500 of the realistic sports broadcasting transmission and viewing system according to an embodiment of the present invention may be characterized by displaying the main character profile matching the mobile camera 100 of the currently viewed screen on one side of the screen. .

In other words, the profile of the main character (player, referee, etc.) that matches the mobile camera 100, which is information that allows you to check whose perspective the screen you are currently viewing was captured, can be displayed on one side of the screen.

As shown in Figure 2, the method of transmitting and viewing realistic sports broadcasts according to an embodiment of the present invention is a method of transmitting and viewing realistic sports broadcasts in the form of a program executed by an operation processing means including a computer. , video collection step (S10), data conversion step (S20), video transmission step (S30), video relay step (S40), video reception step (S50), and video playback step (S60), wherein the data conversion step (S20) or the video relay step (S40) is characterized by transmitting 3D video by applying 3D conversion technology.

Parallax, caused by the difference in human eye distance (average 6.5 cm), transmits two different two-dimensional images to the brain.

The left and right images transmitted in this way are recognized as one three-dimensional image through the brain.

Just like two eyes, two cameras are placed left and right, and left and right images are captured simultaneously through the camera lens.

By screening the left and right images captured in this way using specific equipment, a three-dimensional effect is acquired.

A difference called binocular parallax occurs in the captured left and right images due to the distance between the two cameras.

3D conversions technology can be broadly divided into two types. The first is to film by installing two cameras on equipment called a rig at the filming site, similar to the method used in movie shooting, and the second is to film and produce 3D stereoscopic images using a virtual camera in the software. This is how to do it.

The method of shooting by installing two cameras is divided into the horizontal rig method and the vertical rig method depending on the way the cameras are placed.

The horizontal rig is a method of shooting by arranging two cameras horizontally, like the human eye.

The characteristics of the horizontal rig are that there is no reduction in exposure, no color difference between the left and right images, and that it is easy to use grip equipment. However, if the volume of the two cameras is large, the two lenses can be placed smaller than the average human eye distance of 6.5cm. Since there is no such thing, close-up photography is difficult due to limitations in controlling the distance between axes.

Vertical rigs have the advantage of being able to minimize the distance between axes, which is a disadvantage of horizontal rigs, allowing close-up photography and mounting various cameras and lenses. However, there is light loss due to the half mirror, and there is color difference between the left and right images due to mirror quality.

When humans look at an object, both eyeballs rotate and focus on the intersection of the two eyes. This intersection becomes a point where binocular disparity does not occur.

In the process of shooting 3D stereoscopic images, the focus is adjusted by rotating the two cameras.

Like this, the point where the viewpoints of the two cameras intersect is called the zero point (Zero Parallax Point), and there are three convergence angle configuration methods to adjust the zero point (Zero Parallax Point) when shooting 3D stereoscopic images using a rig. Use .

The three main angle composition methods are parallel, complex, and convergence, and the convergence method is mainly used.

The software method of using a virtual camera is a method of using a virtual camera supported by software.

Currently, Maya and 3D MAX, the 3D software most used in animation production, Davinci Resolve, used in video production, and After Effects, used in advertising production, support virtual stereoscopic cameras for three-dimensional image production. there is.

By using a stereo camera consisting of two virtual cameras placed on the monitor screen, it is possible to shoot 3D stereoscopic images by easily adjusting the inter-axial distance and zero point of the two cameras just by controlling the mouse.

This virtual 3D stereoscopic camera uses a horizontal rig arrangement and uses a convergence method as the viewing angle control method.

This is because in live-action shooting, it is difficult to shoot while adjusting the distance between axes to the minimum due to the volume of the camera, while software cameras have no restrictions on adjusting the camera gap.

Additionally, the runaway method used in live-action shooting causes keystone distortion in the captured left and right images.

Therefore, post-production work to correct keystone distortion is necessary during the post-shooting process, but the stereo camera consisting of two virtual cameras in 3D software supports the function of outputting without keystone distortion.

In the image collection step (S10), the image collection unit 200 receives image data captured from the mobile camera 100.

In the image collection step (S10), the image collection unit 200 including an antenna receives image data captured from the mobile camera 100 and stores it in a designated storage space.

At this time, in the video collection step (S10), video data can be received wirelessly.

In the data conversion step (S20), the data conversion unit 300 converts the image data collected from the image collection unit 200 into a designated standard.

The data conversion step (S20) converts the video signal into a form that is advantageous for transmission through a designated communication network such as a 5G dedicated communication network.

In the data conversion step (S20), image data can be converted to a designated standard such as 8bit, 10bit, or 4:2:0 YUV sampling conversion.

In the video transmission step (S30), the video transmission unit 400 transmits the video data converted from the data conversion unit 300 to the video relay unit 500.

At this time, in the video transmission step (S30), the converted video data can be transmitted to the video relay unit 500 by wire.

In the video relay step (S40), the video relay unit 500 stores and manages the video data collected from the video transmission unit 400.

In the video relay step (S40), the video data collected by the video relay unit 500 can be transmitted to the Internet (online) by an external request.

For example, it can be possible to watch live streaming or replay through a website.

In the video reception step (S50), the video receiver 600 receives the necessary video data from the video relay unit 500.

The video receiver 600 refers to a terminal that requests video to watch video, such as a computer, set-top box, or smart device.

For example, when the video receiver 600 accesses the website managed by the video relay unit 500 and requests a channel that the viewer wants to view or changes the resolution, etc., the video is sent to the video relay step. The video is sent in (S40), and the video sent in the video relay step (S40) is received in the video reception step (S50).

In the video playback step (S60), the video playback unit 700 is connected to the video receiver 600 and plays a 3D (Three Dimensions) video on the HMD.

Here, the connection may be an electrical connection (connection capable of communication) or a mechanical connection.

The HMD may have a built-in processing device for processing and reproducing virtual reality images, and may be connected to the image receiving unit 600 to output image information received from the image receiving unit 600 using a display.

The image receiving unit 600 may be a user terminal or a computing device connected to a server. Depending on the embodiment, the HMD may output a virtual reality image based on information received from the server.

Depending on the embodiment, the HMD may not have a built-in processing device or display, but may be configured to accommodate a user terminal (smart device, etc.) and utilize the display of the user terminal.

The core concept of the method for transmitting and viewing realistic sports broadcasts according to an embodiment of the present invention is to attach a small camera to the body of a player (or referee) located inside the stadium, which has been an inviolable area so far, and allow the user to view the transmitted video as a virtual reality. The key is to have the effect of watching the game directly from the ‘player’s perspective’ by viewing it through HMD, a real-life tool.

This is the presence theory of immersion based on the ITU international technical standards, for example, Heeter (Heeter, C. (1992). Being There: The subjective experience of presence. Presence: Teleoperators and Virtual Environments. MIT Press.) 'The sense of being there' defined by Lombard & Ditton (Lombard, M., & Ditton, T. (1997). At the Heart of It All: The Concept of Presence. Journal of Computer Mediated Communication, 3(2).), Biocca (Biocca, F. (1997). The cyborg's dilemma: Progressive embodiment in virtual environments. Journal of computer-mediated communication, 3(2), JCMC324.), etc. define 'the viewer himself. The key is to actually implement theoretical concepts related to immersion in virtual reality, such as 'you are there' or 'it is here'.

For example, in the case of a baseball broadcast, if a small camera is attached to the catcher's face shield and the video signal is transmitted in real time, viewers wearing HMDs can watch the baseball game from the catcher's perspective. Viewers can change the channel of the video signal, which allows them to watch realistic sports games from the perspectives of players in various positions, such as umpires, pitchers, and first basemen.

In the case of existing sports games, the broadcasting camera is located outside the stadium, so the viewer is positioned from the perspective of a spectator outside the stadium. However, by using the realistic sports broadcast transmission and viewing system according to an embodiment of the present invention, the viewer can directly watch the players inside the stadium. It is possible to have a realistic experience and viewing experience similar to watching a movie.

Applicable sports events include baseball, ice hockey, American football, fencing, bobsleigh (VR), car racing, cycling, snowboarding, ski jumping, skating (speed skating, short track), horseback riding, yachting, taekwondo, etc. It can be applied to a variety of sports games, including wearing games, games using equipment, games using balls, and competitive games.

In competitive matches such as fencing, you can watch the main screen on the broadcast, and when a score is scored, it switches to the scorer's perspective so you can watch the highlights again from the scorer's perspective, or you watch it as a two-shot from each player's perspective, and when a score occurs, the scorer's perspective is displayed. It is also possible to switch to a viewpoint so that highlights can be viewed again from the scorer's viewpoint.

Similarly, in other sports games, when a point is scored, it is possible to automatically play a video from the point of view of the player who scored the point so that the point can be viewed again from the point of view of the player who scored the point.

The realistic sports broadcast transmission and viewing method according to an embodiment of the present invention uses MEC (Multi-access Edge Computing) technology for data transmission and processing from the video collection step (S10) to the video transmission step (S30). It can be characterized as applied.

Multi-Access Edge Computing (MEC) has the advantage of moving traffic and service computing from the centralized cloud to the network edge, closer to customers. Instead of sending all data to the cloud for processing, it analyzes, processes, and stores data at the edge of the network. Therefore, collecting and processing data close to the customer reduces latency and provides real-time performance for high-bandwidth applications.

Wireless communication is used from the image collection step (S10) to before the video transmission step (S30). Therefore, there is a need to convert data into a form that is advantageous for transmission through a designated communication network and transmit it.

In other words, rather than storing and processing the original image captured from the mobile camera 100 in the image relay unit 500, the original image storage and processing can be performed on the data conversion unit 300 side.

Here, processing may include not only conversion to specified standards, but also processing of 3D conversions.

That is, the image data provided in the image receiving step (S50) may be processed in the data conversion step (S20).

At this time, MEC technology for 5G network interoperability can be applied.

MEC (Multi-access Edge Computing) technology for 5G network interconnection is an edge computing technology applied to 5G.

The core standard specifications were created by the ETSI (European Telecommunication Standards Institute) ISG (Industry Specification Group).

MEC enables the deployment of data center-class compute, storage, and network resources at locations in the edge network, close to users and endpoint devices.

MEC provides communications service providers the ability to offer new real-time services with reduced latency.

Additionally, MEC can reduce costs for enterprises and operators by minimizing the amount of data transferred to the centralized cloud and using network bandwidth and resources more efficiently.

The video broadcasting step (S40) of the realistic sports broadcasting transmission and viewing system according to an embodiment of the present invention includes an option to follow the viewpoint of the player who appears on the main screen in the main broadcast, and an option to follow the viewpoint of the player in possession of the ball. , the ability to select any one of a plurality of options, including at least one option selected among the option to follow the attacker's viewpoint, the option to follow the defender's viewpoint, the option to select the screen viewed by the most viewers, and the random option. It may be characterized by providing and transmitting a screen corresponding to the selected option.

That is, the video broadcasting step (S40) may provide an automatic reception mode, and the automatic reception mode includes an option to follow the viewpoint of the player who appears on the main screen in the main broadcast, and an option to follow the viewpoint of the player who owns the ball. , you can choose one of various options, such as the option to follow the attacker's perspective, the option to follow the defender's perspective, the option to select the screen viewed by the most viewers, and the random option.

Although various options are listed above, the present invention is not limited to these, and it is of course possible to apply various options including any one of these options.

The video relaying step (S40) can provide a manual reception mode in which the viewer directly selects a channel and an automatic receiving mode in which the video relaying step (S40) automatically switches channels according to options.

In the video broadcasting step (S40) of the realistic sports broadcast transmission and viewing method according to an embodiment of the present invention, when the viewer selects the AI reception mode through the video receiver 600, a specific mobile camera ( 100) It may be characterized by automatically transmitting the video at the point in time.

The machine learning performs primary machine learning to calculate feature values regarding preset sports characteristic information on the video data collected by the video relay unit 500, collects user information, and collects the collected user information. And using the results of the first machine learning, secondary machine learning can be performed to extract one of the plurality of video data as user-preferred sports video data, and the extracted user-preferred sports video data can be transmitted. .

Here, the first machine learning is performed by applying the video data collected in the video relay unit 500 to a learning module learned based on a plurality of video data containing preset sports characteristic information to the video relay unit ( 500), it is possible to perform primary machine learning to calculate feature values to determine whether the image data collected includes sports characteristic information,

The secondary machine learning performs secondary machine learning using the collected user information and the results of the first machine learning as input, and the images collected by the video relay unit 500 through the secondary machine learning Extract any one of the data as user preferred sports video data,

The preset sports characteristic information includes information related to the sports player's preference, information related to ball possession, information related to the game viewing terminal, information related to the player attempting to score the ball, information related to the foul player, information related to the player when a goal is scored, and information related to the ball when a goal is scored. It may contain at least one piece of information.

Primary machine learning can use artificial neural network algorithms. Additionally, the artificial neural network may be a deep learning neural network, but is not limited to this, and various neural network systems that have been developed or will be developed in the future can be applied.

In the image data analysis described below, algorithms for image recognition, image analysis, and object tracking can be used. The algorithm used in this case is a convolutional neural network, a type of neural network mainly used in voice recognition or image recognition. Neural Networks) may be used, but are not limited to this and various embodiments may exist.

For example, the video relay unit 500 can calculate feature values of sports video data from a plurality of video data using a learning module learned with preset sports characteristic information as input. In other words, the video relay unit 500 constructs a learning module learned by inputting a large amount of video data classified as containing preset sports characteristic information, and uses a plurality of video data captured by a plurality of mobile cameras 100. Feature values of sports video data can be calculated from video data.

As a larger amount of preset sports characteristic information is acquired, the accuracy of the learning module can increase.

The video relay unit 500 may calculate a feature value of 1 for video data that includes preset sports characteristic information, and may calculate a feature value of 0 for video data that does not include preset sports feature information.

In the above, for convenience of explanation, the feature values were calculated by dividing them into 1 or 0, but this is not limited to the method described above. Feature values may be expressed as specific values depending on the degree of inclusion and similarity of preset sports characteristic information.

The preset sports characteristic information may include a plurality of characteristics selected as important in sports games.

For example, sports characteristic information may be arbitrarily selected by the user. In addition, sports characteristic information can be extracted through big data analysis of the characteristics transmitted on broadcast for each major event (e.g., foul, goal scoring, etc.) in a sports game.

The secondary machine learning can use the SVM (Support Vector Machine) algorithm.

The SVM (Support Vector Machine) algorithm is one of the fields of machine learning and is a supervised learning model for pattern recognition and data analysis. It can be an algorithm mainly used for classification and regression analysis.

The video broadcasting step (S40) of the method for transmitting and viewing realistic sports broadcasts according to an embodiment of the present invention may be characterized by displaying the main character's profile matching the mobile camera 100 of the currently viewed screen on one side of the screen. .

In other words, the profile of the main character (player, referee, etc.) that matches the mobile camera 100, which is information that allows you to check whose perspective the screen you are currently viewing was captured, can be displayed on one side of the screen.

In the above, a method for transmitting and viewing realistic sports broadcasting according to an embodiment of the present invention has been described; however, a computer-readable recording medium storing a program for implementing the method for transmitting and viewing realistic sports broadcasting and a method for transmitting and viewing realistic sports broadcasting Of course, a program stored in a computer-readable recording medium for implementing the viewing method can also be implemented.

In other words, those skilled in the art will be able to easily understand that the above-described method of transmitting and viewing realistic sports broadcasts can be provided in a recording medium that can be read by a computer by tangibly implementing a program of commands for implementing it. . In other words, it can be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc., singly or in combination. Program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and usable by those skilled in the computer software art. Examples of the computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and floptical disks. Included are magneto-optical media, and hardware devices specifically configured to store and perform program instructions, such as ROM, RAM, flash memory, USB memory, and the like. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware device may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

The present invention is not limited to the above-described embodiments, and the scope of application is diverse. Of course, various modifications and implementations are possible without departing from the gist of the present invention as claimed in the claims.

100: Mobile camera
200: Video collection department
300: Data conversion unit
400: Video transmission unit
500: Video broadcasting unit
600: Video receiver
700: Video playback unit
S10: Video collection step
S20: Data conversion step
S30: Video transmission step
S40: Video broadcasting stage
S50: Video reception stage
S60: Video playback stage

Claims (10)

A mobile camera (100) attached to the body or equipment of a person participating in a sports game;
An image collection unit 200 that receives image data captured from the mobile camera 100;
A data conversion unit 300 that converts the image data collected from the image collection unit 200 into a designated standard;
a video transmission unit 400 that transmits the video data converted from the data conversion unit 300 to the video relay unit 500;
a video relay unit 500 that stores and manages video data collected from the video transmission unit 400;
a video receiving unit 600 that receives video data from the video relay unit 500; and
An image playback unit 700 connected to the image receiver 600 and playing a 3D (Three Dimensions) image on a HMD (Head Mount Display);
Includes,
The data conversion unit 300 or video relay unit 500
It is characterized by transmitting 3D images by applying 3D conversions technology,
The video relay unit 500 is
When the viewer selects the AI reception mode through the video receiver 600,
Based on machine learning, it is characterized by automatically transmitting images from the viewpoint of a specific mobile camera (100),
The video relay unit 500 is
It is characterized by displaying on one side of the screen the profile of the main character that matches the mobile camera 100 of the screen currently being viewed, so that you can check whose perspective the screen you are currently viewing was taken from.
The video relay unit 500 is
At least one selected from among the option to follow the viewpoint of the player who appears on the main screen in the main broadcast, the option to follow the viewpoint of the player in possession of the ball, the option to follow the attacker's viewpoint, the option to follow the defender's viewpoint, and the random option. Characterized by providing an automatic reception mode that selects any one of the options including the options of,
The video relay unit 500 is
When a point is scored in a sports game, the video from the point of view of the player who scored the point is automatically played so that the point can be viewed again from the point of view of the player who scored the point.
MEC (Multi-access Edge Computing) technology, which analyzes, processes, and stores data at the network edge, is applied, and the processed image data from the data conversion unit 300 is transmitted to the image reception unit 600. ,
The machine learning is
On the video data collected by the video relay unit 500, primary machine learning is performed to calculate feature values regarding preset sports characteristic information, user information is collected, and the collected user information and the primary Characterized by performing secondary machine learning to extract one of the plurality of video data as user-preferred sports video data using the results of machine learning, and transmitting the extracted user-preferred sports video data,
The first machine learning is,
By applying the video data collected in the video relay unit 500 to a learning module learned based on a plurality of video data containing preset sports characteristic information, the video data collected in the video relay unit 500 It is characterized by machine learning that calculates feature values to determine whether feature information is included,
The second machine learning is,
Perform secondary machine learning using the collected user information and the results of the primary machine learning as input, and select one of the video data collected in the video relay unit 500 through the secondary machine learning to select the user. It is characterized by extracting it as sports video data,
The preset sports characteristic information is,
At least one selected from the following: information related to a sports player's preference, information related to ball possession, information related to a game viewing terminal, information related to a player attempting to score a ball, information related to a foul player, information related to a player when a goal is scored, and information related to the ball when a goal is scored. Characterized by including,
The second machine learning is
A realistic sports broadcast transmission and viewing system that uses the SVM (Support Vector Machine) algorithm, a supervised learning model for pattern recognition and data analysis, and an algorithm used for classification and regression analysis.
According to paragraph 1,
The video relay unit 500 is
At least one option selected from among the option to follow the viewpoint of the player who appears on the main screen in the main broadcast, the option to follow the viewpoint of the player in possession of the ball, the option to follow the attacker's viewpoint, the option to follow the defender's viewpoint, and the random option. A realistic sports broadcast transmission and viewing system that provides the ability to select one of a plurality of options including and transmits a screen corresponding to the selected option.
delete delete In a method of transmitting and viewing realistic sports broadcasts in the form of a program executed by an arithmetic processing means including a computer,
An image collection step (S10) in which the image collection unit 200 receives image data captured from the mobile camera 100;
A data conversion step (S20) in which the data conversion unit 300 converts the image data collected from the image collection unit 200 into a designated standard;
A video transmission step (S30) in which the video transmission unit 400 transmits the video data converted from the data conversion unit 300 to the video relay unit 500;
A video relaying step (S40) in which the video relay unit 500 stores and manages video data collected from the video transmission unit 400;
A video receiving step (S50) in which the video receiving unit 600 receives video data from the video relay unit 500; and
An image playback step (S60) in which the image playback unit 700 is connected to the image receiver 600 and plays a 3D (Three Dimensions) image on an HMD;
Includes,
The data conversion step (S20) or video relay step (S40) is
It is characterized by transmitting 3D images by applying 3D conversions technology,
The video relay step (S40) is
When the viewer selects the AI reception mode through the video receiver 600,
Based on machine learning, it is characterized by automatically transmitting images from the viewpoint of a specific mobile camera (100),
The video relay step (S40) is
It is characterized by displaying on one side of the screen the profile of the main character that matches the mobile camera 100 of the screen currently being viewed, so that you can check whose perspective the screen you are currently viewing was taken from.
The video relay step (S40) is
At least one selected from among the option to follow the viewpoint of the player who appears on the main screen in the main broadcast, the option to follow the viewpoint of the player in possession of the ball, the option to follow the attacker's viewpoint, the option to follow the defender's viewpoint, and the random option. Characterized by providing an automatic reception mode that selects any one of the options including the options of,
The video relay step (S40) is
When a point is scored in a sports game, the video from the point of view of the player who scored the point is automatically played so that the point can be viewed again from the point of view of the player who scored the point.
MEC (Multi-access Edge Computing) technology that analyzes, processes, and stores data at the network edge is applied, so that the video data processed in the data conversion step (S20) is transmitted to the video receiver (600) in the video reception step (S50). ), characterized in that it is transmitted to,
The machine learning is
On the video data collected by the video relay unit 500, primary machine learning is performed to calculate feature values regarding preset sports characteristic information, user information is collected, and the collected user information and the primary Characterized by performing secondary machine learning to extract one of the plurality of video data as user-preferred sports video data using the results of machine learning, and transmitting the extracted user-preferred sports video data,
The first machine learning is,
By applying the video data collected in the video relay unit 500 to a learning module learned based on a plurality of video data containing preset sports characteristic information, the video data collected in the video relay unit 500 It is characterized by machine learning that calculates feature values to determine whether feature information is included,
The second machine learning is,
Perform secondary machine learning using the collected user information and the results of the primary machine learning as input, and select one of the video data collected in the video relay unit 500 through the secondary machine learning to select the user. It is characterized by extracting it as sports video data,
The preset sports characteristic information is,
At least one selected from the following: information related to a sports player's preference, information related to ball possession, information related to a game viewing terminal, information related to a player attempting to score a ball, information related to a foul player, information related to a player when a goal is scored, and information related to the ball when a goal is scored. Characterized by including,
The second machine learning is
A method of transmitting and watching realistic sports broadcasts, characterized by using the SVM (Support Vector Machine) algorithm, which is a supervised learning model for pattern recognition and data analysis and an algorithm used for classification and regression analysis.
According to clause 5,
The video relay step (S40) is
At least one option selected from among the option to follow the viewpoint of the player who appears on the main screen in the main broadcast, the option to follow the viewpoint of the player in possession of the ball, the option to follow the attacker's viewpoint, the option to follow the defender's viewpoint, and the random option. A method for transmitting and watching realistic sports broadcasts, comprising providing a function to select one of a plurality of options including and transmitting a screen corresponding to the selected option.
delete delete A computer-readable recording medium storing a program for implementing the method for transmitting and viewing realistic sports broadcasts according to claim 5 or 6.
A program stored in a computer-readable recording medium for implementing the method of transmitting and viewing realistic sports broadcasts according to claim 5 or 6.