KR20150017564A - Judgment system and method for sports game using augmented-reality glass - Google Patents

Judgment system and method for sports game using augmented-reality glass Download PDF

Info

Publication number
KR20150017564A
KR20150017564A KR1020130093651A KR20130093651A KR20150017564A KR 20150017564 A KR20150017564 A KR 20150017564A KR 1020130093651 A KR1020130093651 A KR 1020130093651A KR 20130093651 A KR20130093651 A KR 20130093651A KR 20150017564 A KR20150017564 A KR 20150017564A
Authority
KR
South Korea
Prior art keywords
glass
referee
video
communication module
clip
Prior art date
Application number
KR1020130093651A
Other languages
Korean (ko)
Other versions
KR101540771B1 (en
Inventor
한동관
Original Assignee
한동관
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한동관 filed Critical 한동관
Priority to KR1020130093651A priority Critical patent/KR101540771B1/en
Priority to PCT/KR2014/007345 priority patent/WO2015020466A1/en
Publication of KR20150017564A publication Critical patent/KR20150017564A/en
Application granted granted Critical
Publication of KR101540771B1 publication Critical patent/KR101540771B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/10—Office automation; Time management
    • G06Q10/103—Workflow collaboration or project management
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0003—Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
    • A63B24/0006—Computerised comparison for qualitative assessment of motion sequences or the course of a movement
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0003—Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
    • A63B24/0006—Computerised comparison for qualitative assessment of motion sequences or the course of a movement
    • A63B2024/0012—Comparing movements or motion sequences with a registered reference
    • A63B2024/0015—Comparing movements or motion sequences with computerised simulations of movements or motion sequences, e.g. for generating an ideal template as reference to be achieved by the user

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Human Resources & Organizations (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • Multimedia (AREA)
  • Entrepreneurship & Innovation (AREA)
  • General Health & Medical Sciences (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Economics (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Data Mining & Analysis (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • User Interface Of Digital Computer (AREA)
  • General Engineering & Computer Science (AREA)
  • Primary Health Care (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Acoustics & Sound (AREA)

Abstract

A sports event judgment system using augmented-reality (AR) glass includes: multiple video cameras which shoot a video from shooting angles by being installed in a stadium; a video server which stores a video shot in the video cameras according to the video cameras and transmits a clip video corresponding to the voice command or touch command of a referee; AR glass for judgment which includes a microphone receiving the input of a voice command, a touch pad receiving the input of a touch command, a near field communication module for AR glass transmitting the voice command or the touch command or receiving the clip video corresponding to the voice command or the touch command, and a projector projecting the clip video received by the near field communication module for AR glass onto the eyes of the referee through a prism; and a mobile communication module which transmits the voice command or the touch command, which is received from the near field communication module for AR glass and a near field communication module for smartphone receiving the voice command or the touch command from the near field communication module for AR glass, to the video server and receives the clip video corresponding to the voice command or the touch command from the video server. The system also includes: a smartphone for referee which transmits a clip video, received in the mobile communication module by the near field communication module for smartphone, to the near field communication module for AR glass; and a timer for referee which synchronizes an operation time with a shooting time of a video stored in the video server.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a sports game judgment system and method using an AR glass,

The present invention relates to a sports competition determination system and method, and more particularly, to a sports competition determination system and method using AR glass.

In a variety of sporting events such as baseball, rugby, and wrestling, conventionally, judging ratios due to judgment of the referee are frequent. In some sports, video reading has been introduced as a complementary measure. Depending on the results of the analysis of the video reading, the judgment may be reversed.

According to the conventional video reading method, a video image photographed at various angles is reproduced and read in a video analysis room in a situation where the judge's judgment is ambiguous, and the result is transmitted to the referee and continues to the judgment. This method has a problem that the game is forced to be stopped for a long time and the opinion of the person analyzing the video image, not the referee, is reflected.

Recently, in the case of Axis, a camera is assigned to each player who plays in the field, and a system for tracking the player during the game is also operated.

These cameras are programmed for computer vision programming and servo motor automatic control programs so that they can be automatically tracked without human intervention, allowing automatic shooting without manual control of the camera menus in charge.

However, such a conventional video reading method has an advantage that the determination can be accurately performed, but there is a problem in that the video is read out and the game is delayed and the flow of the game is cut off. For the athletes, the rhythm of the game is broken, and the fun of the visitors is inevitable.

It is an object of the present invention to provide a sports competition determination system using AR glass.

Another object of the present invention is to provide a method of judging a sports game using AR glass.

According to an aspect of the present invention, there is provided a sports game judgment system using AR glass, comprising: a plurality of moving picture cameras installed in a stadium for shooting a game and shooting a moving picture at a plurality of shooting angles; A moving picture server for storing a moving picture photographed by the moving picture camera for each moving picture camera and transmitting a clip moving picture corresponding to a voice command or a touch command of the judge; A touch pad for inputting a touch command of the referee; a voice command input through the microphone or a touch command input by the touch pad; A short distance communication module for the AR glass for receiving the clip video corresponding to the voice command or the touch command; and a short distance communication module for projecting the clip video received by the short distance communication module for the AR glass to the eye of the referee through a prism An augmented-reality glass including a projector; A local communication module for a smart phone receiving a voice command or a touch command from the local communication module for the AR glass; a voice command or a touch command received from the local communication module for the AR glass to the video server; And a mobile communication module for receiving a clip video corresponding to a voice command or a touch command, wherein the short-range communication module for the smart phone comprises a smart card for transmitting a clip video received from the mobile communication module to the short- pawn; And a timer for judging that the operation time is synchronized with the photographing time of the moving picture stored in the moving picture server through the short distance communication module for the smart phone and the mobile communication module.

At this time, the moving picture server extracts and transmits a predetermined number (back number), a predetermined camera number, a clip movie before a predetermined second, according to the voice command, or transmits a predetermined second predetermined time according to the touch command, And extract and transmit the previous clip video.

And the referee AR glass may be configured to reproduce the clip video received by the short distance communication module for the AR glass in a slow motion having a predetermined reproduction speed according to a predetermined voice command of the referee.

According to another aspect of the present invention, there is provided a method of determining a sports competition using AR glass, the method comprising: capturing and transmitting a moving image from a plurality of video cameras installed in a stadium for shooting a competition at each shooting angle; The video server receiving the photographed moving image and storing the received moving image for each moving image camera; The augmented reality glass receives a voice command from a referee through a microphone or receives a touch command of the referee through a touch pad; The AR glass for refereeing transmits the voice command or the touch command to the smartphone for refereeing by short distance communication; The smartphone for referee receiving the voice command or touch command and transmitting the received voice command or touch command to the video server by 3G / 4G mobile communication;

Extracting a clip video corresponding to the received voice command or the touch command among the stored moving pictures and transmitting the clip video to the smartphone for judgment by 3G / 4G mobile communication; Receiving the clip video by the smartphone for referee and transmitting it to the refereeing AR glass by short distance communication; And the AR glass for referee may receive the clip video and project it to the eyes of the referee using a projector.

Here, the step of extracting the clip video corresponding to the received voice command or touch command among the stored moving images by the moving picture server and transmitting the clip video to the smartphone for judgment by 3G / 4G mobile communication, Extracts a clip video before a predetermined number (back number), a predetermined camera number, and a predetermined second (second), or extracts and transmits a clip movie of a predetermined second earlier than the predetermined number of seconds according to the touch command have.

The video recording time of the moving picture stored in the moving picture server may be synchronized with the operation time of the timer for judgment through the judging smartphone.

Meanwhile, the step of the AR glass for referee receiving the clip moving image and projecting the clip moving image on the eye of the referee using a projector may be performed by the AR glass for referee, And reproduced and projected in a slow motion having a predetermined reproduction speed.

According to the sports competition determination system and method using the AR glass as described above, by projecting clip videos of various angles taken in ambiguous situations through the referee's AR glass, the referee can read the video in real time and make an accurate judgment .

As a result, it is possible to carry out the fast and accurate game progress without delaying the game or keeping the flow of the game.

In addition, unlike existing video analysts such as judges other than the judge judgment directly or indirectly involved in the effect is excluded.

Also, by playing the clip video played by the referee at the same time through the display board of the stadium, the player and the viewer can observe the judgment process at the same time. By watching real-time video at the same time by athletes or spectators, it is possible to reduce the possibility of controversy about judging judgment and to proceed fairly and quickly.

1 is a block diagram of a sports competition determination system using AR glass according to an embodiment of the present invention.
2 is a block diagram of a strike zone determination system using AR glass according to an embodiment of the present invention.
3 is a flowchart of a method of determining a sports game using AR glass according to an embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail to the concrete inventive concept.

It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

Like reference numerals are used for like elements in describing each drawing.

The terms first, second, A, B, etc. may be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, .

On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a sports competition determination system using AR glass according to an embodiment of the present invention.

Referring to FIG. 1, a sports competition determination system 100 (hereinafter, referred to as 'sports competition determination system') using AR glass according to an embodiment of the present invention includes a plurality of video cameras 110, a video server 120 An AR glass for refereeing 130, a referee smartphone 140, a referee timer 150, and an electric sign board 160.

The sports competition determination system 100 is configured so that the referee can read the video in a state of ambiguous judgment in real time through the referee's AR glass 130 during the competition, thereby reducing the determination error. In addition, there is an advantage in that it is possible to reduce side effects such as a game delay or flow disturbance according to a conventional video reading method.

In addition, it is possible to exclude judging involvement of a person other than the referee and to allow the athlete and the viewer to observe the video reading process of the referee through the electric sign board 160. Thus, There is an advantage.

Hereinafter, the detailed configuration will be described.

The moving picture camera 110, which is installed in the playing field for photographing a game, can be arranged to be photographed at various angles. The video camera 110 may be provided in a plurality of ways, and in case of ball games, one or more dedicated cameras may be assigned to each player to track movement of each player.

At this time, it is preferable that the moving picture camera 110 allocated to each player is configured to automatically track and photograph the corresponding player with a dedicated servo control program.

Here, the game is not limited to soccer, basketball, rugby, wrestling, and taekwondo.

The video server 120 may be configured to store a moving image photographed by the moving image camera 110 for each moving image camera 110. It is preferable that the video server 120 is provided in the stadium.

The moving picture server 120 may be configured to transmit a clip moving picture corresponding to a judgment voice command or a touch command to the referee smartphone 140. [

That is, the video server 120 receives the voice command or the touch command of the referee from the referee's smartphone 140, analyzes it, extracts the corresponding clip movie, and provides it to the referee's smartphone 140 .

The augmented reality glass 130 includes a microphone 131, a touch pad 132, a near-field communication module 133 for the AR glass, and a projector 134 . ≪ / RTI >

Here, the referee's AR glass 130 is a kind of spectacles to be worn by the referee, and is configured to be capable of viewing an image at the same time as actually observing forward.

For example, google glass, launched by google, is an example.

The microphone 131 may be configured to receive a voice command of the judge.

Here, the voice command is a command for the video server 120 to request the video that the referee wants to read the video.

For example, a voice command may include a predetermined number (a back number) of a player, a predetermined camera number, and a time not less than a predetermined number of seconds indicating whether a video is to be viewed a second before the current time. It is possible to specify the moving picture camera 110 taken at a specific angle among the moving picture camera 110 in which a player of a predetermined number is photographed according to the contents included in the voice command.

As an example of a voice command, the referee may issue a voice command of "10, 3, 10 seconds". Or may be configured to issue a voice command in the name of the player instead of a uniform number. In other words, a voice command of "Lionel Messi, Camera 3, 10 seconds before" can be issued.

The touch pad 132 may be configured to receive a touch command of the referee. The touch pad 132 may be provided on a front portion of the refereeing AR glass 130 and may be configured such that a predetermined command is performed when the referee touches the referee with one hand. It goes without saying that various commands can be programmed to be performed depending on the number of touches.

If there is a touch of the referee, the touch command may be configured to automatically instruct the player to reproduce the moving image before the predetermined time from the current time. That is, when touching once, an instruction to automatically reproduce an image from 10 seconds before to the present can be designated.

In this case, the moving picture server 120 extracts and transmits a predetermined number (back number), a predetermined camera number, and a clip movie before a predetermined second in accordance with a voice command, And extract and transmit the previous clip video.

The local communication module 133 for the AR glass may be configured to transmit a voice command input through the microphone 131 or a touch command input by the touch pad 132 to the local communication module 141 for the smart phone.

Here, the short-range communication method may include all of Wi-Fi, Wi-Fi direct, Bluetooth, and ZigBee.

Meanwhile, the short-range communication module 133 for the AR glass may be configured to receive a voice command or a clip video corresponding to a touch command from the short-range communication module 141 for a smart phone.

If it is possible to perform short-range communication between the short-range communication module 133 for the AR glass and the video server 120, the communication between the short-range AR glass 130 and the video server 120 Is preferably performed.

The projector 134 can be configured to project the clip video received by the short distance communication module 133 for AR glass through a prism on the eyes of the referee. It is the same as the display method of the current Google Glass.

In the case of Google Glass, an image is projected at an angle at which total internal reflection is performed through an optical prism in a micro projector mounted on the frame, so that the image is formed on the user's eyes. It is called AR (augmented-reality) method because the user can selectively view the image through the prism. Currently, HD image quality of 25 inch screen is realized at a distance of about 2.5 m.

On the other hand, the referee AR glass 130 may be configured to reproduce the clip moving image received by the local communication module 131 for the AR glass in a slow motion having a predetermined reproduction speed according to a predetermined voice command of the referee. That is, it is possible to play back slowly and to make the determination accuracy. For example, if the referee says "slow", it can be configured to slow playback during playback. Or if the touch is repeated twice on the touch pad 132, the reproduction may be slowed down.

The referee smartphone 140 may be configured to include a short range communication module 141 and a mobile communication module 142 for the smart phone.

The referee smartphone 140 is a configuration possessed by the referee during the game and serves as a relay function between the referee's AR glass 130 and the video server 120. However, if short-range communication is possible between the refereeing AR glass 130 and the video server 120, the configuration of the referee smartphone 140 may be omitted.

The local area communication module 141 for the smart phone may be configured to receive a voice command or a touch command from the local communication module 133 for the AR glass.

The short-range communication module 141 for the smart phone may be configured to transmit the clip video received from the video server 120 in the mobile communication module 142 to the short-range communication module 133 for the AR-glass.

The mobile communication module 142 may be configured to transmit a voice command or a touch command received from the short-range communication module 141 for smartphone to the moving picture server 120.

The mobile communication module 142 may be configured to receive a voice command or a clip moving picture corresponding to a touch command from the moving picture server 120.

The referee timer 150 may be configured to include a timer-based short-range communication module 151 as a timer provided by the referee for recovering the competition time during the competition.

The operation time of the referee timer 150 may be configured to be synchronized with the photographing time of the moving image stored in the moving image server 120 through the short distance communication module 141 for the smart phone and the mobile communication module 142. [

This is because the time of the video server 120 and the time of the referee timer 150 must be synchronized with each other in order to accurately extract the clip video of the time requested by the referee from the video server 120.

A timer function built in the referee smartphone 140 may be used instead of the referee timer 150. [ At this time, the operation time of the referee smartphone 140 may be configured to be synchronized with the time of the video server 120.

The electric sign board 160 is provided in the stadium and can be configured to simultaneously display clip videos of referees in real time as well as athletes, coaching staffs and visitors.

The electric sign board 160 may be configured to be connected to the moving picture server 120. The display board 160 may be configured to receive and display a clip motion generated according to a voice command or a touch command issued by the judge in real time on the electric sign board 160 as well.

According to the display of the electric signboard 160, the reading process of the referee can be watched as if watching a TV, which is very useful for both coaches, athletes and spectators to quickly and easily reach consent and facilitate fast and fair competition.

It is preferable that the display of the electric sign board 160 is configured to be selectively performed according to the competition progress rule or according to the discretion of the referee.

2 is a block diagram of a strike zone determination system using AR glass according to an embodiment of the present invention.

Referring to FIG. 2, a strike zone determination system 200 (hereinafter referred to as a strike zone determination system) using AR glass according to an embodiment of the present invention includes a moving picture camera 210, a pitcher AR glass 220 ), And a baseball referee AR glass 230.

The strike zone determination system 200 of FIG. 2 is a system specialized to accurately determine whether a pitching ball of a pitcher has entered a strike zone, unlike the embodiment of FIG. It is needless to say that the determination of a baseball game other than the determination of the pitching ball can be made using the embodiment of FIG.

Since the baseball referee stands behind the catcher, it is often difficult to pinpoint the exact position of the pitcher over the body of the catcher. Particularly, in the case of a breaking ball or catcher catching a pitching ball, the catcher moves a little bit of the meat to cause confusion in the judgment of the referee. Thus, the strike zone determination system 200 is configured to reduce the nausea for the strike determination of the referee. Hereinafter, the detailed configuration will be described.

The moving picture camera 210 is arranged to zoom in the catcher on the back of the pitcher and shoot a moving picture. It is preferable to be disposed on the side of the outhouse floor of the baseball field.

The zoom-in moving picture photographed by the moving picture camera 210 may be configured to be transmitted in real time to the baseball referee AR glass 230 by a local communication module (not shown) provided in the moving picture camera. Here, it is preferable that the short-range communication module is a Wi-Fi module in consideration of the distance of the baseball field.

The pitcher AR glass 220 may be configured to include a moving picture camera 221 for the AR glass and a local communication module 222 for the AR glass.

The pitcher's AR glass 220 is a glass to be worn by a pitcher, which is very suitable for confirming that the ball enters the strike zone accurately from the front since the pitcher is often stared until the catcher catches the ball after pitching.

The moving picture camera 221 for the AR glass mounted on the pitcher AR glass 220 can be configured to photograph the front face of the catcher after pitching.

The near-field communication module 222 for the AR glass can be configured to transmit, in real time, the moving picture photographed by the moving picture camera 221 for the AR glass to the baseball referee AR glass 230.

Here, either the moving picture camera 210 or the AR glass for pitcher 220 may be used, or both of them may be used.

The baseball referee AR glass 230 may be configured to include a microphone 231, a touch pad 232, a short range communication module 233 for the AR glass, and a projector 234. [

The microphone 231 may be configured to receive a voice command of the referee.

As an example of a voice command, "replay" may be an instruction to replay a moving picture photographed by the pitcher's AR glass 220 a predetermined number of seconds before. Or "Slow" can be the instruction to replay the video slowly.

When the pitcher is ready to pitch, the referee inputs a voice command "Capture ", and transmits the voice command to the pitcher AR glass 220. [ So that the pitcher AR glass 220 starts to shoot the moving picture and transmits it to the baseball referee AR glass 230 in real time.

The touch pad 232 may be configured to receive a touch command of the referee.

The touch pad 232 may be provided on a base portion of the baseball referee AR glass 230 and may be configured such that a predetermined command is performed when the referee touches the hand with one touch. It goes without saying that various commands can be programmed to be performed depending on the number of touches.

For example, when the touch pad 232 is touched once, a voice command "shooting" is executed, and when the touch pad 232 is touched twice, a voice command "replay" When the touch pad 232 is touched three times, a voice command "Slow" can be inputted and executed.

The local communication module 233 for the AR glass may be configured to transmit a voice command input through the microphone 231 or a touch command input by the touch pad 232 to the AR communication module 222 for AR glass.

Meanwhile, the short-range communication module 222 for the AR glass can be configured to receive the moving picture in real time from the short-range communication module 222 for the AR glass of the pitcher AR glass 220.

The projector 234 may be configured to project a moving image, which is received in real time in the short distance communication module 233 for the AR glass, to the eyes of the referees through a prism.

3 is a flowchart of a method of determining a sports game using AR glass according to an embodiment of the present invention.

Referring to FIG. 3, first, a plurality of moving picture cameras 110 installed in a stadium for shooting a competition take a moving picture at each photographing angle and transmit it to the moving picture server 120 (S101).

Next, the moving picture server 120 receives the moving picture photographed by the moving picture camera 110 and stores the received moving picture for each moving picture camera 110 (S102).

Next, an augmented reality glass 130 receives a voice command from a referee through a microphone 131, or inputs a touch command of a referee through a touch pad 132 (S103).

Next, the referee's AR glass 130 transmits the voice command or the touch command previously input to the referee's smartphone 140 by local communication (S104).

Next, the referee smartphone 140 receives a voice command or a touch command, and transmits the received voice command or touch command to the video server 120 through the 3G / 4G mobile communication (S105).

Next, the video server 120 extracts a clip video corresponding to a voice command or a touch command from the video stored previously, and transmits the clip video to the referee smartphone 140 through the 3G / 4G mobile communication (S106).

At this time, the moving picture server 120 may extract a predetermined number (back number), a predetermined camera number, and a clip movie before a predetermined number of seconds according to a voice command and transmit the extracted clip video.

In addition, the moving picture server 120 may be configured to automatically extract and transmit a predetermined clip moving picture before a predetermined second in accordance with a touch command.

At this time, the photographing time of the moving picture stored in the moving picture server 120 may be configured to be synchronized with the operation time of the judging timer through the judging smartphone 140.

Next, the referee smartphone 140 receives the clip video and transmits it to the refereeing AR glass 130 by short distance communication (S107).

Next, the referee's AR glass 130 receives the clip video and projects it to the eyes of the referee using the projector 134 (S108).

At this time, the referee's AR glass 130 may be configured to reproduce and display the received clip video in a slow motion having a predetermined reproduction speed according to a predetermined voice command of the referee.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention as defined in the following claims There will be.

110: Video camera
120: video server
130: referee AR glass
131: microphone
132: Touchpad
133: Local communication module for AR glass
134: Projector
140: Referee Smartphone
141: Local area communication module for smartphone
142: Mobile communication module
150: Referee timer
151: Local communication module for timer
160:
210: Video camera
220: AR glass for pitcher
221: Video camera for AR glass
222: Local communication module for AR glass
230: AR glass for baseball referee
231: microphone
232: Touchpad
233: Local communication module for AR glass
234: Projector

Claims (4)

A plurality of moving picture cameras installed in the playing field for shooting a game and photographing a moving picture at a plurality of photographing angles;
A moving picture server for storing a moving picture photographed by the moving picture camera for each moving picture camera and transmitting a clip moving picture corresponding to a voice command or a touch command of the judge;
A touch pad for inputting a touch command of the referee; a voice command input through the microphone or a touch command input by the touch pad; A short distance communication module for the AR glass for receiving the clip video corresponding to the voice command or the touch command; and a short distance communication module for projecting the clip video received by the short distance communication module for the AR glass to the eye of the referee through a prism An augmented-reality glass including a projector;
A local communication module for a smart phone receiving a voice command or a touch command from the local communication module for the AR glass; a voice command or a touch command received from the local communication module for the AR glass to the video server; And a mobile communication module for receiving a clip video corresponding to a voice command or a touch command, wherein the short-range communication module for the smart phone comprises a smart card for transmitting a clip video received from the mobile communication module to the short- pawn;
And a timer for judging the operation time to be synchronized with a photographing time of the moving picture stored in the moving picture server through the short distance communication module for the smart phone and the mobile communication module,
The video server includes:
Extracts a clip number of a predetermined number (back number), a predetermined camera number, and a clip number before a predetermined number of seconds according to the voice command, or extracts a clip video of a predetermined second earlier than the predetermined number according to the touch command And transmits the result of the determination to the sports competition determining system using the AR glass. [3] The AR glass for judging according to claim 1,
And the clip video received by the short distance communication module for the AR glass is reproduced in a slow motion having a predetermined reproduction speed according to a predetermined voice command of the referee. A plurality of moving picture cameras installed in a playing field for shooting a game, the moving pictures being taken at respective photographing angles;
The video server receiving the photographed moving image and storing the received moving image for each moving image camera;
The augmented reality glass receives a voice command from a referee through a microphone or receives a touch command of the referee through a touch pad;
The AR glass for refereeing transmits the voice command or the touch command to the smartphone for refereeing by short distance communication;
The smartphone for referee receiving the voice command or touch command and transmitting the received voice command or touch command to the video server by 3G / 4G mobile communication;
Extracting a clip video corresponding to the received voice command or a touch command among the stored moving pictures and transmitting the clip video to the smartphone for judgment by 3G / 4G mobile communication;
Receiving the clip video by the smartphone for referee and transmitting it to the refereeing AR glass by short distance communication;
And the AR glass for referee receives the clip moving image and projects it to the eyes of the referee using a projector,
Wherein the moving picture server extracts a clip video corresponding to the received voice command or touch command among the stored moving pictures and transmits the clip video to the smartphone for judgment by 3G / 4G mobile communication,
Extracts a clip number of a predetermined number (back number), a predetermined camera number, and a clip number before a predetermined number of seconds according to the voice command, or extracts a clip video of a predetermined second earlier than the predetermined number according to the touch command And,
Wherein the recording time of the moving picture stored in the moving picture server
Wherein the judging timer is synchronized with the operation time of the judging timer through the referee smartphone. 4. The method of claim 3, wherein the refractory AR glass receives the clip moving image and projects it to the eye of the referee using a projector,
Wherein the referee AR glass reproduces the received clip video in a slow motion having a predetermined reproduction speed according to a predetermined voice command of the referee and projects it.
KR1020130093651A 2013-08-07 2013-08-07 Judgment system and method for sports game using augmented-reality glass KR101540771B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
KR1020130093651A KR101540771B1 (en) 2013-08-07 2013-08-07 Judgment system and method for sports game using augmented-reality glass
PCT/KR2014/007345 WO2015020466A1 (en) 2013-08-07 2014-08-07 System and method for judging sports game using ar glass

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020130093651A KR101540771B1 (en) 2013-08-07 2013-08-07 Judgment system and method for sports game using augmented-reality glass

Publications (2)

Publication Number Publication Date
KR20150017564A true KR20150017564A (en) 2015-02-17
KR101540771B1 KR101540771B1 (en) 2015-08-06

Family

ID=52461688

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020130093651A KR101540771B1 (en) 2013-08-07 2013-08-07 Judgment system and method for sports game using augmented-reality glass

Country Status (2)

Country Link
KR (1) KR101540771B1 (en)
WO (1) WO2015020466A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022131578A1 (en) * 2020-12-18 2022-06-23 삼성전자 주식회사 Method and electronic device for providing augmented reality environment
US11867904B2 (en) 2020-12-18 2024-01-09 Samsung Electronics Co., Ltd. Method and electronic device for providing augmented reality environment

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11223761B2 (en) 2018-09-04 2022-01-11 Samsung Electronics Co., Ltd. Electronic device for obtaining images by controlling frame rate for external moving object through point of interest, and operating method thereof
KR102527918B1 (en) 2021-02-23 2023-04-28 한남대학교 산학협력단 Ar smart glass system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101759992B1 (en) * 2010-12-28 2017-07-20 엘지전자 주식회사 Mobile terminal and method for managing password using augmented reality thereof
KR101253348B1 (en) * 2011-08-12 2013-04-23 이형호 An eyeglasses for personal safety using portable filming feature and network
KR101835818B1 (en) * 2011-12-19 2018-03-07 주식회사 엔씨소프트 Apparatus and method of view point diversification using three dimensional graphic data of broadcasting objects

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022131578A1 (en) * 2020-12-18 2022-06-23 삼성전자 주식회사 Method and electronic device for providing augmented reality environment
US11867904B2 (en) 2020-12-18 2024-01-09 Samsung Electronics Co., Ltd. Method and electronic device for providing augmented reality environment

Also Published As

Publication number Publication date
WO2015020466A1 (en) 2015-02-12
KR101540771B1 (en) 2015-08-06

Similar Documents

Publication Publication Date Title
US11783721B2 (en) Virtual team sport trainer
US10771760B2 (en) Information processing device, control method of information processing device, and storage medium
JP7123523B2 (en) Method and system for automatically producing television programs
CA2798298C (en) Systems and methods for video processing
US8020098B2 (en) Video analysis system of swing motion
JP6213146B2 (en) Information processing apparatus, recording medium, and information processing method
JP2002248188A (en) Multimedia analyzing system and its usage
KR101540771B1 (en) Judgment system and method for sports game using augmented-reality glass
US20040162154A1 (en) Kinetic motion analyzer
CN102111542A (en) Image processing apparatus, imaging apparatus, image processing method, and program
CN110270078B (en) Football game special effect display system and method and computer device
KR102103757B1 (en) Filming system for bowling
US11538243B2 (en) Video playback method, medium, glasses and program product
WO2021017496A1 (en) Directing method and apparatus and computer-readable storage medium
CN108970091B (en) Badminton action analysis method and system
CN107635627B (en) Billiard ball hitting assisting method, billiard ball hitting assisting system and portable electronic equipment
KR101231147B1 (en) System and method for analyzing golf swing
KR20090032819A (en) Apparatus and method for online multi-user golf game service
WO2021187193A1 (en) Ball game footage analysis device, ball game footage analysis system, ball game footage analysis method, and computer program
KR101905848B1 (en) Measuring device and measuring method for golf club and golf ball and computer readable recording medium having program the same
CN105204284A (en) Three-dimensional stereo playback system based on panoramic circular shooting technology
JP7154998B2 (en) Video tagging device and video tagging method
WO2021182081A1 (en) Ball game video analysis device, ball game video analysis method, and computer program
Akhadov et al. Motion based remote camera control with mobile devices
JP2022173865A (en) Play analysis device, play analysis method, and, computer program

Legal Events

Date Code Title Description
A201 Request for examination
E701 Decision to grant or registration of patent right
GRNT Written decision to grant
LAPS Lapse due to unpaid annual fee