KR20210067875A - Electronic device for tagging event on sports play video and operating method thereof - Google Patents

Abstract

Various embodiments relate to an electronic device for tagging an event for a sports play video and an operating method thereof. It can be configured to map text relay data and a sports play video based on an event that occurs during a sports game, detect the tagging position of the event in the sports play video, and display an indicator for the tagging position of the event on the progress bar of the sports play video. Service users can easily check the location of the event while watching the sports play video.

Description

Electronic device for tagging an event for a game video and an operating method thereof {ELECTRONIC DEVICE FOR TAGGING EVENT ON SPORTS PLAY VIDEO AND OPERATING METHOD THEREOF}

Various embodiments relate to an electronic device for tagging an event occurring during a corresponding sports game with respect to a sports play video of a sports game, and an operating method thereof.

In general, a game image for a sports game is provided. However, there are user requests to report back to a specific situation that occurred during a sports game. However, the electronic device does not provide a service for these user requests while providing the game video. That is, while the user is watching a game video in which a sports game is broadcast live, the user cannot view a specific situation previously occurring during the corresponding sports game again. In addition, since the user has to intuitively find a specific situation that occurred during the sports game while watching the game video recorded for the sports game, it is difficult to see the corresponding situation again.

Various embodiments provide an electronic device for tagging an event representing a specific situation occurring during a sports game on a game image of a sports game, and an operating method thereof.

Various embodiments provide an electronic device that allows a service user to easily check an event occurrence location while watching a game video, and an operating method thereof.

A method of operating an electronic device according to various embodiments of the present disclosure may include mapping text relay data and a game image based on an event occurring during a sports game, detecting a tagging position of the event in the game image, and the It may include displaying an indicator (indicator) for the tagging position on the progress bar (progress bar) of the game video.

The computer program according to various embodiments may be stored in a non-transitory computer-readable recording medium in order to cause the electronic device to execute the operating method.

In a non-transitory computer-readable recording medium according to various embodiments, a program for executing the operating method in the electronic device is recorded.

An electronic device according to various embodiments of the present disclosure includes a memory and a processor connected to the memory and configured to execute at least one command stored in the memory, wherein the processor includes a text message based on an event occurring during a sports game. It may be configured to map the relay data and the game image, detect the tagging position of the event in the game image, and display an indicator for the tagging position on the progress bar of the game image.

According to various embodiments, the electronic device may provide tagging of an event occurring during a sports game with respect to a game image of the sports game. In this case, by mapping the text relay data of the sports game and the game image, the electronic device may more accurately provide event tagging for the game image. That is, the electronic device may provide event tagging as an indicator to the progress bar of the game video. Here, the electronic device may provide tagging information related to an event by using at least one of text relay data or a game image. For example, the tagging information may include at least one of at least a part of text relayed in relation to the event, a thumbnail for the event detected from the game video, or a partial image for the event detected from the game video. Accordingly, the service user may predict the occurrence position of the event in the game image based on the progress bar and the indicator while watching the game image. Through this, the service user can view the desired event again while watching the game video.

1 is a diagram illustrating an electronic device according to various embodiments of the present disclosure;
2 is a diagram for describing operation characteristics of an electronic device according to various embodiments of the present disclosure;
3A, 3B, and 3C are diagrams for explaining a service provided by an electronic device according to various embodiments of the present disclosure;
4 is a diagram illustrating a method of operating an electronic device according to various embodiments of the present disclosure;
FIG. 5 is a diagram illustrating a step of mapping text relay data and game video based on the event of FIG. 4 .
FIG. 6 is a diagram illustrating a tagging position detection step of an event in the game video of FIG. 4 .
FIG. 7 is a diagram illustrating an indicator display step for a tagging position on a progress bar of the game video of FIG. 4 .
8, 9, 10, 11, and 12 are diagrams for explaining a method of operating an electronic device according to an exemplary embodiment.

Hereinafter, various embodiments of the present document will be described with reference to the accompanying drawings.

In this document, the term 'event' may mean an action or event that occurs during a sports game. For example, the sporting event may be baseball, soccer, golf, or the like. For example, when the sports game is baseball, the event may include at least one of pitching, home run, hitting, and scoring. As another example, when the sporting event is soccer, the event may include at least one of scoring or shooting. As another example, when the sporting event is golf, the event may include a shot.

In this document, 'text relay data' may refer to text data relaying a real-time situation for a sports event. Here, the text relay data represents the details of the events, and may include, for example, identification information for each event and an actual time point. In this document, a 'game video' may refer to image data relaying a sports game. Here, the game image may include at least one of an image of a sports game being broadcast live or a video recorded and relayed.

1 is a diagram illustrating an electronic device 100 according to various embodiments. 2 is a diagram for describing operation characteristics of the electronic device 100 according to various embodiments of the present disclosure. 3A, 3B, and 3C are diagrams for explaining a service provided by the electronic device 100 according to various embodiments.

Referring to FIG. 1 , an electronic device 100 according to various embodiments includes a connection terminal 110 , a communication module 120 , an input module 130 , an output module 140 , a memory 150 , or a processor ( 160) may include at least one of. In some embodiments, at least one of the components of the electronic device 100 may be omitted, and at least one other component may be added. In some embodiments, at least any two of the components of the electronic device 100 may be implemented as one integrated circuit. In this case, the electronic device 100 may be a single server or may include a plurality of servers. According to an embodiment, the electronic device 100 may be a server for tagging an event with respect to a game image. According to another embodiment, the electronic device 100 includes a server for tagging an event for a game image, and a server for live broadcasting a game image during a sports game or a server for providing text relay data during a sports game It may further include at least one of.

The connection terminal 110 may be physically connected to the external device 102 in the electronic device 100 . For example, the external device 102 may include another electronic device. To this end, the connection terminal 110 may include at least one connector. For example, the connector may include at least one of an HDMI connector, a USB connector, an SD card connector, or an audio connector.

The communication module 120 may communicate with the external devices 102 and 104 in the electronic device 100 . The communication module 120 may establish a communication channel between the electronic device 100 and the external devices 102 and 104 and communicate with the external devices 102 and 204 through the communication channel. The communication module 120 may include at least one of a wired communication module and a wireless communication module. The wired communication module may be connected to the external device 102 by wire through the connection terminal 102 to communicate via wire. The wireless communication module may include at least one of a short-range communication module and a long-distance communication module. The short-range communication module may communicate with the external device 102 in a short-range communication method. For example, the short-range communication method may include at least one of Bluetooth, WiFi direct, and infrared data association (IrDA). The telecommunication module may communicate with the external device 104 in a telecommunication method. Here, the telecommunication module may communicate with the external device 104 through the network 190 . For example, network 190 may include at least one of a cellular network, the Internet, or a computer network such as a local area network (LAN) or a wide area network (WAN).

In this case, the external devices 102 and 104 may include at least one of other servers, electronic devices, satellites or base stations. For example, the electronic device includes a smart phone, a mobile phone, a navigation system, a computer, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a tablet PC, a game console, It may include at least one of a wearable device, an Internet of things (IoT) device, a home appliance, a medical device, and a robot. According to an embodiment, when the electronic device 100 is a server for tagging an event for a game image, the other server provides a server for live broadcasting of a game image during a sporting event or text relay data during a sporting event. It may include at least one of the servers for At this time, the electronic device may check the tagging of the event for the game image by the electronic device 100 while watching the game image.

The input module 130 may input a signal to be used in at least one component of the electronic device 100 . The input module 130 is an input device configured to allow a user to directly input a signal to the electronic device 100 , a sensor device configured to generate a signal by sensing a surrounding environment, or capture an image to generate image data It may include at least one of the camera modules configured to do so. For example, the input device may include at least one of a microphone, a mouse, and a keyboard. In some embodiments, the sensor device may include at least one of a touch circuitry configured to sense a touch or a sensor circuit configured to measure an intensity of a force generated by the touch.

The output module 140 may output information. The output module 140 may include at least one of a display module configured to visually display information or an audio module configured to audibly reproduce information. For example, the display module may include at least one of a display, a hologram device, and a projector. For example, the display module may be implemented as a touch screen by being assembled with at least one of a touch circuit and a sensor circuit of the input module 130 . For example, the audio module may include at least one of a speaker and a receiver.

The memory 150 may store various data used by at least one component of the electronic device 100 . For example, the memory 150 may include at least one of a volatile memory and a non-volatile memory. The data may include at least one program and input data or output data related thereto. The program may be stored as software including at least one instruction in the memory 150 , and may include, for example, at least one of an operating system, middleware, or an application.

The processor 160 may execute a program in the memory 150 to control at least one component of the electronic device 100 . Through this, the processor 160 may process data or perform an operation. At this time, the processor 160 may execute a command stored in the memory 150 . The processor 160 may provide tagging of an event with respect to a game image for a sports game. To this end, the processor 160 may detect a tagging position for tagging an event in the game image. In this case, the processor 160 may detect the tagging position of each event in the game image by using the text relay data for the sports game.

According to various embodiments, the processor 160 may map the text relay data and the game image based on an event that occurs during a sports game. For example, when the sports game is baseball, the event may include at least one of a goal score, a home run, or a first pitch for each turn at bat. As another example, when the sporting event is soccer, the event may include a score. As another example, when the sporting event is golf, the event may include a tee shot for each hole. The processor 160 may confirm the occurrence location of the event in the game image. Here, the occurrence position only indicates a temporal position in the game video, not the actual time. The processor 160 may recognize the scoreboard of the game image, and confirm the occurrence location of the event in the game image. For example, the processor 160 may confirm the occurrence location of the event on the video timeline defined based on the game video as shown in FIG. 2 . In addition, the processor 160 may check the actual timing of the event in the text relay data. For example, as shown in FIG. 2 , the processor 160 may check the actual timing of the event on an actual timeline defined based on text relay data. Through this, the processor 160 may map the occurrence location and the actual time based on the event. In this case, the processor 160 may map the occurrence location and the actual time point according to the occurrence order of the event.

According to various embodiments, the processor 160 may detect a tagging position of an event in the game video. The processor 160 may recognize a predetermined motion in association with an event, adjacent to the occurrence position in the game image. Here, the motion may represent an action of at least one object that is related to an event and meets at least one predetermined condition. For example, the object may include at least one of a person or a thing. For example, when the sports game is baseball, the motion may include at least one of a swing motion and a pitching motion. As another example, when the sports game is soccer, the motion may include at least one of an air-defense pass motion and a shooting motion. As another example, when the sports game is golf, the motion may include at least one of a swing motion and a putting motion. For example, as shown in FIG. 2 , the processor 160 may identify a motion section adjacent to the occurrence position based on the motion on the image timeline. In addition, the processor 160 may detect a tagging position of the event based on the motion. For example, as shown in FIG. 2 , the processor 160 may detect a tagging position in response to a motion section on an image timeline.

According to various embodiments, the processor 160 may display an indicator for a tagging position of an event on the progress bar while displaying the progress bar of the game image. At this time, the progress bar corresponds to the progress time period of the game video, and the processor 160 may give an indicator to the tagging position within the running time length of the game image. For example, if the game image is an image of a sports game being broadcast live, the duration of the game image may be the length of time from an initial time point when the game video starts to the current time point. As another example, if the game video is an image of a sports game being recorded and relayed, the duration of the game video may be the total time length of the game video. Through this, the processor 160 may proportionally check the tagging position within the running time length of the game video, and display an indicator of the event at the corresponding tagging position. Here, the indicator may have various shapes and sizes.

For example, the processor 160 may display the indicator 320 for the tagging position of the event on the progress bar 310 of the game image 300 as shown in FIG. 3A, 3B or 3C. have. For example, if the sports game is baseball and the event is a score, an indicator 320 for the tagging position of each score in the progress bar 310 of the game image 300 for baseball as shown in FIG. 3A . can be displayed. As another example, if the sports game is soccer and the event is a score, an indicator 320 for the tagging position of each score in the progress bar 310 of the soccer game image 300 as shown in FIG. 3b . can be displayed. As another example, if the sports game is golf and the event is a tee shot for each hole, as shown in FIG. 3C , an indicator for the tagging position of the tee shot for each hole on the progress bar 310 of the game image 300 for golf 320 may be displayed. Accordingly, while the service user watches the game video 300 using an electronic device, based on the progress bar 310 and the indicator 320 , the event occurs within the duration of the game video 300 . location can be predicted.

In some embodiments, the processor 160 may provide tagging information on at least a portion of the game image 300 . To this end, the processor 160 may generate tagging information by using at least one of the text relay data or the game image 300 . In this case, the tagging information may indicate information related to at least one of an event or a tagging location of the event. According to an embodiment, when the service user selects the indicator 320 while watching the game image 300 using an electronic device, the processor 160 selects the indicator 320 on at least a part of the game image 300 . ) may provide tagging information related to the tagging location. In this case, the tagging information may include at least one of information on an event of the selected indicator 320 or event details up to the tagging position of the selected indicator 320 . For example, the tagging information is at least a part of text relayed through text relay data at the actual time of the event, a thumbnail for an event detected from the game image 300, or a partial image for an event detected from the game image 300 may include at least one of Here, the partial image may be detected to start from the tagging position in the game image 300 . According to another embodiment, when the service user selects a location through the progress bar 310 while viewing the game image 300 using an electronic device, the processor 160 displays the game on at least a part of the game image. It is possible to provide event details from the video to the selected location. Here, the event details may indicate a list of tagging information.

4 is a diagram illustrating a method of operating the electronic device 100 according to various embodiments of the present disclosure. FIG. 5 is a diagram illustrating a text relay data and game image mapping step (step 410) based on the event of FIG. 4 . 6 is a diagram illustrating a tagging position detection step (step 420) of an event in the game video of FIG. 7 is a diagram illustrating an indicator display step (step 430) of a tagging position on the progress bar of the game video of FIG. 8, 9, 10, 11, and 12 are diagrams for explaining a method of operating the electronic device 100 according to an exemplary embodiment.

Referring to FIG. 4 , in step 410 , the electronic device 100 may map text relay data for a sports game and a game image. The processor 160 may map the text relay data and the game image based on an event that occurs during a sports game. For example, when the sports game is baseball, the event may include at least one of a goal score, a home run, or a first pitch for each turn at bat. As another example, when the sporting event is soccer, the event may include a score. As another example, when the sporting event is golf, the event may include a tee shot for each hole. This will be described later in more detail with reference to FIG. 5 .

Referring to FIG. 5 , in step 511 , the electronic device 100 may identify the location of the event in the game image. Here, the occurrence position only indicates a temporal position in the game video, not the actual time. At this time, the processor 160 may recognize the scoreboard of the game image, and confirm the occurrence location of the event in the game image. For example, the processor 160 may confirm the occurrence location of the event on the video timeline defined based on the game video as shown in FIG. 2 .

According to an embodiment, the processor 160 may continuously track the scoreboard 810 in the game image 800 . In this case, the processor 160 may recognize the scoreboard 810 in the game image 800 as shown in FIG. 8 . Here, the processor 160 may detect the area of the scoreboard 810 in the game image 800 using an artificial intelligence module such as YOLOv3, for example. In addition, the processor 160 may recognize the event count 830 in the score board 810 . Here, the event count 830 is a number, and the processor 160 may recognize the event count 830 using, for example, a vision module such as an optical character reader (OCR). Through this, the processor 160 may check the occurrence location of the event in response to the change in the event count 830 . That is, the processor 160 may monitor a change in the event count 830 while tracking the score board 810 , thereby confirming the occurrence location of the event. For example, when the sporting event is baseball, the event may represent each pitch, and the event count 830 may represent the cumulative number of pitches in the corresponding sporting event. As another example, when the sporting event is soccer, the event may represent each score, and the event count 830 may represent the total score in the corresponding sporting event.

For example, the processor 160 may identify a predetermined indicator 820 within the scoreboard 810 as shown in FIG. 8 . The indicator 820 may have at least one of a predetermined shape or size. For example, when the sports game is baseball, the indicator 820 may have a baseball shape. Here, the processor 160 may, for example, perform template matching to identify the indicator 820 , thereby detecting the position of the indicator 820 in the scoreboard 810 . Thereafter, the processor 160 may recognize an event count 830 based on the indicator 820 in the scoreboard 810 as shown in FIG. 8 . Here, the processor 160 may predict the location of the event count 830 based on the location of the indicator 820 in the scoreboard 810 . To this end, the location of the event count 830 may be predetermined based on the location of the indicator 820 . For example, the location of the event count 830 may be determined as at least one of right, left, upper, or lower based on the location of the indicator 820 . The processor 160 may recognize the event count 830 at the predicted location. Accordingly, the processor 160 monitors a change in the event count 830 while tracking the score board 810 , thereby confirming the occurrence location of each event.

In step 513 , the electronic device 100 may check the actual time of the event in the text relay data. For example, as shown in FIG. 2 , the processor 160 may check the actual timing of the event on an actual timeline defined based on text relay data.

In step 515 , the electronic device 100 may map an occurrence location and an actual time point based on the event. The processor 160 may map the occurrence location and the actual time point according to the occurrence order of the event.

Thereafter, the electronic device 100 may return to FIG. 4 and proceed to step 420 .

Referring back to FIG. 4 , in step 420 of the electronic device 100 , the processor 160 may detect a tagging position of an event in the game video. The processor 160 may detect a tagging position of the event based on a predetermined motion associated with the event in the game video. Here, the motion may represent an action of at least one object that is related to an event and meets at least one predetermined condition. For example, the object may include at least one of a person or a thing. For example, when the sports game is baseball, the motion may include at least one of a swing motion and a pitching motion. As another example, when the sports game is soccer, the motion may include at least one of an air-defense pass motion and a shooting motion. As another example, when the sports game is golf, the motion may include at least one of a swing motion and a putting motion. This will be described later in more detail with reference to FIG. 6 .

Referring to FIG. 6 , in step 621 , the electronic device 100 may recognize a predetermined motion in association with an event adjacent to a location where it occurs in the game image. In this case, the processor 160 may track the actions of at least one object in the game image. Then, the processor 160 may recognize a predetermined motion from the actions. The processor 160 may recognize motion using, for example, an artificial intelligence (AI) module such as a tensorflow object detection model and a rule-based algorithm. Here, the motion may represent one action or a combination of a plurality of actions satisfying at least one condition predetermined in relation to the event. In addition, the processor 160 may check the motion section for the motion adjacent to the occurrence position in the game video. For example, as shown in FIG. 2 , the processor 160 may identify a motion section adjacent to the occurrence position based on the motion on the image timeline.

According to an embodiment, the processor 160 may track the actions of the plurality of objects 910 , 920 , and 930 in the game image 900 as shown in FIG. 9 . Here, the processor 160 may track the actions of the objects 910 , 920 , and 930 by comparing the frames of the game image 900 according to the image analysis technique. Through this, the processor 160 may recognize a predetermined motion from the actions. For example, when the sports game is baseball, the event may represent each pitch, and the motion may include a pitching motion. Here, the pitching motion is determined by a combination of the actions of the pitcher 910 , the batter 920 and the catcher 930 , and the batter 920 is positioned between the pitcher 910 and the catcher 930 , the catcher 930 . ) may be determined as at least one of a condition that the head position of the batter 920 should be lower than the head position of the batter 920 , or a condition that the foot position of the pitcher 910 is lower than the foot position of the catcher 930 . Accordingly, the processor 160 may check each of the motion sections between the occurrence positions in response to the motion in the game video.

The processor 160 may detect a tagging position of the event based on the motion in step 623 . For example, as shown in FIG. 2 , the processor 160 may detect a tagging position in response to a motion section on an image timeline.

Thereafter, the electronic device 100 may return to FIG. 4 and proceed to step 430 .

Referring back to FIG. 4 , the electronic device 100 may display an indicator for a tagging position of an event on the progress bar while displaying the progress bar of the game video in step 430 . In this case, the progress bar corresponds to the length of the running time of the game video, and the processor 160 may give an indicator to the tagging position within the running time of the game video. For example, if the game image is an image of a sports game being broadcast live, the duration of the game image may be the length of time from an initial time point when the game video starts to the current time point. As another example, if the game video is an image of a sports game being recorded and relayed, the duration of the game video may be the total time length of the game video. Through this, the processor 160 may proportionally check the tagging position within the running time length of the game video, and display an indicator of the event at the corresponding tagging position. Here, the indicator may have various shapes and sizes. For example, the processor 160 may display the indicator 1020 for the tagging position of the event on the progress bar 1010 of the game image 1000 as shown in FIG. 10 . Accordingly, while the service user watches the game image 1000 using an electronic device, based on the progress bar 1010 and the indicator 320 , the event occurs within the duration of the game image 300 . location can be predicted.

In some embodiments, the processor 160 may provide tagging information on at least a portion of the game image 300 . That is, while the service user watches the game image 1000 using the electronic device, the processor 160 may provide tagging information on at least a portion of the game image 300 based on the service user's request. To this end, the processor 160 may generate tagging information by using at least one of the text relay data or the game image 300 . In this case, the tagging information may indicate information related to at least one of an event or a tagging location of the event. This will be described later in more detail with reference to FIG. 7 .

Referring to FIG. 7 , in step 731 , the electronic device 100 may display an indicator for the tagging position of the event on the progress bar of the game image. For example, the processor 160 may display the indicator 1020 for the tagging position of the event on the progress bar 1010 of the game image 1000 as shown in FIG. 10 . For example, when the sports game is baseball and the event is a score, an indicator 1020 for a tagging position of each score may be displayed on the progress bar 1010 of the game image 1000 for baseball. As another example, when the sports game is soccer and the event is a score, an indicator 1020 for a tagging position of each score may be displayed on the progress bar 1010 of the game image 1000 . As another example, if the sports game is golf and the event is a tee shot for each hole, an indicator 1020 for the tagging position of the tee shot for each hole may be displayed on the progress bar 1010 of the game image 1000 for golf. have. According to an embodiment, the progress bar 1010 includes a pointer 1011, and while the service user watches the game image 1000 using an electronic device, the pointer 1011 is the progress bar. It may be located at the end of (1010). According to another embodiment, the processor 160 may further display at least one function button 1030 to which a predetermined function is assigned together with the progress bar 1010 on the game image 1000 .

When the indicator 1020 of the game image 1000 is selected by the service user in operation 733 , the electronic device 100 may provide tagging information to at least a portion of the game image 1000 in operation 735 . When the service user selects the indicator 1020 while watching the game image 1000 using the electronic device, the processor 160 may detect it. Correspondingly, the processor 160 may provide tagging information related to the tagging position of the selected indicator 1020 on at least a portion of the game image 300 . In this case, the tagging information may include at least one of information about the event of the selected indicator 1020 or event details up to the tagging position of the selected indicator 1020 . For example, the processor 160 displays the window 1140 adjacent to the indicator 1020 selected on at least a part of the game image 1000 as shown in FIG. 11 , and tagging information through the window 1140 . can provide Here, the tagging information is at least a portion of the text relayed through the text relay data at the actual time of the event, a thumbnail for the event detected from the game image 1000, or at least a partial image for the event detected from the game image 1000 may contain one. Here, the partial image may be detected to start from the tagging position in the game image 1000 . For example, although not shown, when the window 1140 is additionally selected by the service user, the processor 160 may enlarge the window 1140 on the game image 1000 .

On the other hand, when a location is selected by the service user through the progress bar 1010 in step 737, the electronic device 100 provides event details up to the selected location in at least a part of the game image 1000 in step 739. can When the service user selects a position of the progress bar 310 while viewing the game image 300 using the electronic device, the processor 160 may detect it. In response, the processor 160 may provide event details up to a location selected on at least a portion of the game image 1000 . Here, the event details may indicate a list of tagging information. For example, as shown in FIG. 12 , the processor 160 displays the window 1250 adjacent to the selected position on at least a part of the game image 1000 , and provides event details through the window 1250 . can Here, after moving the pointer 1011 to the selected position of the progress bar 1010 , the processor 160 may display the window 1250 adjacent to the pointer 1011 . For example, although not shown, if the window 1250 is additionally selected by the service user, the processor 160 may enlarge the window 1250 on the game image 1000 .

Meanwhile, although not shown, when the function button 1030 is selected from the game image 1000 by the service user, the processor 160 may provide a function assigned to the function button 1030 . For example, the function assigned to the function button 1030 may be provided by combining partial images of at least one event that has occurred so far. That is, the processor 160 may detect a partial image for each event from the game image 1000 , combine the detected partial images, and provide the same. Here, the processor 160 may display a window (not shown) on at least a part of the game image 1000 and provide a function through the window.

According to an embodiment, when the sports game is baseball, the event may be a score, and the motion may be a pitching motion. In this case, the electronic device 100 may display the score indicator on the progress bar of the game image at the tagging position corresponding to the pitching motion. Specifically, the electronic device 100 may map the text relay data and the game image based on the score. In this case, the electronic device 100 may check the occurrence position of the score in the game image and the actual timing of the score in the text relay data, respectively, and map them. And, the electronic device 100 may detect the tagging position of the score in the game image. In this case, the electronic device 100 may recognize a predetermined pitching motion at a position before the corresponding throwing position adjacent to the score occurrence position, and detect the tagging position from the motion section of the corresponding throwing motion. Through this, the electronic device 100 may display an indicator for the tagging position of the score on the progress bar of the game image.

According to another embodiment, when the sporting event is soccer, the event may be a score, and the motion may be a shooting motion. In this case, the electronic device 100 may display the score indicator on the progress bar of the game image at the tagging position corresponding to the shooting motion. Specifically, the electronic device 100 may map the text relay data and the game image based on the score. In this case, the electronic device 100 may check the occurrence position of the score in the game image and the actual timing of the score in the text relay data, respectively, and map them. And, the electronic device 100 may detect the tagging position of the score in the game image. At this time, the electronic device 100 may recognize a predetermined shooting motion at a position before the corresponding shooting motion adjacent to the score generating position, and detect the tagging position from the motion section of the corresponding shooting motion. Through this, the electronic device 100 may display an indicator for the tagging position of the score on the progress bar of the game image.

According to another embodiment, when the sports game is golf, the event is a tee shot for each hole, and the motion may include a swing motion and a putting motion. In this case, the electronic device 100 may display the indicator for the tee shot for each hole on the progress bar of the game image at the tagging position corresponding to the swing motion or the putting motion. Specifically, the electronic device 100 may map the text relay data and the game image based on the tee shot for each hole. At this time, the electronic device 100 may check the occurrence position of the tee shot for each hole in the game image and the actual timing of the tee shot for each hole in the text relay data, respectively, and map them. In addition, the electronic device 100 may detect a tagging position of a tee shot for each hole in the game image. At this time, the electronic device 100 recognizes a predetermined swing motion or putting motion at a position before the occurrence position adjacent to the occurrence position of the tee shot for each hole, and detects the tagging position from the motion section of the corresponding swing motion or putting motion. can do. Through this, the electronic device 100 may display an indicator for the tagging position of the tee shot for each hole on the progress bar of the game image.

According to various embodiments, the electronic device 100 may provide tagging of an event occurring during a sports game with respect to a game image of the sports game. In this case, the electronic device 100 may more accurately provide event tagging for the game image by mapping the text relay data of the sports game and the game image. That is, the electronic device 100 may provide event tagging as an indicator to the progress bar of the game image. Here, the electronic device 100 may provide tagging information related to an event by using at least one of text relay data or a game image. For example, the tagging information may include at least one of at least a part of text relayed in relation to the event, a thumbnail for the event detected from the game video, or a partial image for the event detected from the game video. Accordingly, the service user may predict the occurrence position of the event in the game image based on the progress bar and the indicator while watching the game image. Through this, the service user can view the desired event again while watching the game video.

The method of operating the electronic device 100 according to various embodiments includes mapping text relay data and a game image based on an event occurring during a sports game (step 410), and detecting a tagging position of the event in the game image performing (step 420), and displaying an indicator for the tagging position of the event on the progress bar of the game video (step 430).

According to various embodiments, the step 410 of mapping the text relay data and the game image may include: confirming the occurrence location of the event in the game image (step 511), confirming the actual time of the event in the text relay data (Step 513), and mapping the occurrence location and the actual time point (Step 515).

According to various embodiments, the step of detecting the tagging location (step 420) is adjacent to the occurrence location in the game video, recognizing a predetermined motion associated with the event (step 621), and based on the motion, and detecting the tagging location (step 623).

According to various embodiments, the method may further include generating tagging information related to a tagging location by using at least one of text relay data or the game video.

According to various embodiments, the method may further include providing tagging information on at least a portion of the game video (step 735) based on the selection of the indicator (step 733).

According to various embodiments, the tagging information is at least one of at least a part of text relayed from an actual point of view, a thumbnail for an event detected from a game video, or a partial image for an event detected to start from a tagging position from the game video. may include.

According to various embodiments, the step of confirming the location of occurrence (step 511) may include recognizing the scoreboard in the game image, recognizing the event count in the scoreboard, and when the event count is changed, the It may include the step of ascertaining the location of the occurrence.

According to various embodiments, the method includes, based on selection of a location through the progress bar (step 737), providing event details from the game video to the selected location on at least a portion of the game video (step 739) step) may be further included.

According to an embodiment, when the sports game is baseball, the event may include at least one of a goal score, a home run, or a first pitch per turn at bat, and the motion may include at least one of a swing motion or a pitching motion.

According to another embodiment, when the sporting event is soccer, the event may include a goal score, and the motion may include at least one of an air-defense pass motion or a shooting motion.

According to another embodiment, when the sporting event is golf, the event may include a tee shot for each hole, and the motion may include at least one of a swing motion and a putting motion.

The electronic device 100 according to various embodiments may include a memory 150 and a processor 160 connected to the memory 150 and configured to execute at least one command stored in the memory 150 . .

According to various embodiments, the processor 160 maps text relay data and a game image based on an event that occurs during a sports game, detects a tagging position of the event in the game image, and displays it on the progress bar of the game image. It may be configured to display an indicator for the tagging location of the event.

According to various embodiments, the processor 160 may be configured to confirm the occurrence position of the event in the game image, determine the actual timing of the event in the text relay data, and map the occurrence position and the actual timing.

According to various embodiments, the processor 160 may be configured to recognize a predetermined motion associated with an event, adjacent to the occurrence position in the game video, and detect a tagging position based on the motion.

According to various embodiments, the processor 160 may be configured to generate tagging information related to a tagging location by using at least one of text relay data or a game image.

According to various embodiments, the processor 160 may be configured to provide tagging information on at least a portion of the game video based on the selection of the indicator.

According to various embodiments, the tagging information is at least one of at least a part of text relayed from a real time point, a thumbnail for an event detected from a game video, or a partial image for an event detected to start from a tagging position from the game video. may include.

According to various embodiments, the processor 160 may be configured to recognize a scoreboard in a game image, recognize an event count in the scoreboard, and check an event occurrence location when the event count is changed.

According to various embodiments, the processor 160 may be configured to provide event details from the game image to the selected position on at least a portion of the game image, based on selection of a position through the progress bar.

According to an embodiment, when the sports game is baseball, the event may include at least one of a goal score, a home run, or a first pitch per turn at bat, and the motion may include at least one of a swing motion or a pitching motion.

According to another embodiment, when the sporting event is soccer, the event may include a goal score, and the motion may include at least one of an air-defense pass motion or a shooting motion.

According to another embodiment, when the sporting event is golf, the event may include a tee shot for each hole, and the motion may include at least one of a swing motion and a putting motion.

The device described above may be implemented as a hardware component, a software component, and/or a combination of the hardware component and the software component. For example, the devices and components described in the embodiments may include a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), and a programmable logic unit (PLU). It may be implemented using one or more general purpose or special purpose computers, such as a logic unit, microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For convenience of understanding, although one processing device is sometimes described as being used, one of ordinary skill in the art will recognize that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that can include For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

Software may comprise a computer program, code, instructions, or a combination of one or more thereof, which configures a processing device to operate as desired or is independently or collectively processed You can command the device. The software and/or data may be embodied in any type of machine, component, physical device, computer storage medium or device for interpretation by or providing instructions or data to the processing device. have. The software may be distributed over networked computer systems, and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to various embodiments may be implemented in the form of program instructions that may be executed through various computer means and recorded in a computer-readable medium. A system may be a continuous storage of an executable program into a computer, or it may be a temporary storage for execution or download. In addition, the medium may be various recording means or storage means in the form of a single or several hardware combined, it is not limited to a medium directly connected to any computer system, and may exist distributed on a network. Examples of the medium include a hard disk, a magnetic medium such as a floppy disk and a magnetic tape, an optical recording medium such as CD-ROM and DVD, a magneto-optical medium such as a floppy disk, and those configured to store program instructions, including ROM, RAM, flash memory, and the like. In addition, examples of other media may include recording media or storage media managed by an app store for distributing applications, sites for supplying or distributing other various software, and servers.

The various embodiments of this document and the terms used therein are not intended to limit the technology described in this document to a specific embodiment, but it should be understood to include various modifications, equivalents, and/or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for like components. The singular expression may include the plural expression unless the context clearly dictates otherwise. In this document, expressions such as “A or B”, “at least one of A and/or B”, “A, B or C” or “at least one of A, B and/or C” refer to all of the items listed together. Possible combinations may be included. Expressions such as “first”, “second”, “first” or “second” can modify the corresponding components regardless of order or importance, and are only used to distinguish one component from another. It does not limit the corresponding components. When an (eg, first) component is referred to as being “(functionally or communicatively) connected” or “connected” to another (eg, second) component, that component is It may be directly connected to the component, or may be connected through another component (eg, a third component).

As used herein, the term “module” includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of one or more functions. For example, the module may be configured as an application-specific integrated circuit (ASIC).

According to various embodiments, each component (eg, a module or a program) of the described components may include a singular or a plurality of entities. According to various embodiments, one or more components or steps among the above-described corresponding components may be omitted, or one or more other components or steps may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to integration. According to various embodiments, steps performed by a module, program or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the steps are executed in a different order, omitted, or , or one or more other steps may be added.

Claims (20)

A method of operating an electronic device, comprising:
mapping the text relay data and the game image based on an event occurring during a sports game;
detecting a tagging position of the event in the game video; and
Displaying an indicator for the tagging position of the event on the progress bar of the game video
A method comprising
The method of claim 1,
The step of mapping the text relay data and the game image,
checking the location of the event in the game image;
checking the actual time of the event from the text relay data; and
Mapping the occurrence location and the actual time point
A method comprising
3. The method of claim 2,
The step of detecting the tagging position comprises:
Recognizing a predetermined motion in relation to the event adjacent to the occurrence location in the game image; and
Detecting the tagging position based on the motion
A method comprising
The method of claim 1,
generating tagging information related to the tagging location using at least one of the text relay data or the game video
A method further comprising:
5. The method of claim 4,
Based on the selection of the indicator, providing the tagging information on at least a part of the game video
A method further comprising:
6. The method of claim 5,
The tagging information is
At least one of at least a portion of the text relayed from the real time point, a thumbnail for the event detected from the game video, or a partial video for the event detected to start at the tagging position from the game video,
Way.
3. The method of claim 2,
The step of confirming the location of the occurrence,
recognizing the scoreboard from the game image;
recognizing an event count within the scoreboard; and
When the event count is changed, checking an occurrence location of the event
A method comprising
The method of claim 1,
Based on the selection of a position through the progress bar, providing event details from the game image to the selected position on at least a part of the game image
A method further comprising:
4. The method of claim 3,
When the sports game is baseball, the event includes at least one of a score, a home run, or a first pitch per turn at bat, and the motion includes at least one of a swing motion or a pitching motion,
When the sporting event is soccer, the event includes a score, and the motion includes at least one of an air-defense pass motion or a shooting motion,
When the sporting event is golf, the event includes a tee shot for each hole, and the motion includes at least one of a swing motion and a putting motion,
Way.
A computer program stored in a non-transitory computer-readable recording medium for executing the method of any one of claims 1 to 9 in the electronic device.
10. A non-transitory computer-readable recording medium in which a program for executing the method of any one of claims 1 to 9 in the electronic device is recorded.
In an electronic device,
Memory; and
a processor coupled to the memory and configured to execute at least one instruction stored in the memory;
The processor is
Maps text relay data and game video based on events that occur during sporting events,
Detect the tagging position of the event in the game video,
configured to display an indicator for the tagging position of the event on the progress bar of the game video,
Device.
13. The method of claim 12,
The processor is
Check the location of the event in the game video,
Check the actual time of the event in the text relay data,
configured to map the location of occurrence to the actual point in time,
Device.
14. The method of claim 13,
The processor is
Adjacent to the occurrence location in the game image, recognize a predetermined motion associated with the event,
configured to detect the tagging location based on the motion,
Device.
13. The method of claim 12,
The processor is
configured to generate tagging information related to the tagging location by using at least one of the text relay data or the game video,
Device.
16. The method of claim 15,
The processor is
configured to provide the tagging information on at least a portion of the game video based on the selection of the indicator,
Device.
17. The method of claim 16,
The tagging information is
At least one of at least a portion of the text relayed from the real time point, a thumbnail for the event detected from the game video, or a partial video for the event detected to start at the tagging position from the game video,
Device.
14. The method of claim 13,
The processor is
Recognizing the scoreboard in the game video,
recognizing the event count within the scoreboard;
configured to, upon a change in the event count, ascertain a location of occurrence of the event,
Device.
13. The method of claim 12,
The processor is
configured to provide event details from the game image to the selected position on at least a portion of the game image based on selection of a position through the progress bar,
Device.
15. The method of claim 14,
When the sports game is baseball, the event includes at least one of a score, a home run, or a first pitch per turn at bat, and the motion includes at least one of a swing motion or a pitching motion,
When the sporting event is soccer, the event includes a score, and the motion includes at least one of an air-defense pass motion or a shooting motion,
When the sporting event is golf, the event includes a tee shot for each hole, and the motion includes at least one of a swing motion and a putting motion,
Device.

Images