JP7467987B2 - Server, chat system, advertisement setting method and advertisement setting program - Google Patents

Description

The present invention relates to a server, a chat system, an advertisement setting method, and an advertisement setting program.

When a sporting event or other match is being held, it is customary to use a social network service (SNS) to watch video of the match on a mobile device or the like to keep track of the match situation. When such a sporting event or other match is being held, not only the athletes but also the supporters who support the athletes may act as a group. For example, after the match, the athletes or support members may hold a gathering such as a dinner party. In such a case, it is effective to transmit advertisements related to the restaurant, conference room, etc. where the meeting will take place. Patent Document 1 describes a method of transmitting advertisements based on information exchanged on a social network service.

JP 2015-509221 A

The above-mentioned Patent Document 1 distributes advertisements based on information extracted from free interactions between users, and does not necessarily obtain information that is effective for advertisement distribution. For this reason, there is a demand for obtaining more effective information for advertisement distribution.

The present invention has been made in consideration of the above, and aims to provide a server, chat system, advertisement setting method, and advertisement setting program capable of delivering advertisements based on highly effective information.

The server according to the present invention includes a video data acquisition unit that acquires video data of a game, a chat data processing unit that can acquire and/or generate chat data related to the game, an excitement information acquisition unit that acquires excitement information indicating the level of excitement in the game, a storage unit that stores the video data, the chat data, and the excitement information in association with each other by time, an image determination unit that determines whether or not target image data that is data of a target image showing an advertising client is included in the stored video data during a period during which the excitement information is equal to or greater than a predetermined threshold, an advertisement setting unit that generates advertisement setting data for displaying an advertisement of the advertising client corresponding to the target image on an external display unit when a video based on the video data and a chat based on the chat data are displayed on the external display unit, and a communication unit that can transmit the video data, the chat data, and the advertisement setting data to an external device.

The chat system according to the present invention includes a video data acquisition unit that acquires video data of a game, a chat data processing unit that is capable of at least one of acquiring and generating chat data related to the game, an excitement information acquisition unit that acquires excitement information indicating the level of excitement in the game, a storage unit that stores the video data, the chat data, and the excitement information in association with each other by time, an image determination unit that determines whether or not target image data, which is data of a target image showing an advertising client, is included in the stored video data during a period during which the excitement information is equal to or greater than a predetermined threshold, and, if the target image data is included during the period, generates video and chat data based on the video data. The server includes an advertisement setting unit that generates advertisement setting data for displaying the advertisement of the advertising client corresponding to the target image on the display unit when chat based on the data is displayed on an external display unit, a server having a server-side communication unit capable of transmitting the video data, the chat data, and the advertisement setting data to an external device, a display unit, a terminal-side communication unit that transmits and receives information between the server-side communication unit, and a display control unit that displays the video and chat based on the video data and chat data received by the terminal-side communication unit on the display unit and, when the advertisement setting data is received by the terminal-side communication unit, displays the advertisement on the display unit based on the advertisement setting data.

The advertisement setting method according to the present invention includes acquiring video data of a game, acquiring and/or generating chat data related to the game, acquiring excitement information indicating the level of excitement in the game, storing the video data, the chat data, and the excitement information in association with each other by time, determining whether or not target image data that is data of a target image indicating an advertising client is included in the stored video data during a period during which the excitement information is equal to or greater than a predetermined threshold, and if the target image data is included during the period, generating advertisement setting data for displaying an advertisement of the advertising client corresponding to the target image on an external display unit when a video based on the video data and a chat based on the chat data are displayed on the external display unit, and transmitting the video data, the chat data, and the advertisement setting data to an external device.

The advertisement setting program of the present invention causes a computer to execute the following processes: acquiring video data of a game; acquiring and/or generating chat data related to the game; acquiring excitement information indicating the level of excitement in the game; storing the video data, the chat data, and the excitement information in association with each other by time; determining whether or not target image data, which is data of a target image indicating an advertising client, is included in the stored video data during a period during which the excitement information is equal to or greater than a predetermined threshold; if the target image data is included during the period, generating advertisement setting data for displaying an advertisement of the advertising client corresponding to the target image on an external display unit when a video based on the video data and a chat based on the chat data are displayed on the external display unit; and transmitting the video data, the chat data, and the advertisement setting data to an external device.

The present invention aims to provide a server, chat system, advertisement setting method, and advertisement setting program that are capable of delivering advertisements based on highly effective information.

FIG. 1 is a block diagram showing an example of a game watching system according to the first embodiment. FIG. 2 is a diagram showing an example of video data stored in the storage unit. FIG. 3 is a diagram showing an example of score data stored in the storage unit. FIG. 4 is a diagram illustrating an example of advertisement setting data stored in the storage unit. FIG. 5 is a diagram illustrating an example of an input unit and a display unit of the terminal device. FIG. 6 is a diagram showing an example of the display content on the display unit of the terminal device. FIG. 7 is a diagram showing another example of the display content on the display unit of the terminal device. FIG. 8 is a flowchart showing an example of an advertisement setting method according to the first embodiment. FIG. 9 is a block diagram showing an example of a chat system according to the second embodiment. FIG. 10 is a diagram illustrating an example of chat data stored in the storage unit. FIG. 11 is a diagram illustrating an example of an input unit and a display unit of a terminal device. FIG. 12 is a diagram showing an example of the display content on the display unit of the terminal device. FIG. 13 is a diagram showing another example of the display content on the display unit of the terminal device. FIG. 14 is a flowchart showing an example of a chat display method according to the second embodiment. FIG. 15 is a flowchart showing an example of a chat display method according to the third embodiment. FIG. 16 is a diagram illustrating an example of advertisement setting data stored in the storage unit. FIG. 17 is a flowchart showing an example of a chat display method according to the fourth embodiment. FIG. 18 is a diagram illustrating an example of advertisement setting data stored in the storage unit. FIG. 19 is a diagram illustrating an example of an input unit and a display unit of a terminal device. FIG. 20 is a flowchart showing an example of a chat display method according to the fifth embodiment. FIG. 21 is a block diagram showing an example of a chat system according to the sixth embodiment. FIG. 22 is a flowchart showing an example of a chat display method according to the sixth embodiment.

The following describes an embodiment of the present invention with reference to the drawings. Note that the present invention is not limited to this embodiment. The components in the following embodiment include those that are easily replaceable by a person skilled in the art, or those that are substantially the same.

[First embodiment]
FIG. 1 is a block diagram showing an example of a match display system 100 according to the first embodiment. The match display system 100 shown in FIG. 1 is used for watching the match content on a mobile terminal or the like in a sports competition such as baseball. By using this match display system 100, even those who cannot participate in or watch the game directly can understand the game situation. The following description will be given using baseball as an example of a sports competition, but the present invention is not limited to this, and similar explanations can be made for other sports competitions such as soccer, volleyball, tennis, and badminton. In addition, the match display system 100 can also be applied to competitions other than sports, such as a dance competition (dance competition), a piano competition (music competition), a karuta competition (card competition or table game competition), and a karaoke competition (singing competition).

As shown in FIG. 1, the match display system 100 comprises a camera 10, a score input unit 20, a server 30, and terminal devices 40 and 40A. The camera 10 captures the match content, for example, at the match venue. The video data captured by the camera 10 is transmitted to the server 30, for example, and managed by the server 30. For example, multiple cameras 10 are provided. Note that there may be only one camera 10. Furthermore, the camera 10 may be any camera capable of capturing video data, and may be, for example, a camera attached to a mobile phone or smartphone. When the camera 10 captures video data, it includes data indicating the time of capture in the video data.

The score input unit 20 inputs game situation data indicating the situation of the game to the server 30. In this embodiment, the game situation data indicating the situation of a baseball game is, for example, score data. Score data is data that constitutes the score recorded in a baseball scorebook, and is each event that constitutes a series of events starting from the pitcher's pitch. A score is a collection of score data. Therefore, multiple score data are created each time the pitcher throws a ball, and one score is created from this. For example, if a batter reaches first base and the runner on first base is tagged out as a fly out to right field, score data indicating that the batter is out, score data indicating that the fly out to right field, and score data indicating that the runner on first base is out are created, and one score is composed of these score data.

In addition to the score data exemplified above, the score may include score data such as the batter's actions, fielder's actions, the determination of the count, the progress of runners who are already on base, and other actions of the batter and fielders. Specifically, the score may include score data such as strike, ball, foul, batting result, type of batted ball, fielder who caught the ball, and progress result. The batting result is information such as out, first base, double, triple, and home run. The type of batted ball is information such as grounder, liner, fly, and bunt, and may be further classified. The fielder who caught the ball is information for specifying the fielder who actually caught the batted ball or the defensive position of the fielder. The progress result is information regarding the progress of runners who were on base, such as "from first base to second base," and may also include other actions of the batter and fielders.

The score input unit 20 may be, for example, an application that inputs the above-mentioned score data as electronic data to the server 30. In this case, the score input unit 20 may be provided in a processing device such as a personal computer that is installed outside the server 30. The score input unit 20 may also be provided in the server 30. Note that in this embodiment, the score input unit 20 does not necessarily have to be provided.

The server 30 comprehensively manages the match display system 100. The server 30 has various applications, data, programs, etc. for managing the match display system 100. The server 30 may be, for example, a personal computer, a workstation, etc., but is not limited to these.

In the server 30, multiple chat groups are set up. Chat groups are set up individually, for example, for each sport, match, or team. The server 30 performs the various processes described below for each chat group.

The server 30 has a video data acquisition unit 31, a score data acquisition unit (match situation data acquisition unit) 32, a tag information setting unit 34, a server-side communication unit 35, a video data selection unit 36, and a memory unit 39.

The video data acquisition unit 31 acquires video data captured by the multiple cameras 10. The video data acquisition unit 31 stores the acquired video data in the memory unit 39. The score data acquisition unit 32 acquires score data input from the score input unit 20 as match situation data. The score data acquisition unit 32 associates the score data with the input time when it was input, and stores the score data in the memory unit 39.

When the server 30 stores the video data and score data, the video data and score data are uploaded to the server 30. When the server 30 stores the video data and score data, the server 30 may include data on the time at which the data was stored (hereinafter referred to as the upload time) in each piece of data. In other words, the video data and score data uploaded to the server 30 include data on the upload time. The server 30 has a management application that manages the video data and score data.

The tag information setting unit 34 sets tag information for each of the multiple video data acquired by the video data acquisition unit 31 and the multiple score data acquired by the score data acquisition unit 32. The tag information includes information about the tag range. The tag range set for the video data is a time range corresponding to the time when each video data was shot. The tag range set for the score data is a time range corresponding to the input time when the score data was input. The tag range set for the score data is set so as to include, for example, a scene in a match where a situation corresponding to the score data occurred. The input time of the score data is the time after the corresponding hitting result, etc., is determined in the match. In this case, the tag range can be, for example, a time range whose end time is the input time of the score data and whose start time is a time a predetermined time back from the input time.

The server-side communication unit 35 is capable of communicating with the terminal device 40. The server-side communication unit 35 is capable of transmitting, for example, video data, score data, and advertisement setting data (described later) stored in the memory unit 39.

The video data selection unit 36 selects a predetermined range of video data from the video data stored in the memory unit 39, and transmits it to the terminal device 40 via the server-side communication unit 35. For example, when certain score data is specified on the terminal device 40, the tag range corresponding to the specified score data is detected. The video data selection unit 36 transmits the video data corresponding to the time set in the tag range from the server-side communication unit 35 to the terminal device 40.

The image determination unit 37 determines whether or not the video data contains target image data, which is data of a target image indicating an advertising client. The advertising client is a person who requests the administrator of the server 30 to display an advertisement together with a video based on the video data. The advertisement includes various contents, such as an introduction of the advertising client, an introduction of a product or service, and the provision of benefits such as coupons. The target image also includes an image of a mark (characters, figures, symbols, three-dimensional shapes or colors, or a combination of these) indicating the advertising client. The target image that serves as the basis for the determination can be stored in the memory unit 39 in advance. In other words, the image determination unit 37 compares the target image data stored in the memory unit 39 with the video data and determines whether or not the video data contains the target image data by image processing or the like.

The advertisement setting unit 38 sets the display mode of the advertisement when the image based on the video data is displayed on the external display unit. In this embodiment, when the video data includes target image data of the advertising client, the advertisement setting unit 38 sets the advertisement corresponding to the target image to be displayed on the display unit when the video based on the video data is displayed on the external display unit. In this case, the advertisement setting unit 38 can set the advertisement to be displayed on the display unit during the period when the target image is displayed on the display unit. The advertisement setting unit 38 can also set the target image and the advertisement to be associated with each other and displayed on the display unit. The advertisement setting unit 38 can set the advertisement of the advertising client corresponding to the target image data not included in the video data not to be displayed.

The advertisement setting unit 38 may also change the display mode of the advertisement depending on at least one of the length of display time for which the target image is displayed and the number of scenes in which the target image is displayed. For example, the advertisement setting unit 38 may change the display content of the advertisement depending on the display time for which the target image is displayed and the number of scenes in which the target image is displayed. The advertisement setting unit 38 may also set the length of the display period of the advertisement depending on the display time for which the target image is displayed and the number of scenes in which the target image is displayed. Note that the changes to the display mode of the advertisement are not limited to the above, and other display modes may also be changed.

The storage unit 39 stores multiple pieces of video data acquired by the video data acquisition unit 31 and score data acquired by the score data acquisition unit 32. The video data includes data showing video footage of the match that was filmed. The video data includes data showing the time when the video footage of the match was filmed. The storage unit 39 also stores target image data of the advertising client.

Figure 2 is a diagram showing an example of video data stored in the storage unit 39. As shown in Figure 2, video data 61 is stored in the storage unit 39 in a state in which it is associated with shooting time data 62 and tag information 63a.

Figure 3 is a diagram showing an example of score data stored in the storage unit 39. As shown in Figure 3, score data 64 is stored in the storage unit 39 in a state associated with processing time data 65 and tag information 63b. Processing time data 65 is information associated with tag information 63b, and is information indicating the processing time of the score data. The processing time of the score data can be, for example, the upload time when the score data is uploaded to the server 30.

The tag information 63 (tag information 63a, 63b) shown in Figures 2 and 3 is information for associating the video data 61 with the score data 64. The tag information 63a and tag information 63b associate the video data 61 with the score data 64 based on the shooting time and the processing time, and store them in the storage unit 39.

Figure 4 is a diagram showing an example of advertisement setting data stored in the storage unit 39. The advertisement setting data 70 includes client data 71, target image data 72, advertisement content data 73, and display mode data 74. The client data 71 indicates the advertisement client. The target image data 72 indicates the content of the target image. The advertisement content data 73 indicates the advertisement content. The display mode data 74 indicates the display mode, such as the timing of display start on the display unit, the timing of display end, and the display position. Each display mode is set, for example, in advance. The display mode data 74 also indicates the setting of whether or not to display on the display unit. In other words, for advertisements that are determined by the image determination unit 37 not to include target image data and are set to hidden by the advertisement setting unit 38, even if the display mode has been set in advance, they are overwritten and set to hidden.

The storage unit 39 also stores an advertisement setting program that causes the computer to execute the following processes: acquiring video data of the match; acquiring match situation data of the match; storing the video data and the match situation data; determining whether the stored video data includes target image data that is data of a target image representing an advertising client; if the target image data is included in the video data, generating advertisement setting data that causes an advertisement of the advertising client corresponding to the target image to be displayed on the display unit when an image based on the video data is displayed on an external display unit; and transmitting the video data, match situation data, and advertisement setting data to the outside.

The terminal device 40, 40A has an input unit 41, a display unit 42, a communication unit 43, a storage unit 44, and a control unit 45. The input unit 41, the display unit 42, the communication unit 43, the storage unit 44, and the control unit 45 are connected via, for example, a bus line. Examples of the terminal device 40 include portable information terminals such as mobile phones, smartphones, tablets, and notebook personal computers.

The input unit 41 is capable of performing a predetermined input operation for inputting information. The input unit 41 outputs an instruction signal to the control unit 45 in response to the input operation. An input device such as a touch panel is used as the input unit 41. Note that, in addition to or instead of a touch panel, a button, lever, dial, switch or other input device may be used as the input unit 41. The input unit 41 outputs an instruction signal in response to the predetermined input operation. The display unit 42 displays various information including characters and images. The display unit 42 has a display panel such as a liquid crystal panel. The display unit 42 is capable of displaying information including video.

Fig. 5 is a diagram showing an example of the input unit 41 and display unit 42 of the terminal device 40 according to this embodiment. As shown in Fig. 5, the terminal device 40 has, for example, a touch panel type input unit 41 and display unit 42. In other words, the touch panel which is the input unit 41 is arranged on top of the display panel which is the display unit 42.

Display unit 42 displays, for example, a video display area M1 and a score display area M2. Video display area M1 displays video based on video data. Note that video display area M1 may display a scroll bar or the like for specifying the playback time of the video. Score display area S1 displays a score based on the score data. The score displayed in score display area S1 is not limited to the form shown in FIG. 5, and may be in other forms, such as the contents of a scoreboard.

When an operation such as a touch operation or a scroll operation is performed on a predetermined area on the surface of the touch panel, the input unit 41 outputs a predetermined instruction signal including position information of the area where the operation was performed and the operation content. The position information is set corresponding to the position of the display unit 42, for example. Note that the configurations of the input unit 41 and the display unit 42 are not limited to the above configurations.

The communication unit 43 communicates information with external devices via wired or wireless communication. For example, the communication unit 43 transmits and receives video data, score data, etc., with the external server 30.

The memory unit 44 has storage such as a hard disk drive or a solid state drive. Note that an external storage medium such as a removable disk may be used as the memory unit 44. The memory unit 44 stores the operating system of the terminal device 40, and various programs and data for controlling the operation of the input unit 41, the display unit 42, and the communication unit 43. For example, the memory unit 44 may store frame data for the video display area M1, the score display area S1, etc. to be displayed on the display unit 42.

The control unit 45 controls each of the input unit 41, the display unit 42, and the communication unit 43. The control unit 45 also performs calculations, processing, etc. in response to instruction signals from the input unit 41. The control unit 45 has a processing device such as a CPU (Central Processing Unit) and a storage device such as a RAM (Random Access Memory) and a ROM (Read Only Memory). The control unit 45 has a data acquisition control unit 54, a storage control unit 55, and a display control unit 56.

The data acquisition control unit 54 accesses the server 30 via the communication unit 43 and acquires the video data, score data, etc. stored in the memory unit 39 of the server 30.

The display control unit 56 controls the display content displayed on the display unit 42. The display control unit 56 controls the display content of the video display area M1 and the score display area S1 based on the video data and score data acquired by the communication unit 43. In addition, when a scroll bar for specifying a playback time is displayed in the video display area M1, the display control unit 56 causes the video data from the playback time specified by the scroll bar to be displayed in the video display area M1.

In addition, in this embodiment, when a score is selected by the input unit 41 from among the scores displayed in the score display area S1, the display control unit 56 transmits information to the server 30 that the score has been selected. In this case, as described above, the video data selection unit 36 in the server 30 selects video data corresponding to the score, and transmits the selected video data to the terminal device 40. The terminal device 40 receives the transmitted video data by the communication unit 43. The display control unit 56 can display an image based on the received video data in the video display area M1.

The display control unit 56 also causes the display unit 42 to display advertisements based on the received advertisement setting data. FIG. 6 is a diagram showing an example of the display content on the display unit 42 of the terminal device 40. When the video data includes target image data, the display control unit 56 controls the display unit 42 to display target images Pa, Pb based on the target image data. These target images Pa, Pb are images such as marks indicating the advertising client. When the target images Pa, Pb are displayed, the display control unit 56 causes the display unit 42 to display, for example, advertisements Ca, Cb of the advertising client corresponding to the target images Pa, Pb based on the advertisement setting data.

The display control unit 56 can display advertisements Ca and Cb to correspond to the target images Pa and Pb, as shown in FIG. 6. For example, the display control unit 56 can directly associate the target images Pa and Pb with advertisements Ca and Cb by displaying advertisement Ca in a speech bubble from the target image Pa and advertisement Cb in a speech bubble from the target image Pb.

Figure 7 is a diagram showing another example of the display content on the display unit 42 of the terminal device 40. As shown in Figure 7, the display control unit 56 can display advertisements Ca and Cb without directly corresponding to the target images Pa and Pb. For example, the display control unit 56 can provide an advertisement display area C1 in a part of the display unit 42 and display advertisements Ca and Cb in the advertisement display area C1.

Based on the settings of the video data, the display control unit 56 can display the advertisements Ca and Cb on the display unit 42 during the period when the target images Pa and Pb are displayed on the display unit 42. In this case, the display control unit 56 can start displaying the advertisements Ca and Cb at a timing corresponding to the start of displaying the target images Pa and Pb. The timing corresponding to the start of displaying may be simultaneous with the start of displaying, or may be a predetermined period after the start of displaying. The display control unit 56 can also end the display of the advertisements Ca and Cb at a timing corresponding to the end of displaying the target images Pa and Pb. The timing corresponding to the end of displaying may be simultaneous with the end of displaying, or may be a predetermined period after the end of displaying. The display control unit 56 may continue to display the advertisements Ca and Cb even when the display of the target images Pa and Pb has ended. The display control unit 56 may set the length of the display period of the advertisements Ca and Cb according to the length of time for which the target images Pa and Pb are displayed and the number of scenes in which the target images Pa and Pb are displayed.

In addition, when displaying advertisements Ca and Cb, the display control unit 56 may display the target images Pa and Pb in an emphasized manner (such as highlighting).

Next, the operation of the match display system 100 configured as described above will be described. FIG. 8 is a flowchart showing an example of an advertisement setting method according to the first embodiment. In FIG. 8, separate flowcharts are shown for the server 30 side and the terminal device 40 side.

As shown in FIG. 8, in the server 30, the video data acquisition unit 31 acquires the video data input from the camera 10 and stores it in the memory unit 39 (step S010). In addition, the score data acquisition unit 32 acquires the score data input from the score input unit 20 and stores it in the memory unit 39 (step S020). In addition, when the video data and score data are acquired, the tag information setting unit 34 sets a tag range as tag information.

The image determination unit 37 determines whether the video data includes target image data (step S030). In step S030, the image determination unit 37 determines whether the video data includes the target image data based on the target image data stored in the storage unit 39 by image processing or the like. If the image determination unit 37 determines that the target image data is included in the video data (Yes in step S030), the advertisement setting unit 38 generates advertisement setting data for displaying the advertisement of the advertising client corresponding to the target image data on the display unit (step S040). On the other hand, if the image determination unit 37 determines that the target image data is not included in the video data (No in step S030), the advertisement setting unit 38 skips the processing of step S040. The server-side communication unit 35 transmits the video data and the score data, and transmits the advertisement setting data if advertisement setting data is generated (step S050).

The terminal device 40 receives the various data transmitted from the server 30. The display control unit 56 displays on the display unit 42 an image based on the image data and a score based on the score data (step S060). The display control unit 56 determines whether or not an advertisement display setting is made based on the advertisement setting data (step S070). If it is determined that an advertisement display setting is made (Yes in step S070), the display control unit 56 displays an advertisement based on the settings in the advertisement setting data (step S080). On the other hand, if the advertisement setting data is not received, or if all display mode data in the advertisement setting data is set to hidden, or if it is determined that an advertisement display setting is not made (No in step S070), the processing of step S080 is skipped.

As described above, the match display system 100 according to the first embodiment includes a server 30 having a video data acquisition unit 31 that acquires video data of a match, a score data acquisition unit 32 that acquires score data of the match, a storage unit 39 that stores the video data and the score data, an image determination unit 37 that determines whether the stored video data includes target image data that is data of a target image showing an advertising client, an advertisement setting unit 38 that generates advertisement setting data for displaying an advertisement of the advertising client corresponding to the target image on the display unit 42 when an image based on the video data is displayed on the external display unit 42 if the target image data is included in the video data, and a server-side communication unit 35 that can transmit the video data, score data, and advertisement setting data to the outside, a display unit 42, a communication unit 43 that transmits and receives information between the server-side communication unit 35, and a terminal device 40 having a display control unit 56 that displays the video and score based on the video data and score data received by the communication unit 43 on the display unit 42, and, when the advertisement setting data is received by the communication unit 43, displays an advertisement on the display unit 42 based on the advertisement setting data.

According to this embodiment, when the video data includes target image data, the server 30 generates advertisement setting data so as to display an advertisement of an advertising client corresponding to the target image data, and the terminal device 40 displays an advertisement based on the advertisement setting data. This allows the advertisement of the advertising client that the user recognizes on the display unit 42 to be displayed, making it possible to deliver advertisements based on highly effective information.

In the match display system 100 according to this embodiment, the advertisement setting unit 38 sets the advertisements Ca and Cb to be displayed on the display unit 42 during the period in which the target images Pa and Pb are displayed on the display unit 42. By displaying the advertisements Ca and Cb at the timing when the user recognizes the target images Pa and Pb, it is possible to impress the user with the real-time display.

In the match display system 100 according to this embodiment, the advertisement setting unit sets the target images Pa, Pb and advertisements Ca, Cb to be associated and displayed on the display unit 42. This allows the user to recognize the target images Pa, Pb of the advertising client associated with the advertisements Ca, Cb.

[Second embodiment]
Next, a second embodiment will be described. Fig. 9 is a block diagram showing an example of a chat system 200 according to the second embodiment. The chat system 200 shown in Fig. 9 is used when chatting about the game content in a sports competition such as baseball. By using this chat system 200, it is possible to inform the game situation, etc., by chatting so that even those who cannot participate in or watch the game directly can understand the game situation.

As shown in FIG. 9, the chat system 200 includes a camera 10, a score input unit 20, a server 130, and terminal devices 40 and 40A. The configurations of the camera 10, the score input unit 20, and the terminal devices 40 and 40A are the same as those in the first embodiment.

The server 130 comprehensively manages the chat system 200. The server 130 has various applications, data, programs, etc. for managing the chat system 200. The server 130 may be, for example, a personal computer, a workstation, etc., but is not limited to these.

In the server 130, multiple chat groups are set up. Chat groups are set up individually, for example, for each sport, match, or team. The server 130 performs the various processes described below for each chat group.

Similar to the first embodiment, the server 130 has a video data acquisition unit 31, a score data acquisition unit (match situation data acquisition unit) 32, a tag information setting unit 34, a server-side communication unit 35, a video data selection unit 36, an image determination unit 37, an advertisement setting unit 38, and a storage unit 39. In this embodiment, the server 130 has a chat data processing unit 33 in addition to the above configuration.

When server 130 stores the video data and chat data, the video data and chat data are uploaded to server 130. When server 130 stores chat data, server 130 includes data of the time when the chat data was stored (hereinafter referred to as the upload time) in the chat data. In other words, chat data uploaded to server 130 includes data of the upload time. Server 130 has a management application that manages the video data and chat data.

The chat data processing unit 33 stores chat data input from the terminal device 40 in the memory unit 39. Furthermore, when score data is acquired by the score data acquisition unit 32, the chat data processing unit 33 generates chat data whose contents correspond to the score data. In this case, the chat data processing unit 33 can generate chat data in which the contents of the score data are expressed in text, for example. This makes it possible to confirm the updated score data as chat information when the score data is updated.

The tag information setting unit 34 sets tag information for each of the multiple pieces of video data acquired by the video data acquisition unit 31 and the multiple pieces of score data acquired by the score data acquisition unit 32. The tag information setting unit 34 also sets tag information for each piece of chat data acquired or generated by the chat data processing unit 33. The tag information includes information about a tag range. The tag range set for the chat data is a time range corresponding to the time when each piece of chat data was acquired or generated.

The server-side communication unit 35 is capable of communicating with the terminal device 40. The server-side communication unit 35 is capable of transmitting, for example, video data, score data, chat data, and advertisement setting data stored in the memory unit 39.

The video data selection unit 36 selects a predetermined range of video data from the video data stored in the memory unit 39, and transmits it from the server-side communication unit 35 to the terminal device 40. For example, when chat data corresponding to a server message generated by the chat data processing unit 33 is specified on the terminal device 40, the tag range corresponding to the specified chat data is detected. The video data selection unit 36 selects video data from the start time of the tag range, and transmits it to the terminal device 40 via the server-side communication unit 35.

As in the first embodiment, the image determination unit 37 determines whether the video data contains target image data, which is data of a target image showing an advertising client. The image determination unit 37 compares the target image data stored in the storage unit 39, for example, with the video data, and determines whether the video data contains the target image data by image processing or the like. In addition, in this embodiment, when a specific team is selected by the user of the terminal device 40, the image determination unit 37 can determine whether the target image data is included in the video data shot for the selected team. In this case, the image determination unit 37 determines whether the target image data is included in the video data shot for the selected team, and does not determine whether the target image data is included in the remaining video data. In addition, when a specific team is not selected by the user of the terminal device 40, the image determination unit 37 can determine, for example, whether all the video data contains the target image data.

The advertisement setting unit 38 sets the display mode of the advertisement when the image based on the video data is displayed on the external display unit. When the video data includes the target image data of the advertising client, the advertisement setting unit 38 sets the advertisement corresponding to the target image to be displayed on the display unit when the video based on the video data is displayed on the external display unit. In this embodiment, when the video data includes the target image data of the advertising client, the advertisement setting unit 38 can set the image based on the video data to be displayed in at least one of the video display area 42a and the chat display area 42b described later on the display unit 42. In this case, the advertisement setting unit 38 can generate chat data (hereinafter referred to as advertisement chat data) so that the chat displayed in the chat display area 42b includes the content of the advertisement. The advertisement setting unit 38 stores the advertisement chat data in the storage unit 39 at a timing based on the advertisement setting data. For example, the advertisement setting unit 38 generates advertisement chat data and stores it in the storage unit 39 at a timing when the target image is displayed on the display unit 42 of the terminal device 40. As a result, the advertisement chat data is transmitted to the terminal device 40 via the server-side communication unit 35, and an advertisement chat based on the advertisement chat data is displayed in the chat display area 42b of the display unit 42 of the terminal device 40. As in the first embodiment, the advertisement setting unit 38 can set the advertisement to be displayed on the display unit during the period when the target image is displayed on the display unit. The advertisement setting unit 38 can set the target image and the advertisement to be displayed on the display unit in association with each other. The advertisement setting unit 38 can set not to display advertisements of advertising clients corresponding to target image data not included in the video data. In this embodiment, when a specific team is selected by the user of the terminal device 40, if the target image data is included in the video data shot for the selected team, the advertisement setting unit 38 sets the advertisement corresponding to the target image to be displayed on the display unit when a video based on the video data for the selected team is displayed on an external display unit.

The advertisement setting unit 38 may also change the display mode of the advertisement depending on at least one of the length of display time for which the target image is displayed and the number of scenes in which the target image is displayed. For example, the advertisement setting unit 38 may change the display content of the advertisement depending on the display time for which the target image is displayed and the number of scenes in which the target image is displayed. The advertisement setting unit 38 may also set the length of the display period of the advertisement depending on the display time for which the target image is displayed and the number of scenes in which the target image is displayed. Note that the changes to the display mode of the advertisement are not limited to the above, and other display modes may also be changed.

The storage unit 39 stores multiple pieces of video data acquired by the video data acquisition unit 31, score data acquired by the score data acquisition unit 32, and chat data acquired or generated by the chat data processing unit 33. The video data includes data showing video footage of the match that was filmed. The video data includes data showing the time when the video footage of the match was filmed. The storage unit 39 also stores target image data of the advertising client. The storage unit 39 also stores team data for a team selected by a user of the terminal device 40.

Figure 10 is a diagram showing an example of chat data stored in the storage unit 39. As shown in Figure 10, the chat data includes an input ID 66, an inputter ID 67, input content 68, and tag information 63c.

The input ID 66 is created each time chat data is input or generated in the server 130. The inputter ID 67 is information for identifying the inputter in one piece of chat data. For example, in the case of chat data generated by the server 130, the inputter ID 67 may be a predetermined value (e.g., "999" or the like). The input content 68 is information indicating the content of a message displayed in the chat display area 42b of the terminal device 40 described later. The input content 68 includes, for example, character data or predetermined illustration data. The tag information 63c is information for identifying chat data created for each input ID 66. The tag information 63c is created each time an input ID 66 is created. The tag information 63c is assigned a tag number in ascending order as an index. The ID number of the input ID 66 may be used as the tag information.

Tag information 63c is information corresponding to, for example, tag information 63a shown in FIG. 2 and tag information 63b shown in FIG. 3. By associating tag information 63c with, for example, tag information 63b, the processing time of score data 64 and chat data are associated. Note that tag information 63b may also be associated with the upload time when chat data was uploaded to server 130. Tag information 63 (63a, 63b, 63c) allows video data, score data, and chat data to be stored in association with each other based on the shooting time and processing time (upload time).

The storage unit 39 also stores an advertisement setting program that causes the computer to execute the following processes: acquiring video data of the match; acquiring and/or generating chat data related to the match; storing the video data and chat data; determining whether the stored video data includes target image data that is data of a target image showing an advertising client; if the target image data is included in the video data, generating advertisement setting data that causes an advertisement of the advertising client corresponding to the target image to be displayed on the display unit when video based on the video data and chat based on the chat data are displayed on an external display unit; and transmitting the video data, chat data, and advertisement setting data to the outside.

The terminal devices 40 and 40A have an input unit 41, a display unit 42, a communication unit 43, a storage unit 44, and a control unit 45. The terminal devices 40 and 40A have the same configuration as in the first embodiment.

FIG. 11 is a diagram showing an example of the input unit 41 and display unit 42 of the terminal device 40 according to this embodiment. As shown in FIG. 11, the terminal device 40 has, for example, a touch panel type input unit 41 and display unit 42. That is, the touch panel which is the input unit 41 is arranged on top of the display panel which is the display unit 42. The input unit 41 can input team information about a specific team that will play a match, for example, by operation of the user of the terminal device 40. The input team information is stored in the memory unit 44. The team information stored in the memory unit 44 is transmitted to the server 130 by the communication unit 43.

Display unit 42 displays, for example, a video display area 42a, a chat display area 42b, and a group display area 42g. Video data is displayed in video display area 42a. Note that a scroll bar or the like for specifying the playback time of the video data may be displayed in video display area 42a.

Chats based on chat data are displayed in the chat display area 42b. For example, the chat display area 42b displays a server message 88 based on chat data generated by the server 130, a third-party message 89 based on chat data entered by a terminal device 40A different from the terminal device 40, and a user message 90 based on chat data entered by the terminal device 40. The server message 88 is, for example, a text representation of the score data entered into the server 130. The server message 88a in the upper part of FIG. 11 is, for example, a message that batter 007 hit a single to center field in the bottom of the eighth inning. The server message 88b in the lower part of FIG. 11 is a message that batter 008 struck out in the bottom of the eighth inning.

The server message 88 and the other person's message 89 are displayed, for example, in the left area of the chat display area 42b. The own message 90 is displayed, for example, in the right area of the chat display area 42b. The server message 88 and the other person's message 89 may be displayed in a differentiated manner, for example, by displaying the message in a different type of frame. This makes it possible to distinguish between the server message 88 and the other person's message 89. The group display area 42g displays information about the group to which the operator of the terminal device 40 belongs. The server message 88, the other person's message 89, and the own message 90 are displayed in a frame such as a speech bubble. For example, the speech bubble is displayed larger to the left and right and up and down in the chat display area 42b as the number of characters increases.

The storage unit 44 stores a chat application for chatting, various programs, data, and the like. For example, the storage unit 44 may store frame data for the video display area 42a, chat display area 42b, group display area 42g, and the like to be displayed on the display unit 42. The storage unit 44 also stores team information input by the input unit 41.

The control unit 45 has a data acquisition control unit 54, a storage control unit 55, and a display control unit 56. The data acquisition control unit 54 accesses the server 130 via the communication unit 43 and acquires video data, chat data, advertisement setting data, etc. stored in the storage unit 39 of the server 130.

The storage control unit 55 stores the video data and chat data acquired from the server 130 in the storage unit 44 in association with each other based on the shooting time and the processing time. The storage control unit 55 stores the advertisement setting data acquired from the server 130 in the storage unit 44.

The display control unit 56 controls the display content displayed on the display unit 42. The display control unit 56 controls the display content of the video display area 42a based on the video data acquired by the communication unit 43. Furthermore, when a scroll bar for specifying a playback time is displayed in the video display area 42a, the display control unit 56 causes the video data from the playback time specified by the scroll bar to be displayed in the video display area 42a.

The display control unit 56 also controls the display content of the chat display area 42b based on the chat data acquired by the communication unit 43. When displaying chats based on the chat data in the chat display area 42b, the display control unit 56 displays as many pieces of chat data as can be displayed in the chat display area 42b in chronological order in one direction based on the upload time. In this embodiment, for example, as shown in FIG. 5, the chats are displayed in chronological order from top to bottom in the chat display area 42b.

When new chat data is stored in the memory unit 39 of the server 130, the display control unit 56 acquires the latest chat data stored in the memory unit 39 via the communication unit 43 and updates the display contents of the chat display area 42b. In this case, the display control unit 56 determines whether or not there is a space to display a new chat below the chat most recently displayed in the chat display area 42b. If there is a space to display a new chat, the display control unit 56 displays the new chat in that space. If there is no space to display a new chat, the display control unit 56 scrolls the entire chat display area 42b in a direction to push the oldest chat displayed in the chat display area 42b, that is, the topmost chat displayed in the chat display area 42b, upward in the chat display area 42b. Then, the display control unit 56 displays the new chat in the space at the bottom vacated by the scrolling. This allows the display control unit 56 to update the chat displayed in the chat display area 42b in real time every time a new chat is uploaded to the server 130 and stored in the memory unit 44.

The display control unit 56 can control the display contents of the chat display area 42b based on past chat data stored in the storage unit 44. For example, when the operator touches the chat display area 42b of the input unit (touch panel) 41 and slides the touch position upward or downward, that is, when performing an operation to manually scroll the chat display area 42b, the display control unit 56 changes the chat displayed in the chat display area 42b according to the scroll direction and scroll amount. For example, when the operator slides the touch position upward, a chat uploaded later in time than the chat displayed up to that point is displayed in the chat display area 42b. When the operator slides the touch position downward, a chat uploaded earlier in time than the chat displayed up to that point is displayed in the chat display area 42b. Note that the method of changing the chat displayed in the chat display area 42b is not limited to the above, and may be performed by other methods such as a button, a keyboard, or a mouse.

In addition, in this embodiment, when one server message is selected by the input unit 41 from among the chat data displayed in the chat display area 42b, the display control unit 56 transmits information to the server 130 that the server message has been selected. In this case, as described above, in the server 130, the video data selection unit 36 selects video data based on the tag range, and transmits the selected video data to the terminal device 40. In the terminal device 40, the communication unit 43 receives the transmitted video data. The display control unit 56 can display the received video data in the video display area 42a.

The display control unit 56 also causes the display unit 42 to display advertisements based on the received advertisement setting data. FIG. 12 is a diagram showing an example of the display contents on the display unit 42 of the terminal device 40. When the video data includes target image data, the display control unit 56 controls the video display area 42a of the display unit 42 to display target images Pa and Pb based on the target image data. The target image Pa is the target image of "Client 1 (see FIG. 4)," who is the advertising client. The target image Pb is the target image of "Client 2 (see FIG. 4)," who is the advertising client. When the target images Pa and Pb are displayed in the video display area 42a, the display control unit 56 causes the display unit 42 to display, for example, advertisements Ca and Cb of the advertising client corresponding to the target images Pa and Pb, based on the advertisement setting data.

The display control unit 56 can display advertisements Ca and Cb in the video display area 42a so as to correspond to the target images Pa and Pb, as shown in FIG. 12. For example, the display control unit 56 can directly associate the target images Pa and Pb with the advertisements Ca and Cb by displaying advertisement Ca in a speech bubble from the target image Pa and advertisement Cb in a speech bubble from the target image Pb.

Figure 13 is a diagram showing another example of the display content on the display unit 42 of the terminal device 40. As shown in Figure 13, the display control unit 56 can display advertisements Ca and Cb in the chat display area 42b. When the display control unit 56 receives advertisement chat data from the server 30, it displays an advertisement chat 91 based on the advertisement chat data in the chat display area 42b. The advertisement chat 91 includes advertisements Ca and Cb of the advertising client corresponding to the target images Pa and Pb.

Figure 14 is a flowchart showing an example of a chat display method according to the second embodiment. In Figure 14, similar to Figure 8, separate flowcharts are shown for the server 130 side and the terminal device 40 side.

As shown in FIG. 14, in the server 130, the video data acquisition unit 31 acquires the video data input from the camera 10 and stores it in the memory unit 39 (step S110). The score data acquisition unit 32 acquires the score data input from the score input unit 20 and stores it in the memory unit 39 (step S120). The chat data processing unit 33 generates chat data corresponding to the score data each time score data is input, and stores it in the memory unit 39 (step S130). Thereafter, the tag information setting unit 34 sets a tag range as tag information.

In addition, the image determination unit 37 determines whether the video data includes target image data (step S140). In step S140, when a specific team is selected on the terminal device 40, the image determination unit 37 acquires team data for the team. When the team data is acquired, the image determination unit 37 determines whether the video data shot for the selected team includes target image data, and does not judge whether the remaining video data includes target image data. In step S140, when the image determination unit 37 determines that the video data includes target image data (Yes in step S140), the advertisement setting unit 38 generates advertisement setting data for displaying an advertisement of the advertising client corresponding to the target image data on the display unit (step S150). In step S150, for example, when a specific team is selected by the user of the terminal device 40, when the video data shot for the selected team includes target image data, the advertisement setting unit 38 sets the advertisement corresponding to the target image to be displayed on the display unit when the video based on the video data for the selected team is displayed on the external display unit. On the other hand, if the image determination unit 37 determines that the target image data is not included in the video data (No in step S140), the advertisement setting unit 38 skips the process of step S150. The server-side communication unit 35 transmits the video data and chat data, and if advertisement setting data is generated, transmits the advertisement setting data (step S160).

At the terminal device 40 side, various data transmitted from the server 130 is received. The display control unit 56 displays video based on the video data and chat based on the chat data on the display unit 42 (step S170). The display control unit 56 judges whether or not there is a setting for advertisement display based on the advertisement setting data (step S180). If it is judged that there is a setting for advertisement display (Yes in step S180), the display control unit 56 displays an advertisement based on the setting in the advertisement setting data (step S190). On the other hand, if advertisement setting data is not received, or if it is judged that there is no setting for advertisement display, such as when all display mode data in the advertisement setting data is set to hidden (No in step S180), the processing of step S190 is skipped.

As described above, the chat system 200 according to the second embodiment includes a server 130 having a video data acquisition unit 31 that acquires video data of a match, a chat data processing unit 33 that can acquire and/or generate chat data related to the match, a storage unit 39 that stores the video data and the chat data, an image determination unit 37 that determines whether the stored video data includes target image data that is data of a target image showing an advertising client, an advertisement setting unit 38 that generates advertisement setting data for displaying an advertisement of the advertising client corresponding to the target image on the display unit 42 when the video based on the video data and the chat based on the chat data are displayed on the external display unit 42 when the target image data is included in the video data, and a server-side communication unit 35 that can transmit the video data, chat data, and advertisement setting data to the outside, a display unit 42, a communication unit 43 that transmits and receives information between the display unit 42 and the server-side communication unit 35, and a display control unit 56 that displays the video and chat based on the video data and chat data received by the communication unit 43 on the display unit 42, and, when the advertisement setting data is received by the communication unit 43, displays an advertisement on the display unit based on the advertisement setting data.

According to this embodiment, when the video data includes target image data, the server 130 generates advertisement setting data so as to display an advertisement of an advertising client corresponding to the target image data, and the terminal device 40 displays an advertisement based on the advertisement setting data. This allows the advertisement of the advertising client that the user recognizes on the display unit 42 to be displayed, making it possible to deliver advertisements based on highly effective information.

In the chat system 200 according to this embodiment, when a specific team is selected by the user of the terminal device 40, the image determination unit 37 determines whether or not the target image data is included in the video data captured for the selected team. This allows an advertisement to be displayed when the user of the terminal device 40 views a video related to the user.

In the chat system 200 according to this embodiment, the advertisement setting unit 38 sets advertisement setting data so that advertisements are displayed in at least one of the video display area 42a, where video is displayed, and the chat display area 42b, where chat is displayed, of the display unit 42. This makes it possible to display advertisements to users who are watching the video and users who are watching the chat.

In the chat system 200 according to this embodiment, when an advertisement is displayed in the chat display area 42b, the advertisement setting unit 38 generates chat data so that the content of the advertisement is included in the chat displayed in the chat display area 42b. This allows the advertisement to be displayed effectively to users who view the chat.

[Third embodiment]
Next, a third embodiment will be described. In this embodiment, a chat system having a configuration similar to that of the second embodiment is used. In the following, the configuration of each part will be described using the same names and symbols as those in the chat system according to the second embodiment, and descriptions of parts having the same configuration as the second embodiment may be omitted or simplified.

In this embodiment, when chat data corresponding to a server message generated by the chat data processing unit 33 is specified on the terminal device 40, the video data selection unit 36 detects a tag range corresponding to the specified chat data. The video data selection unit 36 selects video data from the start time of the tag range. Hereinafter, the video data of the selected range will be referred to as selected video data. The video data selection unit 36 causes the terminal device 40 to transmit the selected video data via the server-side communication unit 35.

The image determination unit 37 is triggered by the designation of chat data in the terminal device 40 to determine whether or not target image data, which is data of a target image showing an advertising client, is included in the selected video data. The image determination unit 37 compares the target image data stored in the storage unit 39 with the selected video data, and determines whether or not the target image data is included in the selected video data by image processing or the like.

The advertisement setting unit 38 sets the display mode of the advertisement when the image based on the selected video data is displayed on the external display unit. When the target image data of the advertisement client is included in the selected video data, the advertisement setting unit 38 sets the advertisement corresponding to the target image to be displayed on the display unit when the image based on the selected video data is displayed on the external display unit. In this embodiment, when the target image data of the advertisement client is included in the selected video data, the advertisement setting unit 38 can set the image based on the selected video data to be displayed in at least one of the video display area 42a and the chat display area 42b described later of the display unit 42. The advertisement setting unit 38 can generate chat data (hereinafter referred to as advertisement chat data) so that the chat displayed in the chat display area 42b includes the content of the advertisement. Also, similar to the second embodiment, the advertisement setting unit 38 can set the advertisement to be displayed on the display unit during the period when the target image is displayed on the display unit. Also, the advertisement setting unit 38 can set the target image and the advertisement to be displayed on the display unit in association with each other. The advertisement setting unit 38 can set the advertisement of the advertisement client corresponding to the target image data not included in the selected video data not to be displayed.

In addition, the advertisement setting unit 38 may change the display mode of the advertisement according to at least one of the length of the display time during which the target image is displayed and the number of scenes in which the target image is displayed, as in the second embodiment. For example, the advertisement setting unit 38 may change the display content of the advertisement according to the display time of the target image and the number of scenes in which the target image is displayed. In this case, when the display time of the target image is shorter than a predetermined threshold and when the number of scenes in which the target image is displayed is smaller than a predetermined threshold, the advertisement setting unit 38 may set the advertisement content to, for example, a product introduction, and when the display time of the target image is longer than a predetermined threshold and when the number of scenes in which the target image is displayed is larger than a predetermined threshold, the advertisement setting unit 38 may set the advertisement content to, for example, a coupon. In addition, the advertisement setting unit 38 may set the length of the display period of the advertisement according to the display time of the target image and the number of scenes in which the target image is displayed. In this case, the display control unit 56 can set the display period of the advertisement longer as the display time of the target image is longer. In addition, the display control unit 56 can set the display period of the advertisement longer as the number of scenes in which the target image is displayed is larger. Note that the change content of the display mode of the advertisement is not limited to the above, and other display modes may be changed.

In this embodiment, the storage unit 39 stores an advertisement setting program that causes a computer to execute the following processes: acquiring video data of a match; acquiring match situation data of the match; generating chat data with content corresponding to the match situation data when the match situation data is acquired; storing the video data, the match situation data, and the chat data in association with each other by time; selecting video data from a time corresponding to the specified chat data when one of the chat data generated and stored in the storage unit is specified on an external terminal device; determining whether or not the selected video data, which is the selected video data, contains target image data, which is data of a target image showing an advertising client, when the selected video data contains target image data, generating advertisement setting data that displays an advertisement of the advertising client corresponding to the target image on the display unit of the terminal device; and transmitting the video data, chat data, and advertisement setting data including the selected video data to the terminal device and receiving the specification of the chat data by the terminal device.

The terminal devices 40 and 40A have an input unit 41, a display unit 42, a communication unit 43, a storage unit 44, and a control unit 45. The terminal devices 40 and 40A have the same configuration as in the second embodiment.

The control unit 45 has a data acquisition control unit 54, a storage control unit 55, and a display control unit 56. The configurations of the data acquisition control unit 54 and the storage control unit 55 are the same as those in the second embodiment.

In this embodiment, similar to the second embodiment, when one server message is selected by the input unit 41 from among the chat data displayed in the chat display area 42b, the display control unit 56 transmits information to the server 130 that the server message has been selected. In this case, as described above, in the server 130, the video data selection unit 36 selects selected video data based on the tag range, and transmits the selected video data to the terminal device 40. In the terminal device 40, the communication unit 43 receives the transmitted selected video data. The display control unit 56 can display the received selected video data in the video display area 42a.

In addition, in this embodiment, the server message specified by the input unit 41 is used as a trigger to cause the image determination unit 37 of the server 130 to determine the target image, and the advertisement setting unit 38 generates advertisement setting data according to the determination result. The generated advertisement setting data is transmitted to the terminal device 40 via the server-side communication unit 35. The display control unit 56 causes the display unit 42 to display an advertisement based on the received advertisement setting data. The advertisement display is similar to that of the second embodiment.

Figure 15 is a flowchart showing an example of a chat display method according to the third embodiment. In Figure 15, separate flowcharts are shown for the server 130 side and the terminal device 40 side.

As shown in FIG. 15, in the server 130, the video data acquisition unit 31 acquires the video data input from the camera 10 and stores it in the memory unit 39 (step S210). The score data acquisition unit 32 acquires the score data input from the score input unit 20 and stores it in the memory unit 39 (step S220). The chat data processing unit 33 generates chat data corresponding to the score data each time score data is input and stores it in the memory unit 39 (step S230). Thereafter, the tag information setting unit 34 sets a tag range as tag information. The server-side communication unit 35 transmits the video data and chat data (step S240).

The terminal device 40 receives various data transmitted from the server 130. The display control unit 56 displays on the display unit 42 an image based on the image data and a chat based on the chat data (step S250). The display control unit 56 judges whether or not a server message has been specified by the input unit 41 among the chat data displayed in the chat display area 42b (step S260). When the display control unit 56 judges that a server message has been specified by the input unit 41 (Yes in step S260), it transmits information to the server 130 indicating that the server message has been specified (step S270). On the other hand, when the display control unit 56 judges that a server message has not been specified by the input unit 41 (No in step S260), it skips the subsequent processing. Note that when the answer to step S260 is No, the display control unit 56 may repeat the processing of step S260.

On the server 130 side, the video data selection unit 36 determines whether or not a server message designation sent from the terminal device 40 has been received (step S280). If it is determined that a server message designation has been received (Yes in step S280), the video data selection unit 36 selects video data corresponding to the designated server message (step S290). On the other hand, if it is determined that a server message designation has not been received (No in step S280), the video data selection unit 36 skips the subsequent processing. Note that if the answer is No in step S280, the video data selection unit 36 may repeat the processing of step S280.

When video data is selected, the image determination unit 37 determines whether the selected video data, which is the selected video data, contains the target image data (step S300). When the image determination unit 37 determines that the target image data is included in the selected video data (Yes in step S300), the advertisement setting unit 38 generates advertisement setting data for displaying the advertisement of the advertising client corresponding to the target image data on the display unit (step S310). On the other hand, when the image determination unit 37 determines that the target image data is not included in the video data (No in step S300), the advertisement setting unit 38 skips the processing of step S310. The server-side communication unit 35 transmits the selected video data, and when advertisement setting data is generated, transmits the advertisement setting data (step S320).

The terminal device 40 receives various data transmitted from the server 130. The display control unit 56 displays an image based on the selected video data on the display unit 42, and if the advertisement display is set by the advertisement setting data, displays an advertisement based on the settings in the advertisement setting data (step S330). On the other hand, if the advertisement display is not set, the advertisement is not displayed, and an image based on the selected video data is displayed on the display unit 42.

As described above, the chat system according to the third embodiment includes a video data acquisition unit 31 that acquires video data of a match, a score data acquisition unit 32 that acquires match situation data of the match, a chat data processing unit 33 that generates chat data having content corresponding to the match situation data when the match situation data is acquired, a memory unit 39 that stores the video data, the match situation data, and the chat data in association with each other by time, a video data selection unit 36 that, when one of the chat data generated by the chat data processing unit 33 and stored in the memory unit 39 is specified on an external terminal device 40, selects video data from the time corresponding to the specified chat data, and an image determination unit 37 that, triggered by the specification of chat data on the terminal device 40, determines whether or not the selected video data, which is the selected video data, contains target image data that is data of a target image showing an advertising client, and, when the selected video data contains target image data, selects the target image corresponding to the selected image. The terminal device 40 includes an advertisement setting unit 38 that generates advertisement setting data for displaying the advertisement of the advertising client on the display unit 42 of the terminal device 40, a server side communication unit 35 that can transmit video data including selected video data, chat data, and advertisement setting data to the terminal device 40 and can receive chat data designated by the terminal device 40, a display unit 42, a communication unit 43 that transmits and receives information between the server side communication unit 35, and a display control unit 56 that displays video and chat based on the video data and chat data received by the communication unit 43 on the display unit 42, transmits a message to the server 130 that a chat has been designated when one of the chats generated by the chat data processing unit 33 and displayed on the display unit 42 is designated by the input unit 41, receives selected video data selected by the video data selection unit 36 from the server 130 and displays it on the display unit 42, and displays an advertisement on the display unit 42 based on the advertisement setting data when the advertisement setting data is received.

According to this embodiment, in the server 130, when the video data contains target image data, the specification of chat data in the terminal device 40 is used as a trigger to generate advertisement setting data so as to display an advertisement of an advertising client corresponding to the target image data, and the advertisement is displayed in the terminal device 40 based on the advertisement setting data. As a result, the advertisement is displayed on the display unit 42, which displays the selected video that the user particularly wants to watch, making it possible to deliver advertisements based on highly effective information.

In the chat system according to this embodiment, the advertisement setting unit 38 changes the display mode of the advertisement according to at least one of the length of display time of the target image displayed in the selected video data and the number of scenes in which the target image is displayed. This makes it possible to change the display mode of the advertisement according to the degree to which the user recognizes the target image.

In the chat system according to this embodiment, the display mode includes the length of the advertisement display period. This allows the length of the advertisement display period to be changed depending on the degree to which the user recognizes the target image.

[Fourth embodiment]
Next, a fourth embodiment will be described. In this embodiment, a chat system having a configuration similar to that of the second embodiment is used. In the following, the configuration of each part will be described using the same names and symbols as those in the chat system according to the second embodiment, and descriptions of parts having the same configuration as the second embodiment may be omitted or simplified.

In this embodiment, when the target image data of the advertising client is included in the video data, the advertising setting unit 38 generates advertising setting data that causes an advertisement corresponding to the target image, among the advertisements of the advertising client corresponding to the target image, to be displayed on the display unit 42 of the terminal device 40 according to the attributes of the terminal device 40 when the video based on the video data is displayed on the display unit 42 of the terminal device 40. In this embodiment, the attributes of the terminal device 40 include the role of the user of the terminal device 40 in the game. The role includes, for example, a defensive position in a baseball game. The attributes of the terminal device 40 may also be the age, gender, etc. of the user of the terminal device 40. The attributes of the terminal device 40 can be input as attribute information using, for example, the input unit 41 of the terminal device 40. The attribute information input from the input unit 41 can be stored, for example, by the storage unit 44. The attribute information stored in the storage unit 44 is transmitted to the server 130 via the communication unit 43 under the control of the control unit 45 when the terminal device 40 communicates with the server 130. The attribute information may be input on the terminal device 40 side based on an instruction from the server 130.

The advertisement setting unit 38 acquires the attributes of the terminal device 40. After acquiring the attributes of the terminal device 40, the advertisement setting unit 38 sets the advertisement setting data so that the display content corresponds to the attributes. For example, a case will be described in which the advertisement client is a sporting goods store and the advertisement content includes various equipment used in baseball games or practice. If the defensive position of the user of a certain terminal device 40 is catcher, the advertisement setting unit 38 can select an advertisement that introduces a catcher's mitt as a product from advertisements for various equipment, and set the advertisement setting data so that the selected advertisement is displayed on the display unit 42. Also, if the user of the terminal device 40 is a minor, the advertisement setting unit 38 can select an advertisement that introduces equipment for minors as a product, and set the advertisement setting data so that the selected advertisement is displayed on the display unit 42.

Figure 16 is a diagram showing an example of advertisement setting data stored in the memory unit 39. The advertisement setting data 370 includes client data 71, target image data 72, advertisement content data 373, and display mode data 74. The client data 71, target image data 72, and display mode data 74 are the same as those in the above embodiment. The advertisement content data 373 is data indicating advertisement content, and is set according to the attributes of the terminal device 40. The advertisement setting unit 38 can set the advertisement content by selecting advertisement content to be displayed on the display unit 42 of the terminal device 40 from the advertisement content data 373 according to the attributes of the terminal device 40.

In this embodiment, the storage unit 39 stores an advertisement setting program that causes a computer to execute the following processes: acquiring video data of a match; acquiring and/or generating chat data related to the match; storing the video data and chat data; determining whether the stored video data includes target image data that is data of a target image showing an advertising client; if the video data includes the target image data, generating advertisement setting data that causes an advertisement corresponding to the target image, according to the attributes of the terminal device, to be displayed on the display unit of the terminal device among advertisements of the advertising client corresponding to the target image when video based on the video data and chat based on the chat data are displayed on the display unit of the terminal device; and transmitting the video data, chat data, and advertisement setting data to the terminal device.

In the terminal device 40, the display control unit 56 of the control unit 45 determines whether or not there is a setting for displaying advertisements based on the advertisement setting data, and if it determines that there is a setting for displaying advertisements, displays advertisements based on the settings in the advertisement setting data. Under the control of the display control unit 56, advertisements according to the attributes of the terminal device 40 are displayed on the display unit 42. For example, if the defensive position of the user of the terminal device 40 is catcher, an advertisement introducing a catcher's mitt as a product is displayed. Also, for example, if the user of the terminal device 40 is a minor, an advertisement introducing equipment for minors as a product is displayed.

Figure 17 is a flowchart showing an example of a chat display method according to the fourth embodiment. In Figure 17, separate flowcharts are shown for the server 130 side and the terminal device 40 side.

As shown in FIG. 17, in the server 130, the video data acquisition unit 31 acquires the video data input from the camera 10 and stores it in the memory unit 39 (step S410). The score data acquisition unit 32 acquires the score data input from the score input unit 20 and stores it in the memory unit 39 (step S420). The chat data processing unit 33 generates chat data whose contents correspond to the score data each time score data is input, and stores it in the memory unit 39 (step S430). Thereafter, the tag information setting unit 34 sets a tag range as tag information.

The image determination unit 37 also determines whether the video data includes target image data (step S440). In step S440, if the image determination unit 37 determines that the video data includes the target image data (Yes in step S440), the advertisement setting unit 38 acquires the attributes of the terminal device 40 (step S450). After acquiring the attributes of the terminal device 40, the advertisement setting unit 38 generates advertisement setting data for displaying the advertisement of the advertising client corresponding to the target image data on the display unit according to the attributes (step S460). On the other hand, if the image determination unit 37 determines that the target image data is not included in the video data (No in step S440), the advertisement setting unit 38 skips the processing of steps S450 and S460. The server-side communication unit 35 transmits the video data and chat data, and transmits the advertisement setting data if it is generated (step S470).

At the terminal device 40 side, the various data transmitted from the server 130 is received. The display control unit 56 displays the video based on the video data and the chat based on the chat data on the display unit 42 (step S480). The display control unit 56 judges whether or not there is a setting for advertisement display based on the advertisement setting data (step S490). If it is judged that there is a setting for advertisement display (Yes in step S490), the display control unit 56 displays the advertisement based on the setting in the advertisement setting data (step S500). On the other hand, if the advertisement setting data is not received, or if it is judged that there is no setting for advertisement display, such as when all the display mode data in the advertisement setting data is set to hidden (No in step S490), the processing of step S500 is skipped.

As described above, the chat system according to the fourth embodiment comprises a video data acquisition unit 31 that acquires video data of a match, a chat data processing unit 33 that is capable of at least one of acquiring and generating chat data relating to the match, a memory unit 39 that stores the video data and chat data, an image determination unit that determines whether or not the stored video data contains target image data that is data of a target image showing an advertising client, and, if the video data contains target image data, when video based on the video data and chat based on the chat data are displayed on the display unit 42 of the terminal device 40, an image determination unit that determines whether or not the video data contains target image data that is data of a target image showing an advertising client. The server 130 has an advertisement setting unit 38 that generates advertisement setting data for displaying advertisements corresponding to the attributes of the terminal device 40 on the display unit 42 of the terminal device 40, a server-side communication unit 35 that can transmit video data, chat data, and advertisement setting data to the terminal device 40, a display unit 42, a communication unit 43 that transmits and receives information between the server-side communication unit 35, and a display control unit 56 that displays video and chat based on the video data and chat data received by the communication unit 43 on the display unit 42, and, when advertisement setting data is received by the communication unit 43, displays advertisements on the display unit 42 based on the advertisement setting data.

According to this embodiment, when the video data contains target image data, the server 130 generates advertisement setting data to display advertisements according to the attributes of the terminal device 40, and the terminal device 40 displays advertisements based on the advertisement setting data. This allows different advertisements to be flexibly displayed for each terminal device 40, making it possible to deliver advertisements based on highly effective information.

In the chat system according to this embodiment, the attributes include attributes about the user of the terminal device 40. The attributes also include the role of the user of the terminal device 40 in the match. This makes it possible to display advertisements that are tailored to the user of the terminal device 40.

In the chat system according to this embodiment, the terminal device 40 has an input unit 41 for inputting information, and attribute information about attributes is input by the input unit 41. This makes it possible to deliver advertisements based on the attributes input by the user on the terminal device 40.

[Fifth embodiment]
Next, a fifth embodiment will be described. In this embodiment, a chat system having a configuration similar to that of the second embodiment is used. In the following, the configuration of each part will be described using the same names and symbols as those in the chat system according to the second embodiment, and descriptions of parts having the same configuration as the second embodiment may be omitted or simplified.

In this embodiment, the image determination unit 37 determines whether or not the video data contains target image data, which is data of a target image showing persons to be determined, including the advertising client. The specific contents of the determination are the same as those in the above embodiments.

When the target image data of the person to be determined is included in the video data, the advertisement setting unit 38 determines whether the person to be determined is a non-requester different from the advertising requester. Examples of non-requesters include a person to be determined who has never requested the display of an advertisement, a person to be determined who was an advertising requester but has stopped requesting advertisements, and the like. When the person to be determined is a non-requester, the advertisement setting unit 38 generates advertisement setting data that causes the display unit 42 to display an advertisement of a corresponding requester who is a predetermined advertising requester corresponding to the non-requester when the video and chat are displayed on the display unit 42 of the terminal device 40, for example. Examples of corresponding requesters include a person to be determined who provides products and services that are the same as, similar to, or related to the products and services provided by the non-requester, such as a competitor of the non-requester. When the person to be determined is a advertising requester, the advertisement setting unit 38 generates advertisement setting data that causes the display unit 42 to display an advertisement of the advertising requester when the video and chat are displayed on the display unit 42 of the terminal device 40, for example.

When displaying an advertisement of a specific advertising client corresponding to a non-requester, the advertising setting unit 38 can display the advertisement in a state that does not correspond to the target image of the non-requester. When the person to be determined that corresponds to the target image is the advertising client, the advertising setting unit 38 can display the advertisement of the advertising client in a state that corresponds to the target image of the advertising client.

Figure 18 is a diagram showing an example of advertisement setting data stored in the storage unit 39. The advertisement setting data 470 includes judgment subject data 75, target image data 72, advertisement content data 73, display mode data 74, type data 76, and corresponding requester data 77. The target image data 72, advertisement content data 73, and display mode data 74 are the same as those in the above embodiment. The judgment subject data 75 is data indicating the judgment subject including the advertisement requester. The type data is data indicating whether the judgment subject is an advertisement requester or a non-requester. The corresponding requester data 77 is data indicating the advertisement requester corresponding to the non-requester when the judgment subject is a non-requester. The advertisement setting unit 38 can set the display content of the advertisement to be displayed on the display unit 42 of the terminal device 40 depending on whether the judgment subject of the target image data included in the video data is an advertisement requester or a non-requester.

In this embodiment, the storage unit 39 stores an advertisement setting program that causes a computer to execute the following processes: acquiring video data of a match; acquiring and/or generating chat data related to the match; storing the video data and chat data; determining whether the stored video data contains target image data, which is data of a target image showing a person to be determined, including an advertising client; if the video data contains target image data and the person to be determined corresponding to the target image is a non-requester other than the advertising client, generating advertisement setting data that displays an advertisement for a specified advertising client corresponding to a non-requester on the display unit when video based on the video data and chat based on the chat data are displayed on an external display unit; and transmitting the video data, chat data, and advertisement setting data to the outside.

In the terminal device 40, the display control unit 56 of the control unit 45 determines whether or not there is a setting for displaying advertisements based on the advertisement setting data, and if it is determined that there is a setting for displaying advertisements, displays advertisements based on the settings in the advertisement setting data. Under the control of the display control unit 56, when the person being determined is a non-requester, advertisements of a specified advertising client corresponding to the non-requester are displayed on the display unit 42.

Figure 19 is a diagram showing an example of the input unit 41 and display unit 42 of the terminal device 40 according to this embodiment. Below, for words in quotation marks (such as "target 1", "target 2", etc.), refer to Figure 18. As shown in Figure 19, when the video data contains target image data, target images Pa and Pb based on the target image data are displayed in the video display area 42a of the display unit 42 under the control of the display control unit 56. Target image Pa is the target image of "target 1", who is the advertising client. Target image Pb is the target image of "target 2", who is a non-client.

When the target image Pa of "Target 1", who is the advertising client, is displayed in the video display area 42a, the display control unit 56 causes, for example, advertisement Ca of "Target 1" to be displayed on the display unit 42 in the display mode of "Display 1" based on the advertisement setting data. An example of the display mode of "Display 1" is a mode in which advertisement Ca is displayed so as to correspond to the target image Pb. In this case, the advertising content of advertisement Ca is "coupon".

On the other hand, when the target image Pb of "target person 2", who is a non-requester, is displayed in the video display area 42a, the display control unit 56 causes the display unit 42 to display advertisement Cb of "target person n", who is a corresponding requester corresponding to "target person 2", in the display mode of "display n" based on the advertisement setting data. An example of the display mode of "display n" is a mode in which advertisement Cb is displayed in a state in which it does not correspond to the target image Pb. Such a mode can be various modes, such as a mode in which advertisement Cb and target image Pb are displayed separately, a mode in which advertisement Ca is displayed in a speech bubble from the target image Pa, while advertisement Cb is displayed in a state in which the source of the advertisement is not indicated, and the like. The advertising content of advertisement Cb is "product n".

Figure 20 is a flowchart showing an example of a chat display method according to the fifth embodiment. In Figure 20, separate flowcharts are shown for the server 130 side and the terminal device 40 side.

As shown in FIG. 20, in the server 130, the video data acquisition unit 31 acquires the video data input from the camera 10 and stores it in the memory unit 39 (step S510). The score data acquisition unit 32 acquires the score data input from the score input unit 20 and stores it in the memory unit 39 (step S520). The chat data processing unit 33 generates chat data corresponding to the score data each time score data is input, and stores it in the memory unit 39 (step S530). Thereafter, the tag information setting unit 34 sets a tag range as tag information.

The image determination unit 37 also determines whether the video data includes target image data (step S540). If the image determination unit 37 determines in step S540 that the video data does not include the target image data (No in step S540), the following steps S550, S560, and S570 are skipped and the process proceeds to step S580. If the image determination unit 37 determines in step S540 that the target image data is included in the video data (Yes in step S540), the advertisement setting unit 38 determines whether the person to be determined corresponding to the target image data is a non-requester (step S550). If the person to be determined is a non-requester in step S550 (Yes in step S550), the advertisement setting unit 38 generates advertisement setting data for displaying an advertisement for a corresponding requester corresponding to a non-requester on the display unit 42 when the video and chat are displayed on the display unit 42 of the terminal device 40, for example (step S560). On the other hand, if it is determined in step S550 that the person being judged is not a non-requester (No in step S550), that is, if it is determined that the person being judged is an advertisement client, the advertisement setting unit 38 generates advertisement setting data for displaying the advertisement of the advertisement client on the display unit 42 when the video and chat are displayed on the display unit 42 of the terminal device 40, for example (step S570). The server-side communication unit 35 transmits the video data and chat data, and transmits the advertisement setting data if it is generated (step S580).

At the terminal device 40 side, the various data transmitted from the server 130 is received. The display control unit 56 displays the video based on the video data and the chat based on the chat data on the display unit 42 (step S590). The display control unit 56 judges whether or not there is a setting for advertisement display based on the advertisement setting data (step S600). If it is judged that there is a setting for advertisement display (Yes in step S600), the display control unit 56 displays the advertisement based on the setting in the advertisement setting data (step S610). On the other hand, if the advertisement setting data is not received, or if it is judged that there is no setting for advertisement display, such as when all the display mode data in the advertisement setting data is set to hidden (No in step S600), the processing of step S610 is skipped.

As described above, the chat system according to the fifth embodiment includes a video data acquisition unit 31 that acquires video data of a match, a chat data processing unit 33 that is capable of at least one of acquiring and generating chat data related to the match, a memory unit 39 that stores the video data and the chat data, an image determination unit 37 that determines whether the stored video data contains target image data that is data of a target image showing a person to be determined, including an advertising client, and, when the video data contains target image data and the person to be determined corresponding to the target image is a non-client other than the advertising client, a chat system based on the video data and the chat data. The terminal device 40 includes an advertisement setting unit 38 that generates advertisement setting data for displaying advertisements of a specific advertising client corresponding to a non-requester on the display unit 42 when the chat is displayed on the external display unit 42, a server 130 having a server-side communication unit 35 that can transmit video data, chat data, and advertisement setting data to the outside, a display unit 42, a communication unit 43 that transmits and receives information with the server-side communication unit, and a display control unit 56 that displays video and chat based on the video data and chat data received by the communication unit 43 on the display unit 42 and, when advertisement setting data is received by the communication unit 43, displays advertisements on the display unit 42 based on the advertisement setting data.

According to this embodiment, when the video data contains target image data of a non-requester, an advertisement for an advertising requester (corresponding requester) corresponding to the non-requester is displayed on the display unit 42. This allows advertisements for products or services corresponding to the products or services of the non-requester to be displayed, making it possible to deliver advertisements based on highly effective information.

In the chat system according to this embodiment, when the advertisement setting unit 38 displays an advertisement for a corresponding requester corresponding to a non-requester, the advertisement is displayed in a state that does not correspond to the target image of the non-requester. This makes it possible to avoid confusion about the source of the advertisement for the corresponding requester.

In the chat system according to this embodiment, when the person to be determined who corresponds to the target image is an advertising client, the advertising setting unit 38 displays the advertising client's advertisement in a state corresponding to the target image of the advertising client. This makes it possible to clearly indicate the source of the advertising client's advertisement. In addition, by combining this with a mode in which an advertisement of a corresponding requester corresponding to a non-requester is displayed in a state not corresponding to the target image of the non-requester, the distinction between the source of the advertisement can be more clearly indicated.

Sixth Embodiment
Next, a sixth embodiment will be described. Fig. 21 is a diagram showing an example of a chat system 600 according to this embodiment. As shown in Fig. 21, the chat system 600 includes a camera 10, a score input unit 20, a server 530, terminal devices 40 and 40A, and an excitement information detection unit 550. The configurations of the camera 10, the score input unit 20, and the terminal devices 40 and 40A are the same as those of the second embodiment.

The excitement information detection unit 550 detects excitement information that indicates the level of excitement in the game. For example, as the game becomes more exciting, the biometric information of the players participating in the game, the photographer using the camera 10, the user of the terminal device 40, and the like is likely to change significantly. In addition, as the game becomes more exciting, the cheers at the game venue are likely to get louder, and the sound of the video data is likely to get louder. In addition, as the game becomes more exciting, the brightness of the video data is likely to get higher. In addition, the game is likely to get more exciting in response to scores such as home runs, multiple base hits, and consecutive strikeouts. In addition, as the game becomes more exciting, the number of chats increases, and the content of the chats is likely to become emotional. Therefore, in this embodiment, the excitement information detection unit 550 can be configured to detect, as excitement information, the biometric information of at least one of the participants and spectators of the game, the volume of the sound of the video data, the brightness value of the video data, the content of the score data, the content of the chat, and the like.

The excitement information can be expressed, for example, by a numerical value. When biometric information is detected as excitement information, a numerical value indicating the magnitude of excitement can be calculated based on the amount of fluctuation in each value of, for example, the heart rate, respiratory rate, blood pressure, body temperature, brain waves, amount of sweat, the subject's body movement, and arterial blood oxygen saturation. For example, the greater the amount of fluctuation in each of the above values, the greater the excitement of the subject from whom the biometric information was obtained can be estimated. For this reason, it can be set so that the greater the amount of fluctuation in each value of the detection result, the greater the excitement information calculated. Note that excitement information is not limited to positive numerical values (indicating excitement) and may include negative numerical values (indicating decline).

Similar to the second embodiment, the server 530 has a video data acquisition unit 31, a score data acquisition unit (match situation data acquisition unit) 32, a chat data processing unit 33, a tag information setting unit 34, a server-side communication unit 35, a video data selection unit 36, an image determination unit 37, an advertisement setting unit 38, and a storage unit 39. In this embodiment, the server 530 further includes an excitement information acquisition unit 551.

The excitement information acquisition unit 551 acquires the excitement information detected by the excitement information detection unit 550, associates it with the video data and chat data by time, and stores it in the storage unit 39.

The video data selection unit 36 selects a predetermined range of video data from the video data stored in the memory unit 39, and transmits it from the server-side communication unit 35 to the terminal device 40. The video data selection unit 36 selects, for example, video data from a period in which excitement information is equal to or greater than a predetermined threshold as the selected video data. In this case, the video data selection unit 36 searches for a tag range for a period in which excitement information is equal to or greater than a predetermined threshold, selects video data from the start time of the tag range, and transmits it to the terminal device 40 via the server-side communication unit 35.

The image determination unit 37 determines whether or not target image data, which is data of a target image, is included in a period of the video data in which the excitement information is equal to or greater than a predetermined threshold value. The image determination unit 37 compares the target image data stored in the storage unit 39, for example, with the video data, and determines whether or not the target image data is included in the above-mentioned period of the video data by performing image processing or the like.

When the target image data is included in the video data for a period in which the excitement information is equal to or greater than a predetermined threshold, the advertisement setting unit 38 generates advertisement setting data for displaying the advertisement of the advertising client corresponding to the target image on the display unit of the chat terminal when the video based on the video data and the chat based on the chat data are displayed on the display unit 42.

The storage unit 39 stores an advertisement setting program that causes a computer to execute the following processes: acquiring video data of a match; acquiring and/or generating chat data related to the match; acquiring excitement information indicating the level of excitement in the match; storing the video data, chat data, and excitement information in association with each other by time; determining whether the stored video data includes target image data that is data of a target image indicating an advertising client; generating advertisement setting data for displaying an advertisement of the advertising client corresponding to the target image on the display unit of the chat terminal when video based on the video data and chat based on the chat data are displayed on an external display unit if the target image data is included in the video data for a period in which the excitement information is equal to or greater than a predetermined threshold; and transmitting the video data, chat data, and advertisement setting data to the outside.

In the terminal device 40, the display control unit 56 of the control unit 45 determines whether or not there is a setting for displaying advertisements based on the advertisement setting data, and if it determines that there is a setting for displaying advertisements, displays advertisements based on the settings in the advertisement setting data. Under the control of the display control unit 56, advertisements based on the advertisement setting data are displayed on the display unit 42 of the terminal device 40 in images based on the selected video data for a period in which the excitement information is equal to or greater than a predetermined threshold.

Figure 22 is a flowchart showing an example of a chat display method according to the sixth embodiment. In Figure 22, separate flowcharts are shown for the server 530 side and the terminal device 40 side.

As shown in FIG. 22, in the server 530, the video data acquisition unit 31 acquires the video data input from the camera 10 and stores it in the memory unit 39 (step S710). The score data acquisition unit 32 acquires the score data input from the score input unit 20 and stores it in the memory unit 39 (step S720). The chat data processing unit 33 generates chat data corresponding to the score data each time score data is input and stores it in the memory unit 39 (step S730). The excitement information acquisition unit 551 acquires the excitement information detected by the excitement information detection unit 550 (step S740). The tag information setting unit 34 then sets a tag range as tag information.

The image determination unit 37 also determines whether the target image data is included in the period of the video data where the excitement information is equal to or greater than a predetermined threshold (step S750). In step S750, if the image determination unit 37 determines that the target image data is included in the above period of the video data (Yes in step S750), the advertisement setting unit 38 generates advertisement setting data for displaying the advertisement of the advertising client corresponding to the target image data on the display unit (step S760). On the other hand, if the image determination unit 37 determines that the target image data is not included in the video data (No in step S750), the advertisement setting unit 38 skips the processing of step S760. The server-side communication unit 35 transmits the video data and chat data, and transmits the advertisement setting data if advertisement setting data is generated (step S770).

At the terminal device 40 side, the various data transmitted from the server 530 is received. The display control unit 56 displays the video based on the video data and the chat based on the chat data on the display unit 42 (step S780). The display control unit 56 judges whether or not there is a setting for advertisement display based on the advertisement setting data (step S790). If it is judged that there is a setting for advertisement display (Yes in step S790), the display control unit 56 displays the advertisement based on the setting in the advertisement setting data (step S800). On the other hand, if the advertisement setting data is not received, or if it is judged that there is no setting for advertisement display, such as when all the display mode data in the advertisement setting data is set to hidden (No in step S790), the processing of step S800 is skipped.

As described above, the chat system 600 according to the sixth embodiment includes a video data acquisition unit 31 that acquires video data of a match, a chat data processing unit 33 that is capable of at least one of acquiring and generating chat data related to the match, an excitement information acquisition unit 551 that acquires excitement information indicating the level of excitement in the match, a memory unit 39 that stores the video data, chat data, and excitement information in association with each other by time, an image determination unit 37 that determines whether or not target image data, which is data of a target image showing an advertising client, is included in the stored video data during a period in which the excitement information is equal to or greater than a predetermined threshold, and, if the target image data is included in the period, generates an image based on the video data. The server 530 has an advertisement setting unit 38 that generates advertisement setting data for displaying an advertisement of an advertising client corresponding to a target image on the display unit 42 when an image and a chat based on the chat data are displayed on the external display unit 42, a server side communication unit 35 that can transmit the image data, chat data, and advertisement setting data to the outside, a display unit 42, a communication unit 43 that transmits and receives information between the server side communication unit 35, and a terminal device 40 that has a display control unit 56 that displays an image and chat based on the image data and chat data received by the communication unit 43 on the display unit 42 and, when advertisement setting data is received by the terminal side communication unit, displays an advertisement on the display unit 42 based on the advertisement setting data.

According to this embodiment, in the server 530, when target image data is included in the video data during a period in which excitement information is equal to or greater than a predetermined threshold, advertisement setting data is generated so as to display an advertisement of the advertising client corresponding to the target image data, and the advertisement is displayed on the terminal device 40 based on the advertisement setting data. As a result, the advertisement is displayed during the period in which the game is in the excitement, making it possible to deliver advertisements based on highly effective information.

In the chat system 600 according to this embodiment, the excitement information includes at least one of the following: biometric information of at least one of the participants in the match and the spectators of the match, the volume of the sound in the video, the brightness value of the video data, the content of the match situation indicating the state of the match, and the content of the chat. This makes it possible to detect and obtain the excitement information as a numerical value corresponding to the actual excitement of the match.

The chat system 600 according to this embodiment further includes a video data selection unit 36 that selects video data from a period in which excitement information is equal to or greater than a predetermined threshold. This allows advertisements to be delivered to users who actively wish to watch video data from a period in which excitement information is equal to or greater than a predetermined threshold.

The technical scope of the present invention is not limited to the above-described embodiments, and appropriate modifications can be made without departing from the spirit of the present invention. For example, in each of the above-described embodiments, when a product or service is purchased through an advertisement displayed on the display unit, a predetermined incentive may be returned from the advertising client to the server operator.

C1...advertisement display area, Ca, Cb...advertisement, M1, 42a...video display area, M2, S1...score display area, ID66...input, ID67...inputter, Pa, Pb...target image, 10...camera, 20...score input section, 30, 130, 530...server, 31...video data acquisition section, 32...score data acquisition section, 33...chat data processing section, 34...tag information setting section, 35...server side communication section, 36...video data selection section, 37...image determination section, 38...advertisement setting section, 39, 44...storage section, 40, 40A...terminal device, 41...input section, 42...display section, 42b...chat display area, 42g...group display area, 43...communication section, 45...control section, 54...data acquisition control section, 55...Storage control unit, 56...Display control unit, 61...Video data, 63, 63a, 63b, 63c...Tag information, 64...Score data, 68...Input contents, 70, 370, 470...Advertisement setting data, 71...Client data, 72...Target image data, 73, 373...Advertisement content data, 74...Display mode data, 75...Judgment subject data, 76...Other data, 77...Response client data, 88, 88a, 88b...Server message, 89...Others' message, 90...Own message, 91...Advertisement chat, 007, 008...Batter, 100...Match display system, 200, 600...Chat system, 550...Excitement information detection unit, 551...Excitement information acquisition unit

Claims (5)

a video data acquisition unit for acquiring video data of a game;
a chat data processing unit capable of at least one of acquiring and generating chat data related to the game;
an excitement information detection unit that outputs excitement information indicating the level of excitement in the game;
An excitement information acquisition unit that acquires the excitement information;
a storage unit that stores the video data, the chat data, and the excitement information in association with each other by time;
an image determination unit that determines whether or not target image data, which is data of a target image showing an advertising client, is included in the stored video data during a period in which the magnitude of the excitement information is equal to or greater than a predetermined threshold;
an advertisement setting unit that generates advertisement setting data for displaying, on an external display unit, an advertisement of the advertising client corresponding to the target image when a video based on the video data and a chat based on the chat data are displayed on the external display unit if the target image data is included in the period;
a communication unit capable of transmitting the video data, the chat data, and the advertisement setting data to an external device ,
The excitement information detection unit detects any one of the heart rate, respiratory rate, blood pressure, body temperature, brain waves, amount of sweat, body movement of the subject, and arterial blood oxygen saturation in the biometric information of at least one subject among the participants of the game and the spectators of the game, and outputs a numerical value calculated based on the amount of fluctuation of the detected value as the magnitude of the excitement information.
server. a video data selection unit that selects the video data during a period in which the level of the excitement information is equal to or greater than the predetermined threshold ,
The server according to claim 1 , wherein the communication unit is capable of transmitting the video data selected by the video data selection unit to an external device. a video data acquisition unit for acquiring video data of a game;
a chat data processing unit capable of at least one of acquiring and generating chat data related to the game;
an excitement information detection unit that outputs excitement information indicating the level of excitement in the game;
An excitement information acquisition unit that acquires the excitement information;
a storage unit that stores the video data, the chat data, and the excitement information in association with each other by time;
an image determination unit that determines whether or not target image data, which is data of a target image showing an advertising client, is included in the stored video data during a period in which the magnitude of the excitement information is equal to or greater than a predetermined threshold;
an advertisement setting unit that generates advertisement setting data for displaying, on an external display unit, an advertisement of the advertising client corresponding to the target image when a video based on the video data and a chat based on the chat data are displayed on the external display unit if the target image data is included in the period;
a server-side communication unit capable of transmitting the video data, the chat data, and the advertisement setting data to an external device ;
The excitement information detection unit detects any one of the heart rate, respiratory rate, blood pressure, body temperature, brain waves, amount of sweat, body movement of the subject, and arterial blood oxygen saturation in the biometric information of at least one subject among the participants of the game and the spectators of the game, and outputs a numerical value calculated based on the amount of fluctuation of the detected value as the magnitude of the excitement information.
A server;
A display unit;
a terminal-side communication unit that transmits and receives information to and from the server-side communication unit;
a display control unit that displays on the display unit video and chat based on the video data and chat data received by the terminal side communication unit, and when the advertisement setting data is received by the terminal side communication unit, displays the advertisement on the display unit based on the advertisement setting data. Acquiring video data of the match;
At least one of acquiring and generating chat data related to the match;
Detecting any one of the heart rate, respiratory rate, blood pressure, body temperature, brain waves, sweat rate, body movement of the subject, and arterial blood oxygen saturation in the biometric information of at least one subject among the participants of the game and the spectators of the game, and outputting a numerical value calculated based on the amount of fluctuation in the detected value as excitement information indicating the level of excitement in the game;
Acquiring the excitement information;
storing the video data, the chat data, and the excitement information in a time-based correspondence;
determining whether or not target image data, which is data of a target image showing an advertising client, is included in the stored video data during a period in which the magnitude of the excitement information is equal to or greater than a predetermined threshold;
generating advertisement setting data for displaying an advertisement of the advertising client corresponding to the target image on an external display unit when the target image data is included in the period and a video based on the video data and a chat based on the chat data are displayed on the external display unit;
and transmitting the video data, the chat data, and the advertisement setting data to an external device. A process of acquiring video data of the game;
A process of at least one of acquiring and generating chat data related to the game;
A process of detecting any one of the heart rate, respiratory rate, blood pressure, body temperature, brain waves, amount of sweat, body movement of the subject, and arterial blood oxygen saturation in biometric information of at least one subject among the participants and spectators of the game, and outputting a numerical value calculated based on the amount of fluctuation of the detected value as excitement information indicating the level of excitement in the game;
A process of acquiring the excitement information;
storing the video data, the chat data, and the excitement information in association with each other by time;
A process of determining whether or not target image data, which is data of a target image showing an advertising client, is included in the stored video data during a period in which the magnitude of the excitement information is equal to or greater than a predetermined threshold value;
a process of generating advertisement setting data for displaying an advertisement of the advertising client corresponding to the target image on an external display unit when the target image data is included in the period and a video based on the video data and a chat based on the chat data are displayed on the external display unit;
and transmitting the video data, the chat data, and the advertisement setting data to an external device.

Images