JP7208427B2 - Score table image processing device, score table image processing method, and score table image processing program - Google Patents

Description

The present invention relates to the technical field of recognizing a score from a photographed image of a score table in a score competition.

When playing a score competition, a player or the like may handwrite a score in a score table. An example of such a sport is golf. In golf, a scorecard is printed with a scorecard. This scorecard has cells for entering the names of each of a plurality of players and cells for entering the scores of each player. 2. Description of the Related Art Conventionally, there is known a technique of photographing a scorecard and identifying the entered score from the photographed image by character recognition (for example, Patent Literature 1).

JP-A-06-318217

By the way, there is a case where it is desired to specify a cell in which the name of a subject who plays a game (for example, a golf player) is entered from the photographed image of the score table. For example, it is conceivable to recognize the subject's name from the image corresponding to the specified cell, or to specify the cell in which the score is entered based on the position of the cell in which the name is entered.

The present invention has been made in view of the above points, and one example of the problem is a score table image processing device that can appropriately identify the names of the main players entered in the score table from the captured image of the score table. An object of the present invention is to provide a score table image processing method and a score table image processing program.

In order to solve the above problems, the invention according to claim 1 provides an image acquisition means for acquiring a photographed image of a score table of a predetermined competition in which scores can be competed among a predetermined number of competition subjects; a name cell identifying means for identifying a name cell in which the name of the subject of the competition is entered from among the cells included in the score table from the captured image; and a system capable of reserving a facility where the competition can be played. name acquisition means for acquiring the names from storage means for storing the names of a plurality of available competition subjects; and names recognized from image portions corresponding to the specified name cells in the acquired photographed images. , and a name identifying means for identifying the name of the competition subject based on a comparison of the acquired name.

According to this invention, the name recognized from the photographed image, the name of the competition subject who can use the system for reserving the facility where the competition can be played, and the competition subject entered in the score table based on the comparison is specified. If only the name is recognized by character recognition from the photographed image of the score table, the name of the main player may not be recognized correctly. On the other hand, there is a possibility that a competition subject using the system will reserve a facility using the system and play a competition at the reserved facility. Therefore, the name of the subject entered in the score table is likely to be the name of the subject that can use the system. Therefore, it is possible to appropriately identify the name of the competition subject entered in the score table.

The invention according to claim 2 is characterized by further comprising name output means for outputting name information indicating the specified name.

According to this invention, it is possible to specify and output the names of the main players entered in the score table.

The invention according to claim 3 further comprises facility usage information acquisition means for acquiring facility usage information indicating a competition subject that uses the facility among the plurality of competition subjects, and the name acquisition means is configured to obtain the plurality of competition subjects. It is characterized by acquiring the name of the competition subject indicated by the acquired facility usage information among the competition subjects.

According to this invention, among the competition subjects who can use the system that can reserve the facilities where they can play the game, the names of the competition subjects who use the facilities are used, and the names of the competition subjects entered in the score table are identified. Since the name of the entity entered in the scorecard is likely to be the name of the entity using the facility, the name of the entity entered in the scorecard can be properly identified.

In the invention according to claim 4, the facility use information acquisition means includes a competition subject who has reserved the use of the facility, a competition subject who is scheduled to play the competition at the reserved facility together with the competition subject, The facility use information indicating at least one of the above is acquired.

According to the present invention, the name of the competition entity that is scheduled to play the competition at the reserved facility is used to identify the name of the competition entity entered in the scorecard. Properly identify the name of the entity entered on the scorecard, as it is likely that the name of the entity entered on the scorecard will be the name of the entity that will be playing the facility-based sport. be able to.

The invention according to claim 5 is characterized in that the facility usage information acquisition means acquires the facility usage information indicating a contest subject who has performed a procedure to start using the facility at the facility.

According to this invention, the name of the competition subject entered in the score table is identified using the name of the competition subject who has completed the procedure for starting to use the facility at the facility. Since the name of the entity entered on the scorecard is likely to be the name of the entity that started using the facility, the name of the entity entered on the scorecard can be properly identified.

According to a sixth aspect of the invention, when the name recognized from the image portion corresponding to the name cell and the acquired name do not correspond, an erroneous recognition suggesting the possibility of erroneous recognition of the name. It is characterized by further comprising erroneously recognized name information output means for outputting name information.

According to the present invention, if the name recognized from the score table does not correspond to the name of the player who can use the system, it suggests the possibility of erroneous recognition of the player's name. Therefore, the user can correct the name of the player in response to the suggested misrecognition.

The invention according to claim 7 is characterized in that the sport is golf.

According to an eighth aspect of the present invention, there is provided, in the score table image processing method executed by a computer, an image obtaining step of obtaining a photographed image of a score table of a predetermined competition in which scores can be competed among a predetermined number of competition subjects. a name cell specifying step of specifying a name cell in which the name of the subject of the competition is entered from among the cells included in the score table from the acquired photographed image; and reserving a facility where the competition can be played. a name acquisition step of acquiring the names from storage means for storing the names of a plurality of competition subjects who can use a possible system; and recognition from an image portion corresponding to the specified name cell in the acquired captured image. and a name identifying step of identifying the name of the player based on a comparison of the obtained name and the obtained name.

According to a ninth aspect of the invention, the computer comprises image acquisition means for acquiring a photographed image of a score table of a predetermined competition in which scores can be competed among a predetermined number of competition subjects; , a name cell identifying means for identifying a name cell in which the name of the subject of the competition is entered among the cells included in the score table; a name acquisition means for acquiring the name from a storage means for storing the name of a competition subject; a name recognized from an image portion corresponding to the specified name cell in the acquired photographed image; It is characterized by functioning as a name specifying means for specifying the name of the competition subject based on the comparison between the name and the name.

According to the present invention, it is possible to appropriately identify the names of the players entered in the score table from the photographed image of the score table.

It is a figure showing an example of the outline composition of golf course reservation system S concerning one embodiment. 1 is a block diagram showing an example of a schematic configuration of a golf course reservation server 1 according to one embodiment; FIG. FIG. 4 is a diagram showing an example of information stored in a database; FIG. 3 is a diagram showing an example of functional blocks of a system control unit 11 in the golf course reservation server 1 according to one embodiment; FIG. It is a figure which shows an example of a picked-up image and a score table. FIG. 10 is a diagram showing an example of a range in which name cell arrangement candidates are specified; FIG. 10 is a diagram showing an example of name cell arrangement candidates; FIG. 10 is a diagram showing another example of a range in which name cell arrangement candidates are specified; FIG. 10 is a diagram showing another example of name cell arrangement candidates; It is a figure which shows the example of a display of score information. FIG. 4 is a sequence diagram showing a processing example of the golf course reservation system according to one embodiment; 5 is a flow chart showing an example of name cell identification processing by the system control unit 11 of the golf course reservation server 1 according to one embodiment. 4 is a flowchart showing an example of score identification processing by the system control unit 11 of the golf course reservation server 1 according to one embodiment; 3 is a diagram showing an example of functional blocks of a system control unit 11 in the golf course reservation server 1 according to one embodiment; FIG. FIG. 10 is a diagram showing a display example of the possibility of misrecognition of a player's name; FIG. 4 is a sequence diagram showing a processing example of the golf course reservation system according to one embodiment; 4 is a flowchart showing an example of player name identification processing by the system control unit 11 of the golf course reservation server 1 according to one embodiment. 4 is a flowchart showing an example of player name identification processing by the system control unit 11 of the golf course reservation server 1 according to one embodiment. 3 is a diagram showing an example of functional blocks of a system control unit 11 in the golf course reservation server 1 according to one embodiment; FIG. FIG. 10 is a diagram showing a display example of the possibility of misrecognition of scores. FIG. 4 is a sequence diagram showing a processing example of the golf course reservation system according to one embodiment; 4 is a flowchart showing an example of score identification processing by the system control unit 11 of the golf course reservation server 1 according to one embodiment; 3 is a diagram showing an example of functional blocks of a system control unit 11 in the golf course reservation server 1 according to one embodiment; FIG. FIG. 4 is a sequence diagram showing a processing example of the golf course reservation system according to one embodiment; 4 is a flowchart showing an example of score identification processing by the system control unit 11 of the golf course reservation server 1 according to one embodiment;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The embodiment described below is an embodiment in which the present invention is applied to a golf course reservation system S capable of reserving a golf course, which is a facility where golf can be played.

[1. First Embodiment]
[1-1. Configuration of Golf Course Reservation System]
First, the configuration and functional overview of the golf course reservation system S according to this embodiment will be described with reference to FIG. FIG. 1 is a diagram showing an example of a schematic configuration of a golf course reservation system S according to this embodiment.

As shown in FIG. 1 , the golf course reservation system S includes a golf course reservation server 1 , a plurality of golf course terminals 2 and a plurality of user terminals 3 . The golf course reservation server 1, each golf course terminal 2, and each user terminal 3 are connected to each other via a network NW. The network NW is constructed by, for example, the Internet, a dedicated communication line (for example, a CATV (Community Antenna Television) line), a mobile communication network (including base stations, etc.), gateways, and the like.

The golf course reservation server 1 is a server device that executes various processes related to a reservation site for reserving a golf course. A user can make a reservation for use of a desired golf course by using the reservation site. In response to a request from the user terminal 3, the golf course reservation server 1 transmits information such as a web page regarding the reservation site. Further, the golf course reservation server 1 may recognize a golf score from a scorecard image captured by the user terminal 3 . The golf course reservation server 1 may include a server device that executes processing related to golf course reservations, and a server device that recognizes scores from scorecard images.

Each golf course terminal 2 is a terminal device used by an employee of the golf course. Examples of the golf course terminal 2 include a tablet computer, a personal computer, and the like. A web browser, an e-mail client, and the like are installed in the golf course terminal 2 . The golf course terminal 2 transmits a request to the golf course reservation server 1 based on an operation by an employee, and displays information such as a web page transmitted from the golf course reservation server 1 in response to this request. The employee uses the golf course terminal 2 to check the reservation status and check-in status of the golf course.

Each user terminal 3 is a terminal device carried by a user who uses the golf course by using the reservation site. For example, the user carries the user terminal 3 and goes to a golf course. Examples of the user terminal 3 include mobile information terminals such as smart phones and tablet computers, mobile phones, and personal digital assistants (PDAs). At the stage of reserving a golf course, the user may use a stationary terminal device such as a personal computer. The user terminal 3 incorporates software such as a browser and an e-mail client. Also, the user terminal 3 may have a dedicated application installed for using a reservation site or for entering a golf score.

Each user terminal 3 also has a function of capturing an image. For example, each user terminal 3 includes a digital camera configured with a CCD (Charge-Coupled Device) sensor, a CMOS (Complementary Metal Oxide Semiconductor) sensor, or the like. The user terminal 3 causes the memory of the user terminal 3 to store the image data of the image captured by the digital camera. Examples of image data formats include JPEG and RAW.

[1-2. Configuration of Golf Course Reservation Server]
Next, the configuration of the golf course reservation server 1 will be described with reference to FIGS. 2 and 3. FIG. FIG. 2 is a block diagram showing an example of a schematic configuration of the golf course reservation server 1 according to this embodiment. As shown in FIG. 2 , the golf course reservation server 1 includes a system control section 11 , a system bus 12 , an input/output interface 13 , a storage section 14 and a communication section 15 . The system control unit 11 and the input/output interface 13 are connected via a system bus 12 .

The system control unit 11 includes a CPU (Central Processing Unit) 11a, a ROM (Read Only Memory) 11b, a RAM (Random Access Memory) 11c, and the like.

The input/output interface 13 performs interface processing between the storage unit 14 and the communication unit 15 and the system control unit 11 .

The storage unit 14 is configured by, for example, a hard disk drive or the like. The storage unit 14 stores databases such as a member DB 14a, a golf companion DB 14b, a golf course DB 14c, a reservation information DB 14d, a check-in DB 14e, and a score DB 14f. "DB" is an abbreviation for database. FIG. 3 is a diagram showing an example of information stored in a database.

In the member DB 14a, member information regarding users who use the golf course reservation system S is stored for each user. Specifically, in the member DB 14a, user IDs, names, addresses, telephone numbers, e-mail addresses, etc. are associated and stored as member information. A user ID is identification information that identifies a user.

In the golf companion DB 14b, information on golf companions of users who use the golf course reservation system S is stored for each user. Specifically, a user ID, a list of golf companions, and the like are stored in association with each other in the golf companion DB 14b. The golf companion list is a list of user IDs of other users who are golf companions of the user indicated by the user ID. For example, the golf course reservation server 1 may add the user ID of the other user to the golf buddy list of each of the users who use the golf course reservation system S to recognize each other as golf buddy.

In the golf course DB 14c, golf courses that can be reserved by the golf course reservation system S are stored for each golf course. Specifically, the golf course DB 14c stores golf course IDs, golf course names, addresses, telephone numbers, e-mail addresses, etc. in association with each other as golf course information. The golf course ID is identification information that identifies the golf course.

The reservation information DB 14d stores reservation information about golf course reservations each time a reservation is made. Specifically, the reservation information DB 14d stores, as reservation information, a reservation number, a reservation person ID, a golf course ID, a date of play, the number of groups, group information, and the like in association with each other. A reservation number is a number that identifies a reservation. The reservation person ID is the user ID of the user who made the reservation. The golf course ID indicates a reserved golf course. The play date indicates the date on which golf is played. The number of pairs indicates how many pairs are used to play golf. A value of 1 or more is set as the number of sets. Group information is information about the group that is going to play golf. Group information corresponding to the number of groups is stored in the reservation information DB 14d. Each group information includes group ID, start time, and member list. The set ID is identification information that identifies the set. The start time is the time at which the group begins playing golf. A member list is a list of members that make up a set. For example, the reserver selects each member of the set or enters information for each member when or after reserving the golf course. For example, it may be possible to select members from the reservation companions of the reservation person. Alternatively, it may be possible to enter each member's name and email address. The member list may include the user IDs of the golf buddies selected by the reservation person or the member information input by the reservation person. For subscribers, the user ID of the subscriber may be included in the member list. One to four members may be selected or entered for each set. Members other than the person who made the reservation are, for example, companions of the person who made the reservation, among the members of all the groups for which the golf course has been reserved in one reservation. A companion is a user who plays golf with the reservation person. Companions need not be limited to members playing on the same hole as the reservation.

The check-in DB 14e stores check-in information regarding users who have checked in at the golf course for each user who has checked in. Specifically, the check-in DB 14e stores check-in information such as a golf course ID, a check-in date and time, a user ID, and the like in association with each other. The golf course ID indicates the golf course where check-in was performed. The check-in date and time indicates the date and time when check-in was performed. The user ID indicates the user who has checked in. Check-in means that a golf player performs procedures at a golf course to start using the golf course. For example, a user activates a dedicated application to display information indicating the user's user ID, such as a barcode, on the screen of the user terminal. Each golf course terminal 2 may be equipped with a barcode reader, for example. An employee of the golf course causes the golf course terminal 2 to read the user ID using a bar code reader. The golf course terminal 2 transmits the read user ID to the golf course reservation server 1 together with the golf course ID of the golf course and the check-in date and time. The golf course reservation server 1 stores the information received from the golf course terminal 2 in the check-in DB 14e. Here, the golf course reservation server 1 may refer to the reservation information and allow check-in only for the person who made the reservation or his/her companion who plans to play golf at the golf course on that day. When checking in, the user may enter the name of the user in the check-in sheet instead of showing the screen of the user terminal 3 to the employee. In this case, the employee may enter the name into the golf course terminal 2 and search for the user who has checked in from among the reserving persons and companions who have reserved the golf course on that day. The golf course reservation server 1 causes the check-in DB 14e to store check-in information including the user ID of the searched user.

The score DB 14f stores score information indicating the golf score of the user who uses the golf course reservation system S and the companion. Specifically, the score DB 14f stores a user ID, a golf course ID, a date of play, score information, one or a plurality of companion score information, etc. in association with each other. The user ID indicates the user who gave the score indicated in the score information. The golf course ID and play date indicate the golf course and play date at which the score indicated in the score information was obtained. Score information may include scores and gross scores for each hole, for example. The companion score information indicates the score given by the companion of the user indicated by the user ID. For example, when the user inputs or fills in the companion's score, the companion's score information is stored in the score DB 14f. Companion score information includes, for example, companion name and score information.

The storage unit 14 further stores various programs such as an operating system, a DBMS (Database Management System), and a server program. The server program is a program that causes the system control unit 11 to execute processing related to golf course usage reservations and processing for recognizing scores from scorecard images. For example, the server program may be obtained from another device via the network NW, or may be recorded on a recording medium such as a magnetic tape, optical disk, or memory card and read via a drive device. good too.

The communication unit 15 is configured by, for example, a network interface controller or the like. The communication unit 15 connects to the golf course terminal 2 and the user terminal 3 via the network NW, and controls the state of communication with these devices.

[1-3. Function overview of the system control unit]
Next, an overview of the functions of the system control unit 11 in the golf course reservation server 1 will be described with reference to FIGS. 4 to 10. FIG. FIG. 4 is a diagram showing an example of functional blocks of the system control unit 11 in the golf course reservation server 1 according to this embodiment. As shown in FIG. 4, the CPU 11a reads and executes various program codes included in the server program, so that the system control unit 11 has a photographed image acquisition unit 1101, a cell information acquisition unit 1102, a hall number cell identification unit 1103, It functions as a name cell identification unit 1104, a score cell identification unit 1105, a score identification unit 1106, a recognition result output unit 1107, and the like.

A photographed image acquisition unit 1101 acquires a photographed image of a golf score table. The score table is printed on, for example, a score card. The user shoots the scorecard with the digital camera of the user terminal 3 . The user terminal 3 transmits the captured image to the golf course reservation server 1 . Thus, the captured image acquisition unit 1101 acquires the captured image from the user terminal 3 . Note that the scores for four persons may be entered in the photographed score table, or the scores for three persons or less may be entered.

FIG. 5 is a diagram showing an example of a captured image and a score table. In FIG. 5, the captured image P includes an image of the scorecard CD. The scorecard CD includes, for example, score tables 100-1 and 100-2. The score table 100-1 is a table for entering the scores for the first through ninth holes. The score table 100-2 is a table for entering scores for the 10th to 18th holes. It should be noted that it may be possible to enter the scores of the 1st hole to the 18th hole in one score table. Score table 100-1 and score table 100-2 each include a plurality of cells. For example, the score table 100-1 includes at least a row 110 of name cells, a row 120 of hall number cells, and a row 130 of score cells. Sequence 110 of name cells includes name cells 111 , 112 , 113 and 114 . Name cell sequence 110 thus includes four cells. Each name cell is a cell in which a player name is entered. The sequence 120 of hall number cells includes hall number cells 121 , 122 , 123 , 124 , 125 , 126 , 127 , 128 and 129 . Each hall number cell is a cell containing a corresponding hall number. Specifically, numbers 1 to 9 are displayed in hole number cells 121 to 129, respectively. A row of score cells 130 is included in the score table 100-1 corresponding to each name cell. A row 130 of score cells exists for each player. Each score cell sequence 130 includes score cells 131 , 132 , 133 , 134 , 135 , 136 , 137 , 138 and 139 . Each score cell is a cell in which the score for the hole indicated by the corresponding hole number is entered. Specifically, the score cells 131 to 139 are filled with the scores of the 1st to 9th holes, respectively. The score table 100-1 may further include a cell in which the total score is entered, a cell that displays the prescribed number of strokes for each hole, a cell that displays the distance of each hole, and the like. The configuration of score table 100-2 may be the same as or similar to the configuration of score table 100-1. The score table 100-1 is a score table whose entry method is vertical. A vertical score table is a score table in which score cells for each player are arranged vertically. The row 110 of name cells may contain the names of all four players, only the names of two or three players, or the name of only one player. May be entered. Alternatively, the row 110 of name cells may not contain any player names.

The cell information acquisition unit 1102 acquires cell information indicating the position and area of each of a plurality of cells included in the score table within the captured image acquired by the captured image acquisition unit 1101 . For example, the cell information acquisition unit 1102 analyzes the captured image and identifies each cell. A method of analyzing the captured image will be described later. The cell information acquisition unit 1102 may specify the coordinates of each cell in the captured image. Each cell is typically rectangular. Therefore, the cell information acquisition unit 1102 may specify the coordinates of the upper left vertex and the coordinates of the lower right vertex of the cell. These coordinates can indicate the location and area of each of the cells. The cell information acquisition unit 1102 may assign a number to each cell, for example, and associate coordinates with the cell number. Then, the cell information acquisition unit 1102 may generate cell information including a combination of the cell number and coordinates of each cell. Note that the user terminal 3 may analyze the captured image and generate the cell information, and the cell information acquisition unit 1102 may acquire the cell information from the user terminal 3 .

A hole number cell identifying unit 1103 selects cells from among a plurality of cells included in the score table based on the characters recognized from the captured image acquired by the captured image acquiring unit 1101 and the cell information acquired by the cell information acquiring unit 1102. , identify a plurality of continuous hole number cells each containing characters respectively indicating a plurality of predetermined holes. The hole number cell identification unit 1103 may identify the hole number cells of, for example, the 1st to 9th holes, the 10th to 18th holes, or the 1st to 18th holes as the predetermined plurality of holes. . For example, the hall number cell identification unit 1103 recognizes numbers from the score table by character recognition. Hall number cell identification unit 1103 identifies whether each cell contains a number (or numerical value) and identifies the number based on the coordinates of the cell indicated by the cell information. The hall number cell identification unit 1103 identifies, as a hall number cell array, a sequence (or a combination) of continuous cells containing numbers 1 to 9, 10 to 18, or 1 to 18 in that order, for example. do.

Based on the cell information acquired by the cell information acquisition unit 1102, the name cell identification unit 1104 identifies a plurality of rows (or combinations) each composed of a predetermined number of continuous cells included in the plurality of cells of the score table. From among them, the sequence that maximizes the total area of the predetermined number of cells is specified as the sequence of name cells. The number of name cells specified by the name cell specifying unit 1104 may be four, for example. Basically, each group playing golf consists of a maximum of four players. Therefore, scores for four people can be entered on most scorecards. Also, the name cells are continuous vertically or horizontally (row direction or column direction). Furthermore, each name cell has a relatively large area among all cells included in the score table. One of the reasons for this is that if the name cell is small, it is difficult to enter the name or read the entered name. Also, some names have a relatively large number of characters, so the name cell is relatively large in consideration of this point. Although the score is entered in the score cell, the score is composed of simple numbers and is composed of one or two digit numbers, so even if the score cell is smaller than the name cell, it cannot be compared with the name. and easy to read the written score. Also, since the cells displaying information such as hole numbers, distances, headings, etc. are printed information, even if these cells are smaller than the name cells, the information displayed in them is easy to read. The area of each name cell may be the largest of all cells included in the score table. However, when looking at individual cells, there may be cells that are larger than the name cell. Therefore, the name cell can be appropriately specified by making a determination based on the sum of a predetermined number of cells. For example, in FIG. 5, name cells 111-114 are horizontally contiguous and their total area is greater than the sum of the other four contiguous cells.

The name cell identification unit 1104 may identify a row of name cells from a row of cells in which four cells forming the row are considered to have the same area. Name cells in the score table generally have the same area. When the areas are considered to be the same as each other, the areas may be completely the same, or the areas may be substantially the same. Even if the areas of the original name cells are the same, the areas of the name cells identified from the captured images may not be completely the same. The substantially same area may mean, for example, that the difference between the area of the cell with the largest area and the area of the cell with the smallest area among the four cells is less than a predetermined threshold. . This threshold may be, for example, the area of any cell or a predetermined percentage of the average area of the cells.

Even when a team of four players plays, for example, when a competition is held, when a score card or score sheet is used to record scores for more than four players. There may be In that case, the number of specified name cells may be more than four.

When a hall number cell is identified by the hall number cell identification unit 1103, the name cell identification unit 1104 may limit candidates for name cell arrangement based on the identified hall number cell. This can reduce the amount of calculation of the total cell area.

For example, the name cell identification unit 1104 may limit the candidates for the name cell arrangement to the arrangement of cells perpendicular to the direction in which the identified hole number cells are arranged. If the hole number cells are aligned vertically, the name cells are aligned horizontally. Conversely, if the hole number cells are arranged horizontally, the name cells are arranged vertically.

Further, for example, the name cell identifying unit 1104 may determine, from among the plurality of cells included in the score table, the position of the hole number cell that includes characters indicating the hole to be played first among the predetermined plurality of holes. Candidates for name cell sequences may be identified from cells on the opposite side of the side where the hall number cell is located. Here, the hole played first is the 1st hole or the 10th hole.

FIG. 6 is a diagram showing an example of a range in which candidate names are identified. As shown in FIG. 6, the hole number cell 121 in the sequence 120 of hole number cells included in the score table 100-1 contains the smallest hole number "1". Since the score table 100-1 is a vertical score table, the hole number cells 122 to 129 are arranged from top to bottom in ascending order of the hole numbers. Therefore, the hole number cells 122 to 129 are located below the hole number cell 121. FIG. The score table 100-1 is divided into a cell group area 141 located above the hole number cell 121 and a cell group area 142 located below the hole number cell 121. FIG. Cells positioned at the same height as hole number cells 121 are excluded for convenience. Since the hall number cells 122 to 129 are located in the area 142, candidates for the row of name cells are identified from the area 141 on the opposite side. For convenience of explanation, 11 cells in area 141 are given identifiers A1 to A11. FIG. 7 is a diagram showing an example of name cell arrangement candidates. As shown in FIG. 6, the hole number cells 121-129 are arranged vertically. Therefore, the name cell identifying unit 1104 selects a row of four horizontally continuous cells among cells A1 to A11 as candidates for the name cell row. For example, as shown in FIG. 7, sequences 210-300 are identified. Row 210 includes cells A1, A2, A3 and A4. Row 220 includes cells A2, A3, A4 and A5. Row 230 includes A3, A4, A5 and A6. Row 240 includes A4, A5, A6 and A7. Row 250 includes A5, A6, A7 and A8. Row 260 includes A1, A2, A9 and A10. Row 270 includes A2, A9, A10 and A11. Row 280 includes A9, A10, A11 and A4. Row 290 includes A10, A11, A4 and A5. Sequence 300 includes A11, A4, A5 and A6. The name cell identification unit 1104 calculates the total area of the cells included in each row. Row 250 is identified as the row of name cells because the total area of cells A5, A6, A7 and A8 is the largest. Cells A5-A8 are name cells 111-114.

FIG. 8 is a diagram showing another example of a range in which candidate names are identified. A score table 100-2 shown in FIG. 8 is a horizontal score table. A horizontal score table is a score table in which score cells for each player are arranged horizontally. As shown in FIG. 8, the score table 100-2 includes a row of name cells 310, a row of hole number cells 320, and the like. Name cell sequence 310 includes name cells 311-314. The row of hall number cells 320 includes hall number cells 321-329. Of the row of hole number cells 320, the hole number cell 321 contains "1" which is the smallest hole number. Since score table 100-2 is a horizontal score table, hole number cells 322 to 329 are arranged from left to right in ascending order of hole numbers. Therefore, hole number cells 322 to 329 are positioned to the right of hole number cell 321 . The score table 100-2 is divided into a cell group area 341 positioned to the left of the hole number cell 321 and a cell group area 342 positioned to the right of the hole number cell 321. FIG. Since the hall number cells 322 to 329 are located in the area 342, candidates for the row of name cells are identified from the area 341 on the opposite side. Eleven cells in the area 141 are given identifiers B1 to B11. FIG. 9 is a diagram showing another example of name cell arrangement candidates. As shown in FIG. 8, the hole number cells 321-329 are arranged vertically. Therefore, the name-cell identifying unit 1104 selects, from cells B1 to B11, a row of four cells that are consecutive in the vertical direction as candidates for the name-cell row. For example, as shown in FIG. 9, sequences 410-490 are identified. Since the total area of cells B5, B6, B7 and B8 included in row 450 is the largest among these, row 450 is identified as a row of name cells. Cells B5-B8 are name cells 311-314.

Based on the position of the name cell specified by the name cell specifying unit 1104, the score cell specifying unit 1105 specifies the score cell in which the score is written, among the cells included in the score table. For example, the score cell identifying unit 1105 may identify a score cell from among a row of cells that perpendicularly intersects the identified row of name cells. When the hall number cell identification unit 1103 has identified the hall number cell, the score cell identification unit 1105 may identify the score cell based on the position of the name cell and the position of the hall number cell. For example, the score cell identifying unit 1105 identifies, as score cells, cells that are included in both a row of cells that intersect the row of name cells and a row of cells that vertically intersect the row of hall number cells. good too.

The score specifying unit 1106 recognizes the score from the image portion corresponding to the score cell specified by the score cell specifying unit 1105 in the captured image acquired by the captured image acquiring unit 1101 . For example, the score identification unit 1106 acquires the coordinates of each identified score cell from the cell information. The score identification unit 1106 identifies a portion corresponding to the coordinates of the score cell from the captured image, and recognizes the score from that portion by character recognition. The score identification unit 1106 recognizes the score of each hole for each player based on the position of each score cell with respect to the name cell and hole number cell. The score identification unit 1106 may also recognize the total score and gross score in the OUT course or IN course from the captured image.

A recognition result output unit 1107 outputs score information indicating the score recognized by the score identification unit 1106 . The score information indicates scores in association with, for example, each player and each hole. The recognition result output unit 1107 may transmit the score information to the user terminal 3 from which the captured image was obtained. Thereby, the recognition result output unit 1107 may cause the user terminal 3 to display the score information. FIG. 10 is a diagram showing a display example of score information. Score information is displayed on the scorecard screen 500 shown in FIG. Scorecard screen 500 is displayed according to a dedicated application. For example, scorecard screen 500 includes four player name cells 510, a plurality of score cells 520, a register button 530, and the like. The player name cell 510 originally displays the player name. However, in this embodiment, the golf course reservation server 1 does not recognize the player name from the photographed image of the score table. Therefore, "Player 1", "Player 2", etc. may be displayed in the player name cell 510 for convenience. Each score cell displays a recognized score. Here, the dedicated application may be configured so that the user can select which score is the player himself/herself. The user may also be able to enter a player name in each player name cell 510 . Alternatively, the dedicated application and the golf course reservation server 1 may be configured so that the user can select a player who has played golf from among the user's golf buddies. The selected player's name may then be displayed in the player name cell 510 . Each score cell 520 displays a score. In FIG. 10, only the score of the OUT course is displayed, but the user terminal 3 may display the score of the IN course according to the user's operation. A dedicated application may also be configured to allow the score in each score cell 520 to be modified and the score to be entered in the score cell 520 . The register button 530 is for requesting the golf course reservation server 1 to store the score information displayed on the scorecard screen 500 in the score DB 14f with the player name and score modified by the user if necessary. is a button.

[1-4. Operation of Golf Course Reservation System]
Next, operations of the golf course reservation system S will be described with reference to FIGS. 11 to 13. FIG. FIG. 11 is a sequence diagram showing a processing example of the golf course reservation system according to this embodiment. For example, a user who has played golf and entered a score in a scorecard causes the user terminal 3 to start photographing the scorecard. The user terminal 3 detects the score table while shooting (step S1). For example, the user terminal 3 determines the model of the user terminal 3 . The user terminal 3 acquires the distortion aberration coefficient corresponding to the lens of the digital camera included in the terminal of the determined model. For example, the user terminal 3 may acquire the distortion aberration coefficient from the golf course reservation server 1 . The user terminal 3 starts shooting a moving image in response to an operation by the user. The user terminal 3 corrects the captured image of each frame of the captured moving image using the distortion aberration coefficient. Then, the user terminal 3 tries to detect the score table from the image of each frame. For example, the user terminal 3 detects multiple convex polygons from the image. At this time, the user terminal 3 also detects a polygon composed of a plurality of polygons. The user terminal 3 approximates each detected polygon to a rectangle. The user terminal 3 determines a rectangle that includes a plurality of other rectangles and is not included in any of the other rectangles as the score table, among the identified rectangles. The user terminal 3 may detect multiple score tables from one frame. The user terminal 3 generates score table position information indicating the coordinates in the image of the detected table. The user terminal 3 transmits the photographed image of the frame in which the score table is detected and the score table position information to the golf course reservation server 1 (step S2). Here, the user may select the golf course where golf was played and the date of play. In response, the user terminal 3 may transmit the golf course ID and play date of the selected golf course to the golf course reservation server 1 .

The golf course reservation server 1 that has received the photographed image and the score table position information from the user terminal 3 executes name cell identification processing for each detected score table, for example (step S3). FIG. 12 is a flowchart showing an example of name cell identification processing by the system control unit 11 of the golf course reservation server 1 according to this embodiment. As shown in FIG. 12, the captured image acquisition unit 1101 extracts the image of the score table from the captured image based on the score table position information (step S101).

Next, the cell information acquiring unit 1102 acquires cell information indicating the position and area of each cell of the score table based on the extracted image of the score table (step S102). For example, the cell information acquisition unit 1102 transforms the shape of the score table in the image into a rectangle by performing a projective transformation on the image of the score table. The cell information acquisition unit 1102 emphasizes line segments in the image by applying morphological transformation to the converted image of the score table. Next, the cell information acquisition unit 1102 detects vertical and horizontal line segments from the image. Next, the cell information acquisition unit 1102 detects intersections of vertical line segments and horizontal line segments. Next, the cell information acquisition unit 1
A rectangle 102 regards a rectangle formed by a vertical line segment and a horizontal line segment as a cell, and generates cell information including the coordinates of each cell based on the coordinates of their intersection.

Next, the hole number cell identification unit 1103 recognizes numbers from the image of the score table (step S103). For example, the hole number cell specifying unit 1103 deletes the line segments forming each cell from the image of the score table. Next, the hole number cell identifying unit 1103 emphasizes characters in the image by applying Otsu's binarization to the image of the score table. The number cell characterization unit 1103 recognizes numbers from images using, for example, a trained convolutional neural network (CNN). At this time, number cell characterization unit 1103 may also recognize alphabets, katakana, and other types of characters.

Next, the number cell characterizing unit 1103 identifies the row of cells of the hole number (step S104). For example, the number cell characterizing unit 1103 identifies cells containing numbers based on the recognized coordinates of each number and the coordinates of each cell. The number cell characterization unit 1103 specifies nine cells arranged vertically or horizontally and containing numbers in order of 1 to 9 or 10 to 18 as hall number cells (step S105).

Next, the number cell characteristic unit 1103 determines whether the writing format of the score table is vertical or horizontal (step S106). For example, the number cell characteristic unit 1103 determines that the entry format is vertical when the hole number cells are arranged vertically, and determines that the entry format is horizontal when the hole number cells are arranged horizontally.

Next, the name cell identification unit 1104 initializes the maximum value of the total cell area to 0 (step S106). Next, the name cell identification unit 1104 identifies the side of the plurality of cells detected from the image where the other hole number cells are located when viewed from the position of the hole number cell containing the hole number “1” or “10”. From the cells on the opposite side, one row of four cells that are continuous in the direction corresponding to the entry format is selected (step S107). Here, the name cell identifying unit 1104 selects a row of cells that are continuous in the horizontal direction when the entry format is vertical, and selects a row of cells which are continuous in the vertical direction when the entry format is horizontal.

Next, the name cell identification unit 1104 calculates the total area of the four selected cells (step S108). Next, the name cell identification unit 1104 determines whether the calculated total area is larger than the current maximum total area (step S109). If the calculated total area is larger than the maximum value (step S109: YES), the name cell identification unit 1104 sets the maximum value of the total area to the calculated total area (step S110).

If the calculated total area is not larger than the maximum value (step S109: NO), or after step S110, the name cell identification unit 1104 checks whether there are any other rows of four cells that have not yet been selected. It is determined whether or not (step S111). If there is a row of cells that has not been selected (step S111: YES), the process proceeds to step S107, and one row of four cells that has not yet been selected is selected. On the other hand, if all the cell rows have been selected (step S111: NO), the name cell identification unit 1104 determines the row of four cells with the largest total area (step S112), The name cell identification process ends.

When the name cell specifying process ends, as shown in FIG. 11, the golf course reservation server 1 executes score specifying process for each detected score table, for example (step S4). FIG. 13 is a flowchart showing an example of score identification processing by the system control unit 11 of the golf course reservation server 1 according to this embodiment. As shown in FIG. 13, the score cell identification unit 1105 identifies score cells based on the cell information acquired in the name identification process and the positions of the name cells and hole number cells (step S201). For example, the score cell identification unit 1105 identifies four sequences of cells orthogonal to the sequence of name cells. In addition, score cell identifying section 1105 identifies nine sequences of cells that are orthogonal to the sequence of hole number cells. The score cell identifying unit 1105 identifies, as score cells, cells included in both the row of cells orthogonal to the row of name cells and the row of cells orthogonal to the row of hall number cells.

Next, the score cell identification unit 1105 determines the number recognized in the name cell identification process as the score from the portion corresponding to the position of each identified score cell in the image of the score table (step S202). At this time, the score cell identification unit 1105 determines, based on the position of each score cell, the score of that cell is the score of what hole of what player. After step S202 ends, the score identification process ends.

When the score specifying process ends, as shown in FIG. 11, the recognition result output unit 1107 transmits the score information of each player, in which each specified score is associated with the hole number, to the user terminal 3 (step S5). .

Upon receiving the score information from the golf course reservation server 1, the user terminal 3 displays the score based on the score information (step S6). For example, the user terminal 3 displays a score screen and displays each score within the score screen. Also, the user terminal 3 may display the total score and gross score of the OUT course and the IN course.

Next, the user operates the user terminal 3 to input the name of the player who made the score shown in each piece of score information. At this time, the user may select which scored player is the user himself/herself, and input the names of the companions who scored the remaining scores (step S7). The user terminal 3 transmits the final score information of the user using the user terminal 3 to the golf course reservation server 1 together with the user ID of the user, and each companion who associates the score information with the name of the companion. The score information is transmitted to the golf course reservation server 1 (step S8). At this time, the user may select the golf course where golf was played and the date of play. In response, the user terminal 3 may transmit the golf course ID and play date of the selected golf course to the golf course reservation server 1 .

The golf course reservation server 1 associates the score information, companion score information, golf course ID, and play date received from the user terminal 3 with the user ID and stores them in the score DB 14f (step S9).

As described above, according to the present embodiment, the golf course reservation server 1 acquires a photographed image of a golf score table. Further, the golf course reservation server 1 acquires cell information indicating the position and area of each of the plurality of cells included in the score table within the acquired photographed image. Further, based on the obtained cell information, the golf course reservation server 1 selects a predetermined number of cells from among a plurality of rows each composed of a predetermined number of continuous cells included in the plurality of cells of the score table. The row with the largest total area is specified as the row of name cells in which player names are entered. Therefore, it is possible to appropriately specify the cell in which the player name is written from the photographed image of the score table.

Here, the golf course reservation server 1 selects characters indicating each of a plurality of predetermined holes from a plurality of cells of the score table based on the characters recognized from the acquired photographed image and the acquired cell information. A plurality of successive hole number cells each containing may be identified. Further, the golf course reservation server 1 may limit candidates for arranging name cells based on the identified hole number cells. In this case, the amount of calculation of the total area can be reduced.

Here, the golf course reservation server 1 may limit candidates for name cells to cells arranged perpendicularly to the direction in which the identified hole number cells are arranged. In this case, it is possible to appropriately limit the direction in which the predetermined number of candidate cells are arranged.

In addition, the golf course reservation server 1, among the plurality of cells of the score table, places a golf ball on the side opposite to the cell containing the characters indicating the other holes, when viewed from the position of the cell including the characters indicating the first hole. A candidate name cell sequence may be identified from a cell. In this case, based on the positional relationship of the cells, it is possible to limit the range in which a row of a predetermined number of cells as candidates is specified in the score table.

Further, the golf course reservation server 1 may specify a score cell in which a score is entered among a plurality of cells of the score table based on the specified position of the name cell. Further, the golf course reservation server 1 may output score information indicating the score recognized from the image portion corresponding to the specified score cell in the acquired photographed image. In this case, the scores entered in the score table can be output.

Alternatively, the golf course reservation server 1 may specify a sequence of four continuous name cells.

[2. Second Embodiment]
Next, a second embodiment will be described. In this embodiment, the golf course reservation server 1 recognizes the player name from the image of the name cell specified in the score table. At this time, the golf course reservation server 1 may use the name of the member of the golf course reservation system S to identify the player name. In particular, the golf course reservation server 1 may specify the player name using the golf course reservation information (and companion information). Except for the points described below, this embodiment may be the same as the first embodiment.

[2-1. Function overview of the system control unit]
Next, an overview of the functions of the system control unit 11 will be described with reference to FIGS. 14 and 15. FIG. FIG. 14 is a diagram showing an example of functional blocks of the system control unit 11 in the golf course reservation server 1 according to this embodiment. In FIG. 14, the same reference numerals are assigned to the same elements as in FIG. In this embodiment, the system control unit 11 includes a captured image acquisition unit 1101, a cell information acquisition unit 1102, a hall number cell identification unit 1103, a name cell identification unit 1104, a score cell identification unit 1105, a score identification unit 1106, and a recognition result output unit. 1107, a facility usage information acquisition unit 1108, a member name acquisition unit 1109, a name identification unit 1110, and the like.

The facility usage information acquisition unit 1108 acquires facility usage information indicating a player who uses the golf course. The player indicated by the facility usage information may be, for example, a user planning to use the golf course, a user currently using the golf course, or a user who has used the golf course. The facility usage information acquisition unit 1108 acquires reservation information as facility usage information. The reservation information includes the user ID of the person who reserved the golf course. There is a possibility that the reservation person is a player who plans to play golf using the golf course. Also, the facility usage information acquisition unit 1108 may acquire one or a plurality of member lists included in the reservation information. The member list shows players who plan to play golf at the reserved golf course. Here, the facility usage information acquisition unit 1108 may acquire reservation information with a play date of today. In addition, the facility use information acquisition unit 1108 may acquire a member list of a group whose golf play start time is earlier than the current time in the reservation information whose play date is today. Alternatively, when the user terminal 3 captures an image of the score table, the user terminal 3 may add location information to the captured image by, for example, geotagging. This position information indicates the position and the date and time when the image was taken. The user terminal 3 may transmit the captured image to which the position information is added to the golf course reservation server 1 . The facility usage information acquisition unit 1108 determines which golf course or vicinity the image was taken based on the position information added to the captured image and the address of each golf course stored in the golf course DB 14c. . The facility usage information acquisition unit 1108 may acquire reservation information of the golf course where the image was taken and whose playing date matches the shooting date. Alternatively, the dedicated application and the golf course reservation server 1 may be configured so that the user can select the golf course where the user played golf and the date of play. In this case, the facility usage information acquisition unit 1108 may acquire reservation information in which the user is the person who made the reservation or is an accompanying person, and reservation information of the golf course and play date selected by the user.

The member name acquisition unit 1109 acquires member names from the member DB 14a that stores the names of members who are players who can use the golf reservation system S. FIG. The member name acquisition unit 1109 may acquire a name, family name, or first name as a member name. Since the member of the golf reservation system S is extracted as a candidate for the player who gave the score entered in the scorecard, the player name can be appropriately specified from the scorecard.

The member name acquisition unit 1109 may acquire the names of all members, or the names of members who satisfy a predetermined condition. For example, when facility usage information is acquired by the facility usage information acquisition unit 1108, the member name acquisition unit 1109 may acquire the name of the member indicated by the facility usage information among the plurality of members. Since the member who uses the golf course is extracted as a candidate for the player who gave the score entered in the scorecard, the player name can be appropriately specified from the scorecard. Particularly in this embodiment, the member name acquisition unit 1109 may acquire the name of at least one of the reservation person and the accompanying person indicated by the reservation information.

The member name acquisition unit 1109 may acquire the name of the user of the user terminal 3 that has transmitted the photographed image of the score table. There is a probability that the user who took the picture of the score table is the player whose score is entered in the score table. Also, the member name acquisition unit 1109 may acquire the names of the user's golf course associates.

The name specifying unit 1110 creates a score table based on the image portion corresponding to at least one name cell among the name cells specified by the name cell specifying unit 1104 in the captured image acquired by the captured image acquiring unit 1101. Identify the player name listed. For example, based on the cell information, the image portion corresponding to the name cell is specified in the captured image. The captured image acquisition unit 1101 recognizes the written characters from the specified image by character recognition. The captured image acquisition unit 1101 may specify the recognized one or more characters themselves as the player name described in the score table.

When the member name acquisition unit 1109 acquires the member name, the name identification unit 1110 compares the name recognized from the image portion corresponding to the name cell with the name acquired by the member name acquisition unit 1109. to specify the player name. For example, the name identification unit 1110 may calculate the rate of matching between the characters that make up the recognized name and the characters that make up the acquired member name. The match rate may be the percentage of characters that match between the recognized name and the member name out of the total number of characters that make up the recognized name and the number of characters that make up the member name. The member name acquisition unit 1109 may identify a member name whose matching rate with the name recognized from the image is equal to or greater than a predetermined value as the player name described in the score table. If there are a plurality of members whose matching rate with the name recognized from the image is equal to or higher than a predetermined value, the member name acquisition unit 1109 adds the member name with the highest matching rate among those members to the score table. It may be specified as the listed player name. The name identifying unit 1110 may identify player names such that a plurality of player names entered in the score table are different player names (member names). When the member name acquisition unit 1109 acquires the names of the members included in the member list of each group, the name identification unit 1110 recognizes, for each group, the names of all the members of the group and the image of the score table. may be compared with the names of all players provided. The name identification unit 1110 determines that, for all members in the set, the degree of matching with any name recognized from the image is equal to or greater than a predetermined value, and the name for which the maximum degree of matching is calculated is different from the other members. A tuple may be identified as the tuple whose member's name is entered in the score table. Then, the name identification unit 1110 may identify the name of each player from the names of the members of the identified group.

In this embodiment, the name cell identification unit 1104 may identify the name cell by a method other than identifying the cell arrangement that maximizes the total area of four cells. For example, the name cell identification unit 1104 may identify, as a name cell, a cell in which characters likely to be the player's name are recognized as a result of recognizing characters from each cell.

A recognition result output unit 1107 outputs the player name specified by the name specifying unit 1110 . For example, the recognition result output unit 1107 transmits the player name to the user terminal 3 together with score information indicating the score recognized from the captured image. The user terminal 3 may display the player name and score, for example, on the scorecard screen.

If the name recognized from the image portion corresponding to the specified name cell does not correspond to the member name acquired by the member name acquisition unit 1109, the recognition result output unit 1107 may misrecognize the player name. You may output misrecognized player name information suggesting . The name does not correspond may be, for example, the case where there is no member name whose matching rate is equal to or higher than a predetermined value for any name recognized from the image. Since the user who captured the score table is a member of the golf course reservation system S, there is a high probability that the scores of the members of the golf course reservation system S are entered in the score table. Regardless of such circumstances, if the player name recognized from the captured image does not correspond to any member name, there is a possibility of erroneous recognition. The recognition result output unit 1107 may transmit information indicating the possibility of misrecognition to the user terminal 3 as misrecognized player name information. Further, the recognition result output unit 1107 may transmit information indicating a player name that may be misrecognized to the user terminal 3 as misrecognized player name information. As a result, the recognition result output unit 1107 causes the user terminal 3 to display information indicating that there is a possibility of misrecognition of the player name.

FIG. 15 is a diagram showing a display example of the possibility of player name misrecognition. In FIG. 15, the same reference numerals are assigned to the same elements as in FIG. A scorecard screen 500 shown in FIG. 15 includes four player name cells 510, a plurality of score cells 520, a registration button 530, a message 540, misrecognized player name information 550, and the like. The message 540 includes information indicating the possibility of misrecognition, such as "There is a possibility of misrecognition of the player name", "Please check the player name", "Please correct the player name", etc. It may be information prompting confirmation or correction of the name. The erroneously recognized player name information 550 is information indicating the possibility of erroneous recognition of the player name indicated in which player name cell 510 among the four player name cells 510 . For example, the erroneously recognized player name information 550 may be displayed such that the display mode of the cell 510 in which the player name may be misrecognized is different from the display mode of the other cells 510 . Examples of different display modes include cell color, player name font style, thickness or color, and line style, thickness or color surrounding the cell.

[2-2. Operation of Golf Course Reservation System]
Next, the operation of the golf course reservation system S will be described with reference to FIGS. 16 and 17. FIG. FIG. 16 is a sequence diagram showing a processing example of the golf course reservation system according to this embodiment. In FIG. 16, the same steps as in FIG. 11 are assigned the same numbers.

As shown in FIG. 16, steps S1 to S3 are first executed. Next, the golf course reservation server 1 executes a player name identification process for each detected score table, for example (step S21). FIG. 17 is a flowchart showing an example of player name identification processing by the system control unit 11 of the golf course reservation server 1 according to this embodiment. As shown in FIG. 17, the name cell identification unit 1104 recognizes the player name from the portion corresponding to the position of each identified score cell in the image of the score table extracted by the name cell identification process (step S301). . For example, the name cell identifying unit 1104 uses a learned CNN to recognize the player name from the image.

Next, the member name acquisition unit 1109 acquires the name of the user from the member information stored in the member DB 14a in association with the user ID of the user of the user terminal 3 that has transmitted the captured image (step S302). Next, the facility usage information acquisition unit 1108 acquires reservation information from the reservation information DB 14d (step S303). For example, the facility usage information acquisition unit 1108 may acquire reservation information of a golf course and a play date specified from the position information added to the captured image. Next, the member name acquisition unit 1109 acquires the names of the reservation person and the accompanying person based on the acquired reservation information (step S304). For example, the member name acquisition unit 1109 acquires the user ID of the person who made the reservation from the reservation information. Also, the member name acquisition unit 1109 acquires the user ID of each companion from the member list included in the reservation information. The member name acquisition unit 1109 acquires the name from the member information stored in the member DB 14a in association with each of these user IDs.

Next, the name cell identification unit 1104 sets the player number M to 1 (step S305). Next, the name cell identification unit 1104 calculates the match rate between the M-th player name among the recognized player names and each player name obtained in steps S302 and S304 (step S306). Next, the name cell identifying unit 1104 determines whether or not the maximum matching rate among the calculated matching rates is less than a predetermined threshold (step S307). If the maximum match rate is less than the threshold (step S307: YES), the name cell identifying unit 1104 determines that there is a possibility of misrecognition of the M-th player name (step S308).

If the maximum match rate is not less than the threshold (step S307: NO), or after step S308, the name cell identification unit 1104 determines whether the number M is smaller than the number of recognized player names. (Step S309). If the number M is smaller than the number of player names (step S309: YES), the name cell specifying unit 1104 increments the number M by 1 (step S310), and the process proceeds to step S306.

On the other hand, if the number M is not smaller than the number of player names (step S309: NO), the name cell identification unit 1104 determines each player name to be displayed on the user terminal 3 based on the calculated match rate. (Step S311). For example, the name cell identification unit 1104 may determine the member name with the highest matching rate among the member names whose matching rate with the player name recognized from the image is equal to or higher than the threshold as the player name to be displayed. good. When a player name whose maximum matching rate is less than a threshold value is recognized from the captured image, the name cell identifying unit 1104 may determine the player name itself as the player name to be displayed.

Next, the name cell identifying unit 1104 generates erroneously recognized player name information indicating the player name determined to be possibly erroneously recognized in step S308 (step S312), and the player name identifying process ends.

When the player name specifying process ends, step S4 is executed as shown in FIG. Next, the recognition result output unit 1107 transmits the score information recognized from the captured image, the player name, and the incorrectly recognized player name information to the user terminal 3 (step S22).

The user terminal 3 displays the score information and the player name received from the golf course reservation server 1 on the scorecard screen (step S23). Next, the user terminal 3 determines whether there is a possibility of erroneous recognition based on the erroneously recognized player name information (step S24). If there is a possibility of misrecognition (step S24: YES), the user terminal 3 displays a message indicating the possibility of misrecognition and misrecognition player name information on the scorecard screen (step S25).

If there is no possibility of misrecognition (step S24: NO), or after step S25, the user corrects the player name and score as necessary (step S26). The user terminal 3 transmits the final player name and score information to the golf course reservation server 1 together with the user ID of the user terminal 3 (step S8).

The golf course reservation server 1 associates the player name, score information, golf course and playing date received from the user terminal 3 with the user ID received from the user terminal 3 and stores them in the score DB 14f (step S27). Here, if the player name includes the name of the user of the user terminal 3 that has transmitted the score information, the golf course reservation server 1 may store the corresponding score information as the score information of that user. . Of the player names, a player name other than the name of the user of the user terminal 3 may be determined as the companion name. The golf course reservation server 1 may store the name of the companion and the corresponding score information as companion score information. Further, when the companion name is the first name of the member acquired in the player name identification process, the golf course reservation server 1 associates the member's user ID with the companion's score information, the golf course ID, and the golf course ID. The date may be stored in the score DB 14f.

As described above, according to the present embodiment, the golf course reservation server 1 selects a player's identify the first name. Also, the golf course reservation server 1 outputs information indicating the specified name. Therefore, it is possible to specify and output the player name entered in the score table.

Here, the golf course reservation server 1 may acquire member names from the storage unit 14 that stores the names of a plurality of members who can use the golf reservation system S. Alternatively, the golf course reservation server 1 may specify the player name based on a comparison between the name recognized from the image portion corresponding to the name cell and the acquired member name. In this case, it is possible to appropriately identify the player name entered in the score table.

Here, the golf course reservation server 1 may acquire facility usage information indicating a player who uses the golf course among the plurality of players. Further, the golf course reservation server 1 may acquire the player name indicated by the acquired facility usage information among the plurality of players. In this case, the player name entered in the score table is highly likely to be the name of the player who uses the golf course, so the player name entered in the score table can be appropriately specified.

Here, the golf course reservation server 1 makes a reservation indicating at least one of a person who made a reservation to use the golf course and a companion who plans to play golf at the reserved golf course together with the person who made the reservation. The information may be acquired as facility usage information. In this case, there is a high possibility that the player name entered in the score table is the name of a player who plans to play golf using the golf course. can.

Further, if the golf course reservation server 1 does not match the name recognized from the image portion corresponding to the name cell and the member name of the golf course reservation system S, an erroneous recognition suggesting the possibility of erroneous recognition of the name. Player name information may be output. In this case, if the name recognized from the score table and the member name of the golf reservation system S do not correspond, the possibility of erroneous recognition of the player name is suggested. Therefore, the user can correct the player name in response to the suggestion of misrecognition.

[3. Third Embodiment]
Next, a third embodiment will be described. In this embodiment, the golf course reservation server 1 uses check-in information of the golf course to identify the player name from the photographed image of the score table. Except for the points described below, this embodiment may be the same as the second embodiment.

[3-1. Function overview of the system control unit]
Next, a functional overview of the system control unit 11 will be described. The facility usage information acquisition unit 1108 acquires check-in information as facility usage information. The check-in information indicates the player who has started using the golf course. Here, the facility usage information acquisition unit 1108 may acquire check-in information indicating that the play date is today. Alternatively, when position information is added to the captured image, the facility usage information acquisition unit 1108 may acquire check-in information of the golf course and play date specified by the position information added to the captured image. Alternatively, the dedicated application and the golf course reservation server 1 may be configured so that the user can select the golf course where the user played golf and the date of play. In this case, the facility usage information acquisition unit 1108 may acquire check-in information for the golf course and play date selected by the user.

The member name acquisition unit 1109 acquires the member's name indicated by the check-in information acquired by the facility usage information acquisition unit 1108 . The name identification unit 1110 identifies the player name based on a comparison between the name recognized from the image portion corresponding to the name cell and the name of the checked-in member obtained by the member name obtaining unit 1109 .

[3-2. Operation of Golf Course Reservation System]
Next, the operation of the golf course reservation system S will be explained using FIG. FIG. 18 is a flowchart showing an example of player name identification processing by the system control unit 11 of the golf course reservation server 1 according to this embodiment. In FIG. 18, the same steps as in FIG. 17 are given the same numbers.

As shown in FIG. 18, steps S301 and S302 are first performed. Next, the facility usage information acquisition unit 1108 acquires check-in information from the check-in DB 14e (step S321). Next, the member name acquisition unit 1109 acquires the name of the user who has checked in based on the acquired check-in information (step S322). For example, the member name acquisition unit 1109 acquires the user ID of the user who has checked in from the check-in information. The member name acquisition unit 1109 acquires the name from the member information stored in the member DB 14a in association with the acquired user ID. Next, steps S305 to S312 are executed, and the player name specifying process ends.

As described above, according to the present embodiment, the golf course reservation server 1 acquires, as facility usage information, check-in information indicating a player who has completed procedures to start using the golf course at the golf course. In this case, the name of the player who checked in is used to identify the player name entered in the score table. Since there is a high possibility that the player name entered in the score table is the name of the player who started using the golf course, the player name entered in the score table can be appropriately specified.

[4. Fourth Embodiment]
Next, a fourth embodiment will be described. In this embodiment, when the score recognized from the image of the score table deviates from the standard, the golf course reservation server 1 outputs information indicating that the score may be misrecognized. do. Except for the points described below, this embodiment may be the same as any of the first to third embodiments.

[4-1. Function overview of the system control unit]
Next, a functional overview of the system control unit 11 will be described with reference to FIGS. 19 and 20. FIG. FIG. 19 is a diagram showing an example of functional blocks of the system control unit 11 in the golf course reservation server 1 according to this embodiment. In FIG. 19, the same reference numerals are assigned to the same elements as in FIG. In this embodiment, the system control unit 11 includes a captured image acquisition unit 1101, a cell information acquisition unit 1102, a hall number cell identification unit 1103, a name cell identification unit 1104, a score cell identification unit 1105, a score identification unit 1106, and a recognition result output unit. 1107, the reference score acquisition unit 1111 and the like.

The reference score acquisition unit 1111 acquires a reference score in golf. A baseline score may be, for example, a standard, typical, normal or average score. For example, a predetermined reference score may be stored in the storage unit 14 for each prescribed number of strokes. Further, a predetermined reference gross score may be stored in the storage unit 14 . The reference score acquisition unit 1111 may acquire, for example, a standard, common, normal, or average score range as the reference score.

Alternatively, the reference score acquisition unit 1111 acquires a reference score based on the score DB 14f that stores score information indicating a score obtained by playing golf at a golf course reserved using the golf reservation system S. may For example, the reference score acquisition unit 1111 may acquire the statistical value of scores stored in the score DB 14f as the reference score. Examples of score statistics include mean, median, and mode. The reference score acquisition unit 1111 may calculate a score statistic for each prescribed number of strokes. In addition, the reference score acquisition unit 1111 may calculate a gross score statistical value. The reference score acquisition unit 1111 may acquire an appropriate score range as the reference score, for example, based on the average value and standard deviation of the scores. If it is possible to specify which golf course score was entered in the scorecard, the reference score obtaining unit 1111 obtains the reference score based on the score information associated with the golf course ID of the golf course. You may For example, a dedicated application may be configured to allow the user to select a golf course where the user has played when sending a shot image of a scorecard. Alternatively, the reference score acquisition unit 1111 may specify the golf course from the position information added to the captured image. The reference score acquisition unit 1111 may periodically calculate the statistical value of the score and store the statistical value in advance in the storage unit 14 .

The recognition result output unit 1107 determines the possibility of misrecognition of the score based on the comparison result between the score recognized from the image of the score table by the score specifying unit 1106 and the reference score acquired by the reference score acquisition unit 1111. False recognition score information suggesting is output. For example, the score cell identification unit 1105 may determine that misrecognition may occur when the difference between the recognized score and the reference score is equal to or greater than a predetermined value. The score cell identification unit 1105 may determine the possibility of misrecognition for each hole. Also, the score cell identification unit 1105 may determine the possibility of gross score recognition. Alternatively, the score cell identifying unit 1105 may determine that there is a possibility of erroneous recognition when the recognized score is outside the range of the standard score. The recognition result output unit 1107 may transmit information indicating the possibility of misrecognition to the user terminal 3 as misrecognition score information. Further, the recognition result output unit 1107 may transmit information indicating a score (combination of a player and a hole) with a possibility of misrecognition to the user terminal 3 as misrecognition score information. As a result, the recognition result output unit 1107 causes the user terminal 3 to display information indicating that there is a possibility of misrecognition of the score.

FIG. 20 is a diagram showing a display example of the possibility of misrecognition of scores. In FIG. 20, the same reference numerals are assigned to the same elements as in FIG. A scorecard screen 500 shown in FIG. 20 includes four player name cells 510, a plurality of score cells 520, a registration button 530, a message 560, misrecognized score name information 570, and the like. The message 560 includes information indicating the possibility of misrecognition, score confirmation or It may be information prompting correction. The misrecognition score information 570 is information indicating the possibility of misrecognition of the score indicated in which score cell 520 among the score cells 520 . For example, the misrecognition score information 570 may be displayed such that the cell 520 in which there is a possibility of score misrecognition is displayed differently from the other cells 520 . Examples of different display modes include cell color, score font style, thickness or color, line style, thickness or color surrounding the cell, and the like.

As in the case of the second embodiment or the third embodiment, the system control unit 11 recognizes the player name from the part corresponding to the specified name cell in the image of the score table, and recognizes the player name together with the score information. The first name may be sent to the user terminal 3. Further, the system control unit 11 may determine whether or not there is a possibility of misrecognition of the player name, and transmit misrecognized player name information to the user terminal 3 based on the result of this determination.

[4-2. Operation of Golf Course Reservation System]
Next, the operation of the golf course reservation system S will be described with reference to FIGS. 21 and 22. FIG. FIG. 21 is a sequence diagram showing a processing example of the golf course reservation system according to this embodiment. In FIG. 21, the same steps as in FIG. 11 are assigned the same numbers. As shown in FIG. 21, steps S1 to S3 are executed first. Next, the golf course reservation server 1 executes score identification processing, for example, for each detected score table (step S41).

FIG. 22 is a flowchart showing an example of score identification processing by the system control unit 11 of the golf course reservation server 1 according to this embodiment. In FIG. 22, the same steps as in FIG. 13 are assigned the same numbers. As shown in FIG. 22, steps S201 and S202 are first executed.

Next, the score identification unit 1106 sets the player number M to 1 (step S221). Next, the score identification unit 1106 sets the hole number N to 1 or 10, which is the initial value, based on the hole number cell identification result (step S222). Next, the score identification unit 1106 acquires the average score of the Nth hole (step S223). For example, the score identification unit 1106 may recognize the prescribed number of strokes for each hole by character recognition from the image of the score table. The score cell identifying unit 1105 may acquire the score of the hole with the same number of strokes as the number of strokes of the N-th hole from the score information stored in the score DB 14f. Then, the score identification unit 1106 may calculate the average value of the obtained scores. Alternatively, when the played golf course is identified, the score identification unit 1106 may acquire the score of the Nth hole from the score information stored in the score DB 14f associated with the golf course ID of the golf course. good. Then, the score identification unit 1106 may calculate the average value of the obtained scores.

Next, the score identifying unit 1106 determines that the difference between the score for the Nth hole among the scores recognized from the array of score cells corresponding to the name cell of the Mth player in the score table and the obtained average value is a predetermined value. is less than the threshold value (step S224). If the difference between the score for the Nth hole of the Mth player and the average value is not less than the threshold (step S224: NO), the score identification unit 1106 determines that the score for the Nth hole of the Mth player may have been misrecognized. It is determined that there is a possibility (step S225).

If the difference between the score for the Nth hole of the Mth player and the average value is less than the threshold (step S224: YES), or after step S225, the score specifying unit 1106 adds 8 to the initial value of the hole number. to calculate the maximum hole number. Therefore, the score identification unit 1106 obtains 9 or 18 as the maximum value. Then, the score specifying unit 1106 determines whether or not the hole number N is less than the maximum value (step S226). If the hole number N is less than the maximum value (step S226: YES), the score specifying unit 1106 increases the hole number N by 1 (step S227), and the process proceeds to step S223.

On the other hand, if the hole number N is not less than the maximum value (step S226: NO), the score identification unit 1106 determines whether or not the player number M is less than 4 (step S228). If the player number M is less than 4 (step S228: YES), the score identification unit 1106 increases the player number M by 1 (step S229), and the process proceeds to step S222.

On the other hand, if the player number M is not less than 4 (step S228: NO), the score identification unit 1106 generates misrecognition score information indicating the score determined to have the possibility of misrecognition in step S225 ( Step S230), the score identification process ends.

When the score identification process ends, as shown in FIG. 21, the recognition result output unit 1107 transmits the score information and misrecognition score information recognized from the captured image to the user terminal 3 (step S42).

The user terminal 3 displays the score on the scorecard screen based on the score information (step S6). Next, the user terminal 3 determines whether or not there is a possibility of misrecognition of the score based on the misrecognition score information (step S43). If there is a possibility of misrecognition (step S43: YES), the user terminal 3 displays a message indicating the possibility of misrecognition and misrecognition score information on the scorecard screen (step S44). If there is no possibility of erroneous recognition (step S43: NO), or after step S44, steps S7 to S9 are executed.

As described above, according to the present embodiment, the golf course reservation server 1 acquires a standard score in golf. Further, the golf course reservation server 1 outputs misrecognition score information suggesting the possibility of misrecognition of the score based on the result of comparison between the score recognized from the score table and the reference score. Therefore, the user can correct the score according to the suggestion of misrecognition.

Here, the golf course reservation server 1 may acquire a reference score based on the score stored in the storage unit 14 in the golf course reserved using the golf reservation system S. In this case, an erroneous score recognition is suggested based on a comparison between the score recognized from the score table and the score obtained in past play at the golf course reserved using the golf reservation system S. . Therefore, it is possible to appropriately suggest misrecognition of the score by using the score of actual past play.

Here, the golf course reservation server 1 may acquire the score statistics stored in the storage unit 14 as the reference score. In this case, for example, a past standard score is used, so it is possible to appropriately suggest misrecognition of the score.

[5. Fifth Embodiment]
Next, a fifth embodiment will be described. In this embodiment, the golf course reservation server 1 recognizes the player name from the image of the name cell specified in the score table. At this time, the golf course reservation server 1 uses the name of the member of the golf course reservation system S to identify the player name. Further, the golf course reservation server 1 acquires the past score of the member whose name is recognized from the image of the score table as a reference score. Then, if the score recognized from the image of the score table deviates from the member's past score, the golf course reservation server 1 provides information indicating the possibility of erroneous recognition of the score. Output. Except for the points described below, this embodiment may be the same as the fourth embodiment.

[5-1. Function overview of the system control unit]
Next, a functional overview of the system control unit 11 will be described with reference to FIG. 23 . FIG. 23 is a diagram showing an example of functional blocks of the system control unit 11 in the golf course reservation server 1 according to this embodiment. In FIG. 23, the same reference numerals are assigned to the same elements as in FIG. 14 or FIG. In this embodiment, the system control unit 11 includes a captured image acquisition unit 1101, a cell information acquisition unit 1102, a hall number cell identification unit 1103, a name cell identification unit 1104, a score cell identification unit 1105, a score identification unit 1106, and a recognition result output unit. 1107, member name acquisition unit 1109, name identification unit 1110, reference score acquisition unit 1111, and the like.

The functions of the member name acquisition unit 1109 and the name identification unit 1110 may be the same as in the case of the second embodiment or the third embodiment. Here, the name identifying unit 1110 identifies the name of any one of the members of the golf course reservation system S as the player name entered on the scorecard.

The reference score obtaining unit 1111 obtains, as a reference score, the score of the player who obtained the score recognized from the image portion corresponding to the specified score cell in the captured image among the scores stored in the score DB 14f. For example, the reference score obtaining unit 1111 obtains score information associated with the user ID of the member having the player name identified by the name identifying unit 1110 based on the image portion corresponding to the name cell. If it is possible to specify which golf course score was entered in the scorecard, the reference score acquisition unit 1111 obtains the golf course ID of the golf course and the user ID of the member whose player name is specified. Associated score information may be obtained. When a plurality of pieces of score information are acquired, the reference score acquisition unit 1111 may acquire statistical values of the plurality of scores as a reference score. The method of calculating statistical values may be the same as in the fourth embodiment. The reference score acquisition unit 1111 may calculate a score statistic for each hole or for each prescribed number of strokes, for example. In addition, the reference score acquisition unit 1111 may calculate a statistic value of the gross score.

The score identification unit 1106 may determine that there is a possibility of misrecognition when the difference between the recognized score and the reference score is equal to or greater than a predetermined value. Recognition result output section 1107 outputs misrecognition score information based on the determination result by score cell identification section 1105 . The method of determining erroneous recognition and the method of outputting erroneous recognition score information may be the same as in the fourth embodiment.

It should be noted that the system control unit 11 may not specify the player by character recognition from the captured image of the score table, but the user may select each player when capturing the score table, for example. As in the second or third embodiment, the system control unit 11 determines whether or not there is a possibility of misrecognition of the player name, and based on the result of this determination, generates misrecognized player name information. It may be transmitted to the user terminal 3.

[5-2. Operation of Golf Course Reservation System]
Next, the operation of the golf course reservation system S will be described with reference to FIGS. 24 and 25. FIG. FIG. 24 is a sequence diagram showing a processing example of the golf course reservation system according to this embodiment. In FIG. 24, the same steps as in FIG. 16 or 21 are given the same numbers. As shown in FIG. 24, steps S1 to S3 and S21 are executed first. Next, the golf course reservation server 1 executes score identification processing, for example, for each detected score table (step S61).

FIG. 25 is a flowchart showing an example of score identification processing by the system control unit 11 of the golf course reservation server 1 according to this embodiment. In FIG. 25, the same steps as in FIG. 22 are assigned the same numbers. As shown in FIG. 25, steps S201, S202 and S221 are first executed.

Next, the reference score acquisition unit 1111 acquires the score information of the M-th player (step S241). For example, the reference score acquisition unit 1111 acquires score information stored in the score DB 14f in association with the user ID of the user with the Mth player name.

Next, the reference score acquisition unit 1111 sets the initial value of the hole number N (step S222). Next, the reference score obtaining unit 1111 obtains the score of the Nth hole from the score information obtained in step S241 (step S242). For example, the reference score acquisition unit 1111 may acquire a score that is played in the same number of strokes as the number of strokes for the Nth hole. Alternatively, if there is score information when the M-th player has played at the same golf course in the past, the reference score acquisition unit 1111 may acquire the score of the N-th hole of that golf course. Next, the reference score obtaining unit 1111 calculates the average value of the obtained scores (step S243).

Next, the score identification unit 1106 determines that the difference between the score of the Nth hole among the scores recognized from the array of score cells corresponding to the name cell of the Mth player in the score table and the obtained average value is the threshold value. It is determined whether or not it is less than (step S224). If the difference between the score for the Nth hole of the Mth player and the average value is not less than the threshold (step S224: NO), the score identification unit 1106 determines that the score for the Nth hole of the Mth player may have been misrecognized. It is determined that there is a possibility (step S225).

If the difference between the score for the Nth hole of the Mth player and the average value is less than the threshold (step S224: YES), or after step S225, the score specifying unit 1106 adds 8 to the initial value of the hole number. to calculate the maximum hole number. Then, the score specifying unit 1106 determines whether or not the hole number N is less than the maximum value (step S226). If the hole number N is less than the maximum value (step S226: YES), the score specifying unit 1106 increases the hole number N by 1 (step S227), and the process proceeds to step S242.

On the other hand, if the hole number N is not less than the maximum value (step S226: NO), the score identification unit 1106 determines whether or not the player number M is less than 4 (step S228). If the player number M is less than 4 (step S228: YES), the score identification unit 1106 increases the player number M by 1 (step S229), and the process proceeds to step S222.

On the other hand, if the player number M is not less than 4 (step S228: NO), the score identification unit 1106 generates erroneous recognition score information (step S230), and ends the score identification process.

When the score identification process ends, as shown in FIG. 24, the recognition result output unit 1107 transmits the score information recognized from the captured image, the player name, and the incorrectly recognized score information to the user terminal 3 (step S62).

The user terminal 3 displays the score information and the player name on the scorecard screen (step S23). Next, the user terminal 3 determines whether or not there is a possibility of misrecognition of the score (step S43). If there is a possibility of misrecognition (step S43: YES), the user terminal 3 displays a message indicating the possibility of misrecognition and misrecognition score information (step S44).

If there is no possibility of erroneous recognition (step S43: NO), or after step S44, steps S26, S8 and S27 are executed.

As described above, according to the present embodiment, the golf course reservation server 1 uses the score of the member who obtained the score recognized from the photographed image of the score table among the scores stored in the storage unit 14 as the reference score. obtained as a score of Therefore, the past score of the player whose score is entered in the score table is used to suggest an erroneous recognition of the score. Therefore, misrecognition of the score can be suggested appropriately.

Here, the golf course reservation server 1 may acquire from the storage unit 14 the score of the member identified based on the character recognition of the image portion corresponding to the identified name cell in the photographed image of the score table. . In this case, the player whose name is entered in the score table is specified based on the photographed image of the score table, and the player's past score is used to suggest an erroneous score recognition. Therefore, the user can omit the task of selecting the player who scored.

[6. Other embodiments]
In the embodiments described so far, the invention has been applied to golf. However, the present invention may be applied to sports other than golf in which a predetermined number of players can compete for scores. Examples of competitions include sports, games, and the like. A competition entity is the entity that plays the competition. A player, a team, etc. are mentioned as an example of a competition subject. Each subject earns a score by playing the competition. The score obtained can be entered in the score table. Examples of score tables include score cards, score sheets, score boards, and the like.

The number of competition subjects competing for scores is basically two or more. The number of competing entities competing for score or the upper limit of the number of competing entities competing for score may be determined by, for example, the rules of the competition, the practices of the competition, the rules of the venue where the competition is played, and the like. In the score table image processing device of the present invention, the cell having the largest total area of the number of cells in a plurality of arrays composed of the number of cells according to the rules, customs, rules, etc. of the target competition may specify the sequence of cells in which the name of the subject is entered.

For the same reason as described above, in the score table, the name cell in which the name of the contestant is entered is likely to be larger than the cell in which the stage number is displayed or the score is entered. There may be cells that are by themselves larger than the name cell. However, name cells are ordered consecutively. Considering the total area of a predetermined number of consecutively arranged cells, it is unlikely that there exists a row of cells with a larger area than the row of name cells. Therefore, the present invention is applicable to various competitions.

In the target competition, it may be possible to obtain a score at each of a plurality of predetermined stages. A stage indicates, for example, a place, period, times, etc., in which a competition is played. A score is calculated for each stage. Winning or losing may be determined by summing the scores of all stages. These stages may also be determined by, for example, rules, conventions, rules, and the like. For example, in golf, each stage is a hole. The total score of all 18 holes from the 1st hole to the 18th hole determines the result. Further, golf courses are divided into an OUT course consisting of the 1st to 9th holes and an IN course consisting of the 10th to 18th holes. Therefore, in the case of golf, the predetermined plurality of stages may be, for example, the 1st to 9th holes, the 10th to 18th holes, or the 1st to 18th holes.

The score table image processing device of the present invention may be applied to a device that executes processing related to reservation of a facility where the target competition can be played, or may be applied to a device that does not execute processing related to reservation. The facility itself where the competition can be played may or may not be reservable. Grounds, courts, courses, and the like are examples of facilities where competitions can be played.

The score table image processing device of the present invention may be applied to a terminal device capable of capturing a score table instead of a server device.

Baseball is an example of sports to which the present invention can be applied. In the case of baseball, two teams compete for scores. For example, scores for two teams can be entered on the scoreboard. For example, a player, manager, or other person of any team takes a picture of the scoreboard with a terminal device. The captured image is transmitted from the terminal device to the score table image processing device. The score table image processing device identifies, from among a plurality of rows of two cells, the row of cells having the maximum total area of the two cells as the row of cells in which the team name is written. may A stage in baseball is an inning. The score table image processor may identify consecutive cells each containing an inning number from 1-9.

Mahjong is an example of a game to which the present invention can be applied. In mahjong, four players compete for scores. For example, scores for four players can be entered on the score sheet. Mahjong may be played by three players, but it is sufficient if the scores for four players can be entered on the score sheet. For example, any player shoots the scoreboard. The score table image processing device identifies the row of cells in which the sum of the areas of the four cells is the largest among the plurality of rows of four cells as the row of cells in which the player names are entered. may

1 golf course reservation server 2 golf course terminal 3 user terminal 11 system control unit 12 system bus 13 input/output interface 14 storage unit 14a member DB
14b Golf friends DB
14c Golf Course DB
14d Reservation information DB
14e Check-in DB
14f Score DB
NW network 1101 captured image acquisition unit 1102 cell information acquisition unit 1103 hall number cell identification unit 1104 name cell identification unit 1105 score cell identification unit 1106 score identification unit 1107 recognition result output unit 1108 facility usage information acquisition unit 1109 member name acquisition unit 1110 name identification Unit 1111 Reference score acquisition unit

Claims (9)

an image acquisition means for acquiring a photographed image of a score table of a predetermined competition in which scores can be competed among a predetermined number of competition subjects;
a name cell specifying means for specifying a name cell in which the name of the main subject is entered from among the cells included in the score table from the acquired photographed image;
a name acquisition means for acquiring the names from a storage means for storing the names of a plurality of competition subjects who can use a system for reserving a facility where the competition can be played;
a name specifying means for specifying the name of the main subject based on a comparison between the name recognized from the image portion corresponding to the specified name cell in the acquired photographed image and the acquired name; ,
A score table image processing device comprising: 2. The score table image processing apparatus according to claim 1, further comprising name output means for outputting name information indicating said specified name. Further comprising facility usage information acquisition means for acquiring facility usage information indicating a competition subject that uses the facility among the plurality of competition subjects,
3. The score table image processing apparatus according to claim 1, wherein the name acquisition means acquires the name of the competition subject indicated by the acquired facility usage information among the plurality of competition subjects. . The facility use information acquisition means is configured to indicate at least one of a competition subject who has reserved use of the facility and a competition subject who is scheduled to play the competition at the reserved facility together with the competition subject. 4. The score table image processing device according to claim 3, wherein usage information is acquired. 5. The score table image processing apparatus according to claim 3, wherein the facility usage information acquiring means acquires the facility usage information indicating a competition subject who has performed a procedure to start using the facility at the facility. . Misrecognized name information for outputting misrecognized name information suggesting the possibility of misrecognition of the name when the name recognized from the image portion corresponding to the name cell does not correspond to the acquired name. 6. The score table image processing apparatus according to claim 1, further comprising output means. 7. The score table image processing device according to claim 1, wherein the game is golf. In a computer-implemented score table image processing method,
an image acquisition step of acquiring a photographed image of a score table of a predetermined competition in which scores can be competed among a predetermined number of competition subjects;
a name cell identifying step of identifying a name cell in which the name of the subject is entered from among the cells included in the score table from the acquired photographed image;
a name acquisition step of acquiring the names from a storage means for storing the names of a plurality of competition subjects who can use a system for reserving a facility where the competition can be played;
a name specifying step of specifying the name of the competition subject based on a comparison between the name recognized from the image portion corresponding to the specified name cell in the acquired photographed image and the acquired name; ,
A score table image processing method comprising: the computer,
an image acquisition means for acquiring a photographed image of a score table of a predetermined competition in which scores can be competed among a predetermined number of competition subjects;
a name cell specifying means for specifying a name cell in which the name of the main subject is entered from among the cells included in the score table from the acquired photographed image;
a name acquisition means for acquiring the names from a storage means for storing the names of a plurality of competition subjects who can use a system for reserving a facility where the competition can be played;
Name identifying means for identifying the name of the subject based on a comparison between the name recognized from the image portion corresponding to the identified name cell in the obtained photographed image and the obtained name;
A score table image processing program characterized by functioning as

Images