JP2018151720A - Vacant seat detection program, vacant seat detection device, and vacant seat detection method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a vacant seat detection program capable of allowing a user to view the number of persons to be able to enter a store as a set, a vacant seat detection device, and a vacant seat detection method.SOLUTION: An imaging device having an imaging range covering a store room captures a photographed image. A plurality of vacant seats contained in the captured photographed image are extracted, presence or no-presence of two or more vacant seats having a prescribed relation among the plurality of vacant seats is determined, and output is made according to the determination result. The process is executed by a computer.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an empty seat detection program, an empty seat detection device, and an empty seat detection method.

  2. Description of the Related Art In recent years, restaurants such as restaurants (hereinafter also simply referred to as stores) have introduced reservation systems that allow customers to make reservations via websites. Specifically, for example, each store posts information on the number of people that can enter the store (number of people that can be reserved) for each time slot on the website of each store. Then, the user browses the website of each store and makes a reservation at a desired date and time.

  Thereby, the user can make a reservation without making a telephone call to the store, for example (see, for example, Patent Documents 1 and 2).

JP 2005-234661 A JP 2014-071703 A

  However, in the reservation system as described above, the number of people who can enter the store is simply displayed, and the user cannot confirm, for example, how many seats are available.

  Accordingly, an object of one embodiment is to provide a vacant seat detection program, a vacant seat detection device, and a vacant seat detection method that allow a user to view how many people can enter a store.

  According to one aspect of the embodiment, a captured image captured by an imaging device including the inside of a store in an imaging range is acquired, a plurality of vacant seats included in the acquired captured image are extracted, and the plurality of vacant seats The computer determines whether or not there are two or more vacant seats having a predetermined relationship, and causes the computer to execute a process of outputting according to the result of the determination.

  According to one aspect, it is possible to make a user browse how many people can enter a store.

FIG. 1 is a diagram illustrating an overall configuration of the information processing system 10. FIG. 2 is a flowchart for explaining the outline of the vacant seat detection process in the first embodiment. FIG. 3 is a diagram illustrating the hardware configuration of the information processing apparatus 1. FIG. 4 is a functional block diagram of the information processing apparatus 1. FIG. 5 is a flowchart for explaining details of the vacant seat detection process in the first embodiment. FIG. 6 is a flowchart for explaining details of the vacant seat detection process in the first embodiment. FIG. 7 is a flowchart for explaining details of the vacant seat detection process in the first embodiment. FIG. 8 is a diagram illustrating a specific example of tables and seats installed in each store. FIG. 9 is a diagram for explaining a specific example of the table management information 131. FIG. 10 is a diagram for explaining a specific example of the table attribute information 132. FIG. 11 is a diagram illustrating a specific example of tables and seats installed in each store during business hours. FIG. 12 is a diagram for explaining a specific example of the vacant seat management information 133. FIG. 13 is a diagram illustrating a specific example of tables and seats installed in each store during business hours. FIG. 14 is a diagram illustrating a specific example of a screen including the processing result of the vacant seat detection process. FIG. 15 is a diagram illustrating a specific example of vacant seat detection processing. FIG. 16 is a diagram illustrating a specific example of vacant seat detection processing. FIG. 17 is a diagram illustrating a specific example of the vacant seat detection process. FIG. 18 is a diagram illustrating a specific example of vacant seat detection processing.

[Configuration of information processing system]
FIG. 1 is a diagram illustrating an overall configuration of the information processing system 10. An information processing system 10 illustrated in FIG. 1 includes an information processing device 1 having a storage unit 130 (hereinafter also referred to as a vacant seat detection device 1), an imaging device 2, and an operation terminal 3. In the information processing system 10 shown in FIG. 1, the imaging device 2 includes imaging devices 2a, 2b, and 2c.

  The imaging device 2 is, for example, a camera installed in each store, and captures the situation in the store at least during the business hours of the store.

  The information processing apparatus 1 is composed of one or more physical machines. For example, the information processing device 1 acquires a moving image (image) captured by the imaging device 2 and executes a process of detecting a vacant seat in each store (hereinafter also referred to as a vacant seat detection process). Specifically, the information processing apparatus 1 performs vacancy detection processing by referring to various types of information stored in the storage unit 130 (for example, information stored in advance by a person in charge at each store). In the example shown in FIG. 1, the information processing apparatus 1 is connected to each imaging apparatus 2 via a network NW such as the Internet network.

  The operation terminal 3 is, for example, a PC (Personal Computer) installed in each store. The person in charge at each store inputs various information to the information processing apparatus 1 via the operation terminal 3. Hereinafter, an outline of the vacant seat detection process in the first embodiment will be described.

[Outline of First Embodiment]
FIG. 2 is a flowchart for explaining the outline of the vacant seat detection process in the first embodiment.

  As shown in FIG. 2, the information processing apparatus 1 stands by until a captured image in the store is acquired (NO in S1). Specifically, the information processing apparatus 1 may stand by until a captured image transmitted by each imaging apparatus 2 is received, for example. In addition, each imaging device 2 may transmit a captured image at regular timing, for example, at intervals of 10 minutes.

  And when the captured image in a store is acquired (YES of S1), the information processing apparatus 1 extracts the some vacant seat contained in the captured image acquired by the process of S1 (S2). Specifically, for example, the information processing apparatus 1 determines that a seat in the vacant seat state that is not less than a predetermined threshold among seats included in the captured image acquired in the process of S1 is a vacant seat. The vacant seat state is, for example, a state where there is no object that moves in each seat.

  Furthermore, the information processing apparatus 1 determines whether there are two or more vacant seats having a predetermined relationship among the plurality of vacant seats extracted in the process of S2 (S3). The predetermined relationship is, for example, a relationship arranged continuously at a counter in the store, a relationship arranged in the same table in the store, or a relationship arranged in a plurality of adjacent tables in the store.

  Thereafter, the information processing apparatus 1 outputs according to the determination result in the process of S3 (S4). Specifically, the information processing apparatus 1 outputs information indicating two or more vacant seats having a predetermined relationship.

  That is, the information processing apparatus 1 has two or more vacant seats in which two or more new users (new customers) can be seated from the captured images taken by the imaging apparatus 2 installed in each store. It is determined whether or not a set of exists. Then, for example, the information processing apparatus 1 specifies and outputs the maximum number of vacant seats among the two or more existing vacant seats.

  As a result, the information processing apparatus 1 allows the user to browse the current number of people that can enter the store (information indicating how many people can enter the store). Therefore, for example, the user can make a reservation while referring to the current number of people who can enter the store. Further, since the person in charge at each store automatically updates the information indicating the current number of people who can enter the store, it is not necessary to perform an input operation of information indicating the current number of people who can enter the store.

[Hardware configuration of information processing device]
Next, the hardware configuration of the information processing apparatus 1 will be described. FIG. 3 is a diagram illustrating the hardware configuration of the information processing apparatus 1.

  As illustrated in FIG. 3, the information processing apparatus 1 includes a CPU 101 that is a processor, a memory 102, an external interface (I / O unit) 103, and a storage medium (storage) 104. Each unit is connected to each other via a bus 105.

  The storage medium 104 stores a program 110 for performing vacant seat detection processing in a program storage area (not shown) in the storage medium 104.

  As shown in FIG. 3, when executing the program 110, the CPU 101 loads the program 110 from the storage medium 104 to the memory 102 and performs vacancy detection processing in cooperation with the program 110.

  The storage medium 104 includes, for example, a storage unit 13 (hereinafter also referred to as an information storage area 130) that stores information used when performing vacant seat detection processing. The external interface 103 communicates with each imaging device 2 and the operation terminal 3.

[Functions of information processing device]
Next, a functional block diagram of the information processing apparatus 1 will be described. FIG. 4 is a functional block diagram of the information processing apparatus 1.

  As shown in FIG. 4, the CPU 101 of the information processing apparatus 1 cooperates with the program 110 to output an information management unit 111, an image acquisition unit 112, a vacant seat extraction unit 113, a vacant seat determination unit 114, and a result output. The unit 115 operates. In the information storage area 130, for example, table management information 131, table attribute information 132, and vacant seat management information 133 are stored.

  For example, when the table management information 131 or the table attribute information 132 is input by a person in charge at each store, the information management unit 111 stores the input information in the information storage area 130. Specifically, the information management unit 111 stores, in the information storage area 130, each piece of information input by the person in charge of each store via the operation terminal 3, for example. The table management information 131 is information indicating the position of the table and the number of seats arranged at each store. The table attribute information 132 is information indicating the attributes of the tables arranged in each store. Specific examples of the table management information 131 and the table attribute information 132 will be described later.

  The image acquisition unit 112 acquires a captured image captured by the imaging device 2 including the inside of each store in the imaging range. Specifically, the image acquisition unit 112 receives captured images transmitted from captured images from each store.

  The vacant seat extraction unit 113 extracts one or more vacant seats included in the captured image acquired by the image acquisition unit 112. Then, the vacant seat determination unit 114 determines the presence or absence of two or more vacant seats having a predetermined relationship among the one or more vacant seats extracted by the vacant seat extraction unit 113. Specifically, the vacant seat extraction unit 113 extracts one or more vacant seats included in the captured image, and generates vacant seat management information 133 indicating the current vacant seat status in the table seats arranged in each store. Then, the vacant seat determination unit 114 refers to the vacant seat management information 133 generated by the vacant seat extraction unit 113 and determines whether there are two or more vacant seats having a predetermined relationship. A specific example of the vacant seat management information 133 will be described later.

  The result output unit 115 outputs according to the determination result by the vacant seat determination unit 114. Specifically, the result output unit 115 performs output corresponding to the determination result by the vacant seat determination unit 114, for example, to the operation terminal 3 to which the person in charge of each store inputs various information.

[Details of First Embodiment]
Next, details of the first embodiment will be described. 5 to 7 are flowcharts illustrating details of the vacant seat detection process in the first embodiment. FIGS. 8 to 18 are diagrams for explaining the details of the vacant seat detection process in the first embodiment. The vacant seat detection process shown in FIGS. 5 to 7 will be described with reference to FIGS.

[Information storage processing]
First, of the vacant seat detection processing, processing for storing the table management information 131 and the table attribute information 132 in the information storage area 130 (hereinafter also referred to as information storage processing) will be described. FIG. 5 is a diagram illustrating the information storage process.

  The information management unit 111 of the information processing apparatus 1 stands by until the table management information 131 or the table attribute information 132 is received (NO in S11). Specifically, the information management unit 111 waits until the person in charge at each store inputs the table management information 131 or the table attribute information 132 via the operation terminal 3, for example.

  When the table management information 131 or the table attribute information 132 is received (YES in S11), the information management unit 111 stores the received table management information 131 or the table attribute information 132 in the information storage area 130. That is, the information management unit 111 stores various types of information referred to when the vacant seat detection process is performed in the information storage area 130 in advance. Hereinafter, specific examples of the table management information 131 and the table attribute information 132 will be described.

[Specific examples of table management information and table attribute information]
It is a figure explaining the specific example of the table and seat installed in each store first. FIG. 8 is a diagram illustrating a specific example of tables and seats installed in each store.

  In the store shown in FIG. 8, tables TB11, TB12, and TB13, tables TB21, TB22, and TB23, tables TB31 and TB32, and tables TB41, TB42, TB43, and TB44 are arranged in a straight line. In the store shown in FIG. 8, the seats on the table TB51 are used as counter seats.

  In the example shown in FIG. 8, the spaces where the tables TB41, TB42, TB43, and TB44 are installed are used as individual rooms. Therefore, the tables TB41, TB42, TB43, and TB44 cannot be used as a table integrated with an adjacent table. On the other hand, the tables TB11, TB12, and TB13, the tables TB21, TB22, and TB23, and the tables TB31 and TB32 can be used as tables that are integrated with adjacent tables, respectively. Hereinafter, as shown in FIG. 8, the right seats of the table TB51 are called seats CT1 to CT4 in order from the top, and the lower seats of the table TB51 are called seats CT5 to CT12 in order from the right.

  Next, a specific example of the table management information 131 will be described. FIG. 9 is a diagram for explaining a specific example of the table management information 131.

  The table management information 131 shown in FIG. 9 includes an “item number” identifying each piece of information included in the table management information 131, “identification information” identifying each table or seat, and “seats” indicating the number of seats in each table. The item has “number” and “position” indicating the position of each table in the store.

  Each seat of the table TB51 described with reference to FIG. 8 is a seat that can guide (seat) a new customer to another seat even when there is a seat where the customer is already seated. is there. In addition, each seat of the table TB51 is a seat where a plurality of customers can be seated as a seat integrated with an adjacent seat. Therefore, in the table management information 131 shown in FIG. 9, each of the seats CT1 to CT12 is managed in the same manner as the other tables (tables TB11 to TB44).

  Thereby, the information processing apparatus 1 can efficiently manage the vacant seat status of each table and each seat in accordance with the arrangement status of each table and each seat in the store. Hereinafter, the tables TB11 to TB44 and the seats CT1 to CT12 are collectively referred to as a table.

  Specifically, in the table management information 131 shown in FIG. 9, “TB11” is set as “identification information” and “4” is set as “seat number” for the information whose “item number” is “1”. As a “position”, “60, 5” is set. Further, in the table management information 131 shown in FIG. 9, “TB12” is set as “identification information” and “4” is set as “seat number” for the information whose “item number” is “2”. “60, 20” is set as the “position”. Further, in the table management information 131 shown in FIG. 9, “CT1” is set as “identification information” and “1” is set as “seat number” for the information whose “item number” is “13”. “50, 20” is set as the “position”. Further, in the table management information 131 shown in FIG. 9, “CT2” is set as “identification information” and “1” is set as “seat number” for the information whose “item number” is “2”. “50, 24” is set as the “position”. Description of other information included in FIG. 9 is omitted.

  Note that the information management unit 111 may generate the table management information 131 by specifying the position and the number of seats of each table in the store from the in-store captured image captured by the imaging device 2. For example, the information management unit 111 may store the generated table management information 131 in the information storage area 130 without receiving the input of the table management information 131 from the operation terminal 3. Thereby, the information processing apparatus 1 can reduce the burden on the person in charge of each store associated with the input of the table management information 131, for example.

  Next, a specific example of the table attribute information 132 will be described. FIG. 10 is a diagram for explaining a specific example of the table attribute information 132.

  The table attribute information 132 shown in FIG. 10 can be used as an “item number” that identifies each piece of information included in the table attribute information 132, “identification information” that identifies each table, and a table integrated with each table. As an item, there is an “adjacent table” in which identification information of an adjacent table is set.

  Specifically, in the table attribute information 132 shown in FIG. 10, for example, “TB11” is set as “identification information” and “TB12” is set as “neighboring table” in the information whose “item number” is “1”. Is set. Further, in the table attribute information 132 shown in FIG. 10, for example, “TB12” is set as “identification information” and “TB11, TB13” is set as “adjacent table” in the information whose “item number” is “2”. Is set. Further, in the table attribute information 132 shown in FIG. 10, for example, “TB13” is set as “identification information” and “TB12” is set as “neighboring table” for the information whose “item number” is “3”. Has been. That is, the table attribute information 132 illustrated in FIG. 10 indicates that tables having “TB11”, “TB12”, and “TB13” as “identification information” can be used as an integrated table.

  In the table attribute information 132 shown in FIG. 10, for example, “TB41” is set as “identification information” and “none” is set as “adjacent table” for information whose “item number” is “9”. Has been. That is, the table attribute information 132 illustrated in FIG. 10 indicates that a table having “TB41” as “identification information” cannot be used as an integrated table with an adjacent table.

  Further, in the table attribute information 132 shown in FIG. 10, for example, “CT1” is set as “identification information” and “CT2” is set as “adjacent table” for information whose “item number” is “13”. Has been. Similarly, in the “adjacent table” of information in which “CT2” to “CT12” are set in the “identification information” (information in which the “item number” is “14” to “24”), they are installed next to each other. The seat identification information is set. That is, the table attribute information 132 shown in FIG. 10 indicates that, for example, a seat whose “identification information” is “CT1” to “CT12” is a seat that can seat a maximum of 12 passengers as an integrated seat. Show. Description of other information included in FIG. 10 is omitted.

[Details of vacancy detection processing]
Next, details of the vacant seat detection process will be described. 6 to 7 are diagrams illustrating the vacant seat detection process.

  As shown in FIG. 6, the image acquisition unit 112 of the information processing apparatus 1 stands by until a captured image in the store is acquired (NO in S21).

  And when the captured image in a shop is acquired (YES of S21), the vacant seat extraction part 113 of the information processing apparatus 1 refers to the table management information 131 stored in the information storage area 130, and acquired it by the process of S21. The position of the table in the captured image is specified (S22). That is, the vacant seat extraction unit 113 refers to the table management information 131 and acquires information necessary for identifying each table from the captured image acquired in the process of S21. And the vacant seat extraction part 113 specifies the position of the table in a captured image with the acquired information.

  Thereafter, the vacant seat extracting unit 113 refers to the captured image acquired in the process of S21, specifies each vacant seat of the table whose position is specified in the process of S22, and generates vacant seat management information 133 that is information indicating the specified vacant seat. (S23). The vacant seat extraction unit 113 stores the generated vacant seat management information 133 in the information storage area 130, for example. Hereinafter, a specific example of the vacant seat management information 133 will be described.

[Specific examples of vacancy management information]
First, specific examples of tables and seats installed in each store during business hours will be described. 11 and 13 are diagrams illustrating specific examples of tables and seats installed in each store during business hours.

  In the example shown in FIG. 11, two, four, four, two and three customers are seated on the tables TB22, TB31, TB32, TB41 and TB44, respectively. In addition, customers are seated in the seats CT1, CT2, CT5, CT6, CT7, CT8, CT9, CT11 and CT12 of the table TB51.

  On the other hand, in the example shown in FIG. 11, no one customer is seated on the tables TB11, TB12, TB13, TB21, TB23, TB42, and TB43. In the example shown in FIG. 11, no passengers are seated in the seats CT3, CT4, and CT10.

  Next, a specific example of the vacant seat management information 133 corresponding to the store situation described in FIG. 11 will be described. FIG. 12 is a diagram for explaining a specific example of the vacant seat management information 133.

  The vacant seat management information 133 shown in FIG. 12 includes an “item number” for identifying each piece of information included in the vacant seat management information 133, “identification information” for identifying each table, and “vacant seats” indicating the seat availability of each table. "Situation" as an item. “Vacancy status” indicates that all the seats at each table are vacant (that is, a state where a new customer can be seated), or all the seats at each table are not vacant. “X” is set to indicate that a new customer cannot be seated.

  Specifically, in the vacant seat management information 133 shown in FIG. 12, the “identification information” is “TB11”, “TB12”, “TB13”, “TB21”, “TB23”, “TB42”, “TB43”, “CT3”. “CT” and “CT10” are set as “O” in the “vacant seat status” of the information. On the other hand, in the vacant seat management information 133 shown in FIG. 12, the “identification information” is “TB22”, “TB31”, “TB32”, “TB41”, “TB44”, “CT1”, “CT2”, “CT5”, “ “X” is set in “vacant seat status” of information of “CT6”, “CT7”, “CT8”, “CT9”, “CT11”, and “CT12”.

  Returning to FIG. 6, the vacant seat determination unit 114 of the information processing apparatus 1 refers to the vacant seat management information 133 stored in the information storage area 130 and identifies a table in which all seats are vacant (S24).

  Specifically, in the vacant seat management information 133 described with reference to FIG. 12, “TB11”, “TB12”, “TB13”, “TB21” are included in the “identification information” of the information in which “O” is set in the “vacancy status”. ”,“ TB23 ”,“ TB42 ”,“ TB43 ”,“ CT3 ”,“ CT4 ”, and“ CT10 ”.

  Subsequently, as shown in FIG. 7, the vacant seat determination unit 114, when a table in which all seats are vacant is identified in the process of S24 (YES in S31), the table attribute information stored in the information storage area 130 Referring to 132, a table group consisting of a plurality of tables that can be used as an integrated table among the tables specified in the process of S24 is specified (S32).

  Specifically, in the table attribute information 132 described with reference to FIG. 10, “TB11”, “TB12”, and “TB13” are set in the “identification information”. "TB11, TB13" and "TB12" are set. In the table attribute information 132 described with reference to FIG. 10, “TB32, TB22” and “TB22” are set in the “adjacent table” of the information in which “TB21” and “TB23” are set in the “identification information”, respectively. Has been. In the table attribute information 132 described with reference to FIG. 10, “None” is set in the “adjacent table” of the information in which “TB42” and “TB43” are set in the “identification information”. Furthermore, in the table attribute information 132 described with reference to FIG. 10, “CT2, CT4” and “CT3, CT5” are set in the “adjacent table” of the information in which “CT3” and “CT4” are set in the “identification information”, respectively. Is set.

  That is, the table attribute information 132 shown in FIG. 10 indicates that the tables TB11, TB12, and TB13 can be used as an integrated table. Further, the table attribute information 132 shown in FIG. 10 indicates that the seats CT3 and CT4 can be used as an integrated seat. On the other hand, the table attribute information 132 shown in FIG. 10 indicates that the table TB21 and the table TB23 cannot be used as an integrated table. Further, the table attribute information 132 shown in FIG. 10 indicates that the table TB42 and the table TB43 cannot be used as an integrated table.

  Therefore, the vacant seat determination unit 114 specifies a table group including the tables TB11, TB12, and TB13 and a table group including the seats CT3 and CT4 in the process of S32.

  And the vacant seat determination part 114 calculates the total number of the vacant seats of the table contained in the table group specified by the process of S32 for every table group specified by the process of S32 (S33).

  Specifically, in the table management information 131 described with reference to FIG. 9, “4 (seats)” is included in the “number of seats” of the information in which “TB11”, “TB12”, and “TB13” are set in the “identification information”. "Is set. Therefore, the vacant seat determination unit 114 calculates 12 (seat) as the total number of vacant seats in the tables TB11, TB12, and TB13 included in the table group specified in the process of S32. Further, in the table management information 131 described with reference to FIG. 9, “1 (seat)” is set for each “number of seats” in the information in which “CT3” and “CT4” are set in the “identification information”. . Therefore, the vacant seat determination unit 114 calculates 2 (seats) as the total number of vacant seats of the seats CT3 and CT4 included in the table group specified in the process of S32.

  In addition, in the process of S31, when the table in which all seats are vacant is not specified in the process of S24 (NO in S31), the vacant seat determination unit 114 does not perform the processes of S32 and S33.

  After that, the vacant seat determination unit 114 specifies the maximum number among the total number of vacant seats of the tables included in each table group specified in the processing of S32 and the number of vacant seats of each table not specified in the processing of S32. (S34).

  Specifically, the tables not specified in the process of S32 are the tables TB21, TB23, TB42, TB43, and CT10. In the table management information 131 described with reference to FIG. 9, the “identification information” includes “TB21”, “TB23”, “TB42”, “TB43”, and “CT10”. “4 (seat)”, “4 (seat)”, “4 (seat)”, “4 (seat)” and “1 (seat)” are set, respectively. Therefore, as shown in FIG. 13, the vacant seat determination unit 114 sets “4 (seats)”, “4 (seats)”, and “4 (seats)” as the number of vacant seats in the table not specified in the process of S32. "," 4 (seat) "and" 1 (seat) "are specified.

  Further, as shown in FIG. 13, the vacant seat determination unit 114 identifies “12 (seat)” as the total number of vacant seats in the tables (tables TB11, TB12, and TB13) included in the table group identified in the process of S32. . Furthermore, as shown in FIG. 13, the vacant seat determination unit 114 specifies “2 (seats)” as the number of tables (seats CT3 and CT4) included in the table group specified in the process of S32.

  Therefore, in this case, in the process of S34, the vacant seat determination unit 114 specifies “12 (seat)”, which is the total number of vacant seats in the table included in the table group specified in the process of S32, as the maximum number.

  And the result output part 115 of the information processing apparatus 1 outputs the maximum number specified by the process of S34 as a process result of a vacant seat detection process (S35). Specifically, the result output unit 115 outputs, for example, “12 (seat)” specified in the process of S34. Hereinafter, a specific example of the screen including the processing result output by the result output unit 115 will be described.

[Specific example of screen including processing result of vacancy detection processing]
FIG. 14 is a diagram illustrating a specific example of a screen including the processing result of the vacant seat detection process.

  The screen shown in FIG. 14 includes a map OP1 around the store subject to the vacant seat detection process, and position information OP2 of the user (user's mobile terminal) viewing the screen including the processing result of the vacant seat detection process. , The process result OP3 output in the process of S35.

  Specifically, on the screen shown in FIG. 14, characters indicating “12 names are possible” are output as the processing result OP3 output in the processing of S35.

  In other words, the information processing apparatus 1 determines whether there is a set of two or more vacant seats in a situation where two or more new customers can be seated from the captured images taken by the imaging apparatus 2 installed in each store. Determine whether. Then, for example, the information processing apparatus 1 specifies and outputs the maximum number of vacant seats among the two or more existing vacant seats.

  Thereby, as shown in FIG. 14, the information processing apparatus 1 allows the user to browse the current number of people who can enter the store.

[Specific example of vacancy detection processing]
Next, a specific example of the vacant seat detection process will be described. 15 to 18 are diagrams for explaining a specific example of the vacant seat detection process. Hereinafter, as shown in FIG. 15, after the situation in the store described with reference to FIG. An explanation will be given for a case where a customer who was seated in the store leaves the store.

  In this case, in the processing of S23, the vacant seat extracting unit 113 sets the “identification information” to “TB12”, “TB21”, “TB23”, “TB42”, “TB43” as in the vacant seat management information 133 shown in FIG. “CT3”, “CT4”, “CT7”, “CT8”, “CT9”, “CT10”, “CT11” and “CT12” are set to “vacant seat status”. Further, in this case, the vacant seat extracting unit 113 has the “identification information” of “TB11”, “TB13”, “TB22”, “TB31”, “TB32”, “TB41” as in the vacant seat management information 133 shown in FIG. ”,“ TB44 ”,“ CT1 ”,“ CT2 ”,“ CT5 ”, and“ CT6 ”,“ X ”is set in“ vacant seat status ”.

  The vacant seat determination unit 114 is information set in the “identification information” of the information in which “◯” is set in “vacant seat status” in the vacant seat management information 133 described in FIG. “TB12”, “TB21”, “TB23”, “TB42”, “TB43”, “CT3”, “CT4”, “CT7”, “CT8”, “CT9”, “CT10”, “CT11” and “CT12” Is identified. Therefore, the vacant seat determination unit 114 identifies the table group including the seats CT3 and CT4 and the table group including the seats CT7, CT8, CT9, CT10, CT11, and CT12 in the process of S32.

  Here, the tables not specified in the process of S32 are the tables TB12, TB21, TB23, TB42, and TB43. In the table management information 131 described with reference to FIG. 9, the “number of seats” of the information in which “TB12”, “TB21”, “TB23”, “TB42”, and “TB43” are set in the “identification information” “4 (seat)” is set for each. Therefore, as shown in FIG. 17, the vacant seat determination unit 114 specifies “4 (seat)” as the number of vacant seats in the table not specified in the processing of S32 as shown in FIG.

  Therefore, in this case, the vacant seat determination unit 114 sets the maximum number of “6 (seats)” that is the total number of vacant seats of the tables (seats CT7 to CT12) included in the table group specified in the process of S32 in the process of S34. As specified.

  Thereafter, the result output unit 115 outputs “6 (seat)” which is the maximum number specified in the process of S34 in the process of S35. Specifically, as illustrated in FIG. 18, the result output unit 115 outputs, for example, characters indicating “six possible names” as the processing result OP3.

  As described above, the information processing apparatus 1 according to the present embodiment acquires a captured image captured by the imaging apparatus 2 including the inside of the store in the imaging range. Then, the information processing apparatus 1 extracts a plurality of vacant seats included in the acquired captured image, and determines the presence or absence of two or more vacant seats having a predetermined relationship among the plurality of vacant seats. Thereafter, the information processing apparatus 1 outputs according to the determination result.

  In other words, the information processing apparatus 1 determines whether there is a set of two or more vacant seats in a situation where two or more new customers can be seated from the captured images taken by the imaging apparatus 2 installed in each store. Determine whether. Then, for example, the information processing apparatus 1 specifies and outputs the maximum number of vacant seats among the two or more existing vacant seats.

  As a result, the information processing apparatus 1 allows the user to view the current number of people who can enter the store. Therefore, for example, the user can make a reservation while referring to the current number of people who can enter the store. Further, since the person in charge at each store automatically updates the information indicating the current number of people who can enter the store, it is not necessary to perform an input operation of information indicating the current number of people who can enter the store.

  The above embodiment is summarized as follows.

(Appendix 1)
Obtain the captured image captured by the imaging device that includes the store in the imaging range,
Extracting a plurality of empty seats included in the acquired captured image;
Determining whether or not there are two or more vacant seats having a predetermined relationship among the plurality of vacant seats;
Output according to the result of the determination,
A vacant seat detection program for causing a computer to execute processing.

(Appendix 2)
The output according to the result of the determination includes an output of the number of people who can be accepted according to the number of two or more vacant seats having the predetermined relationship.
The vacant seat detection program according to Supplementary Note 1, wherein

(Appendix 3)
The output according to the result of the determination outputs the maximum number of the two or more vacant seats having the predetermined relationship as the acceptable number of people,
The vacant seat detection program according to supplementary note 2, characterized by:

(Appendix 4)
The predetermined relationship is a relationship arranged continuously on the counter, a relationship arranged on the same table, or a relationship arranged on a plurality of adjacent tables.
The vacant seat detection program according to Supplementary Note 1, wherein

(Appendix 5)
The plurality of vacant seats are seats whose vacant seat time is equal to or greater than a threshold value.
The vacant seat detection program according to Supplementary Note 1, wherein

(Appendix 6)
Two or more vacant seats having a relationship arranged on the same table are all the seats arranged on the same table.
The vacant seat detection program according to supplementary note 4, characterized by:

(Appendix 7)
The two or more vacant seats having a relationship arranged on the plurality of adjacent tables are all seats arranged on the plurality of adjacent tables.
The vacant seat detection program according to supplementary note 4, characterized by:

(Appendix 8)
An image acquisition unit for acquiring a captured image captured by an imaging device including the inside of the store in an imaging range;
A vacant seat extracting unit that extracts a plurality of vacant seats included in the acquired captured image;
A vacant seat determination unit that determines the presence or absence of two or more vacant seats having a predetermined relationship among the plurality of vacant seats;
A result output unit that outputs in accordance with the result of the determination,
A vacant seat detection device characterized by that.

(Appendix 9)
The result output unit outputs the maximum number of the two or more vacant seats having the predetermined relationship as the acceptable number of people,
The vacant seat detection device according to appendix 8, characterized by:

(Appendix 10)
Obtain the captured image captured by the imaging device that includes the store in the imaging range,
Extracting a plurality of empty seats included in the acquired captured image;
Determining whether or not there are two or more vacant seats having a predetermined relationship among the plurality of vacant seats;
Output according to the result of the determination,
A vacant seat detection method that causes a computer to execute processing.

(Appendix 11)
The output according to the result of the determination outputs the maximum number of the two or more vacant seats having the predetermined relationship as the acceptable number of people,
The vacant seat detection method according to supplementary note 10, characterized by:

1: Information processing device 2a: Imaging device 2b: Imaging device 2c: Imaging device 3: Operation terminal 130: Storage unit

Claims (9)

Obtain the captured image captured by the imaging device that includes the store in the imaging range,
Extracting a plurality of empty seats included in the acquired captured image;
Determining whether or not there are two or more vacant seats having a predetermined relationship among the plurality of vacant seats;
Output according to the result of the determination,
A vacant seat detection program for causing a computer to execute processing. The output according to the result of the determination includes an output of the number of people who can be accepted according to the number of two or more vacant seats having the predetermined relationship.
The vacant seat detection program according to claim 1. The output according to the result of the determination outputs the maximum number of the two or more vacant seats having the predetermined relationship as the acceptable number of people,
The vacant seat detection program according to claim 2. The predetermined relationship is a relationship arranged continuously on the counter, a relationship arranged on the same table, or a relationship arranged on a plurality of adjacent tables.
The vacant seat detection program according to claim 1. The plurality of vacant seats are seats whose vacant seat time is equal to or greater than a threshold value.
The vacant seat detection program according to claim 1. Two or more vacant seats having a relationship arranged on the same table are all the seats arranged on the same table.
The vacant seat detection program according to claim 4. The two or more vacant seats having a relationship arranged on the plurality of adjacent tables are all seats arranged on the plurality of adjacent tables.
The vacant seat detection program according to claim 4. An image acquisition unit for acquiring a captured image captured by an imaging device including the inside of the store in an imaging range;
A vacant seat extracting unit that extracts a plurality of vacant seats included in the acquired captured image;
A vacant seat determination unit that determines the presence or absence of two or more vacant seats having a predetermined relationship among the plurality of vacant seats;
A result output unit that outputs in accordance with the result of the determination,
A vacant seat detection device characterized by that. Obtain the captured image captured by the imaging device that includes the store in the imaging range,
Extracting a plurality of empty seats included in the acquired captured image;
Determining whether or not there are two or more vacant seats having a predetermined relationship among the plurality of vacant seats;
Output according to the result of the determination,
A vacant seat detection method characterized in that a computer executes processing.

Images