JP2021101295A - Information processor, information processing method, terminal device and terminal device control program - Google Patents

Abstract

To reduce labor of finding a store.SOLUTION: An information processor according to the present application comprises an usage condition acquisition unit, an image acquisition unit, a reservation information acquisition unit, and a selection unit. The usage condition acquisition unit acquires an usage condition of a store. The image acquisition unit acquires an image obtained by photographing the interior of the store. The reservation information acquisition unit acquires reservation information of the store. The selection unit selects a store that is presumed to be available at the date and time of use indicated in the usage condition based on the acquired image of the store and the reservation information of the store.SELECTED DRAWING: Figure 5B

Description

The present invention relates to an information processing device, an information processing method, a terminal device, and a terminal device control program.

Conventionally, information such as the number of people waiting and waiting time (congestion status information) is provided to store users as to whether or not there are vacant seats in the store, and if there are no vacant seats, the store is displayed in real time using images. A technique for conveying the atmosphere of the above has been proposed (see Patent Document 1).

Japanese Unexamined Patent Publication No. 2004-220150

However, in the above-mentioned technology, for example, when a store user searches for a store that can be used at a specified time (for example, 10 minutes after the present), information and an image of the congestion status of a plurality of stores are obtained. It takes time to find a store because you have to look for it while looking at it. The present application has been made in view of the above, and an object of the present application is to reduce the trouble of searching for a store.

The information processing apparatus according to the present application includes an image acquisition unit, a reservation information acquisition unit, and a selection unit. The image acquisition unit acquires an image obtained by photographing the inside of the store. The reservation information acquisition department acquires the reservation information of the store. The selection unit selects a store that is presumed to be available based on the acquired image of the store and the reservation information of the store.

According to one aspect of the embodiment, there is an effect that the trouble of searching for a store can be reduced.

FIG. 1 is a diagram showing an example of information processing according to the first embodiment. FIG. 2 is a diagram showing an example of a process in which the information processing apparatus according to the first embodiment analyzes an image of a situation in each store and determines the vacancy status of each store in real time. FIG. 3 is a diagram showing a configuration example of the information processing system according to the first embodiment. FIG. 4 is a diagram showing an example of a store reservation database according to the first embodiment. FIG. 5A is a diagram showing a configuration example of the photographing apparatus according to the first embodiment. FIG. 5B is a diagram showing a configuration example of the information processing apparatus according to the first embodiment. FIG. 6 is a diagram showing an example of a usage status database according to the first embodiment. FIG. 7 is a diagram showing an example of a store database according to the first embodiment. FIG. 8 is a diagram showing a configuration example of a user terminal according to the first embodiment. FIG. 9 is a diagram showing an example of a usage condition reception screen on the user terminal according to the first embodiment. FIG. 10 is a diagram showing an example of a store information display screen on the user terminal according to the first embodiment. FIG. 11 is a flowchart showing an example of the information processing procedure of the information processing apparatus according to the first embodiment. FIG. 12 is a flowchart showing an example of the information processing procedure of the user terminal according to the first embodiment. FIG. 13 is a diagram showing a configuration example of the information processing system according to the second embodiment. FIG. 14 is a diagram showing an example of an image database according to the second embodiment. FIG. 15 is a flowchart showing an example of the information processing procedure of the information processing apparatus according to the second embodiment. FIG. 16 is a diagram showing an example of a display screen of a user terminal according to each embodiment. FIG. 17 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device.

[Embodiment]
Hereinafter, the information processing apparatus, the information processing method, the terminal apparatus, and the embodiment for implementing the terminal apparatus control program (hereinafter referred to as “the embodiment”) according to the present application will be described in detail with reference to the drawings. Note that this embodiment does not limit the information processing device, the information processing method, the terminal device, and the terminal device control program according to the present application. Further, in the following embodiments, the same parts will be designated by the same reference numerals, and duplicate description will be omitted. First, the first embodiment of the present invention will be described.

[First Embodiment]
[Example of information processing]
An example of information processing according to the first embodiment will be described with reference to FIG. FIG. 1 is a diagram showing an example of information processing according to the first embodiment. In FIG. 1, the information processing device selects a store that matches the usage conditions entered by the store user based on the store vacancy status determined from the image taken by the photographing device and the store reservation database. The processing to be performed will be described. The store is, for example, a restaurant such as a cafe, a pub, or a restaurant. In the first embodiment, the photographing device that captures the image of each store is, for example, an AI (Artificial Intelligence) camera, and analyzes the captured image.

There may be a difference between the number of vacant seats in a restaurant that is open for reservation services at the restaurant and the actual number of vacant seats. This is because if all the vacant seats are released on the reservation service, the store will be dedicated to reservations and general customers will not be able to enter. Therefore, in order to confirm the vacant seat information of the store in real time, in addition to the information of the store reservation database, the vacant seat information of the store determined from the actual store image taken by the camera is also required.

The information processing device receives input of store usage conditions from the store user's terminal device (user terminal) (step S1). The conditions for using this store are, for example, the location of the store (the area where the store is located), the usage time, the number of people, the budget, the atmosphere, and the like.

The photographing device installed in each store determines the number of people in the store by analyzing the images of the situation inside the store. Then, the information processing device grasps (determines) the vacancy status of each store in real time based on the number of users of each store acquired from each photographing device (step S2).

Next, the information processing device refers to, for example, the information in the store reservation database provided by a gourmet site or the like, and confirms whether or not there is a reservation for each store (step S3). Thereby, for example, the information processing device can confirm whether or not the desired number of seats are vacant at the desired usage time for the store determined to have vacant seats based on the number of users of each store. ..

Then, the information processing device selects a store that matches the usage conditions input in S1 and confirms that seats for the desired number of users are available at the desired usage time, and the user of the user. Display on a terminal or the like (step S4). After that, for example, the user selects a desired store from the stores displayed in S4, performs reservation processing to the selected store, and then enters the store.

By doing so, the user can obtain information on the store that matches his / her desired usage time, number of users, and preference. As a result, for example, after a primary party such as a banquet, it is possible to reduce the time and effort for the user to search for a store to be the venue for the secondary party.

Here, the process of determining the vacancy status of each store in real time by the information processing apparatus 100 described in S2 of FIG. 1 will be described with reference to FIG.

For example, an example in which three photographing devices 10-1 to 10-3 are installed in the stores E1 to E3 will be described. Further, in the following, unless otherwise specified, the three stores E1 to E3 are collectively referred to as store E. Similarly, the three imaging devices 10-1 to 10-3 are collectively referred to as an imaging device 10. The photographing device 10 is, for example, a camera installed in the store, a camera held by a store clerk, or the like.

As shown in FIG. 2, the three photographing devices 10 installed in each of the three stores E photograph the situation in each corresponding store E (step S21). In the example of FIG. 2, the photographing device 10-1 installed in the store E1 photographs the situation in the store E1. Further, the photographing device 10-2 installed in the store E2 photographs the situation in the store E2. Further, the photographing device 10-3 installed in the store E3 photographs the situation in the store E3.

Subsequently, each of the photographing devices 10 analyzes an image obtained by photographing the situation in the store E (step S22), and determines the number of users in the store E. Then, the information processing device 100 acquires the number of users of the store E (step S23). Specifically, the information processing device 100 acquires the number of users of each store E corresponding to each of the three stores E1 to E3 by the three photographing devices 10-1 to 10-3. Subsequently, the information processing device 100 determines the vacancy status of each store E based on the acquired number of users of each store E (step S24). For example, in the information processing device 100, based on the acquired number of users of the store E and the number of seats of the store E described in the store database, a person is assigned to a percentage of the seats prepared in the store E. Judge whether you are sitting or not.

[Information processing system configuration]
Next, the configuration of the information processing system S according to the first embodiment will be described with reference to FIG. FIG. 2 is a diagram showing a configuration example of the information processing system S according to the first embodiment. As shown in FIG. 3, the information processing system S includes a photographing device 10, a user terminal (terminal device) 20, a store reservation server 30, and an information processing device 100. The photographing device 10, the user terminal 20, the store reservation server 30, and the information processing device 100 are connected to each other via a network N so as to be communicable by wire or wirelessly.

The photographing device 10 is, for example, a camera installed in the store, a camera held by a store clerk, or the like. The image captured by the photographing device 10 may be a still image or a moving image. The photographing device 10 analyzes an image of the situation in the store and determines the number of users in the store.

The user terminal 20 is an information processing device used by a user who browses store information via an application or a web page. The user terminal 20 is, for example, a smartphone, a mobile phone, a tablet terminal, a PDA (Personal Digital Assistant), a desktop PC (Personal Computer), a notebook PC, or the like.

The store reservation server 30 has a store reservation database 31. FIG. 4 shows an example of the store reservation database 31 according to the embodiment. The store reservation database 31 stores the reservation information of each store. As shown in FIG. 4, this reservation information has items such as "store ID", "reservation ID", "reservation number of people", and "reservation time".

For example, in FIG. 4, the number of reservations for the reservation ID "1" of the store ID "E1" is "4 (people)", and the reservation time is "2019/10/8 19: 00-21: 00". Is shown.

Returning to the description of FIG. The information processing device 100 is realized by, for example, a server device or the like. The information processing device 100 selects a store that matches the usage conditions input by the store user based on the number of store users acquired from the photographing device 10 and the store reservation database.

[Configuration of imaging device]
Next, the configuration of the photographing apparatus 10 according to the first embodiment will be described with reference to FIG. 5A. FIG. 5A is a diagram showing a configuration example of the photographing apparatus 10 according to the first embodiment. As shown in FIG. 5A, the photographing device 10 includes a communication unit 110, a storage unit 12, and a control unit 13.

The communication unit 11 is realized by, for example, a NIC (Network Interface Card) or the like. Then, the communication unit 11 is connected to the network by wire or wirelessly, and transmits / receives information to / from the information processing device 100.

The storage unit 12 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a storage device such as a hard disk or an optical disk. The storage unit 12 stores information, processing results, and the like that the control unit 13 refers to when performing various processes.

The control unit 13 includes an image acquisition unit 14, an image analysis unit 15, and an analysis result transmission unit 16.

The image acquisition unit 14 acquires an image. For example, the image acquisition unit 14 acquires an image of the situation inside the store.

The image analysis unit 15 analyzes the image acquired by the image acquisition unit 14. For example, the image analysis unit 15 determines the number of users in the store by analyzing an image of the situation in the store. The image analysis unit 15 may identify a person image from an image or a moving image by a known image analysis technique using a person detection technique, and count the number of people based on the number of the identified person images.

The analysis result transmission unit 16 transmits the analysis result by the image analysis unit 15 to the information processing device 10. For example, the analysis result transmission unit 16 attaches a store ID and a time stamp (shooting date and time) to the information processing device 100 to the number of users in the store, which is the analysis result by the image analysis unit 15, (of the store). Information about the number of users) is sent. The analysis result transmission unit 16 may use the camera ID, which is the identification information of its own photographing device 10, instead of the store ID described above.

By analyzing the image in the store on the photographing device 10 side as described above and transmitting the analysis result to the information processing device 100, the amount of traffic when the photographing device 10 transmits information to the information processing device 100 can be obtained. Can be reduced. Further, since the information transmitted by the photographing device 10 to the information processing device 100 indicates only the number of users and does not include information for identifying an individual such as a person's image, privacy can be maintained.

[Configuration of information processing device]
Next, the configuration of the information processing apparatus 100 according to the first embodiment will be described with reference to FIG. 5B. FIG. 5B is a diagram showing a configuration example of the information processing apparatus 100 according to the first embodiment. As shown in FIG. 5B, the information processing device 100 includes a communication unit 110, a storage unit 120, and a control unit 130.

The communication unit 110 is realized by, for example, a NIC or the like. Then, the communication unit 110 is connected to the network by wire or wirelessly, and transmits / receives information to / from the photographing device 10, the user terminal 20, and the store reservation server 30.

The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 120 has an image database 121 and a store database 122.

The usage status database 121 stores information regarding the number of users of the store transmitted from the photographing device 10. FIG. 6 is a diagram showing an example of the usage status database 121 according to the first embodiment. In the example shown in FIG. 6, the usage status database 121 has items such as "store ID", "number of users", and "shooting date and time".

For example, FIG. 6 shows that the number of users of “2019/9/17: 00 10:00” in the store E1 identified by the store ID is “12”.

The store database 122 stores the store information of each store. FIG. 7 shows an example of the store database 122 according to the embodiment. As shown in FIG. 7, the store information has items such as "store ID", "cooking genre", "budget", "atmosphere", "location", and "number of seats".

For example, in FIG. 7, the cooking genre of the store with the store ID "E1" is "Japanese food", the budget is "000 to XXX yen", the atmosphere is "suitable for dates", and the location is " It is "Shimbashi 〇-〇-〇", and the number of seats is "○○".

Returning to the description of FIG. 5B. The control unit 130 is a controller, and for example, various programs (information processing programs) stored in a storage device inside the information processing device 100 by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like. (Corresponding to one example) is realized by executing RAM as a work area. Further, the control unit 130 is a controller, and is realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

The control unit 130 includes a usage condition acquisition unit 131, an analysis result acquisition unit 132, a reservation information acquisition unit 133, a selection unit 134, a provision unit 135, and a reservation processing unit 136.

The usage condition acquisition unit 131 acquires the usage conditions of the store from the user terminal 20. The usage conditions of this store include, for example, information such as the usage date and time (usage time), location, cooking genre, number of users, budget, atmosphere, etc. of the store desired to be used.

The analysis result acquisition unit 132 acquires the analysis result of the image in the store E from the photographing device 10. Specifically, the analysis result acquisition unit 132 acquires information on the number of users of each store E transmitted from the photographing device 10 in each store E for each of the plurality of stores E. Then, the analysis result acquisition unit 132 stores the acquired information in the image database 121.

The reservation information acquisition unit 133 acquires store reservation information from the store reservation database 31 of the store reservation server 30.

Based on the number of users of the store and the reservation information of the store, it is estimated that the selection unit 134 can use the seats for the number of users indicated in the usage conditions at the usage date and time indicated in the usage conditions acquired from the user terminal 20. Select a store (candidate store).

For example, the selection unit 134 determines the vacancy status in the store based on the number of users of the store (recent number of users) stored in the usage status database 121 and the number of seats in the store shown in the store database 121. To do. Then, the selection unit 134 determines the usage date and time (for example, 10 minutes later) indicated in the above usage conditions based on the determined vacancy status in the store and the reservation information of the store acquired by the reservation information acquisition unit 133. ), Select a store where it is estimated that seats for the number of users indicated in the terms of use can be used.

For example, the selection unit 134 considers a case where the usage date and time indicated in the usage conditions is 10 minutes later and the number of users is four. In this case, the selection unit 134 has four seats in the store based on the number of users (recent number of users) of the store stored in the usage status database 121 and the number of seats in the store shown in the store database 121. If it is determined that there are vacant seats, it is confirmed whether or not seats for four people are vacant in the store even after 10 minutes by referring to the reservation information of the store acquired by the reservation information acquisition unit 133. Then, the selection unit 134 estimates that the store can be used if it can be confirmed that the store has seats for four people even after 10 minutes.

Further, when selecting a store, the selection unit 134 may select, for example, in consideration of other conditions included in the usage conditions (for example, the location of the store, the cooking genre, the budget, the atmosphere, etc.).

For example, if the usage conditions include conditions such as a store location, cooking genre, budget, and atmosphere, the selection unit 134 refers to the store information in the store database 122 and selects a store that satisfies these conditions. To do. As a result, the selection unit 134 can select a store in consideration of conditions such as the location of the store, the cooking genre, the budget, and the atmosphere shown in the usage conditions.

The providing unit 135 provides the information of the store selected by the selection unit 134 to the user terminal 20. For example, the providing unit 135 transmits the information of the store selected by the selecting unit 134 to the user terminal 20 of the transmission source of the usage conditions.

The reservation processing unit 136 processes the reservation of the store. For example, when the providing unit 135 receives the reservation information of the store from the user terminal 20 after transmitting the store information to the user terminal 20, the reservation processing unit 136 sends the store reservation server 30 based on the reservation information. Perform store reservation processing.

[User terminal configuration]
Next, the configuration of the user terminal 20 according to the first embodiment will be described with reference to FIG. FIG. 8 is a diagram showing a configuration example of the user terminal 20 according to the first embodiment. As shown in FIG. 8, the user terminal 20 includes a communication unit 21, a storage unit 22, an input unit 23, an output unit 24, and a control unit 25.

The communication unit 21 is an interface such as a NIC that communicates with the information processing device 100 communicably connected to the network N.

The storage unit 22 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk.

The input unit 23 is an input device that receives various operations from the user. For example, the input unit 23 is realized by a keyboard, a mouse, operation keys, or the like. The output unit 24 is a display device for displaying various information. For example, the output unit 24 is realized by a liquid crystal display or the like. When a touch panel is adopted for the user terminal 20, the input unit 23 and the output unit 24 are integrated.

The control unit 25 is a controller, and for example, various programs (corresponding to an example of a terminal device control program) stored in a storage device inside the user terminal 20 are executed by a CPU, MPU, or the like using the RAM as a work area. It is realized by. Further, the control unit 25 is a controller, and is realized by, for example, an integrated circuit such as an ASIC or FPGA.

The control unit 25 includes a reception unit 251, a transmission unit 252, a reception unit 253, and a display unit 254.

The reception unit 251 accepts the input of the usage conditions of the store E. The reception unit 251 accepts the input of the usage conditions from the usage condition reception screen shown below, for example.

FIG. 9 is a diagram showing an example of a usage condition reception screen in the user terminal 20 according to the first embodiment. When the predetermined application is started, the reception unit 251 displays information such as "Please enter the terms of use", a pull-down display of "location", and a pull-down display of "time", for example, as shown in FIG. , The pull-down display of "cooking genre", the pull-down display of "number of people", the pull-down display of "budget", and the confirmation button are displayed on the output unit 24. Then, the reception unit 251 accepts the input of the usage conditions from the above-mentioned usage condition reception screen, and when the input of the confirmation button is received, outputs the input usage conditions to the transmission unit 252.

The transmission unit 252 transmits the usage conditions received by the reception unit 251 to the information processing device 100. The receiving unit 253 receives the store information (store information that matches the usage conditions) selected by the information processing device 100.

The display unit 254 displays the store information received by the reception unit 253 on the output unit 24. FIG. 10 is a diagram showing an example of a store information display screen on the user terminal 20 according to the embodiment. For example, the display unit 254 displays a list of stores selected by the information processing device 100 as "recommended stores" on the output unit 24 as shown in FIG.

Returning to the description of FIG. The reservation information transmission unit 255 transmits the reservation information of the store to the information processing device 100. For example, when the display unit 254 displays the information of the store selected by the information processing device 100 on the output unit 24 and then receives the selection input of the store to be reserved from the user via the input unit 23, the reservation information transmission unit 255 Sends the reservation information of the store to the information processing device 100.

The photographing device 10 has decided to transmit information regarding the number of users of the store to the information processing device 100 as a result of image analysis of the store, but the present invention is not limited to this. For example, the image analysis unit 15 of the photographing device 10 analyzes the image of the store and determines the vacancy status of the store (for example, how many users are using the number of seats in the store). Then, the analysis result transmission unit 16 may transmit the vacancy status of the store to the information processing device 100 as a result of image analysis of the store. In this case, it is not necessary for the information processing device 100 to determine the vacancy status of the store.

[Processing procedure]
Next, the information processing procedure of the information processing apparatus 100 according to the first embodiment will be described with reference to FIG. FIG. 11 is a flowchart showing an example of the information processing procedure of the information processing apparatus 100 according to the first embodiment.

As shown in FIG. 11, the usage condition acquisition unit 131 of the information processing device 100 acquires the usage conditions of the store from the user terminal 20 (step S11). In addition, the analysis result acquisition unit 132 acquires information on the number of users of each store from each of the photographing devices 10 (step S12). Then, the analysis result acquisition unit 132 stores the acquired information on the number of users of each store in the usage status database 121. After that, the selection unit 134 determines the vacancy status in each store based on the latest number of users of each store stored in the usage status database 121 and the number of seats in each store shown in the store database 121. (Step S13). In addition, the reservation information acquisition unit 133 acquires the reservation information of the store from the store reservation database 31 (step S14). Then, the selection unit 134 selects a store that satisfies the usage condition acquired in S11 based on the vacancy status in the store determined in S13, the reservation information of the store acquired in S14, and the store information of the store database 122. Select (step S15). After that, the providing unit 135 provides the information of the store selected in S15 to the user terminal 20 (step S16).

Although the description is omitted in FIG. 11, when the reservation processing unit 136 receives the store reservation information from the user terminal 20 after S16, the store reservation process is performed based on the reservation information.

Next, the information processing procedure of the user terminal 20 according to the first embodiment will be described with reference to FIG. FIG. 12 is a flowchart showing an example of the information processing procedure of the user terminal 20 according to the first embodiment.

As shown in FIG. 12, the reception unit 251 accepts the usage conditions of the store E (step S31).

The transmission unit 252 transmits the usage conditions to the information processing device 100 (step S32). When the information processing device 100 receives the usage conditions from the user terminal 20, the information processing device 100 selects a store based on the usage conditions, the image of each store, and the reservation information of each store. Then, the information processing device 100 transmits the information of the selected store to the user terminal 20.

The receiving unit 253 receives the information of the store selected by the information processing device 100 (step S33).

The display unit 254 displays the store information received by the reception unit 253 on the output unit 24 (step S34).

Although the description is omitted in FIG. 12, when the reservation information transmission unit 255 receives the selection input of the information of the store to be reserved from the store information displayed on the output unit 24 after S34, the store is concerned. The reservation information of is transmitted to the information processing apparatus 100.

[Second Embodiment]
The information processing system S may use a photographing device that does not have an image analysis function. In this case, the image analysis of each store is performed on the information processing device side. For example, when the photographing device photographs the situation in the store, it transmits information to the information processing apparatus by adding the store ID (or the camera ID of its own photographing device) and the time stamp (shooting date and time) to the image. .. Then, the information processing device analyzes the image of the store transmitted from each of the photographing devices, and determines the vacancy status of each store based on the analysis result. The information processing system S in this case will be described as the second embodiment. The same configurations as those of the first embodiment are designated by the same reference numerals, and the description thereof will be omitted.

The information processing apparatus 100a according to the second embodiment will be described with reference to FIG. The information processing apparatus 100a includes an image acquisition unit 132a in place of the analysis result acquisition unit 132 (see FIG. 5B), and an image database 121a in place of the usage status database 121 (see FIG. 5B). Further, the information processing apparatus 100a includes a selection unit 134a instead of the selection unit 134 (see FIG. 5B).

The image acquisition unit 132a acquires an image of the situation in the store from the photographing device. Specifically, the image acquisition unit 132a acquires an image of the situation of the store from the photographing device in each store for each of the plurality of stores. Then, the image acquisition unit 132a stores the acquired image in the image database 121a. For example, the image acquisition unit 132a acquires an image of each store in real time from each photographing device and stores it in the image database 121a.

The image database 121a stores the image of the store transmitted from the photographing device. FIG. 14 is a diagram showing an example of the image database 121a according to the second embodiment. In the example shown in FIG. 14, the image database 121a has items such as "store ID", "image", and "shooting date and time". For example, FIG. 14 shows that the shooting date and time of the image “image # 3” of the store ID “store E1” is “2019/9/17: 00 10:00”.

Based on the image of the store and the reservation information of the store, the selection unit 134a is presumed to be able to use the seats for the number of users indicated in the usage conditions at the usage date and time indicated in the usage conditions acquired from the user terminal 20. Select (Store Candidate).

For example, the selection unit 134a analyzes the real-time image of the store acquired by the image acquisition unit 132a and determines the vacancy status in the store. Then, the selection unit 134a is based on the determined vacancy status in the store and the reservation information of the store acquired by the reservation information acquisition unit 133, and the usage date and time indicated in the above usage conditions (for example, 10 minutes later). ), Select a store where it is estimated that seats for the number of users indicated in the terms of use can be used.

For example, the selection unit 134a considers a case where the usage date and time indicated in the usage conditions is 10 minutes later and the number of users is four. In this case, when the selection unit 134a determines that the store has vacant seats for four people from the analysis result of the image of the store in real time, the reservation information of the store acquired by the reservation information acquisition unit 133 is referred to. Check if seats for 4 people are available at the store even after 10 minutes. Then, the selection unit 134a presumes that the store can be used if it can be confirmed that the store has seats for four people even after 10 minutes.

[Processing procedure]
Next, the information processing procedure of the information processing apparatus 100a according to the second embodiment will be described with reference to FIG. FIG. 15 is a flowchart showing an example of the information processing procedure of the information processing apparatus 100a according to the second embodiment.

Since the process of S41 of FIG. 15 is the same as the process of S11 of FIG. 11, the description will be omitted and the description will be given from S42 of FIG. The image acquisition unit 132a of the information processing device 100a acquires an image of each store from each of the photographing devices (step S42 in FIG. 15). Then, the image acquisition unit 132a stores the acquired image of each store in the image database 121a. After that, the selection unit 134a analyzes the image acquired in S42 and determines the vacancy status in each store (step S43). Since the processing of S44 to S46 is the same as that of S14 to S16 of FIG. 11, the description thereof will be omitted.

Even in this way, the information processing system S selects a store that matches the usage conditions input by the store user based on the image of each store taken by the photographing device and the store reservation database 31. be able to.

[Modification example]
When the selection units 134 and 134a described above select a store, the store may be selected so that the distance from the user terminal 20 that sends the usage conditions is within a predetermined value.

In this case, for example, when the user terminal 20 transmits the usage conditions to the information processing devices 100 and 100a, the user terminal 20 also transmits the position information of the user terminal 20 (for example, GPS (Global Positioning System) information). When the selection unit 134 of the information processing device 100 selects a store, the location information of the user terminal 20 is used, the above usage conditions are satisfied, and the distance from the user terminal 20 is within a predetermined value. Select a store. Then, the providing unit 135 transmits the information of the selected store to the user terminal 20.

By doing so, the user can obtain information on the store that satisfies the above-mentioned usage conditions and is relatively close to the place where he / she is.

Further, the user terminal 20 may display a screen in which the location of the store transmitted from the information processing device 100 is mapped on the map. For example, as shown in FIG. 13, the display unit 254 of the user terminal 20 displays a screen on a map in which the current location of the user terminal 20 and the location of the store transmitted from the information processing device 100 are mapped. By doing so, the user can confirm the location of the store that satisfies the above-mentioned usage conditions and is relatively close to the location of the user on the map. When the user terminal 20 receives the selection input of the store on the map, the user terminal 20 may display the information of the store, perform the reservation processing of the store, or the like.

Further, when the information processing apparatus 100 selects a store, it may be selected without using the above-mentioned usage conditions.

For example, the information processing device 100 can be used from stores whose distance from the user terminal 20 is within a predetermined value based on the position information of the user terminal 20, the real-time image of the store, and the reservation information of the store. Select a store that is presumed to be. Then, the information processing device 100 transmits the information of the selected store to the user terminal 20. After that, for example, the user terminal 20 displays the store information received from the information processing device 100 on the screen (for example, on the above map). Further, when the usage conditions are received from the user terminal 20 after transmitting the store information selected by the information processing device 100 to the user terminal 20, a store satisfying the above usage conditions is selected from the selected stores. It may be transmitted to the user terminal 20.

By doing so, the user can select a store after confirming the stores that can be used relatively close to the place where he / she is.

Further, when the selection units 134 and 134a select a store, the store may be selected using the position information designated by the user terminal 20. This location information may be included in the usage conditions when the user terminal 20 transmits the usage conditions to the information processing device 100, or may be transmitted separately from the usage conditions. Further, the location information may be specified by the name of the place (for example, Shinjuku, Shimbashi, etc.) or may be specified from the map.

Further, for example, when the selection units 134 and 134a select stores, the stores are ranked according to the degree of matching with the usage conditions, and the store information including the ranking is provided by the selection units 134 and 134a. It may be output to. In this case, the selection units 134 and 134a may, for example, rank higher in the order of a predetermined store designated from a gourmet site or the like.

In each of the above-described embodiments, the information processing devices 100 and 100a perform the store reservation process, but the present invention is not limited to this. For example, the user terminal 20 may make a reservation by making a phone call to the store or accessing the store reservation server 30. In this case, the reservation processing unit 136 in the information processing devices 100 and 100a is unnecessary, and the reservation information transmission unit 255 in the user terminal 20 is also unnecessary.

[effect]
As described above, the information processing apparatus 100 according to the present embodiment includes a usage condition acquisition unit 131, an image acquisition unit 132, a reservation information acquisition unit 133, and a selection unit 134. The usage condition acquisition unit 131 acquires the usage conditions of the store including the usage date and time of the store and the number of users. The image acquisition unit 132 acquires an image obtained by photographing the situation in the store. The reservation information acquisition unit 133 acquires the reservation information of the store including the reservation date and time of the store and the number of reserved people. The selection unit 134 selects a store where it is estimated that seats for the number of users can be used at the usage date and time indicated in the usage conditions, based on the acquired image of the store and the reservation information of the store.

In addition, the selection unit 134 analyzes the image of the store in real time to determine the vacancy status in the store, and is shown in the usage conditions based on the determined vacancy status in the store and the reservation information of the store. Select a store where it is estimated that seats for the number of users can be used at the date and time of use.

As a result, the information processing device 100 according to the present embodiment can select a store where it is estimated that seats for the number of users can be used at the date and time of use indicated in the usage conditions. As a result, it is possible to reduce the time and effort for the user to search for a store.

In addition, the terms of use of the store further include at least one of the location, genre, and budget at the time of use of the store. When selecting a store, the selection unit 134 estimates that seats for the number of users can be used at the date and time of use indicated in the terms of use, and at least one of the location, genre, and budget at the time of use indicated in the terms of use. Select a store that meets the conditions of.

As a result, the information processing device 100 according to the present embodiment can select a store in consideration of the location, genre, budget at the time of use, and the like of the store desired by the user. As a result, the information processing device 100 can select a store that suits the user's taste.

The information processing device 100 according to the present embodiment further includes a providing unit 135 that provides information on the store selected by the selecting unit 134.

As a result, the information processing device 100 according to the present embodiment can provide information on the selected store.

Further, the user terminal 20 according to the present embodiment includes a reception unit 251, a transmission unit 252, a reception unit 253, and a display unit 254. The reception unit 251 accepts input of store usage conditions including the store usage date and time and the number of users. The transmission unit 252 selects a store where it is estimated that seats for the number of users can be used at the date and time of use indicated in the usage conditions, based on the image obtained by taking a picture of the situation in the store and the reservation information of the store. The store usage conditions are transmitted to the processing device. The receiving unit 253 receives the information of the store selected by the information processing device 100. The display unit 254 displays the received store information.

As a result, the user terminal 20 according to the present embodiment can display the store information selected by the information processing device 100.

Further, the user terminal 20 according to the present embodiment further includes a reservation information transmission unit 255 for transmitting reservation information for a store selected from the displayed store information.

As a result, the user terminal 20 according to the present embodiment can reserve the store selected by the information processing device 100.

[Hardware configuration]
Further, the information processing device, the user terminal, or the photographing device according to each of the above-described embodiments is realized by, for example, a computer 1000 having a configuration as shown in FIG. Hereinafter, the information processing device 100 will be described as an example. FIG. 13 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device 100. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, an HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

The CPU 1100 operates based on a program stored in the ROM 1300 or the HDD 1400, and controls each part. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started, a program depending on the hardware of the computer 1000, and the like.

The HDD 1400 stores a program executed by the CPU 1100, data used by such a program, and the like. The communication interface 1500 receives data from another device via a predetermined communication network and sends it to the CPU 1100, and transmits the data generated by the CPU 1100 to the other device via the predetermined communication network.

The CPU 1100 controls an output device such as a display or a printer, and an input device such as a keyboard or a mouse via the input / output interface 1600. The CPU 1100 acquires data from the input device via the input / output interface 1600. Further, the CPU 1100 outputs the generated data to the output device via the input / output interface 1600.

The media interface 1700 reads a program or data stored in the recording medium 1800 and provides the program or data to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700, and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. And so on.

For example, when the computer 1000 functions as the information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 realizes the function of the control unit 130 by executing the program loaded on the RAM 1200. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, these programs may be acquired from another device via a predetermined communication network.

[Other]
Further, among the processes described in the above-described embodiments and modifications, all or part of the processes described as being automatically performed can be manually performed, or the processes described as being manually performed. It is also possible to automatically perform all or part of the processed processing by a known method. In addition, the processing procedure, specific name, and information including various data and parameters shown in the above document and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the illustrated information.

Further, each component of each of the illustrated devices is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of the device is functionally or physically distributed / physically in arbitrary units according to various loads and usage conditions. Can be integrated and configured.

Further, the above-described embodiments and modifications can be appropriately combined as long as the processing contents do not contradict each other.

Although some of the embodiments of the present application have been described in detail with reference to the drawings, these are examples, and various modifications are made based on the knowledge of those skilled in the art, including the embodiments described in the disclosure column of the invention. It is possible to practice the present invention in other improved forms.

Further, the above-mentioned "section, module, unit" can be read as "means" or "circuit". For example, the acquisition unit can be read as an acquisition means or an acquisition circuit.

20 User terminal 100 Information processing device 131 Information processing device 131 Usage condition acquisition unit 132 Image acquisition unit 133 Reservation information acquisition unit 134 Selection unit 135 Providing unit 251 Reception unit 252 Transmission unit 253 Reception unit 254 Display unit 255 Reservation information transmission unit

Claims (11)

The image acquisition unit that acquires the image obtained by taking a picture of the inside of the store,
The reservation information acquisition department that acquires the reservation information of the store, and
A selection unit that selects a store that is presumed to be available based on the acquired image of the store and the reservation information of the store.
An information processing device characterized by being equipped with. The information processing device
Further equipped with a usage condition acquisition unit for acquiring the usage conditions of the store,
The selection unit
The information processing apparatus according to claim 1, wherein a store that is presumed to be available at the date and time of use indicated in the terms of use is selected based on the acquired image of the store and the reservation information of the store. .. The terms of use of the store are as follows:
Including the date and time of use of the store and the number of users
The reservation information of the store is
Including the reservation date and time of the store and the number of reservations
The selection unit
When selecting a store that is presumed to be available, it is presumed that seats for the number of users can be used at the date and time of use indicated in the terms of use, based on the acquired image of the store and the reservation information of the store. The information processing apparatus according to claim 2, wherein a store is selected. The selection unit
The real-time image of the store is analyzed to determine the vacant seat status in the store, and based on the determined vacant seat status in the store and the reservation information of the store, the above-mentioned usage date and time indicated in the usage conditions The information processing device according to claim 3, wherein a store in which seats for the number of users are presumed to be available is selected. The terms of use of the store are as follows:
Including at least one of the store locations, genres and budgets at the time of use,
The selection unit
When selecting the store, it is estimated that seats for the number of users can be used at the date and time of use indicated in the terms of use, and at least one of the place, genre, and budget at the time of use indicated in the terms of use. The information processing apparatus according to claim 3, wherein a store satisfying the conditions is selected. The information processing device according to claim 1, further comprising a providing unit that provides information on the store selected by the selecting unit. The selection unit
Based on the location information of the user's terminal device, the acquired image of the store, and the reservation information of the store, the store where the distance from the user's terminal device is within a predetermined value and is presumed to be available. The information processing apparatus according to claim 1, wherein the information processing apparatus is selected. It is an information processing method executed by a computer.
The image acquisition process to acquire the image obtained by taking a picture of the inside of the store,
The reservation information acquisition process for acquiring the reservation information of the store, and
A selection process for selecting a store that is presumed to be available based on the acquired image of the store and the reservation information of the store, and
An information processing method characterized by including. The reception department that accepts input of store usage conditions and
The usage conditions of the store are set for the information processing device that selects the store that is presumed to be available at the usage date and time indicated in the usage conditions based on the image obtained by photographing the inside of the store and the reservation information of the store. The transmitter to send and
A receiver that receives store information selected by the information processing device, and
A display unit that displays the received store information, and
A terminal device comprising. The terminal device according to claim 9, further comprising a reservation information transmitting unit for transmitting reservation information for a store selected from the displayed store information. The reception procedure for accepting input of store usage conditions and
The usage conditions of the store are set for the information processing device that selects the store that is presumed to be available at the usage date and time indicated in the usage conditions based on the image obtained by photographing the inside of the store and the reservation information of the store. Sending procedure and sending procedure
The receiving procedure for receiving the store information selected by the information processing device, and
The display procedure for displaying the received store information and
A terminal device control program characterized by having a computer execute the above.

Images