JP2021184268A - Information processing device, information processing method and program - Google Patents

Abstract

To provide an information processing device capable of reducing the number of steps required for converting seat layout into electronic data.SOLUTION: A control unit is configured to identify the position of multiple tables on the basis of position identification information included in pick-up images of inside of a shop including multiple tables each having a piece of position identification information. The control unit is also configured to generate electronic data of a floor map reflected with the position of the identified multiple tables in the positional relationship of the inner walls and the multiple tables in the shop.SELECTED DRAWING: Figure 4

Description

The present technology relates to an information processing device, an information processing method and a program, and relates to a technology for converting the positions of chairs and tables (seating layout) in restaurants into electronic data.

Electronic data of chair and table positions (seat layout) in restaurants may be necessary not only when opting in to services of information processing systems that support store operations, but also when changing the seat layout. be. In the past, the seat layout was manually converted into electronic data. This takes man-hours and labor. There is also the possibility of human error.

Patent Document 1 discloses an electronic device that photographs a floor in a store and generates layout data of a table in the store based on the table image.

Japanese Unexamined Patent Publication No. 2016-95560

However, in the technique disclosed in Patent Document 1, the process of recognizing a table becomes difficult, and an error in information processing may occur. With the technique disclosed in Patent Document 1, it is difficult to reduce the man-hours required for converting the seat layout into electronic data.

In view of these circumstances, an object of the present invention is to reduce the man-hours required for converting the seating layout into electronic data.

One aspect of the present invention that achieves the above object is an information processing apparatus including a control unit.
The control unit identifies the positions of the plurality of tables based on the position identification information included in the captured image of the inside of the store including the plurality of tables provided with the position identification information.
In addition, the control unit generates electronic data in which the identified positions of the plurality of tables are reflected in the inner wall of the store and the floor map showing the positional relationship of the plurality of tables.

According to the information processing apparatus, the position of the table accurately identified by the position identification information is reflected in the floor map. In addition, since the electronic data of the floor map is output, the man-hours required for converting the seat layout into electronic data can be reduced.

The information processing apparatus may be configured as follows.
The captured image includes at least one position identification information arranged on the wall of the room in which the plurality of tables are arranged, and the control unit is based on the position identification information arranged on the wall. The position of the above wall is identified, the above-mentioned plurality of tables, and each of the above-mentioned plurality of tables are localized on the above-mentioned floor map based on the relative positional relationship based on each position.

According to the information processing apparatus, it is possible to acquire the position of the table relative to the wall whose position is accurately identified by the position identification information.

The information processing apparatus may be configured as follows.
When the control unit recognizes that any one of the plurality of tables has moved by a predetermined first distance or more, the control unit identifies the position information of the plurality of tables and relates to the positions of the identified plurality of tables. Reflect the location information on the above floor map again.

According to the above information processing device, if there is a change in the table position, it can be immediately reflected in the floor map.

The information processing apparatus may be configured as follows.
The control unit recognizes the join of the two tables when the distance between any two of the plurality of tables is less than a predetermined second distance.

According to the above-mentioned information processing apparatus, when the change of the table position is related to the joining of two tables, it can be recognized.

The information processing apparatus may be configured as follows.
The position identification information consists of identification marks arranged on the edge of the table and / or on the top surface of the table.

Thereby, a specific aspect of the position identification information can be provided.

The information processing apparatus may be configured as follows.
The control unit calculates the distance between the tables based on the position information related to the positions of the identified plurality of tables, and calculates the allowable number of seats for each table based on the calculated distance between the tables.

According to the above information processing device, the allowable number of seats for each table is automatically calculated when the digitized data of the seating layout is created / updated, and the man-hours for creating the seating layout can be reduced.

The information processing apparatus may be configured as follows.
After identifying the positions of the plurality of tables based on the position identification information, the control unit compares the electronic data immediately before the identification with the electronic data immediately before the identification, and based on the comparison result, a part of the position identification information and the edge of the table. Extracts the unrecognized table and recognizes that the customer is seated in the extracted table.

According to the above information processing device, it is possible to create a practical seating layout even when the customer is in the store.

The information processing apparatus may be configured as follows.
After identifying the positions of the plurality of tables based on the position identification information, the control unit compares the electronic data immediately before the identification with the electronic data immediately before the identification, and recognizes the position identification information and all the edges of the table based on the comparison result. Extract the table that was not done and recognize that the extracted table has been removed.

According to the above information processing device, it is possible to create a practical seating layout even when the customer is in the store.

Further, the above problem can also be achieved by the following information processing method.
A step of identifying the positions of the plurality of tables based on the position identification information included in a photographed image of the inside of a store including a plurality of tables having position identification information, and a plurality of identified tables. An information processing method including a step of generating electronic data in which the position of a table is reflected in a floor map showing the positional relationship between the inner wall of the store and the plurality of tables.

The above problems can also be achieved by the following programs.
The computer identifies the positions of the plurality of tables based on the position identification information included in the captured image of the inside of the store including the plurality of tables provided with the position identification information. A program that executes a process of generating electronic data in which the positions of the plurality of tables are reflected in the inner wall of the store and the floor map showing the positional relationship of the plurality of tables.

As described above, according to the present invention, it is possible to reduce the man-hours required for converting the seating layout into electronic data.

It is a figure which shows the system structure of one Embodiment which concerns on this invention. It is a figure which shows the hardware configuration example of the information processing apparatus which concerns on the said embodiment. It is a figure which shows the structural example of various data stored in the storage part which concerns on the said embodiment. It is a figure which shows the flow of the information processing (1) of the information processing apparatus which concerns on the said embodiment. It is a figure for demonstrating the position identification information in the said Embodiment. It is explanatory drawing of the position identification based on the position identification information in the said embodiment. It is a figure which shows the flow of the information processing (2) of the information processing apparatus which concerns on the said embodiment. It is a figure which shows the flow of information processing of the information processing apparatus which concerns on one Embodiment which concerns on this invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<First Embodiment>
[System configuration]
FIG. 1 is a diagram showing a configuration of a seating layout creation system 1 according to the present embodiment. As shown in the figure, the seating layout creation system 1 according to the present embodiment includes an information processing device 100 and a camera 200. The camera 200 captures an image (including a moving image and a still image) of the inside of the restaurant. The information processing apparatus 100 creates a seating layout based on an image taken by the camera 200. Tables 300 are arranged in each store.

The information processing device 100 including the control unit according to the present embodiment can be configured as a terminal using a general-purpose computer. The system configuration example of FIG. 1 is only an example, and the information processing apparatus 100 may be installed in the store to be a complete system in the store.

The camera 200 according to the present embodiment is an example of a photographing means, and photographs an image (either a moving image or a still image) of the inside of a restaurant in the store. In the present embodiment, the camera 200 is a CCD (Charge Coupled Device) camera having a lens (not shown) oriented at an entire circumference of 360 ° and converting an image obtained from the lens into electronic data by photoelectric conversion. Needless to say, this is an example for implementation, and as another example, an image in the store may be taken by using two or more CCD cameras.

FIG. 1 schematically shows an example of the seating layout in the store. In the figure, what is shown by a rectangle is a table, and what is shown by a circle is a chair. In the present embodiment, the "seat layout" refers to the positions of chairs and tables in the store, as described above. In addition, the "floor map" shall be a plan view of the store that does not reflect the positions of the chairs and tables. The floor map contains location information about the location of immovable walls and columns.

[Hardware configuration of information processing device]
FIG. 2 is a diagram showing a hardware configuration of the information processing apparatus 100. As shown in the figure, the information processing unit 100 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, an input / output interface 15, and a bus connecting them to each other. 14 is provided.

The CPU 11 appropriately accesses the RAM 13 and the like as necessary, and controls the entire block in an integrated manner while performing various arithmetic processes. The ROM 12 is a non-volatile memory in which firmware such as an OS, a program, and various parameters to be executed by the CPU 11 is fixedly stored. The RAM 13 is used as a work area of the CPU 11, and temporarily holds an OS, various applications being executed, and various data being processed.

A display unit 16, an operation reception unit 17, a storage unit 18, a communication unit 19, and the like are connected to the input / output interface 15. The display unit 16 is a display device using, for example, an LCD (Liquid Crystal Display), an OELD (Organic Electro-Luminescence Display), a CRT (Cathode Ray Tube), or the like. The operation receiving unit 17 is, for example, a pointing device such as a mouse, a keyboard, or other input device. The display unit 16 and the operation reception unit 17 may be combined into one by a liquid crystal touch panel.

The storage unit 18 is a non-volatile memory such as an HDD (Hard Disk Drive), a flash memory (SSD; Solid State Drive), or another solid-state memory. The OS, various applications, and various data are stored in the storage unit 18.

The communication unit 19 is various modules for wireless communication such as NIC (Network Interface Card) and wireless LAN. The communication unit 19 enables data transmission / reception to / from other terminals of this terminal.

By adopting the above-mentioned hardware configuration, order information from a plurality of users and / or user terminals can be centrally collected in the information processing apparatus 100, and efficient information processing becomes possible.

[Data content of storage]
Among various data stored in the storage unit 18, the data related to the configuration and operation of the present embodiment described below will be described.

FIG. 3 is a diagram showing a configuration example of various data stored in the storage unit 18. As shown in FIG. 3, the storage unit 18 has a floor map database 181, a position identification information database 182, and a seating layout database 183. Each database is related to each other and is constructed as one relational database as a whole. Note that this is just an example for convenience of explanation, and in other embodiments, it does not have to be a relational database. Moreover, it may be a simple storage table rather than a database.

The floor map database 181 is a database that stores a floor plan (floor map) of a store. The floor plans of a plurality of stores may be stored. The position identification information database 182 is a database that stores the position identification information described later. The seat allocation layout database 183 is a database that stores information related to the positions of tables and chairs (seat allocation layout) for each store.

In the present embodiment, the digitized data of the seat layout is information (electronic data) in which the floor map, which is the stored content of the floor map database 181, is combined with the information related to the seat layout, which is the stored content of the seat layout database 183. ). Needless to say, this aspect is an example, and the information processing apparatus 100 may generate electronic data of the seating layout in a manner different from that shown in the present embodiment.

Information processing using the hardware configuration described above (described later) constitutes a functional configuration such as a control unit and an input unit of the present embodiment. The input / output interface 15 is an example of an input unit of the present embodiment. The CPU 11 is an example of a control unit of the present embodiment.

[Information processing (1)]
FIG. 4 shows the flow of information processing (1) of the information processing apparatus according to the present embodiment. As shown in the figure, when the floor map and the captured image are input to the input / output interface 15 (ST11), the CPU 11 related to the control unit first recognizes the position identification information (ST12).

In ST11, the floor map is stored in the floor map database 181 but may be input from another device or the like via the communication unit 19. The captured image is input to the information processing apparatus 100 from the camera 200 of FIG. 1 at any time via the communication unit 19.

Next, recognition of position identification information (ST12) will be described. The position identification information according to the present embodiment consists of identification marks arranged on the edge of the table and / or on the top surface of the table. FIG. 5 is a diagram for explaining the position identification information in the present embodiment. FIG. 5A shows an example in which the position identification information 301 is arranged on the top surface of the table 300. FIG. 5B shows an example in which the position identification information 301 is arranged on the edge of the table 300. These two patterns may be combined.

The position identification information may be in any form as long as it can be optically recognized, but in the present embodiment, a two-dimensional bar code is adopted. As described above, such position identification information is stored in the position identification information database 182. The recognition of the position identification information of ST12 is performed by pattern matching between the stored position identification information and the object in the captured image.

Since the present embodiment grasps the positions of a plurality of tables in the store, ST12 usually recognizes a plurality of position identification information. Next, for each position identification information, the position is identified based on the position identification information (ST13), and the distance between the tables is calculated based on the identified position (ST 14 ). ST13 and ST14 basically repeat until the position is identified based on all the recognized position identification information. In the figure, the circled number 1 in ST13 indicates the flow from FIG. 7, which will be described later.

The identification of the position based on the position identification information will be described with reference to FIG. There may be a difference in the height of the table depending on the restaurant, but in this embodiment, there is no difference in the height for the sake of simplicity, and the top surface of the table can be approximated to a flat surface. Further, it is assumed that the position identification information described with reference to FIG. 5 is arranged on the top surface.

In FIG. 6A, the horizontal axis is a view of the top surface of the table 300 as viewed from the sideways y-axis direction. The vertical axis is the height z. As shown in the figure, the camera 200 takes a picture of a table, a chair, or the like so as to look down from a position higher than the table 300. In the figure, x1 is the length of the position identification information 301 in the x-axis direction. In this embodiment, a square-shaped two-dimensional bar code is used as the position identification information. Further, the position identification information has the same size (x1) in all the tables.

In this case, (a part of) the captured image of the camera 200 is shown in FIG. 6 (b). However, the one shown in the figure is an image obtained by removing the distortion from the 360-degree camera by correction. In this case, the apparent size x2 of the front position identification information, the apparent size x4 of the back position identification information, and the apparent length x3 between the two position identification information are obtained from the captured image.

The CPU 11 calculates the actual length of x3 from the relationship between the size x1 of the default position identification information and the apparent lengths x2, x3, and x4 acquired from the captured image (ST13). Since the location of the position identification information is registered in the position identification information database 182 in advance and the size of the table is also known, if the CPU 11 can calculate the distance between adjacent position identification information, the distance between the tables Can also be calculated (ST14).

So far, only the table has been illustrated as the target for arranging the position identification information. However, the placement target of the position identification information is not limited to this, and in the present embodiment, it is also placed on an immovable object such as a wall or a pillar of a store. As a result, the table, which is a movable object, is localized in the floor map of the store by calculating the distance from the wall on the immovable object by the CPU 11.

Next, the CPU 11 reflects the identified table position on the floor map (ST15). The position is identified for the wall as described above, but since the position of the wall is plotted on the floor map in advance, only the table may be newly plotted on the floor map in ST15.

Next, the CPU 11 calculates the allowable number of seats for each table based on the distance between the tables calculated in ST14 (ST16). Since the size of the space in which the customer can sit is known (for example, it may be set to 60 cm or the like), the CPU 11 checks the distance between the wall and the table and the space in which the customer can sit. The allowable number of seats is calculated by repeating the process of incrementing the allowable number of seats when is secured.

Next, the CPU 11 generates electronic data of the seating layout based on the information processing results of ST15 and ST16 (ST17). The positions of objects such as walls, pillars, and tables identified in ST15 are acquired as quantified data such as distances from other objects. The CPU 11 generates electronic data of the seating layout based on this data.

Although it depends on the desired format of the digitized data, as an example of the output mode, the table may be written in the plan view overlooking the inside of the store as shown in FIG.

This concludes the description of information processing (FIG. 4) by the information processing apparatus 100 according to the present embodiment, which generates electronic data of the seating layout based on the floor map and the captured image. The above-mentioned information processing may be executed, for example, at the timing when the store opts in to the service of the information processing system that supports the store operation, or when the business of the day starts.

[Information Law Processing (2)]
On the other hand, since the camera 200 inputs the captured image to the information processing apparatus 100 at any time, the seating layout may be converted into electronic data at an arbitrary timing. In addition, when the electronic data conversion execution process is performed again at an arbitrary timing after the seating layout converted into electronic data is once created, it may be called "update of seating layout".

Arbitrary timing for updating the seating layout may be, for example, periodically executed at a predetermined cycle. In addition, it may be executed at a predetermined timing, for example, at the timing of customer replacement, at the time of switching between lunch business and dinner business, and at the time of off-season. By executing the above-mentioned information processing at a predetermined timing, the man-hours required for converting the seat layout into electronic data can be reduced. This merit is especially great in stores where the customer base and menu differ greatly between lunch and dinner.

When the information processing of the flow shown in FIG. 4 is executed at a predetermined timing, the CPU 11 may detect some kind of trigger and execute the information processing. For example, the passage of a predetermined time may be a trigger for information processing. Alternatively, for example, it may be detected that the trigger is manually input by the user. In the present embodiment, with reference to FIG. 7, an example will be described in which the camera 200 detects the movement of the table in the image without the store being photographed as a trigger.

FIG. 7 shows the flow of information processing (2) of the information processing apparatus according to the present embodiment. This information processing is an update process of the seating layout. In the figure, the next circled number 1 of ST23 or ST24 indicates that it is in ST13 of FIG. 4 described above.

In FIG. 7, the CPU 11 recognizes the position identification information as in ST12 at any time. The CPU 11 identifies the position where the position identification information is arranged immediately before the identification and the position where the position identification information is arranged after the identification of the same position identification information. As a result, when the table is moved by a predetermined first distance or more, the movement of the table is detected (ST21).

The table movement detection (ST21) may detect the movement of any one of the tables. When detected (ST21, Yes), the CPU 11 again identifies the position based on the position identification information (ST13 in FIG. 4) via the circled number 1 (described later in the description of ST22 to ST24). Subsequently, the CPU 11 reflects the position of the moved table on the floor map (ST15) and generates the electronic data (ST17) according to the flow of FIG. That is, the seating layout is updated.

When updating the seating layout, the CPU 11 lays out the position change based on the seating layout once created, centering on the place where the table position changes based on the image taken by the camera 200. Create a seating layout that is reflected in.

Further, at the time of this update, that is, when the CPU 11 outputs data again, in the recognition of the position identification information (ST12), the newly input (ST11) captured image and the captured image used at the previous output, old and new 2 The captured images may be compared and only different areas may be targeted for position identification. This makes it possible to reduce the amount of calculation and suppress identification errors.

In the present embodiment, as shown in FIG. 7, ST21, and Yes, during ST 23, incorporates a process for recognizing the coupling of the table. When the movement of the table is detected in ST21, the CPU 11 calculates the interval between the table adjacent to the moved table and the moved table (ST22). The processing of ST22 is the same as that of ST14.

Next, the CPU 11 determines whether or not there is a place where the distance between adjacent tables is less than a predetermined second distance (ST23). If there is such a place, we recognize that the two tables that make up the place are joined. When there are two seats for two people and they are combined, the information processing apparatus 100 recognizes that there is one seat for four people. In addition, this will be reflected in the seating layout.

According to the present embodiment described above, the man-hours required for converting the seating layout into electronic data are reduced. Even when the table is moved, the electronic data that reflects it is output, which greatly reduces the man-hours.

<Second embodiment>
The above-described embodiment can be modified in various ways. For example, in the above embodiment, the position identification based on the position identification information (ST13 in FIG. 4) is repeatedly executed for each of the plurality of position identification information recognized in ST12, but this is a processing procedure. It's just one example. The position identification (ST13) may be performed once for all the recognized position identification information. That is, even in a non-repeating manner, the same effect as that of the above embodiment can be obtained.

In addition, for example, in the above embodiment, the recognition of the position identification information (ST12) by the CPU 11 is basically performed without any omission. However, when the information processing of the above embodiment is actually executed during the operation of the store, it is assumed that the position identification information is in the shadow of obstacles, customers, store employees, etc., and is not photographed by the camera 200. Will be done. An embodiment that provides a solution in this regard will be described below.

FIG. 8 shows the flow of information processing of this embodiment. FIG. 8 may be executed following the process of creating the electronic data (ST17) of FIG. The process of FIG. 8 may be executed in succession to any of new creation and update of the seating layout.

The CPU 11 compares the electronic data related to the seating layout generated in ST17 with the electronic data related to the seating layout immediately before being generated (updated) in ST17 stored in the seating layout database 183 (ST31). ..

Next, the CPU 11 extracts the position identification information that was not recognized by the generated electronic data (ST32). If it is not extracted, the process may be terminated.

Next, from the extracted ones, those in which a part of the edge of the table in which the extracted position identification information is arranged cannot be recognized is extracted (ST33). The edge of the table can be detected by pattern-matching the image of the table with respect to the image captured by the camera 200 and then detecting the image of the table in which a part is missing.

The CPU 11 recognizes that the customer is seated on the table extracted by ST33 (ST34). This makes it possible to create a practical seating layout even when the customer is in the store.

Further, from the position identification information extracted in ST32, information in which all the edges of the table on which the information is placed cannot be recognized is extracted (ST35). This is simpler than the processing of ST33, and if the table cannot be detected as a result of pattern matching, the table in which such position identification information is arranged may be extracted.

The CPU 11 recognizes that the table extracted by ST35 has been removed (ST36). This makes it possible to create a practical seating layout even when the customer is in the store.

Although the invention of the present application has been described above with reference to the embodiments, the invention of the present application is not limited to the above-described embodiment. Various changes that can be understood by those skilled in the art can be made within the scope of the present invention in terms of the configuration and details of the present invention. Also included in the scope of the present invention are systems or devices in which the different features contained in each embodiment are combined in any way.

Further, the present invention may be applied to a system composed of a plurality of devices, or may be applied to a single device. Furthermore, the present invention is also applicable when the information processing program that realizes the functions of the embodiment is directly or remotely supplied to the system or device. Therefore, in order to realize the function of the present invention on a computer, a program installed on the computer, a medium containing the program, and a server on a network for downloading the program are also included in the scope of the present invention.

1 ... Seat layout generation system 11 ... CPU
18 ... Storage unit 19 ... Communication unit 181 ... Floor map database 182 ... Location identification information database 183 ... Seat layout database 100 ... Information processing device 200 ... Camera 300 ... Table

Claims (9)

The positions of the plurality of tables are identified based on the position identification information included in the captured image of the inside of the store including the plurality of tables provided with the position identification information.
Information provided with a control unit that calculates the distance between the tables based on the position information related to the positions of the identified plurality of tables and calculates the allowable number of seats for each table based on the calculated distance between the tables. Processing equipment. The information processing apparatus according to claim 1.
The control unit is an information processing device that calculates the allowable number of seats based on whether or not the distance between the tables is equal to or greater than a predetermined value at which a person can sit. The information processing apparatus according to claim 1 or 2.
The control unit reflects the identified positions of the plurality of tables and the calculated allowable number of seats on the floor map showing the positional relationship between the inner wall of the store and the plurality of tables. Information processing device to generate. The information processing apparatus according to any one of claims 1 to 3.
The control unit is an information processing device that recognizes a join between the two tables when the distance between any two of the plurality of tables is less than a predetermined second distance. The information processing apparatus according to any one of claims 1 to 4.
The position identification information is an information processing apparatus including identification marks arranged on the edge of the table and / or on the top surface of the table. The information processing apparatus according to any one of claims 1 to 5.
After identifying the positions of the plurality of tables based on the position identification information, the control unit compares the electronic data immediately before the identification with the electronic data immediately before the identification, and based on the comparison result, a part of the position identification information and the edge of the table. An information processing device that extracts a table that was not recognized and recognizes that the customer is seated in the extracted table. The information processing apparatus according to any one of claims 1 to 6.
After identifying the positions of the plurality of tables based on the position identification information, the control unit compares the electronic data immediately before the identification with the electronic data immediately before the identification, and recognizes the position identification information and all the edges of the table based on the comparison result. An information processing device that extracts a table that has not been used and recognizes that the extracted table has been removed. The positions of the plurality of tables are identified based on the position identification information included in the captured image of the inside of the store including the plurality of tables provided with the position identification information.
The distance between the tables is calculated based on the position information related to the positions of the identified plurality of tables.
An information processing method for calculating the allowable number of seats for each table based on the calculated distance between the tables. On the computer
A step of identifying the positions of the plurality of tables based on the position identification information included in the captured image of the inside of the store including the plurality of tables provided with the position identification information.
A step of calculating the distance between the tables based on the position information related to the positions of the identified plurality of tables, and
A program that executes a step of calculating the allowable number of seats for each table based on the calculated distance between the tables.

Images