JP2021026399A - Image output device and image output method - Google Patents

Abstract

To protect privacy of human present in places such as a shop as well as provide an image indicating the situation of the place.SOLUTION: An image output device 1 comprises: a storage part 12 storing a reference image indicative of layout corresponding to the layout of places included in an imaging range by an imaging apparatus; an acquisition part 111 acquiring a picked-up image captured by the imaging apparatus; an identification part 113 identifying, on the basis of the picked-up image acquired by the acquisition part 111, a human position in which a human is present in the picked-up image; and an output part 115 superposing the human position identified by the identification part 113 with the reference image and outputting it.SELECTED DRAWING: Figure 2

Description

The present invention relates to an image output device and an image output method that output an image showing the situation of a place such as a store.

Patent Document 1 discloses a system that provides vacant seat information by analyzing a captured image in a store to detect the number and position of tables and chairs and detecting the presence or absence of customers.

International Publication No. 2018/116359

The system described in Patent Document 1 superimposes and displays an icon indicating a vacant seat on a captured image. The captured image may show customers in the store. Therefore, there is a problem that it is not preferable from the viewpoint of privacy protection to publish the captured image on which the icon indicating the vacant seat is superimposed to an unspecified party.

The present invention has been made in view of these points, and an object of the present invention is to be able to provide an image showing the situation of a place such as a store while protecting the privacy of a person.

The image output device of the first aspect of the present invention acquires a storage unit that stores a reference image representing a layout corresponding to the layout of a place included in the image pickup range by the image pickup device, and an image captured by the image pickup device. The acquisition unit, the specific unit that identifies the human position in the captured image based on the captured image acquired by the acquisition unit, and the human position specified by the specific unit in the reference image. It has an output unit that superimposes and outputs the indicated figures.

The specific unit specifies a seat position where a seat is located in the captured image based on the captured image, and the output unit indicates the first figure showing the human position and the seat position. A second figure different from the first figure may be superimposed on the reference image and output.

The specific unit identifies the seat position where the seat is located in the captured image based on the human position specified in the past, and the output unit displays the first figure showing the human position and the seat position. A second figure different from the first figure shown may be superimposed on the reference image and output.

The specific unit may specify the human attribute based on the captured image, and the output unit may change the display mode of the figure indicating the human position based on the attribute.

The output unit may superimpose the figure on the reference image and output the figure when the number of humans specified by the specific unit changes.

The output unit may superimpose the figure on the reference image and transmit it to an information terminal associated with a place where the image pickup apparatus is installed in advance.

The image output device further includes a receiving unit that receives a browsing request from an information terminal, and the output unit transmits the reference image by superimposing the graphic on the information terminal that has transmitted the browsing request. May be good.

The acquisition unit may acquire the captured image from the imaging device when the receiving unit receives the viewing request.

The image output device may further have a generation unit that generates the reference image by processing the captured image to extract a structure at a place where the image pickup device is installed.

The storage unit may store in advance the captured image captured by the imaging device as the reference image within a predetermined period.

The image output method of the second aspect of the present invention includes a step of storing a reference image representing a layout corresponding to the layout of a place included in the image pickup range by the image pickup apparatus in the storage unit, which is executed by the processor, and the image pickup apparatus. A step of acquiring an captured image, a step of specifying a human position in the captured image based on the captured image acquired by the acquisition step, and a step of specifying the reference image. It has a step of superimposing and outputting a figure indicating the human position specified by.

According to the present invention, it is possible to provide an image showing the situation of a place such as a store while protecting the privacy of a person in the place.

It is a schematic diagram of the image output system which concerns on embodiment. It is a block diagram of the image output system which concerns on embodiment. It is a schematic diagram for demonstrating the store where the image pickup apparatus is installed. It is a figure which shows an exemplary reference image. It is a figure which shows an exemplary captured image. It is a front view of the information terminal which displays the registration screen and the message screen on the display part. It is a figure which shows an exemplary situation image. It is a sequence diagram of the image output method executed by the image output system which concerns on embodiment.

[Overview of image output system S]
FIG. 1 is a schematic diagram of an image output system S according to the present embodiment. The image output system S includes an image output device 1, an image pickup device 2, and an information terminal 3. The image output system S may include other devices such as servers and terminals.

The image output device 1 is a computer that outputs an image showing the situation of a place such as a store based on the captured image captured by the image pickup device 2. The image output device 1 can communicate with the image pickup device 2 and the information terminal 3 via a network such as the Internet or a local area network.

The image pickup device 2 is a device provided in a place such as a store and includes one or more image pickup units that capture a predetermined imaging range. The imaging range of the imaging device 2 (that is, the orientation and magnification of imaging) may be changeable. The image pickup device 2 transmits the captured image captured by the image pickup unit to the image output device 1.

The information terminal 3 is a communication terminal that accepts user operations and displays various information. The user is, for example, a customer or employee of a store. The information terminal 3 is, for example, a mobile terminal such as a smartphone or a tablet terminal, or a personal computer. The information terminal 3 has an operation unit such as a touch panel capable of accepting an operation by a user, and a display unit such as a liquid crystal display capable of displaying information.

The outline of the process of outputting an image by the image output system S according to the present embodiment will be described below. The image output device 1 stores in advance a reference image representing a layout corresponding to the layout (arrangement) of a place included in the image pickup range by the image pickup device 2. The reference image is an image showing a layout that is the same as or similar to the layout of equipment such as tables and chairs in a store or the like.

Next, the image output device 1 acquires the captured image captured by the image pickup device 2. The image output device 1 identifies the human position, which is the position where the human is in the captured image. In order to identify the human position, the image output device 1 uses a known image recognition technique (person detection technique).

Then, the image output device 1 generates a situation image showing the situation of a place such as a store by superimposing a figure showing a specified human position on the reference image stored in the storage unit, and information the generated situation image. Output to terminal 3. The figure indicating the human position is an icon having a predetermined shape such as a circle, an ellipse, or a rectangle.

With such a configuration, the image output device 1 outputs information indicating the presence or absence of a human being on a reference image having a layout that is the same as or similar to the layout of a place such as an actual store. Therefore, the image output device 1 has the information terminal 3 in a place such as a store, while protecting the privacy of the person in the place, information indicating the situation in the place (for example, the ratio of vacant seats and the degree of congestion). Can be provided to users.

[Configuration of image output system S]
FIG. 2 is a block diagram of the image output system S according to the present embodiment. In FIG. 2, the arrows indicate the main data flows, and there may be data flows not shown in FIG. In FIG. 2, each block shows a functional unit configuration, not a hardware (device) unit configuration. Therefore, the block shown in FIG. 2 may be mounted in a single device, or may be mounted separately in a plurality of devices. Data transfer between blocks may be performed via any means such as a data bus, a network, or a portable storage medium.

The image output device 1 has a control unit 11 and a storage unit 12. The control unit 11 includes an acquisition unit 111, a generation unit 112, a specific unit 113, a reception unit 114, and an output unit 115. The storage unit 12 has a reference image storage unit 121.

The storage unit 12 is a storage medium including a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk drive, and the like. The storage unit 12 stores in advance the program executed by the control unit 11. The storage unit 12 may be provided outside the image output device 1, and in that case, data may be exchanged with the control unit 11 via a network. The reference image storage unit 121 stores a reference image representing a layout corresponding to the layout of a place included in the imaging range by the imaging device 2. The reference image storage unit 121 may be a storage area on the storage unit 12, or may be a database configured on the storage unit 12.

The control unit 11 is, for example, a processor such as a CPU (Central Processing Unit), and by executing a program stored in the storage unit 12, the acquisition unit 111, the generation unit 112, the specific unit 113, the reception unit 114, and the output unit Functions as 115. At least a part of the function of the control unit 11 may be executed by an electric circuit. Further, at least a part of the functions of the control unit 11 may be realized by the control unit 11 executing a program executed via the network.

The image output system S according to the present embodiment is not limited to the specific configuration shown in FIG. The image output device 1, the image pickup device 2, and the information terminal 3 are not limited to one device each, and may be configured by connecting two or more physically separated devices by wire or wirelessly. Further, the image output device 1 and the image pickup device 2 may be integrated. The image output device 1 may be configured by a single computer, may be configured by a plurality of servers that cooperate with each other, or may be configured by a cloud that is a collection of computer resources.

[Explanation of image output method]
Hereinafter, the image output method executed by the image output system S according to the present embodiment will be described in detail. FIG. 3 is a schematic diagram for explaining a store in which the image pickup apparatus 2 is installed. The image pickup device 2 is arranged so that the image pickup range including the position where the customer or the employee sits or stands in the store can be imaged. In the example of FIG. 3, the image pickup device 2 is installed in the restaurant. A plurality of image pickup devices 2 may be provided at one place.

First, a process in which the image output device 1 generates a reference image will be described. In the image output device 1, the acquisition unit 111 transmits an image pickup instruction to the image pickup device 2. The acquisition unit 111 acquires the captured image captured by the imaging device 2.

The generation unit 112 performs predetermined image processing on the captured image acquired by the acquisition unit 111 to generate a reference image representing a layout corresponding to the layout (arrangement) of the location included in the imaging range by the imaging device 2. It is generated and stored in the reference image storage unit 121. The range represented by the reference image is the same as the range captured by the imaging device 2.

FIG. 4 is a diagram showing an exemplary reference image A. The reference image A does not include personally identifiable information and represents an outline of a structure such as a table in a store. The generation unit 112 refers to the captured image by performing a process of extracting a structure at a place where the image pickup device 2 is installed (for example, a process of leaving only the outline of the structure in the captured image). Generate an image. As a result, the generation unit 112 can remove information that can identify an individual such as a customer from the captured image and generate a reference image showing the layout in the store.

As another method, the generation unit 112 may use the captured image captured during the period when there are no customers in the store, such as the closing time of the store, as the reference image. In this case, the generation unit 112 transmits an imaging instruction to the imaging device 2 within a predetermined period in which there are no customers in the store. The generation unit 112 acquires the captured image from the image pickup device 2 and stores it in the reference image storage unit 121 as a reference image. As a result, the generation unit 112 can generate a reference image representing the layout in the store in a state in which information that can identify an individual such as a customer is not included, without processing the captured image.

The reference image storage unit 121 generates a reference image (for example, a manually generated reference image) that is generated outside the image output device 1 and represents a layout corresponding to the layout of a place included in the image pickup range by the image pickup device 2. It may be stored in advance. In this case, it is not necessary for the generation unit 112 to generate the reference image in the image output device 1.

Next, the process by which the image output device 1 identifies the position of a human in the captured image will be described. The image output device 1 performs a process of outputting a situation image on condition that the above-mentioned reference image is stored in the reference image storage unit 121.

In the image output device 1, the acquisition unit 111 acquires the captured image captured by the image pickup device 2. The acquisition unit 111 acquires an captured image by transmitting an imaging instruction to the imaging device 2 at a predetermined time interval or at a predetermined time. Further, the acquisition unit 111 may acquire an captured image by transmitting an imaging instruction to the imaging device 2 when the receiving unit 114 described later receives a viewing request from the information terminal 3.

In addition, the acquisition unit 111 may acquire captured images automatically captured by the imaging device 2 at predetermined time intervals or at predetermined times. In addition, the acquisition unit 111 may automatically acquire the captured image on the opening date and opening time of the store set in advance. Further, the acquisition unit 111 may acquire the captured image automatically captured when the image pickup device 2 detects a human by an infrared sensor or the like.

The identification unit 113 identifies the position of a human being in the captured image based on the captured image acquired by the acquisition unit 111. For example, the specific unit 113 detects a human being included in the captured image by applying a known image recognition technology (person detection technology) to the captured image, and sets the range of coordinates in which the human is detected to the human position. Identify as. Further, even if the storage unit 12 stores in advance a range in which it is necessary to determine the vacancy status (for example, the outside of the counter, the periphery of the table, etc.), and the specific unit 113 specifies the human position only within that range. Good. As a result, the image output device 1 can determine whether or not there is a human being in the range where it is necessary to determine the vacancy status.

FIG. 5 is a diagram showing an exemplary captured image B. In FIG. 5, the human position specified by the specific unit 113 in the captured image B is represented by a broken line. In FIG. 5, two customers and one employee are detected in the captured image B.

Further, the identification unit 113 may specify the attributes of each of one or more humans detected in the captured image. Human attributes are information that indicates the general characteristics of humans, such as gender and age. In this case, the identification unit 113 identifies the human attribute by detecting the human by distinguishing each attribute in the image recognition technology. As a result, the image output device 1 can output a situation image including information on what kind of gender and age a person is in the store.

Further, the identification unit 113 may specify whether or not the person detected in the captured image is an employee as a human attribute. In this case, the employee's clothes (uniform) are stored in the storage unit 12 in advance, and the specific unit 113 detects that the human being is wearing the employee's clothes in the image recognition technology. Identifies that is an employee. Further, a range in which an employee can be located (for example, inside a counter, in front of a cash register, etc.) is stored in advance in the storage unit 12, and the specific unit 113 stores the person when the position of the person is within the range. May be identified as an employee. As a result, the image output device 1 can output a situation image including information for analyzing whether or not the employees are properly arranged.

Further, the specific unit 113 may specify the seat position where the seat is located in the captured image. In this case, the specific unit 113 detects a seat (for example, a chair or a sofa) included in the captured image by applying a known image recognition technique (object detection technique) to the captured image, and sets the seat. The range of detected coordinates is specified as the seat position.

The method in which the specific unit 113 specifies the human position, the human attribute, and the seat position based on the captured image is not limited to the above-mentioned specific method, and may be another method. For example, the specific unit 113 may specify the seat position based on the human position specified in the past. In this case, the specific unit 113 aggregates the human positions specified in a plurality of different captured images. Then, the identification unit 113 specifies a range of coordinates of a predetermined size below the human position specified more than a predetermined number of times in a plurality of captured images as a seat position. In this way, the specific unit 113 can estimate the position of the seat without performing the seat detection process by estimating that the seat is located at a position where humans are frequently present.

Next, a process in which the image output device 1 outputs a situation image will be described. In the information terminal 3, the user who is a customer performs an operation for registering a place (store) where the image pickup apparatus 2 is installed. FIG. 6A is a front view of the information terminal 3 displaying the registration screen for the information terminal 3 to register the store on the display unit. The registration screen is provided by application software such as a message service or SNS (Social Networking Service).

When the user performs an operation for registering a store on the registration screen (for example, pressing a predetermined button), the information terminal 3 has a store ID for identifying the store and a terminal ID for identifying the information terminal 3. Is transmitted to the image output device 1. In the image output device 1, the receiving unit 114 stores the store ID and the terminal ID received from the information terminal 3 in the storage unit 12 in association with each other. The association between the store ID and the terminal ID may be performed by a database provided outside the image output device 1, a message service different from the image output device 1, or an SNS management device. As a result, the information terminal 3 is associated with the place where the image pickup apparatus 2 is installed in advance.

After registering the store, on the information terminal 3, the user who is a customer performs an operation for transmitting a viewing request of the status image of the registered store. FIG. 6B is a front view of the information terminal 3 displaying a message screen for the information terminal 3 to send and receive a message to and from the store on the display unit. The message screen is provided by application software such as a message service or SNS.

When the user performs an operation for transmitting a browsing request on the message screen (for example, inputting a message including a predetermined keyword such as "vacant seat"), the information terminal 3 sends the browsing request including the terminal ID to the image output device. Send to 1. After that, the information terminal 3 receives the situation image C output by the output unit 115 described later and displays it on the display unit.

In the image output device 1, the receiving unit 114 receives a browsing request from the information terminal 3. When the receiving unit 114 receives the browsing request, the output unit 115 superimposes a figure indicating the human position specified by the specific unit 113 on the reference image stored in the reference image storage unit 121 to display the situation of the store. Generate a situation image showing. Then, the output unit 115 transmits the generated situation image to the information terminal 3 that has transmitted the viewing request.

7 (a) and 7 (b) are diagrams showing an exemplary situation image C. In the example of FIG. 7A, the situation image C includes the graphic C1 superimposed on the reference image A and showing the human position specified by the specific unit 113. For example, the figure C1 is an icon having a predetermined shape such as a circle, an ellipse, or a rectangle. As a result, the user can know the number and arrangement of people in the store without identifying an individual.

In the example of FIG. 7B, the situation image C shows the first figure C1 superimposing on the reference image A indicating the human position specified by the specific unit 113, and the seat position specified by the specific unit 113. A second figure C2 different from the first figure C1 is included. The output unit 115 outputs the first figure C1 and the second figure C2 in different display modes (for example, different shapes). As a result, the user can know at a glance the position of a person in the store and the position of a seat in the store.

Further, the output unit 115 changes the display mode (for example, color) of the first figure C1 according to the human attribute specified by the specific unit 113. For example, the output unit 115 outputs the first figure C1 having a different color depending on whether the person is an employee or a customer, and outputs the first figure C1 having a different color depending on the gender and age group of the person. .. As a result, the user can easily grasp what kind of person is in the store.

Even if the receiving unit 114 does not receive the browsing request, the store opening date and opening time set in advance, the number of people specified by the specific unit 113 changes, or the image output. When a predetermined operation is performed in the device 1, the output unit 115 generates a store situation image C, and one or more information terminals 3 associated with the store (that is, the information terminal 3 in which the store is registered). You may send to. As a result, the image output device 1 transmits the store status image C to the information terminal 3 associated with the store in advance, without the user performing an operation of transmitting the browsing request using the information terminal 3. Can be done.

Further, when the storage unit 12 stores the vacant seat rate and the degree of congestion when the receiving unit 114 receives the browsing request from the user last time, and then the vacant seat rate and the degree of congestion change within a predetermined time, the output unit 115 May transmit the situation image C to the user's information terminal 3. At that time, the output unit 115 may transmit a message including a character string such as "A vacant seat for ○ people has appeared" in addition to the situation image C. As a result, the image output device 1 can automatically notify the user of changes in the vacant seat status and encourage the user to come to the store even if there are no vacant seats when the user sends a browsing request, for example.

When the output unit 115 performs an operation indicating that the user has entered the store on the first information terminal 3, the output unit 115 transmits the situation image C to the second information terminal 3 different from the first information terminal 3. You may send it. The second information terminal 3 is a terminal that is previously associated with the first information terminal 3 by, for example, a message service, SNS, or the like. As a result, the image output device 1 can notify the friend of the user who has entered the store of the situation of the store and urge them to come to the store.

The output unit 115 may output the vacant seat rate or the number of vacant seats in addition to the situation image C. In this case, the output unit 115 calculates the vacancy rate or the number of vacant seats based on the number of seats (seat positions) specified by the specific unit 113 and the number of humans (human positions) specified by the specific unit 113. , Send to the information terminal 3. At this time, the output unit 115 may calculate the vacancy rate or the number of vacant seats using the number of non-employees specified by the specific unit 113. As shown in FIG. 6B, the information terminal 3 displays the vacancy rate or the number of vacant seats on the display unit together with the situation image C. As a result, the image output device 1 can notify the user of the ratio of vacant seats as a numerical value in addition to the situation image C.

Further, the storage unit 12 may store the range of counter seats, the range of table seats, and the like in advance in the reference image, and the output unit 115 may output the number of vacant seats for each counter seat or table seat. As a result, the image output device 1 can notify the user how many seats are available for each seat.

In addition to the situation image C, the output unit 115 may transmit a message set by a store employee or manager to the information terminal 3. The message includes a character string such as "Beer is 100 yen until XX" when there are many vacant seats. In addition, the store employee or manager may set a period during which the message can be displayed. The information terminal 3 displays the received message on the periphery of the situation image C or on the situation image C on the display unit. When a displayable period is set for the received message, the information terminal 3 displays the message only within the period. As a result, the image output device 1 can notify the user of a message from the store as well as the situation image C.

Further, the image output device 1 may send and receive messages to and from the information terminal 3 via a management device such as a message service or SNS. For example, when the user inputs a message including the keyword "reservation" on the message screen, the information terminal 3 transmits the input message to the image output device 1. When the receiving unit 114 receives the message including the keyword "reserved" in the image output device 1, the output unit 115 transmits the message "Please input the time and the number of people" to the information terminal 3.

After that, when the receiving unit 114 receives the message including the time and the number of people and the store employee or the manager performs an operation for accepting the reservation, the output unit 115 sends a message "reservation completed" to the information terminal. Send to 3. On the other hand, when the store employee or the manager performs an operation for not accepting the reservation when the store is full, the output unit 115 stops the transmission of the situation image C or displays a message "full". It is superimposed on the situation image C and transmitted to the information terminal 3. As a result, the image output device 1 can not only notify the user of the situation image C, but also exchange a message with the user for the purpose of making a reservation or the like.

Further, the image output device 1 may transmit the situation image C of the store satisfying the condition specified by the user from among the plurality of stores to the information terminal 3 owned by the user. For example, when the user inputs a condition indicating a place, the number of people, a store category, or the like on the message screen, the information terminal 3 transmits the input condition to the image output device 1. When the receiving unit 114 receives the condition in the image output device 1, the output unit 115 acquires the number of vacant seats in a plurality of stores that match the condition category (for example, a bar) around the condition location (for example, Ginza). Extract one or more stores for which the number of vacant seats acquired is equal to or greater than the required number of seats. Then, the output unit 115 transmits the extracted situation image C of one or more stores to the information terminal 3. As a result, the image output device 1 can notify the user of the status of the store that satisfies the condition specified by the user.

In the present embodiment, the image output system S outputs a situation image of a store such as a restaurant as an example, but it can also be applied to other places. For example, the image output system S can notify the user of the degree of congestion of the store by outputting a status image of the store of the product. Further, for example, by outputting a status image of a facility such as a hotel, an inn, or a shared office, it is possible to notify the user of the availability of rooms, toilets, bathrooms, and the like in the facility. As described above, the image output system S according to the present embodiment can output a situation image showing the situation of the place to any place where a person enters and exits.

[Sequence of image output method]
FIG. 8 is a sequence diagram of an image output method executed by the image output system S according to the present embodiment. In the image output device 1, the acquisition unit 111 transmits an image pickup instruction to the image pickup device 2. The acquisition unit 111 acquires the captured image captured by the imaging device 2. The generation unit 112 generates a reference image representing a layout corresponding to the layout of a place included in the image pickup range by the image pickup apparatus 2 by performing predetermined image processing on the image captured image acquired by the acquisition unit 111. It is stored in the reference image storage unit 121 (S11).

In the image output device 1, the acquisition unit 111 acquires the captured image captured by the image pickup device 2 (S12). The identification unit 113 identifies the position of a human being in the captured image based on the captured image acquired by the acquisition unit 111 (S13).

In the information terminal 3, the user who is a customer performs an operation for registering a place (store) where the image pickup apparatus 2 is installed (S14). When the user performs a predetermined operation using the information terminal 3, the information terminal 3 transmits a store ID for identifying the store and a terminal ID for identifying the information terminal 3 to the image output device 1. .. In the image output device 1, the receiving unit 114 stores the store ID and the terminal ID received from the information terminal 3 in the storage unit 12 in association with each other. As a result, the information terminal 3 is associated with the place where the image pickup apparatus 2 is installed in advance.

In the information terminal 3, the user who is a customer performs an operation for transmitting a viewing request for a status image of the registered store (S15). When the user performs a predetermined operation using the information terminal 3, the information terminal 3 transmits a browsing request including the terminal ID to the image output device 1. Steps S12 to S13 and steps S14 to S15 may be performed in parallel, or may be performed in the reverse order.

In the image output device 1, the receiving unit 114 receives a browsing request from the information terminal 3. When the receiving unit 114 receives the browsing request, the output unit 115 superimposes a figure indicating the human position specified by the specific unit 113 on the reference image stored in the reference image storage unit 121 to display the situation of the store. A situation image showing the above is generated (S16). Here, the output unit 115 may generate a situation image including information indicating human attributes and seat positions. Then, the output unit 115 transmits the generated situation image to the information terminal 3 that has transmitted the viewing request (S17). The information terminal 3 displays the situation image transmitted by the image output device 1 on the display unit (S18).

[Effect of Embodiment]
In the image output system S according to the present embodiment, the image output device 1 superimposes and outputs information indicating the presence or absence of a human being on a reference image of a layout corresponding to the layout of a place such as an actual store. Therefore, the image output device 1 can provide information indicating the situation at the place to the user who has the information terminal 3 while protecting the privacy of the person at the place such as a store.

Further, since the range of the reference image and the range of the captured image are the same, the image output device 1 can project the human position specified in the captured image as it is on the reference image. Therefore, since it is not necessary to associate the image pickup range with the image pickup device 2 with the map in the store, the image output system S can be easily introduced in a place such as a store.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes can be made within the scope of the gist. is there. For example, all or a part of the device can be functionally or physically distributed / integrated in any unit. Also included in the embodiments of the present invention are new embodiments resulting from any combination of the plurality of embodiments. The effect of the new embodiment produced by the combination has the effect of the original embodiment.

The processors of the image output device 1 and the information terminal 3 are the main constituents of each step included in the image output method shown in FIG. That is, the processors of the image output device 1 and the information terminal 3 read a program for executing the image output method shown in FIG. 8 from the storage unit, and execute the program to control each unit of the image output system S. , The image output method shown in FIG. 8 is executed. Some of the steps included in the image output method shown in FIG. 8 may be omitted, the order between the steps may be changed, and a plurality of steps may be performed in parallel.

S Image output system 1 Image output device 2 Image pickup device 3 Information terminal 11 Control unit 111 Acquisition unit 112 Generation unit 113 Specific unit 114 Reception unit 115 Output unit 12 Storage unit 121 Reference image storage unit

Claims (11)

A storage unit that stores a reference image representing a layout corresponding to the layout of a place included in the imaging range of the imaging device, and a storage unit.
An acquisition unit that acquires an image captured by the image pickup device, and
Based on the captured image acquired by the acquisition unit, a specific unit that identifies a human position in the captured image and a specific unit that identifies a human position in the captured image.
An output unit that superimposes and outputs a figure indicating the human position specified by the specific unit on the reference image, and
An image output device. Based on the captured image, the specific unit identifies the seat position where the seat is located in the captured image.
The output unit according to claim 1, wherein the output unit outputs a first figure showing the human position and a second figure showing the seat position, which is different from the first figure, superimposed on the reference image. Image output device. The specific unit identifies the seat position where the seat is located in the captured image based on the human position specified in the past.
The image according to claim 1, wherein the output unit outputs a first figure showing the human position and a second figure showing the seat position, which is different from the first figure, superimposed on the reference image. Output device. The specific unit identifies the human attribute based on the captured image, and determines the human attribute.
The image output device according to any one of claims 1 to 3, wherein the output unit changes the display mode of the figure indicating the human position based on the attribute. The image output device according to any one of claims 1 to 4, wherein the output unit outputs the graphic superimposed on the reference image when the number of humans specified by the specific unit changes. .. The image according to any one of claims 1 to 5, wherein the output unit transmits the figure by superimposing the figure on the reference image to an information terminal associated with a place where the image pickup device is installed in advance. Output device. It also has a receiver that receives browsing requests from information terminals.
The image output device according to any one of claims 1 to 5, wherein the output unit transmits the figure by superimposing the figure on the reference image to the information terminal that has transmitted the viewing request. The image output device according to claim 7, wherein the acquisition unit acquires the captured image from the image pickup device when the reception unit receives the viewing request. Any one of claims 1 to 8, further comprising a generating unit that generates the reference image by processing the captured image to extract a structure at a place where the imaging device is installed. The image output device described in 1. The image output device according to any one of claims 1 to 8, wherein the storage unit stores in advance an image captured by the image pickup device as the reference image within a predetermined period. The processor runs,
A step of storing a reference image representing a layout corresponding to the layout of a place included in the imaging range by the imaging device in the storage unit, and
The step of acquiring the captured image captured by the imaging device, and
Based on the captured image acquired by the acquired step, a step of identifying a human position in the captured image and a step of identifying a human position in the captured image.
A step of superimposing and outputting a figure indicating the human position specified by the specific step on the reference image, and
An image output method having.

Images