JP2023016266A - Image sensor system and computer program - Google Patents

Abstract

To provide an image sensor system and a computer program capable of supporting maintenance work so that it can be performed efficiently and accurately.SOLUTION: A computer program of an embodiment includes a stayer position detection unit and a maintenance information creation unit. The stayer position detection unit detects the position of a stayer who has stayed in a target space based on imaging data obtained by photographing a target space of maintenance work. The maintenance information creation unit creates maintenance information indicating a position requiring maintenance based on the position of the stayer detected by the stayer position detection unit.SELECTED DRAWING: Figure 1

Description

Embodiments of the present invention relate to image sensor systems and computer programs.

As is well known, people's activities in buildings, facilities, etc., generate various maintenance works such as cleaning, disinfection, cleaning, and various maintenance. For example, bacteria and viruses attached to furniture and equipment from people remain active for a certain period of time, so it is necessary to clean and disinfect items that are directly touched by people or within a distance where droplets can reach. is a public health need. In addition, users have psychological anxiety about whether cleaning and disinfection are properly done, and there is a strong demand for cleaning and disinfection.

For this reason, maintenance work such as cleaning and disinfection is generally organized in an efficient routine for each building/facility as a whole. are also subject to maintenance in order to perform maintenance work reliably.

On the other hand, in recent years, telecommuting and staggered working hours have been recommended in order to avoid crowds and congestion. As a result, the number of people who come to the office to work has actually decreased, and the time zones for coming to the office have become dispersed. For this reason, for some fixtures and equipment in buildings and facilities, the ratio of unnecessary maintenance work, such as the next maintenance work without anyone using it from the previous maintenance work, is increasing. is increasing.

In this way, while there is a strong demand for cleaning and disinfection of bacteria and viruses attached to fixtures and equipment, there is a problem that unnecessary maintenance work tends to increase.

Japanese Patent No. 6222703 Japanese Patent No. 6156665 Japanese Patent No. 6481400 WO2020/105241

SUMMARY OF THE INVENTION An object of the present invention is to provide an image sensor system and a computer program capable of assisting maintenance work to be performed efficiently and accurately.

A computer program according to an embodiment causes a computer to function as a visitor position detection unit and a maintenance information creation unit. The visitor position detection unit detects the position of the visitor who has stayed in the target space based on the imaging data obtained by photographing the target space of the maintenance work. The maintenance information creating unit creates maintenance information indicating a position requiring maintenance based on the position of the resident detected by the resident position detecting unit.

Further, the computer program of the embodiment causes a computer to function as a resident position detection unit, a worker position detection unit, and a progress information generation unit. The visitor position detection unit detects the position of the visitor who has stayed in the target space based on the imaging data obtained by photographing the target space of the maintenance work. The worker position detection unit detects the position where the worker who performs the maintenance work stayed in the target space based on the imaging data of the target space. The progress information generation unit generates a progress image showing the position detected by the resident position detection unit and the position detected by the worker position detection unit on a map showing the inside of the target space.

Further, the computer program of the embodiment causes a computer to function as a resident position detection unit, a worker position detection unit, and a progress determination unit. The visitor position detection unit detects the position of the visitor who has stayed in the target space based on the imaging data obtained by photographing the target space of the maintenance work. The worker position detection unit detects the position where the worker who performs the maintenance work stayed in the target space based on the imaging data of the target space. The progress determination unit determines progress of the maintenance work based on the position detected by the resident position detection unit and the position detected by the worker position detection unit.

1 is a diagram showing a configuration example of an image sensor system according to the present invention; FIG. FIG. 2 is a layout diagram of a place where the image sensor shown in FIG. 1 is installed; 2 is a perspective view of where the image sensor shown in FIG. 1 is installed; FIG. 4 is a flowchart for explaining the operation of the image sensor shown in FIG. 1; 4 is a flowchart for explaining the operation of the maintenance support server shown in FIG. 1; 2 is an example of an image captured by the image sensor shown in FIG. 1; An image of an example of a heat map based on the captured image illustrated in FIG. FIG. 8 is a diagram exemplifying a maintenance map creation process based on the heat map illustrated in FIG. 7; FIG. 8 is a diagram exemplifying a maintenance map creation process based on the heat map illustrated in FIG. 7; FIG. 8 is a diagram exemplifying a maintenance map creation process based on the heat map illustrated in FIG. 7; 4 is a flowchart for explaining the operation of the maintenance support server shown in FIG. 1; The figure which illustrated the maintenance implementation map creation process. The figure which showed the image of information sharing performed between a worker and a manager. The figure which shows the intensity distribution of the wavelength before irradiation by an ultraviolet irradiation device. The figure which shows the intensity distribution of the wavelength at the time of irradiation by an ultraviolet irradiation device. The figure which shows the intensity distribution of the wavelength of three colors before irradiation by an ultraviolet irradiation device. The figure which shows the intensity distribution of the wavelength of three colors at the time of irradiation by an ultraviolet irradiation device.

An embodiment will be described below with reference to the drawings.
FIG. 1 shows the configuration of an information processing system including an image sensor system and a computer program according to one embodiment. In the following description, the above-described image sensor system and computer program are applied to an office as an object of maintenance, as an example.

(composition)
This image sensor system includes image sensors 10a to 10d, communication units 11a to 11d, a repeater 20, and a maintenance support server 30, as shown in FIG. The maintenance support server 30 includes an operation unit 32 and a display unit 33, communicates with the external server SV through the network NW, and communicates with the portable information device 100a, the virtual glass 100b, and the HMD through the access point AP accommodated in the network NW. (Head Mounted Display) 100c.

The image sensors 10a to 10d are image processing apparatuses with built-in digital cameras, are installed on the ceiling of a space (in this example, an office) to be maintained, and photograph the inside of the space (office) from the ceiling. A wide-angle lens or a fisheye lens is used as a lens for shooting, and a wide range of the inside of the office is shot from the ceiling.

The above digital camera includes an optical system including a plurality of lenses and a zoom mechanism for varying the distance between these lenses, an imaging unit including an image sensor such as CMOS (Complementary MOS), and an imaging unit. and a signal processing unit that generates imaging data in a predetermined format (for example, JPEG (Joint Photographic Experts Group)) from the imaging signal obtained by.

In addition, the obtained image data contains additional information (such as Exif (Exchangeable image file format) data) that indicates the date and time the image was taken (camera identification information), and the shooting conditions (shutter speed, aperture value, angle of view, etc.). ) is added and recorded.

In addition, the image sensors 10a to 10d perform image processing on imaged data obtained by photographing with a digital camera, detect people staying in the office, and have a detection function of detecting their positions and staying time. Prepare. A staying person can be detected by applying a well-known technique such as taking a difference between a plurality of images.

FIG. 2 illustrates a layout diagram of an office to be maintained, viewed from the ceiling. This office is a general one, and fixtures such as lockers, office desks, and chairs are arranged in an orderly fashion, and these fixtures form corridors for people to pass through. In FIG. 2, 10 indicates the position of the ceiling where the image sensors 10a to 10d are installed.

FIG. 3 illustrates a perspective view of an office to be maintained as seen obliquely from above. In this example, in the office, the room R is divided into four spaces, that is, work areas Aa to Ad. is exemplified.

The image sensors 10a to 10d photograph each area in the office from above from the ceiling of each area, and detect the presence of a person or the like by image analysis. In addition, in the office shown in FIG. 3, various fixtures 7 are scattered in the same way as in FIG. 2, and an aisle area Ae exists.

The image sensors 10a to 10d each have a processor and a memory, and the processor executes the OS and application software stored in the memory to realize various functions such as the above-described imaging, image processing, and person detection. The person detection function may be performed by the maintenance support server 30, which will be described later, based on the imaging data.

The communication unit 11 a is a network communication device that performs communication via Ethernet (registered trademark) or the like, and transmits detection results and imaging data of the image sensor 10 a to the repeater 20 . Similarly, the communication units 11b to 11d transmit the detection results and imaging data of the corresponding image sensors 10b to 10d to the repeater 20, respectively.

The repeater 20 is, for example, a line concentrator such as a hub, and is a repeater for transmitting data sent from the communication units 11a to 11d to the maintenance support server 30 respectively.

The maintenance support server 30 forms the core of the services provided by the system, and performs detection, analysis, data generation, etc., based on the imaging data and detection results captured by the image sensors 10a to 10d. To provide support information to workers performing maintenance work in the office.

Further, the maintenance support server 30 has an image sensor communication unit 31a, a network communication unit 31b, an operation unit 32, a display unit 33, an imaging data storage unit 34, a facility information storage unit 35, a map information storage unit 36 as a specific configuration. , and a control unit 300 .

The image sensor communication unit 31a is a communication interface that communicates with the communication units 11a to 11d through the repeater 20. For example, the image sensor communication unit 31a transmits instructions for remotely controlling the image sensors 10a to 10d, 10d receives imaging data and detection results.

The network communication unit 31b communicates with the external server SV through the network NW, or communicates with the portable information device 100a, virtual glasses 100b, and HMD 100c through the network NW and access point AP.

The network NW may be a public network such as the Internet, a private network (including VPN) operated within an organization or building, or a combination of these networks. good too.

Wireless communication between the access point AP and the portable information device 100a, virtual glass 100b, and HMD 100c may be high-speed communication such as wireless LAN or local 5G (fifth generation mobile communication system).

The mobile information device 100a is an information processing device having a wireless communication function, such as a smartphone, a tablet terminal, or a laptop personal computer, and can visually display information sent from the maintenance support server 30. .

The virtual glasses 100b and the HMD 100c are wearable terminals worn by maintenance workers and their managers, and are information processing devices equipped with a wireless communication function, which display information sent from the maintenance support server 30. , can visually provide information to the wearer.

The operation unit 32 is an input device such as a keyboard and a mouse, and is used by an operator to input initial setting information or to input individual instructions according to the operational status of the system.

The display unit 33 is a display device using a display device such as a liquid crystal display, and displays images based on imaging data captured by the image sensors 10a to 10d, detection results and analysis results based on these images, various created maps, and the like. can be displayed.

The imaging data storage unit 34, the facility information storage unit 35, and the map information storage unit 36 store RAM (Random Access Memory), ROM (Read Only Memory), flash memory such as SSD (Solid State Drive), and HDD (Hard Disk Drive). and other recording devices are provided in combination as appropriate according to the characteristics of the data. A single storage device may be used to divide the storage directory.

The imaging data storage unit 34 stores imaging data and detection results captured by the image sensors 10a to 10d.
The facility information storage unit 35 stores information on facilities to be maintained. For example, it stores information such as the arrangement of the image sensors 10a to 10d and the portions where the photographing ranges of the image sensors 10a to 10d overlap.
The map information storage unit 36 stores various maps generated by the control unit 300, which will be described later.

The control unit 300 controls each unit of the maintenance support server 30 in an integrated manner, and includes a processor and a memory. The processor executes an OS and application software stored in the memory to realize various functions. do. Specific functions include a map generating section 300a, a maintenance monitoring section 300b, a map information providing section 300c, and a communication control section 300d.

The map generation unit 300a generates a heat map, a maintenance map, a maintenance execution map, etc., based on image data and detection results captured by the image sensors 10a to 10d. That is, the map generator 300a is an example of a visitor position detector and a maintenance information generator.

A heat map is information that maps the space (office) subject to maintenance on a roughly horizontal plane, and visually shows the locations where office users stayed in colors and shades according to the length of time they stayed. This is a map showing the In other words, the heat map is a map of the space that is subject to maintenance, and visually shows the degree of stay time of the visitor (for example, detection frequency) in colors and shades for each position on the map. It is a thing.

Similar to the above heat map, the maintenance map is information in which the space (office) subject to maintenance is mapped on a roughly horizontal plane. be. That is, the maintenance map is an example of maintenance information.

Similar to the maintenance map, the maintenance implementation map is information in which the interior of the space (office) subject to maintenance is mapped on a roughly horizontal plane. is a map showing That is, the maintenance implementation map is an example of maintenance implementation information.

The maintenance monitoring unit 300b performs a process of reflecting the positions where maintenance has been performed among the positions shown in the maintenance map on the maintenance implementation map, based on the imaging data and detection results captured by the image sensors 10a to 10d. That is, the maintenance monitoring unit 300b is an example of a worker position detection unit, a progress information generation unit, a progress determination unit, and a maintenance implementation information creation unit.

The map information providing unit 300c converts map information generated by the map generating unit 300a and the maintenance monitoring unit 300b into data that can be displayed on the portable information device 100a, the virtual glasses 100b, and the HMD 100c, and provides the data.

The communication control unit 300d controls the image sensor communication unit 31a and the network communication unit 31b to perform control for communicating with external devices.

(motion)
Next, the operation of the image sensor system having the above configuration will be described.
First, the operation of the image sensors 10a-10d will be described with reference to FIG. Since the image sensors 10a to 10d have the same configuration and operate in the same manner at the place where they are installed, they are referred to as "image sensor 10" in the following description.

That is, in the following description, the image sensor 10 may be any one of the image sensors 10a to 10d. Similarly, the communication units 11a to 11d are also explained as the communication unit 11. FIG. That is, the communication unit 11 is one of the communication units 11a to 11d connected in association with the image sensor 10. FIG.

First, in step S401, the processor of the image sensor 10 reads initial setting data from the memory, and proceeds to step S402. Thereafter, the processor operates according to the initial setting data. In the initial settings, an imaging cycle and the like are set. That is, for example, it is set whether shooting is performed at intervals of 1 second or at intervals of 10 seconds.

In step S402, the processor controls the digital camera to capture an image of the target area (office), obtains image data, and proceeds to step S403.

In step S403, the processor analyzes the image of the imaging data obtained in step S402, and determines whether or not there is a visitor (office user) within the office (inside the image) within the imaging range. That is, in this case, the visitor is detected. The visitor can be detected, for example, by detecting a change in an image, such as taking a difference between a plurality of images, or by applying well-known techniques such as pattern recognition. If there is a visitor, the process proceeds to step S404, and if there is no visitor, the process proceeds to step S405.

In step S404, the processor outputs the imaging data in which the visitor is detected to the communication unit 11, and proceeds to step S405. Accordingly, the communication unit 11 transmits the imaging data output from the image sensor 10 to the maintenance support server 30 .

In step S405, the processor determines whether or not a predetermined time has passed since the imaging performed in step S402, that is, whether or not the next imaging timing has arrived. If the next imaging timing has arrived, the process proceeds to step S402. If the imaging timing has not yet arrived, the process proceeds to step S405 again and waits for the imaging timing to arrive.

Next, operations of the maintenance support server 30 will be described. Operations of the maintenance support server 30 include a map creation process for creating map data and a maintenance tallying process for tallying maintenance work.
FIG. 5 is a flowchart for explaining map creation processing of the maintenance support server 30 .

First, in step S501, the communication control unit 300d controls the image sensor communication unit 31a to receive the imaging data transmitted from the image sensor 10, and the process proceeds to step S502. The received imaging data is stored in the imaging data storage unit 34 .

In step S502, based on the current time and the time information included in the captured data stored in the captured data storage unit 34, the control unit 300 selects a preset time period (for example, office hours (from 8:00 am to 8:00 am). 8:00 p.m.), etc.) has been completed. Here, if the acquisition of imaging data is completed, the process proceeds to step S503, and if not completed, the process proceeds to step S501 to continue the collection.

In step S503, the control unit 300 determines whether or not to create a heat map based on preset initial setting information (or an instruction through the operation unit 32). Here, if the heat map is not to be created, the process proceeds to step S504, and if the heat map is to be created, the process proceeds to step S505.

In step S504, the control unit 300 creates a simplified version of the maintenance map based on the simple setting information preset by the map generation unit 300a, and the process proceeds to step S507. Simple setting information includes information indicating positions that require maintenance in advance (for example, positions where frequently used common fixtures are installed) and positions that do not require maintenance. Based on this information, Create a maintenance map that indicates the positions where maintenance should be performed (positions that require maintenance).

Here, the case of creating a maintenance map has been described as an example, but the present invention is not limited to this. For example, create a textual list of locations where maintenance should be performed, and create information that describes the frequency of use for each location. This information may be provided and notified to the operator.

In step S505, the control unit 300 creates a heat map based on the imaging data stored in the imaging data storage unit 34 by the map generation unit 300a, and proceeds to step S506. That is, the map generating unit 300a detects the positions of the users of the office based on the imaging data of the office.

Here, an example of creating a heat map will be described.
A case in which the imaging data is, for example, as shown in FIG. 6A will be described as an example. This imaging data is obtained by photographing a room with a layout as shown in FIG. 6B from the ceiling with a fish-eye lens.

First, the map generation unit 300a detects office users from the image based on the image data stored in the image data storage unit 34 and captured during a preset time period, and detects the positions of the office users. do. Further, the map generation unit 300a obtains the detection frequency (stay time) for each position based on the detected positions, and generates heat map data expressing this frequency on a map.

FIG. 7 is an example of a heat map. In this example, for each position of a predetermined block size, high-frequency positions are darkened, low-frequency positions are lightened, and no detections are made according to the detection frequency. Shown in transparency (original image). It should be noted that the frequency of detection may be indicated by colors instead of shades. In the example of FIG. 7, the heat map maps the inside of the office with a pseudo-horizontal plane.

Alternatively, the image sensor 10 may detect the positions and count the frequencies, and the map generator 300a may use the detection results to create a heat map.

In step S506, the control unit 300 creates a maintenance map indicating positions where maintenance should be performed (positions requiring maintenance) based on the heat map created by the map generation unit 300a in step S505, and the process proceeds to step S507. . In other words, the map generator 300a detects positions that require maintenance based on the detected positions of office users.

Here, an example of creating a maintenance map will be described.
For example, in the case of imaging data as shown in FIG. 7, the map generation unit 300a divides the heat map area into a grid as shown in FIG. 8, and assigns coordinates to each square forming the grid.

Then, based on the detection frequency shown in the heat map created in step S505, the map generation unit 300a identifies positions where the detection frequency is equal to or higher than a predetermined value as positions requiring maintenance (hereinafter referred to as maintenance-required positions), as shown in FIG. maintenance positions), and as shown in FIG. 10, maintenance map data representing the maintenance-required positions on a map is generated. In this example, the maintenance map maps the inside of the office with a pseudo-horizontal plane.

Further, in the maintenance map of this example, both positions where the detection frequency is equal to or higher than a predetermined value and positions adjacent to these positions may be regarded as maintenance-required positions. As a result, positions where the detection frequency is equal to or higher than a predetermined value and positions adjacent thereto are indicated on the maintenance map as positions requiring maintenance.

In step S507, the control unit 300 creates a maintenance implementation map for tallying (recording) locations where maintenance has been performed based on the maintenance map created by the map generation unit 300a in step S504 or step S506. End the process.

Next, the maintenance tallying process of the maintenance support server 30 will be described.
FIG. 11 is a flowchart for explaining the maintenance tallying process of the maintenance support server 30. As shown in FIG.

First, in step S1101, the control unit 300 detects the current time by the maintenance monitoring unit 300b, and determines whether or not the preset maintenance start time has arrived.

If the maintenance start time has arrived, the process proceeds to step S1102. If the maintenance start time has not yet arrived, the arrival of the maintenance start time is continuously monitored in step S1101.

In step S1102, the communication control unit 300d controls the image sensor communication unit 31a to start receiving image data output from the image sensor 10, and the process proceeds to step S1103. After that, the received imaging data are sequentially stored in the imaging data storage unit 34 .

In step S1103, the maintenance monitoring unit 300b analyzes the imaging data, and the control unit 300 determines whether maintenance work has started based on the analysis result. The start of maintenance work is determined, for example, by whether or not the worker performing maintenance appears in the image of the captured data.

Specifically, for example, information specifying the clothing of the worker (color of work clothing) is stored in advance as an initial setting, pattern recognition of clothing, signature of light with a specific wavelength (for example, ultraviolet sterilization) lighting), etc. Alternatively, the worker may transmit a notification indicating work start to the maintenance support server 30 from the mobile information device 100a or the like.

Here, when the start of maintenance work is detected, the process proceeds to step S1104, and when the start of work is not detected, the start of work is continuously monitored in step S1103.

In step S1104, the control unit 300 analyzes the imaging data stored in the imaging data storage unit 34 by the maintenance monitoring unit 300b, reflects the analysis result in the maintenance execution map, and proceeds to step S1105. That is, the position of the worker is detected based on the imaging data of the office taken by the maintenance monitoring unit 300b.

Specifically, the maintenance monitoring unit 300b analyzes the imaging data, detects the position of the worker and the length of stay of the worker at each position, and determines whether the maintenance work is performed at a position where the worker has stayed for a predetermined time or longer. I judge that. Then, for the positions where the maintenance work has been performed, information indicating the completion of the work is recorded in the maintenance work map.

In step S1105, the maintenance monitoring unit 300b of the control unit 300 creates progress image data indicating the progress of the maintenance work based on the maintenance implementation map, and the process proceeds to step S1106. As will be explained later, the progress image data shows both the position where maintenance is required (almost identical to the position where the office user stayed) and the position where the worker stayed. It is the image data which shows progress.

In step S1106, the control unit 300 displays an image based on the progress image data generated by the map information providing unit 300c in step S1105 on the display unit 33, and proceeds to step S1107.

FIG. 12 shows an example of an image based on the progress image data. As shown in this figure, different hatching indicates the squares of positions determined to have undergone maintenance with respect to the area requiring maintenance (see FIG. 10). A worker or the like who sees this image can grasp the progress of the maintenance work, the remaining position of the maintenance work, and the like.

In addition to the display unit 33, as shown in FIG. 13, the progress image data is transmitted to the portable information device 100a, the virtual glass 100b, and the HMD 100c, respectively, and an image showing the progress is displayed on each device. good too.

In this case, the same progress image data will be distributed to a plurality of workers Op1 and Op2 as well as to the manager M who manages the workers. Therefore, information about the progress of maintenance can be shared between the operators Op1 and Op2, and between the operator Op1 (Op2) and the manager M, which contributes to an improvement in work efficiency. In other words, it is possible to share the information of the position where the work is insufficient, divide the work, and avoid duplication of work.

In step S1107, the maintenance monitoring unit 300b of the control unit 300 determines whether or not the maintenance work has been completed, that is, the progress of the maintenance work, based on the maintenance execution map. The determination of the end of the maintenance work is made, for example, when the ratio of positions where maintenance has been performed to positions requiring maintenance indicated on the maintenance implementation map is equal to or greater than a certain ratio.

Alternatively, the maintenance monitoring unit 300b may analyze the imaging data and determine whether or not the maintenance work has been completed. In this case, the determination of the end of the maintenance work is made, for example, by determining whether or not the state in which the worker performing the maintenance is not shown in the image of the captured data has continued for a certain period of time or longer.

Specifically, for example, information specifying the clothes of the worker (the color of the work clothes) is stored in advance as an initial setting, or pattern recognition of the clothes is performed. Alternatively, the worker may transmit a notification indicating that the work has been completed to the maintenance support server 30 from the portable information device 100a or the like.

Here, if the end of the maintenance work is detected, the process proceeds to step S1108, and if the end of the work is not detected, the process proceeds to step S1104 to continue counting the maintenance implementation status.

In step S1108, the control unit 300 displays on the display unit 33 that the maintenance monitoring unit 300b has completed the maintenance work, and ends the processing.

The progress image data may be transmitted not only to the display unit 33, but also to the portable information device 100a, the virtual glass 100b, or the HMD 100c so that each device displays an image indicating completion of work. According to this, the manager M can recognize the completion of the work.

(summary)
As described above, in the image sensor system configured as described above, the map generation unit 300a detects the location where the office user has stayed based on the imaging data captured by the image sensor 10, and identifies the location where maintenance is required. Create a maintenance map as a location. Then, based on the image data captured by the image sensor 10 of the worker performing maintenance, the maintenance monitoring unit 300b detects positions where maintenance has been performed, and totalizes them in a maintenance execution map.

Therefore, according to the image sensor system configured as described above, it is possible to grasp the positions where maintenance such as cleaning is required and the positions where maintenance has been performed, thereby supporting the efficient and accurate maintenance work. can. As a result, it becomes possible to improve the efficiency by allocating the various resources required for maintenance work intensively to the necessary areas, and further effects can be expected, for example, in terms of public health.

In addition, the locations requiring maintenance can be displayed as a maintenance map on various devices, and the locations where maintenance has been performed can be displayed as a maintenance implementation map on various devices. Accurate information can be provided by providing accurate information.

It should be noted that the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying constituent elements without departing from the scope of the present invention at the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. Further, for example, a configuration in which some components are deleted from all the components shown in the embodiments is also conceivable. Furthermore, components described in different embodiments may be combined as appropriate.

For example, in the above embodiment, the positions of workers are detected and the progress of maintenance is totaled, but the present invention is not limited to this. In recent years, indoor disinfection may be performed using an ultraviolet irradiator. For the image of the image sensor 10, if the RGB colors are not separated, it is impossible to find the difference between the state where the ultraviolet irradiator is turned off as shown in FIG. 14 and the state where the ultraviolet ray irradiator is turned on as shown in FIG. difficult.

However, when the image of the image sensor 10 is separated into RGB colors, comparing the state where the ultraviolet irradiator is turned off as shown in FIG. 16 and the state where the ultraviolet ray irradiator is turned on as shown in FIG. As shown in FIG. 17, the red (R) wavelength and the blue (B) wavelength are characterized by having strong values. The presence or absence of workers can be determined.

Focusing on this feature, the maintenance monitoring unit 300b may detect the execution position (worker's position) of indoor disinfection using an ultraviolet irradiator and create a maintenance execution map.
In addition, it goes without saying that various modifications can be made in the same way without departing from the scope of the present invention.

DESCRIPTION OF SYMBOLS 10... Image sensor 10a-10d... Image sensor 11... Communication part 11a-11d... Communication part 20... Repeater 30... Maintenance support server 31a... Image sensor communication part 31b... Network communication part 32... Operation unit 33 Display unit 34 Imaging data storage unit 35 Facility information storage unit 36 Map information storage unit 100a Portable information device 100b Virtual glass 300 Control unit 300a Map generation unit , 300b... maintenance monitoring unit, 300c... map information providing unit, 300d... communication control unit, Aa to Ad... work area, Op1, Op2... worker, M... manager.

Claims (12)

the computer,
a visitor position detection unit that detects the position of a visitor staying in the target space based on image data obtained by photographing the target space for maintenance work;
a maintenance information creation unit that creates maintenance information indicating a location requiring maintenance based on the location of the visitor detected by the location detection unit;
program to function as The maintenance information creating unit creates maintenance information indicating a position requiring maintenance based on the position of the resident detected by the resident position detecting unit. This is a map showing the locations where maintenance is required for
A program according to claim 1. the computer,
a visitor position detection unit that detects the position of a visitor staying in the target space based on image data obtained by photographing the target space for maintenance work;
A worker position detection unit that detects a position at which a worker performing maintenance work has stayed in the target space based on imaging data of the target space;
a progress information generation unit that generates a progress image showing the position detected by the resident position detection unit and the position detected by the worker position detection unit on a map showing the inside of the target space;
program to function as the computer,
a visitor position detection unit that detects the position of a visitor staying in the target space based on image data obtained by photographing the target space for maintenance work;
A worker position detection unit that detects a position at which a worker performing maintenance work has stayed in the target space based on imaging data of the target space;
a progress determination unit that determines progress of maintenance work based on the position detected by the resident position detection unit and the position detected by the worker position detection unit;
program to function as Further, a maintenance information creating unit for creating maintenance information indicating a position requiring maintenance based on the position of the resident detected by the resident position detecting unit, wherein the maintenance information is used for maintenance within the target space. A map showing the required location,
5. A program according to claim 4. Further, a maintenance implementation information creation unit that creates maintenance implementation information indicating a position where maintenance has been performed based on the worker position detected by the worker location detection unit, wherein the maintenance implementation information is generated in the target space. A map showing the location where maintenance was performed in
5. A program according to claim 4. The map visually indicates the degree according to the detection frequency by at least one of shading or color,
6. A program according to claim 2, 3 or 5. The worker position detection unit color-separates an image based on imaging data obtained by photographing the target space, and detects a position where a worker performing maintenance work has stayed in the target space based on a specific ultraviolet wavelength. ,
A program according to any one of claims 3 to 6. 7. The program according to claim 2, 3, 5, or 6, further functioning as a transmission unit that transmits the map data to a plurality of external devices capable of visually displaying the map. an image sensor that captures an image of the target space for maintenance work and obtains image data;
a visitor position detection unit that detects the position of a visitor staying in the target space based on the imaging data;
a maintenance information creation unit that creates maintenance information indicating a location requiring maintenance based on the location of the visitor detected by the location detection unit;
An image sensor system comprising: an image sensor that captures an image of the target space for maintenance work and obtains image data;
a visitor position detection unit that detects the position of a visitor staying in the target space based on the imaging data;
a worker position detection unit that detects a position where a worker performing maintenance work stayed in the target space based on the imaging data;
a progress information generation unit that generates a progress image showing the position detected by the resident position detection unit and the position detected by the worker position detection unit on a map showing the inside of the target space;
An image sensor system comprising: an image sensor that captures an image of the target space for maintenance work and obtains image data;
a visitor position detection unit that detects the position of a visitor staying in the target space based on the imaging data;
a worker position detection unit that detects a position where a worker performing maintenance work stayed in the target space based on the imaging data;
a progress determination unit that determines progress of maintenance work based on the position detected by the resident position detection unit and the position detected by the worker position detection unit;
An image sensor system comprising:

Images