JP2021107998A - Information processing system, method for controlling the same, and program - Google Patents

Abstract

To provide a technique that allows an administrator to efficiently check that a person different from a person who puts laundry into a washing machine or a dryer in a coin-operated laundry takes out the laundry from the washing machine or the dryer.SOLUTION: An information processing system comprises: acquisition means that acquires, with a surveillance camera, a video obtained by photographing the inside of a coin-operated laundry shop; and notification means that, when the video acquired by the acquisition means is analyzed and it is determined that a person who puts laundry and a person who takes out the laundry are different from each other in the same washing machine or dryer, gives notification to inform a user of the fact.SELECTED DRAWING: Figure 7

Description

The present invention relates to an information processing system, a control method and a program thereof, and in particular, a person different from the person who put the laundry in the washing machine or dryer of a coin laundry took out the laundry from the washing machine or dryer. Regarding technology for managers to check efficiently.

Conventionally, for example, it has been proposed to photograph the inside of a coin laundry store with a surveillance camera, and the manager confirms the photographed image and monitors the inside of the store (for example, Patent Document 1).

However, the manager has to keep checking the image taken by the surveillance camera in order to monitor the inside of the store, and the work is complicated and inefficient.

In addition, recently, there have been cases where the laundry put in the washing machine or dryer of the coin laundry is stolen, and in the past, the administrator can efficiently check the images of the surveillance cameras in such cases. There wasn't.

Japanese Unexamined Patent Publication No. 2006-352179

Therefore, an object of the present invention is to efficiently confirm that a person different from the person who put the laundry in the washing machine or dryer of the coin laundry took out the laundry from the washing machine or dryer. be.

The present invention is a person who puts laundry in the same washing machine or dryer as a result of analyzing an acquisition means for acquiring an image of the inside of a coin laundry store with a surveillance camera and an image acquired by the acquisition means. The laundry is provided with a notification means for notifying the user when it is determined that the person who took out the laundry is different.

Further, the present invention is a control method in an information processing system, and as a result of analyzing an acquisition process of acquiring an image of the inside of a coin laundry store with a surveillance camera and an image acquired by the acquisition process, the same washing is performed. The machine or the dryer is characterized by including a notification process for notifying the user when it is determined that the person who put the laundry and the person who took out the laundry are different. Further, the present invention is a program for functioning as the above-mentioned information processing system.

According to the present invention, the administrator can efficiently confirm that a person different from the person who put the laundry in the washing machine or dryer of the coin laundry took out the laundry from the washing machine or dryer.

An example of the system configuration of the information processing system of the present invention is shown. It is a figure which showed an example of the hardware composition of the information processing apparatus applicable to the server 100, the mobile terminal 101, and the information processing apparatus 102 which concerns on this embodiment. It is a block diagram which shows the hardware structure of the surveillance cameras 103A and 103B. It is a figure which shows an example of the appearance of the washer / dryer 105A. It is a figure which shows an example of the structure in the store of a coin laundry 501. It is a figure which shows an example of the alert screen 601. It is a flowchart which shows an example of the process executed by the surveillance camera 103A, and the server 100. It is a figure which shows an example of the image management table 800.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 shows an example of a system configuration of the information processing system of the present invention.

The information processing system shown in FIG. 1 includes a plurality of surveillance cameras 103A and 103B, a server 100 that acquires and analyzes images taken by each surveillance camera, and an administrator terminal (an administrator) that operates the images and analysis results. The information processing device 102 and the mobile terminal 101) are connected and configured so as to be able to communicate with each other via a network.

The surveillance camera 103 is a network camera that photographs the inside of the store of the coin laundry 106, and photographs the washing machines or dryers 105A and 105B in the store from the front.

Further, each surveillance camera transmits an image (moving image and / or a still image) taken by each surveillance camera to the server 100, and the server 100 stores the image. Further, the server 100 can transmit the video to the administrator terminal (mobile terminal 101, information processing device 102) and display it on the display unit of the mobile terminal 101 and the information processing device 102. As a result, the manager can check the video in the store.

FIG. 2 is a diagram showing an example of a hardware configuration of an information processing device applicable to the server 100, the mobile terminal 101, and the information processing device 102 according to the present embodiment.

As shown in FIG. 2, the information processing apparatus includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 203, a RAM (Random Access Memory) 202, an input controller 205, and a video controller 206 via a system bus 204. The memory controller 207 and the communication I / F controller 208 are connected.

The CPU 201 comprehensively controls each device and controller connected to the system bus 204.

The storage device such as the ROM 203 or the external memory 211 is a control program executed by the CPU 201, such as a BIOS (Basic Input / Output System) or an OS (Operating System), or a computer-readable and executable program for realizing the information processing method. And holds various necessary data (including data table).

The RAM 202 functions as a main memory, a work area, and the like of the CPU 201. The CPU 201 realizes various operations by loading a program or the like necessary for executing the process from the ROM 203 or the external memory 211 into the RAM 202 and executing the loaded program.

The input controller 205 controls the input from the input device 209 (input device). Examples of the input device 209 include a pointing device such as a keyboard, a touch panel, and a mouse.

When the input device 209 is a touch panel, the user can give various instructions by pressing (touching with a finger or the like) the icon, the cursor, or the button displayed on the touch panel.

Further, the touch panel may be a touch panel such as a multi-touch screen that can detect the position touched by a plurality of fingers.

The video controller 206 controls the display on an external output device such as the display device 210. The display shall include the display of a notebook computer integrated with the main body. The external output device is not limited to the display, and may be, for example, a projector. Further, as for the device that can be accepted by the above-mentioned touch operation, the input device 209 is provided.

The video controller 206 can control a video memory (VRAM) for display control, a part of the RAM 202 can be used as a video memory area, and a dedicated video memory is separately provided. Is also possible.

The memory controller 207 controls access to the external memory 211. As the external memory, a boot program, various applications, font data, a user file, an edit file, an external storage device (hard disk) for storing various data, and a memory such as a flexible disk (FD) can be used.

The communication I / F controller 208 connects and communicates with an external device via a network, and executes communication control processing on the network. For example, communication using TCP / IP, Wi-Fi, and communication using a 3G line and an LTE line are possible.

A storage device such as the external memory 211 is a medium for permanently storing information, and its form is not limited to a storage device such as a hard disk. For example, it may be a medium such as SSD (Solid State Drive).

It can also be used as a temporary memory area during various processes performed by the communication terminal in the present embodiment.

The CPU 201 enables display on the display device 210 by, for example, executing an outline font expansion (rasterization) process in the display information area in the RAM 202. Further, the CPU 201 enables a user instruction with a mouse cursor or the like (not shown) on the display device 210.

Next, an example of the hardware configuration of the surveillance cameras 103A and 103B shown in FIG. 1 will be described with reference to FIG.

FIG. 3 is a configuration diagram showing the hardware configuration of the surveillance cameras 103A and 103B.

The CPU 301 comprehensively controls each device and controller connected to the system bus 304. Further, the ROM 302 or the external memory 305 includes a BIOS (Basic Input / Output System) and an operating system program (hereinafter, OS) which are control programs of the CPU 301, and various programs which will be described later and which are necessary for realizing the functions described later. Is remembered. The RAM 303 functions as a main memory, a work area, and the like of the CPU 301.

The CPU 301 realizes various operations by loading a program or the like necessary for executing a process into the RAM 303 and executing the program.

The memory controller (MC) 306 is a smart device connected to a hard disk (HD) or a PCMCIA card slot that stores a boot program, various applications, font data, user files, edit files, various data, image data, etc. via an adapter. Controls access to the external memory 305 such as media (registered trademark).

The camera unit 307 of the surveillance cameras 103 and 104 is connected to the image processing unit 308, and the light obtained through the lens directed to the surveillance target is photoelectrically converted by a light receiving cell such as a CCD or CMOS. After that, the RGB signal and the complementary color signal are output to the image processing unit 308.

The image processing unit 308 of the surveillance cameras 103 and 104 performs white balance adjustment, gamma processing, and sharpness processing based on the RGB signal and the color capture signal, and further performs YC signal processing to perform the brightness signal Y and the chroma signal (hereinafter referred to as the chroma signal). , YC signal), compress the YC signal in a predetermined compression format (for example, PEG format, Motion PEG format, etc.), and the compressed data is temporarily stored in the external memory 305 as image data.

The communication I / F controller (communication I / FC) 309 connects and communicates with an external device via a network, executes communication control processing on the network, and stores an image stored in the external memory 305. The data is transmitted to the external device by the communication I / F controller 309.

FIG. 4 is a diagram showing an example of the appearance of the washer / dryer 105A.

As shown in FIG. 4, the washer / dryer 105A has a window 401 that can be opened and closed to put laundry, a handle 408 for opening and closing the window 401, and a selection button (404) for selecting a washing mode. , 405, 406), a display unit 403, a coin insertion unit 402, and a drum unit 409.

The window 401 is transparent, and the laundry put in the drum portion 409 can be confirmed from the outside of the washer / dryer 105A.

The selection buttons (404, 405, 406) have a plurality of washing modes in which the time required for washing and / or drying, the amount capable of washing and / or drying, and the charge for washing and / or drying are different from each other. In this embodiment, a selection button 404 for selecting a long-time / large-volume / high-priced washing mode 1, a selection button 405 for selecting a medium-time / medium-weight / medium-price washing mode 2, a short-time / small-volume / low-price washing mode 405. Each of the three selection buttons 406 of the selection button 406 for selecting the washing mode 3 is provided.

Further, the display unit 403 displays an error code indicating an abnormality of the washer / dryer 105A and the remaining time required for washing and / or drying. The coin insertion unit 402 is a port for inserting money, and there may be an electronic money reception unit instead of the coin insertion unit 402.

FIG. 5 is a diagram showing an example of the configuration of the coin laundry 501 in the store.

As shown in FIG. 5, the store of the coin laundry 501 is equipped with a washer / dryer 105A, a washer / dryer 105B, a money changer 503, a trash can 504, and a chair 502.

There is a risk that the animal may enter the store when the customer enters the store or the door of the store opens, and FIG. 5 shows an example of the store in which the animal has entered. The animal 505 is an animal that is not a human (person).

Next, the processing executed by the surveillance camera 103A and the server 100 will be described with reference to the flowchart shown in FIG.

FIG. 7 is a flowchart showing an example of processing executed by the surveillance camera 103A and the server 100.

The processing of each step of S701 to S702 shown in FIG. 7 is realized by the CPU of the surveillance camera 103A loading the program into the memory and executing it.

The processing of each step of S703 to S710 shown in FIG. 7 is realized by the CPU of the server 100 loading the program into the memory and executing it.

The surveillance camera 103A photographs the inside of the coin laundry store and acquires an image (S701).

Then, the surveillance camera 103A transmits the video (moving image) taken in S701 to the server 100 (S702).

When the server 100 acquires the image from the surveillance camera 103A (S703), the server 100 analyzes the image and acquires identification information for identifying the person who puts the laundry in the washer / dryer to identify the person. (S704). Here, the identification information is identification information that can be identified from an image, for example, an individual is identified from a face, a body shape, clothes, or their colors.

S703 is an application example of the acquisition means, and acquires an image of the inside of a coin laundry store with a surveillance camera.

In S704, by identifying the movement of the person putting the laundry in the washing / drying machine and the movement of the laundry 407 put in the washing / drying machine 105B from the video, the laundry is put in the washing / drying machine 105B. Identify the person who puts.

Next, the server 100 analyzes the image acquired in S703, and the person specified in S704 identifies the washer / dryer containing the laundry (S705).

Specifically, the washing / drying machine containing the laundry from the positional relationship between the person specified in S704 and the washing / drying machine, or the moving direction of the laundry put in by the person specified in S704. To identify.

Then, the server 100 displays the identification information of the person specified in S704, the identification information for identifying the washer / dryer specified in S705, and the washing / drying in the video management table 800 stored in the memory of the server 100. The person who puts the laundry in the dryer is registered in association with the time identified in S704 (S706).

FIG. 8 is a diagram showing an example of the video management table 800.

The video management table 800 shown in FIG. 8 is composed of items of "time", "washing machine / dryer", "person who put in the laundry", "person who put out the laundry", and "tag". There is.

The "time" is the time when the person who puts the laundry in the washer / dryer can be identified by S704 (the time when the person puts the laundry in the washer / dryer), or the washing / drying. The time when the person who puts out the laundry to the machine can be identified by S707 (the time when the person puts out the laundry from the washing / drying machine) is stored. The "washing machine / dryer" stores identification information for identifying the washing / drying machine specified in S705 and S708. The "person who puts the laundry" stores identification information for identifying the person identified in S704. The "person who put out the laundry" stores identification information for identifying the person identified in S707, which will be described later. In the "tag", a tag attached in S710, which will be described later, is stored.

Next, the server 100 analyzes the image acquired in S703, acquires identification information for identifying the person who is taking out the laundry from the washer / dryer, and identifies the person (S707). Here, the identification information is identification information that can be identified from an image, for example, an individual is identified from a face, a body shape, clothes, or their colors.

In S707, the laundry is removed from the washer / dryer by identifying the movement of the person taking out the laundry from the washer / dryer and the movement of the laundry 407 being taken out from the washer / dryer from the video. Identify the person who is issuing.

Next, the server 100 analyzes the image acquired in S703, and the person specified in S707 identifies the washer / dryer that put out the laundry (S708).

Specifically, the washing / drying machine that puts out the laundry from the positional relationship between the person specified in S707 and the washer / dryer, or the direction in which the laundry put out by the person specified in S707 is moving. To identify.

Then, the server 100 displays the identification information of the person specified in S707, the identification information for identifying the washer / dryer specified in S708, and the washing / drying in the video management table 800 stored in the memory of the server 100. The person who puts out the laundry in the dryer is registered in association with the time identified in S707.

When the processes up to S708 are executed, for example, the video management table 800 shown in FIG. 8 is stored in the memory of the server 100.

Next, the server 100 determines whether or not the person who puts in and takes out the laundry is the same person in the same washer / dryer (S709).

S709 is an application example of the determination means, in which the images acquired in S703 are analyzed in S704 to S708, and in the same washing machine or dryer, a person who puts the laundry and a person who takes out the laundry. Is different.

Specifically, the server 100 is a "person who puts the laundry" in order from the record having the same "washing machine / dryer" value in the video management table 800 and having the oldest "time" value. By determining whether the data of "the person who put out the laundry" and the data of "the person who put out the laundry" match, it is judged whether or not the person who put in and out the laundry is the same person in the same washer / dryer. ..

Then, when the server 100 determines in S709 that the person who puts in and takes out the laundry is not the same person in the same washer / dryer (NO), the server 100 refers to the administrator terminal operated by the administrator. , Notifies an alert that the person who puts in and takes out the laundry is not the same person in the same washer / dryer (S710).

S710 is an application example of the notification means of the present invention, and as a result of analyzing the images acquired in S703 in S704 to S709, the person who put the laundry and the laundry are taken out in the same washing machine or dryer. When it is determined that the person is different from the person (S709: NO), the user is notified to that effect.

Further, in S710, the server 100 determines that the data of the "person who put the laundry in" and the data of the "person who put out the laundry" do not match in S709 of the "tag" of the record. Add "○" as a tag to the item and memorize it.

Further, in S710, the server 100 transmits the video 602 acquired in S703 and the alert screen 601 shown in FIG. 6 to the administrator terminal (mobile terminal 101, information processing device 102).

FIG. 6 is a diagram showing an example of the alert screen 601.

The alert screen 601 is an area for displaying the video 602 (which may be a live video) acquired and recorded in S703, and the time zone (606, 607) of the record with the tag “○” of the video management table 800. It is a screen including a timeline 604, a timeline 607, and an alert message 603 that can identify.

In this way, the timeline 604 can identifiablely display the time zone (606, 607) of the image in which it can be confirmed that the person who puts in and takes out the laundry is not the same person in the same washer / dryer. can.

Further, in the timeline 604, among the records with the tag "○" of the video management table 800, the time zone 606 in which the laundry is put in and the time zone 607 in which the laundry is taken out are color-coded so as to be identifiable. Is displayed.

When the administrator terminal (mobile terminal 101, information processing device 102) receives the video 602 transmitted in S710 and the alert screen 601, the video 602 is displayed on the display unit of the administrator terminal (mobile terminal 101, information processing device 102). The alert screen 601 including the above is displayed.

S710 is an application example of the display control means, in which the image acquired in S703 is controlled so as to be displayable, and in the same washing machine or dryer, a person who puts the laundry and a person who takes out the laundry If it is determined that they are different, the timeline for distinguishing the time zone in which the laundry is put in and the time zone in which the laundry is taken out is controlled to be displayed.

In this way, the administrator (user) confirms the notification when a person different from the person who put the laundry in the washing machine or the dryer of the coin laundry takes out the laundry from the washing machine or the dryer, or It becomes possible to confirm the time zone in which it is necessary to confirm the image of a person different from the person who put the laundry in the washing machine or the dryer of the coin laundry and taking out the laundry from the washing machine or the dryer. Therefore, it is possible to efficiently confirm to the manager that a person different from the person who put the laundry in the washing machine or dryer of the coin laundry has taken out the laundry from the washing machine or dryer.

As described above, according to the present invention, it is possible to efficiently confirm to the administrator that a person different from the person who put the laundry in the washing machine or dryer of the coin laundry took out the laundry from the washing machine or dryer. Can be done.

The present invention can be implemented as, for example, a system, an apparatus, a method, a program, a recording medium, or the like. Specifically, it may be applied to a system composed of a plurality of devices, or may be applied to a device composed of one device.

Further, the program in the present invention is a program in which a computer can execute the processing method of the illustrated flowchart, and the storage medium of the present invention stores a program in which the computer can execute the processing method. The program in the present invention may be a program for each processing method of each device.

As described above, a recording medium on which a program that realizes the functions of the above-described embodiment is recorded is supplied to the system or device, and the computer (or CPU or MPU) of the system or device stores the program in the recording medium. Needless to say, the object of the present invention can be achieved by reading and executing.

In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium on which the program is recorded constitutes the present invention.

Recording media for supplying programs include, for example, flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, magnetic tapes, non-volatile memory cards, ROMs, EEPROMs, and silicon. A disk or the like can be used.

Further, by executing the program read by the computer, not only the function of the above-described embodiment is realized, but also the OS (operating system) or the like running on the computer is actually operated based on the instruction of the program. Needless to say, there are cases where a part or all of the processing is performed and the processing realizes the functions of the above-described embodiment.

Further, after the program read from the recording medium is written in the memory provided in the function expansion board inserted in the computer or the function expansion unit connected to the computer, the function expansion board is based on the instruction of the program code. It goes without saying that there are cases where the CPU or the like provided in the function expansion unit performs a part or all of the actual processing, and the processing realizes the functions of the above-described embodiment.

Further, the present invention may be applied to a system composed of a plurality of devices or a device composed of one device. It goes without saying that the present invention can also be applied when it is achieved by supplying a program to a system or an apparatus. In this case, by reading the recording medium in which the program for achieving the present invention is stored into the system or the device, the system or the device can enjoy the effect of the present invention.

Further, by downloading and reading a program for achieving the present invention from a server, database, or the like on the network by a communication program, the system or device can enjoy the effect of the present invention. It should be noted that all the configurations in which each of the above-described embodiments and modifications thereof are combined are also included in the present invention.

100 Server 101 Mobile terminal 102 Information processing device 103 Surveillance camera 104 Surveillance camera

Claims (7)

An acquisition method for acquiring images of the inside of a coin laundry store with a surveillance camera,
As a result of analyzing the image acquired by the acquisition means, when it is determined that the person who put the laundry in and the person who took out the laundry are different in the same washing machine or dryer, the user is notified to that effect. Notification means to notify and notification
An information processing system characterized by being equipped with. The image acquired by the acquisition means is analyzed, and in the same washing machine or dryer, a determination means for determining whether the person who put the laundry in and the person who took out the laundry is different is provided.
When the determination means determines that the person who puts the laundry and the person who takes out the laundry are different persons in the same washing machine or dryer, the user notifies the user. The information processing system according to claim 1, wherein the information processing system is notified to notify the user. In the same washing machine or dryer, if it is determined that the person who put the laundry in and the person who took out the laundry are different, a timeline that can identify the time zone when the laundry is taken out is displayed. The information processing system according to claim 1 or 2, wherein the display control means for controlling the operation is provided. In the same washing machine or dryer, if it is determined that the person who put the laundry in and the person who took out the laundry are different, the time zone in which the laundry is put and the person who took out the laundry are taken out. The information processing system according to claim 3, further comprising a display control means for controlling so as to display a timeline that can identify each of the time zones. The information processing system according to claim 4, wherein the display control means controls the video acquired by the acquisition means so that it can be displayed. It is a control method in an information processing system.
The acquisition process of acquiring images of the inside of a coin laundry store with a surveillance camera,
As a result of analyzing the video acquired by the acquisition process, if it is determined that the person who put the laundry in and the person who took out the laundry are different in the same washing machine or dryer, the user is notified to that effect. Notification process to notify to inform and
A control method characterized by comprising. A program for functioning as the information processing system according to any one of claims 1 to 5.

Images