JP2017228868A - Imaging System - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve the availability of an alignment mark.SOLUTION: An imaging system comprises an imaging apparatus; an information processing apparatus to be imaged by the imaging apparatus; a presentation unit which presents an alignment mark to be used to adjust an analysis region in a captured image; and a presentation control unit which controls the presentation unit to present the alignment mark in an adjustment mode being a mode to perform the adjustment.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an imaging system.

  In recent years, with the development of image analysis technology, an image captured by a camera or the like is analyzed with high accuracy, and the analysis result is used for various purposes. For example, by using the analysis result for the monitoring service, the occurrence of an abnormal situation can be detected with high accuracy. It is also possible for the robot to recognize the state of a person or an object using the image analysis result and to operate appropriately according to the state.

  Here, a shift in the imaging area or analysis area of a camera or the like has a great influence on the accuracy of image analysis. Therefore, various methods have been researched and developed for adjusting the imaging region or the analysis region. For example, a method has been proposed in which an imaging region or the like is adjusted based on the position or size of a captured mark. The following Patent Document 1 discloses a technique for recognizing a mark in a captured image. Patent Document 2 discloses a technique in which a mark is displayed in a direction in which an imaging apparatus should move when an imaging target deviates from the imaging area. Patent Document 3 discloses a technique for setting a monitoring area using a mark.

Japanese Patent Laying-Open No. 2005-210666 JP 2007-142866 A JP 2001-145092 A

  Here, the conventional technique has a problem that the availability of a mark (hereinafter referred to as an alignment mark) used for adjusting an imaging area or an analysis area is low. For example, there has been a problem that adjustment of the analysis region in the captured image becomes difficult because the alignment mark is illegally modified by a malicious third party or the alignment mark is damaged. In some cases, the alignment mark cannot be applied to the imaging target because the design of the alignment mark is not good.

  Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a new and improved imaging system capable of improving the availability of alignment marks. is there.

  In order to solve the above problems, according to an aspect of the present invention, an imaging apparatus, an information processing apparatus that is an imaging target of the imaging apparatus, and an alignment mark used for adjusting an analysis region in the captured image are presented. An imaging system is provided, comprising: a presentation unit that performs presentation, and a presentation control unit that causes the presentation unit to present the alignment mark in an adjustment mode in which the adjustment is performed.

  The presenting unit may present the alignment mark in an imaging region of the imaging device.

  The presenting unit may present the alignment mark at a plurality of locations.

  The presenting unit may be a display surface that displays an image, and the display surface may display the alignment mark.

  The display surface may be a display surface for information processing used by a user.

  The presenting unit may be a card processing unit that inserts or ejects a card, and the card processing unit may present the alignment mark using a dedicated card with the inserted alignment mark.

  The card processing unit may present the alignment mark by exposing a portion of the dedicated card to which the alignment mark is attached to the outside of the card handling slot.

  The card processing unit may process a card for information processing used by a user.

  The presenting unit may present the alignment mark by a partial operation or modification of the information processing apparatus.

  You may further provide the mode control part which switches the said adjustment mode and the non-adjustment mode in which the said presentation part does not present the said alignment mark.

  The information processing apparatus is a cash processing apparatus, and the cash processing apparatus further includes a card detection unit that detects that a dedicated card has been inserted into a card handling port, and the mode control unit is configured by the card detection unit. When insertion of the dedicated card is detected, the mode may be switched to the adjustment mode.

  An adjustment unit that specifies the target region based on information on the relative relationship between the alignment mark and the analysis target region in the captured image and the captured alignment mark, and performs the adjustment using the target region May be further provided.

  The adjustment unit may perform the adjustment by setting the analysis region in the target region.

  The adjustment unit may eliminate the shift by performing the adjustment when a shift occurs between the target region and the analysis region.

  The adjustment unit may eliminate the shift by moving the imaging device.

  The adjustment unit may eliminate the shift by editing the captured image.

  There may be a plurality of the analysis regions.

  You may further provide the model specific part which analyzes the imaged said alignment mark and specifies the model of the said information processing apparatus.

  The image analysis unit may further include an image analysis unit configured to determine whether the imaged operation or state is normal by comparing the analysis result of the analysis region with a learning result of a normal operation or state in the analysis region.

  As described above, according to the present invention, the availability of alignment marks can be improved.

It is a figure which shows the structure of the imaging system in one Embodiment of this invention. It is a figure which shows the structure of ATM in one Embodiment of this invention. It is a figure which shows the captured image and analysis area which were imaged with the camera. It is a figure which shows the alignment mark and analysis area | region in a captured image. It is a figure which shows the adjustment method of an analysis area | region. It is a figure which shows the adjustment method of an analysis area | region. It is a figure which shows the adjustment method of an analysis area | region. It is a flowchart which shows operation | movement of ATM and a camera at the time of adjustment mode. It is a flowchart which shows operation | movement of ATM and a camera at the time of a test operation mode. It is a figure which shows the message displayed on a display part at the time of test operation mode. It is a figure which shows the exclusive card | curd with which the alignment mark was attached | subjected. It is a figure which shows presentation of the alignment mark by a dedicated card. It is a figure which shows presentation of the alignment mark by the one part operation | movement or deformation | transformation of ATM.

  Exemplary embodiments of the present invention will be described below in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, the duplicate description is abbreviate | omitted by attaching | subjecting the same code | symbol.

The description will be made in the following order.
1. 1. Overview of imaging system Structure of ATM Operation 4. Modified example

<1. Overview of imaging system>
First, an overview of an imaging system according to an embodiment of the present invention will be described with reference to FIG. FIG. 1 is a diagram illustrating a configuration of an imaging system according to an embodiment of the present invention.

  As shown in FIG. 1, an imaging system according to an embodiment of the present invention includes an ATM 100 (Automated / Automatic Teller Machine) installed in a financial institution, a camera 200 that captures the ATM 100, and a dedicated camera used for the ATM 100. The card 300 is configured. The ATM 100 also includes a card handling port 30, a bankbook handling port 40, a banknote handling port 50, a coin handling port 60, a display surface 70, and a receiver 80. The card handling port 30 is a part into which various cards are inserted or ejected. The bankbook handling port 40 is a part where various bankbooks are inserted or discharged. The bill handling port 50 is a portion into which bills are inserted or discharged. The coin handling port 60 is a portion into which coins are inserted or discharged. The display surface 70 is a part that displays various screens such as an operation screen. The receiver 80 is a part that converts voice into an electrical signal or converts an electrical signal into voice for a call.

  The ATM 100 in the present embodiment is an information processing apparatus installed in a financial institution or a retail store, and is also called a cash processing apparatus. The user can use the ATM 100 to deposit or withdraw cash from the savings account, make a balance inquiry, fill in a passbook, or transfer to another account. In the present embodiment, the ATM 100 is described as an example, but the present invention can be applied to other than the ATM 100. For example, the present invention may be applied to any device such as an online transaction terminal installed in a ticket vending machine, vending machine, or convenience store of a transportation facility.

  The ATM 100 can detect an abnormal operation or state by analyzing a captured image provided from the camera 200. Thereafter, the ATM 100 notifies the monitoring center of information regarding the detected abnormal operation.

  The camera 200 in this embodiment is attached to the upper part of ATM100, and images a part of ATM100. Then, the camera 200 transmits captured image data to the ATM 100. In the present embodiment, the case where the installation position of the camera 200 is the upper part of the ATM 100 will be described as an example, but the installation position of the camera 200 can be changed as appropriate. For example, the camera 200 may be installed beside the ATM 100 or may be installed so as to contact the ATM 100. A plurality of cameras 200 may be installed.

  The dedicated card 300 in this embodiment is a card used to change the imaging system to the adjustment mode. When the dedicated card 300 is inserted into the ATM 100, the mode of the imaging system is changed from the non-adjustment mode to the adjustment mode. The adjustment mode is a mode in which the analysis area in the captured image is adjusted.

(background)
In recent years, fraudulent acts against ATMs have frequently occurred, and the methods of fraudulent acts are diversified. For example, by attaching a skimming device to an ATM card handling port, the user's card information is obtained illegally, or the movement of the user's hand is imaged with a small camera, so that the card PIN entered by the user is There have also been cases of illegal acquisition. If the card information or the password is extracted, it may be abused for manufacturing a counterfeit card.

  There are also various problems other than fraud. For example, a user, particularly an elderly person or a foreigner, may not understand an ATM operation method and may perform an incorrect operation. In addition, the user may misplace the bag after using the ATM.

  The imaging system can detect the occurrence of the above problem by analyzing a captured image captured by the camera 200. More specifically, the imaging system learns a captured image in which a normal operation or state is captured, and compares the learning result with the feature amount of the captured image, thereby causing an abnormality such as attachment of a skimming device. Can detect any movement or condition.

  By the way, in the image analysis, since the shift of the imaging region or the analysis region has a great influence on the accuracy of the analysis, when the shift occurs, it is necessary to correct the shift by adjustment work. Of course, adjustment work is also required when installing the ATM. At this time, if the adjustment work is complicated, the burden on the operator increases. However, if the adjustment work is simple, there is a possibility that an unauthorized adjustment is performed by a malicious third party. For example, when the imaging area is changed, a state in which fraud such as attachment of a skimming device is not detected may occur.

  The imaging system can automatically perform adjustment work by analyzing the position of the alignment mark in the captured image. Moreover, since adjustment work is not performed unless the dedicated card 300 is inserted into the ATM 100, it is possible to prevent a third party from performing unauthorized adjustments.

<2. Structure of ATM>
The outline of the imaging system in the present embodiment has been described above. Then, with reference to FIG. 2, the structure of ATM100 in this embodiment is demonstrated. FIG. 2 is a diagram showing a configuration of the ATM 100 in one embodiment of the present invention.

  The ATM 100 in the present embodiment includes a communication unit 110, a control unit 120, a card processing unit 130, a passbook processing unit 140, a banknote processing unit 150, a coin processing unit 160, a display unit 170, and a call unit 180. And a storage unit 190. The control unit 120 includes an image analysis unit 121, an alarm unit 122, a mode control unit 123, a presentation control unit 124, an adjustment unit 125, and a model specifying unit 126.

(Communication Department)
The communication unit 110 is an interface to the camera 200 and a monitoring center (not shown). The communication unit 110 provides captured image data transmitted from the camera 200 to the control unit 120, and transmits information related to the control of the camera 200 provided from the control unit 120 to the camera 200. In addition, the communication unit 110 transmits information such as abnormal operation provided from the control unit 120 to the monitoring center. The communication unit 110 may be a wired or wireless transmission path interface.

(Image Analysis Department)
The image analysis unit 121 analyzes a captured image captured by the camera 200. Here, a more specific description will be given with reference to FIG. FIG. 3 is a diagram illustrating a captured image captured by the camera 200 and an analysis region.

  As shown in FIG. 3, the captured image includes a card handling port 30, a passbook handling port 40, a bill handling port 50, a coin handling port 60, a display surface 70, and a receiver 80. . The image analysis unit 121 reads and learns a captured image of an object to be imaged. And the image analysis part 121 specifies what the target object is by comparing this learning result with the feature-value of a captured image. The image analysis unit 121 also identifies an alignment mark 10 to be described later using the same method. The image analysis unit 121 can detect the shift of the imaging region by specifying the captured object.

  In addition, the image analysis unit 121 analyzes an action or state captured in the analysis region 20 in real time. More specifically, the image analysis unit 121 compares the feature amount of the captured image in the analysis region 20 with the normal model. Here, the normal model is information constructed by extracting a feature amount from a captured image of a normal operation or state in the analysis region 20, and the operation model or state name information is included in the normal model. May be included. Then, the image analysis unit 121 compares the feature amount of the captured image in the analysis region 20 with the normal model, and determines whether or not the operation is normal.

  Thereby, the image analysis unit 121 can detect the fraud in real time. For example, the image analysis unit 121 can detect an operation of attaching an unauthorized device to the ATM 100 or an operation of inserting an unauthorized card. In addition, the image analysis unit 121 can detect a situation where the user is not correctly operating the ATM 100. For example, the image analysis unit 121 can detect an abnormal movement of the user's hand or a situation where the operation has not been completed for a long time. In addition, the image analysis unit 121 can detect the presence of a foreign object such as a forgotten object.

  By narrowing the detailed analysis range to the analysis region 20, the accuracy of the analysis can be improved as compared with the case where the entire captured image is analyzed. For example, when the entire captured image is analyzed, there is a possibility that the accuracy of the analysis may be reduced by analyzing a person or an object that should not be analyzed, such as a person walking around the ATM 100. By narrowing the range of detailed analysis to the analysis region 20, such problems can be avoided and the accuracy of analysis can be improved. In FIG. 3, the analysis area 20 is set in the vicinity of the card handling slot 30, but this is an example, and the location and number of the analysis areas 20 are arbitrary.

(Alarm part)
When an abnormal operation or state is detected by the image analysis unit 121, the alarm unit 122 notifies the monitoring center or the like via the communication unit 110. In addition, the alarm unit 122 may also notify information regarding abnormal operation or state contents, occurrence date and time, occurrence location, and the like. In the test operation mode, the alarm unit 122 stops the above notification function. The test operation mode will be described later.

(Mode control unit)
The mode control unit 123 switches the imaging system mode to any one of the non-adjustment mode, the adjustment mode, and the test operation mode. More specifically, the mode control unit 123 switches the mode of the ATM 100 from the non-adjustment mode to the adjustment mode when the dedicated card 300 is inserted into the card handling port 30 of the ATM 100. The non-adjustment mode is a mode in which the ATM 100 is used by the user as usual and image analysis is performed. The adjustment mode is a mode in which the analysis region 20 is adjusted. The mode control unit 123 switches from the adjustment mode to the test operation mode after the adjustment is completed. The test operation mode is a mode in which an abnormality detection test is performed. The mode control unit 123 switches from the test operation mode to the non-adjustment mode after the abnormality detection test is completed. Operations in the adjustment mode and the test operation mode will be described later.

(Presentation control unit)
In the adjustment mode, the presentation control unit 124 causes the display unit 170 to display the alignment mark 10 so as to be captured by the camera 200. Here, a display method of the alignment mark 10 will be described with reference to FIG. FIG. 4 is a diagram showing the alignment mark 10 and the analysis region 20 in the captured image. As shown in FIG. 4, the presentation control unit 124 displays two alignment marks 10 on the display unit 170 (the display surface 70 in the captured image). However, this is only an example, and the shape and number of alignment marks 10 to be displayed are arbitrary.

  In this method, since the alignment mark 10 is not displayed when no adjustment is performed, a simpler screen can be provided as compared with the method in which the alignment mark 10 is always displayed. Further, the possibility that the alignment mark 10 is damaged or deteriorated can be reduced.

  Moreover, the alignment mark 10 can be easily changed by this method. For example, when the alignment mark 10 is physically installed on the ATM 100, in order to change the alignment mark 10, an operator must perform an operation of changing the alignment mark 10 on each ATM 100. Further, depending on the structure of the ATM 100, the alignment mark 10 may not be changed. On the other hand, in the method in which the alignment mark 10 is displayed on the display unit 170, the alignment mark 10 of each ATM 100 can be collectively changed remotely via a network.

  The presentation control unit 124 may display not only the alignment mark 10 but also a mark (hereinafter referred to as “model mark”) by which the model of the ATM 100 can be specified on the display unit 170. The shape of this mark is arbitrary. For example, the presentation control unit 124 may display the model number of the ATM 100 on the display unit 170. Thereby, the model of ATM100 is specified by the analysis of a captured image, and the adjustment part 125 can perform adjustment according to a model.

(Adjustment part)
The adjustment unit 125 adjusts the analysis region 20 based on the alignment mark 10 in the adjustment mode. Here, the adjustment method of the analysis region 20 will be described with reference to FIGS. 5 to 7 are diagrams illustrating a method for adjusting the analysis region 20.

  FIG. 5 shows a method of correcting the shift by the adjustment unit 125 setting the analysis region 20 to the analysis target region 21. The analysis target region 21 is a region where analysis using a normal model is possible. As shown in 5A of FIG. 5, when the imaging region of the camera 200 is shifted for some reason and the analysis region 20 is shifted from the analysis target region 21, the adjustment unit 125 is based on the alignment mark 10 as shown in 5B. The position of the analysis region 20 is set to the analysis target region 21.

  More specifically, the adjustment unit 125 grasps in advance the relative positional relationship between the alignment mark 10 and the analysis target region 21 in the captured image. Then, the adjustment unit 125 sets the analysis region 20 based on this positional relationship and the position and size of the alignment mark 10 in the captured image after the shift. With this method, the image analysis unit 121 can correctly perform image analysis in the non-adjustment mode.

  Here, as shown in FIG. 5, adjustment is performed using a plurality of alignment marks 10, whereby the adjustment accuracy can be improved. More specifically, when adjustment is performed using one alignment mark 10, if the position of the alignment mark 10 specified by the image analysis unit 121 is deviated from the correct position, the accuracy of adjustment decreases. On the other hand, when the adjustment is performed using the plurality of alignment marks 10, the image analysis unit 121 can recognize the displacement of the position of the alignment marks 10 based on the specified positional relationship of the plurality of alignment marks 10. . Therefore, since the image analysis unit 121 can adjust the shift or redo the specific process of the alignment mark 10, it is possible to improve the accuracy of the adjustment.

  FIG. 6 shows a method of correcting the shift by the adjustment unit 125 controlling the direction of the camera 200 and the like. 6A, when the analysis region 20 is shifted from the analysis target region 21, the adjustment unit 125 physically moves the camera 200 and adjusts the direction of the camera 200 and the like as illustrated in 6B. Thus, the deviation of the analysis region 20 is corrected. The adjustment unit 125 can physically move the camera 200 by providing information related to the control of the camera 200 to the camera 200 via the communication unit 110. With this method, the image analysis unit 121 can correctly perform image analysis in the non-adjustment mode.

  FIG. 7 shows a method in which the adjustment unit 125 corrects the deviation by editing the captured image. As shown in 7A of FIG. 7, when the analysis region 20 is shifted from the analysis target region 21 due to enlargement of the captured image, the adjustment unit 125 performs analysis by reducing the captured image as illustrated in 7B. The shift of the region 20 is corrected. The adjustment unit 125 may appropriately change the position of the captured image. When the captured image is reduced (not shown), the adjustment unit 125 corrects the shift of the analysis region 20 by enlarging the captured image.

  Further, the adjustment unit 125 may perform various types of image editing in addition to enlargement or reduction. For example, the adjustment unit 125 may change the parameter value in order to correct brightness (exposure), color (white balance), distortion, focus, and the like of the captured image. This makes it easier for the image analysis unit 121 to recognize the captured object. In addition, since the image analysis unit 121 can easily recognize the alignment mark 10, it is possible to improve deviation correction accuracy.

  In this method, the edited content of the captured image is provided to the image analysis unit 121 after adjustment. Then, the image analysis unit 121 can correctly perform image analysis by performing the same editing as the editing content on the captured image in the non-adjustment mode.

  The adjustment unit 125 can change the adjustment method according to the model of the ATM 100 identified by the model identification unit 126. For example, the adjustment unit 125 can change information on the relative positional relationship between the alignment mark 10 and the analysis target region 21 in accordance with the ATM 100 model. Thereby, the adjustment part 125 can set the analysis area | region 20 correctly, even when the position or magnitude | size of the card handling port 30 etc. differ with models. Further, the adjustment unit 125 may change the shape or number of the alignment mark 10 and the analysis region 20 according to the model. Moreover, the adjustment part 125 may change the adjustment method of the analysis area | region 20 shown in FIGS. 5-7 according to a model.

(Model identification part)
The model identifying unit 126 identifies the model of the ATM 100 based on the captured model mark. The model specifying unit 126 may specify the model of the ATM 100 based on the characteristics of each part of the ATM 100 that has been imaged.

(Card processing department)
The card processing unit 130 functions as a card detection unit that detects that a card has been inserted into the card handling port 30. The card processing unit 130 processes a card inserted into the card handling slot 30. Here, the card is arbitrary if it is a card on which information processing such as reading and writing of card data is performed. For example, the card may be a cash card or a credit card. The card processing unit 130 also takes in or discharges a card.

(Passbook Processing Department)
The passbook processing unit 140 processes the passbook inserted into the passbook handling port 40. The bankbook is, for example, various bankbooks issued by financial institutions. The passbook processing unit 140 reads and rewrites the passbook, takes in or discharges the passbook, and the like.

(Bill Processing Department)
The banknote processing unit 150 performs various processes related to banknotes. For example, the banknote processing unit 150 takes in banknotes inserted into the banknote handling port 50 or discharges banknotes to the banknote handling port 50.

(Coin processing department)
The coin processing unit 160 performs various processes related to coins. For example, the coin processing unit 160 takes in coins input into the coin handling port 60 or discharges coins to the coin handling port 60.

(Display section)
The display unit 170 displays on the display surface 70 a screen used for information processing such as depositing and withdrawing from a deposit / saving account. The content of the image displayed on the screen is arbitrary. For example, the display unit 170 displays an operation button or an image related to the operation result. The display unit 170 also functions as a presentation unit by displaying the alignment mark 10.

(Calling part)
The call unit 180 provides a function for a user using the ATM 100 to make a call with a person in charge of an inquiry window using the receiver 80. When the user picks up the handset 80 and presses the contact button or the like, the call unit 180 connects to the person in charge. Further, the call unit 180 can notify the user of the reception by receiving an incoming call from the person in charge and issuing a reception sound.

(Memory part)
The storage unit 190 stores information related to the processing of the control unit 120. For example, the storage unit 190 stores a normal model, information on the feature values of the components of the ATM 100, information on the model corresponding to the model mark, information on the relative positional relationship between the alignment mark 10 and the analysis region 20, and the like. Further, the storage unit 190 may store a result of image analysis or a captured image.

<3. Operation>
The configuration of the ATM 100 has been described above. Next, the operation of the imaging system will be described with reference to FIGS. FIG. 8 is a flowchart showing operations of the ATM 100 and the camera 200 in the adjustment mode.

  First, in step S1000, the card processing unit 130 detects the dedicated card 300 inserted into the card handling slot 30. In step S1004, the mode control unit 123 switches the mode of the ATM 100 from the non-adjustment mode to the adjustment mode. In step S1008, the presentation control unit 124 causes the display unit 170 to display the alignment mark 10.

  In step S <b> 1012, the image analysis unit 121 acquires a captured image from the camera 200 via the communication unit 110. In step S1016, the image analysis unit 121 analyzes the captured image and searches for the alignment mark 10. If the alignment mark 10 is detected (step S1020 / Yes), the image analysis unit 121 acquires the position and size of the alignment mark 10 in step S1028.

  When the alignment mark 10 is not detected (step S1020 / No), the process of step S1008 is performed (step S1024). Here, the presentation control unit 124 may appropriately change the display position of the alignment mark 10 so that the alignment mark 10 is detected. For example, when the alignment mark 10 is not detected because the alignment mark 10 is not shown in the captured image, the presentation control unit 124 changes the display position of the alignment mark 10 to be included in the imaging region. Also good. The possibility that the image analysis unit 121 detects the alignment mark 10 can be improved by the presentation control unit 124 autonomously correcting the display position of the alignment mark 10.

  In step S1032, the image analysis unit 121 specifies the analysis target region 21 based on the position and size of the alignment mark. When the analysis target region 21 and the analysis region 20 are shifted (or when the shift is larger than a predetermined threshold), the adjustment unit 125 adjusts the analysis region 20 in step S1040.

  In step S1044, the display unit 170 displays an image on which the captured image and the analysis region 20 are superimposed. Thereby, the operator can confirm the analysis area 20 after adjustment. In step S1048, the mode control unit 123 switches the mode from the adjustment mode to the test operation mode. Even when the analysis target region 21 and the analysis region 20 are not shifted in step S1036 (or when the shift is equal to or smaller than a predetermined threshold value), the same processing as step S1048 is performed.

  Subsequently, the operation of the imaging system in the test operation mode will be described with reference to FIGS. 9 and 10. FIG. 9 is a flowchart showing operations of the ATM 100 and the camera 200 in the test operation mode. FIG. 10 is a diagram illustrating a message displayed on the display unit 170 in the test operation mode.

  During the test operation mode, as shown in 10A of FIG. 10, the display unit 170 displays a message “Test mode in operation”. In step S1100, the alarm unit 122 stops the function of notifying abnormality detection. In step S1104, the worker performs an abnormal operation or a normal operation on the ATM 100, and confirms that these operations are correctly detected. Examples of the abnormal operation include an operation of attaching a skimming device to the card handling port 30, an operation of inserting an unauthorized card, and the like.

  When the image analysis unit 121 detects an abnormality (step S1108 / Yes), in step S1112, the display unit 170 displays a message “abnormality has been detected” for several seconds as illustrated in 10B of FIG. Thereby, the operator can confirm that an abnormal operation is detected. If the image analysis unit 121 does not detect any abnormality (step S1108 / No), in step S1116, the display unit 170 displays a message indicating normality for a few seconds (not shown), or the message 10A in FIG. May continue to be displayed.

  When the operator finishes the test (step S1120 / Yes), the card processing unit 130 discharges the dedicated card 300 from the card handling port 30. The test may be terminated by pressing an end button shown in 10A or 10B of FIG. When the worker does not finish the test (step S1120 / No), the process of step S1104 is performed (step S1128).

<4. Modification>
The operation of the imaging system in the present embodiment has been described above. Next, a modification of the alignment mark presentation method will be described.

(First modification)
First, a first modification will be described with reference to FIGS. 11 and 12. FIG. 11 is a diagram showing the dedicated card 310 to which the alignment mark 11 is given. FIG. 12 is a diagram showing presentation of the alignment mark 11 by the dedicated card 310.

  As shown in FIG. 11, in the first modification, the alignment mark 11 is given to the dedicated card 310. The dedicated card 310 of FIG. 11 is provided with three alignment marks 11, and each of the alignment marks 11 has a different shape. However, this is an example, and the shape and the number of the alignment marks 11 are arbitrary.

  In the first modification, the card processing unit 130 functions as a presentation unit for the alignment mark 11. More specifically, in step S1008 in FIG. 8, the presentation control unit 124 controls the card processing unit 130 to handle the dedicated card 310 so that the portion to which the alignment mark 11 is given is exposed. Drain from the mouth 30. Until the image analysis unit 121 detects the alignment mark 11, the card processing unit 130 changes the position of the dedicated card 310.

  In this method, since the alignment mark 11 is not presented when no adjustment is performed, the appearance of the ATM 100 can be made simpler than the method in which the alignment mark 11 is always presented. Further, the possibility that the alignment mark 11 is damaged or deteriorated can be reduced.

  The first modification can be used in combination with a method in which the alignment mark 10 described above is displayed on the display unit 170. Thereby, even when the alignment mark 10 is not displayed on the display unit 170 due to a failure of the display unit 170 or the like, the adjustment work can be performed using the alignment mark 11 of the dedicated card 310. Further, fine adjustment using the alignment mark 11 of the dedicated card 310 may be performed after adjustment using the alignment mark 10 displayed on the display unit 170.

(Second modification)
Next, a second modification will be described with reference to FIG. FIG. 13 is a view showing presentation of the alignment mark 12 by a part of the operation or deformation of the ATM 100. In the second modification, the alignment mark 12 is presented by a part of the ATM 100 that functions as a presentation unit operating or deforming. The shape and the number of alignment marks 12 are arbitrary.

  For example, as shown in FIG. 13, a presentation unit 90 (not shown in FIG. 2) is provided on the ATM 100. The presentation unit 90 includes a lid and an alignment mark 12, and the alignment mark 12 is exposed when the lid is opened. This configuration is an example, and the presentation unit 90 can be changed as appropriate.

  In the second modification, the presentation control unit 124 controls the presentation unit 90 to open the lid and expose the alignment mark 12 in step S1008 of FIG. In this method, since the alignment mark 12 is not presented when no adjustment is performed, the appearance of the ATM 100 can be made simpler than the method in which the alignment mark 12 is always presented. Further, the possibility that the alignment mark 12 is damaged or deteriorated can be reduced.

  The second modification can be used in combination with the above-described method in which the alignment mark 10 is displayed on the display unit 170 or the first modification. Thereby, even when the alignment mark 10 is not displayed on the display unit 170 or when the adjustment work according to the first modification is impossible, the adjustment work can be performed using the alignment mark 12 of the presentation unit 90. Further, fine adjustment using the alignment mark 12 of the presentation unit 90 may be performed after adjustment using the alignment mark 10 displayed on the display unit 170.

  The preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, but the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention pertains can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present invention.

  For example, a part of the configuration of the ATM 100 can be provided outside. For example, the image analysis unit 121, the alarm unit 122, the adjustment unit 125, and the model specifying unit 126 may be included in an external device.

  From another point of view, for example, each step in the flowchart described in the present specification does not necessarily have to be processed in time series in the order described in the flowchart. Also, each step of the flowchart can be omitted as appropriate. For example, in the flowchart of FIG. 8, the switching process to the test operation mode (step S1048) can be omitted.

  Further, the effects described in the present specification are merely illustrative or exemplary and are not limited. That is, the technology according to the present invention can exhibit other effects that are apparent to those skilled in the art from the description of the present specification in addition to or instead of the above effects.

10, 11, 12 Alignment mark 20 Analysis area 21 Analysis target area 30 Card handling slot 40 Passbook handling slot 50 Banknote handling slot 60 Coin handling slot 70 Display surface 80 Handset 90 Presentation unit 100 ATM
DESCRIPTION OF SYMBOLS 110 Communication part 120 Control part 130 Card processing part 140 Passbook processing part 150 Banknote processing part 160 Coin processing part 170 Display part 180 Calling part 190 Memory | storage part 200 Camera 300, 310 Dedicated card

Claims (19)

An imaging device;
An information processing apparatus that is an imaging target of the imaging apparatus;
A presentation unit that presents an alignment mark used to adjust the analysis region in the captured image;
An imaging system comprising: a presentation control unit that causes the presentation unit to present the alignment mark in an adjustment mode in which the adjustment is performed.   The imaging system according to claim 1, wherein the presenting unit presents the alignment mark in an imaging region of the imaging device.   The imaging system according to claim 1, wherein the presenting unit presents the alignment mark at a plurality of locations. The presenting unit is a display surface for displaying an image,
The imaging system according to any one of claims 1 to 3, wherein the display surface displays the alignment mark.   The imaging system according to claim 4, wherein the display surface is a display surface for information processing used by a user. The presenting unit is a card processing unit that inserts or ejects a card,
The imaging system according to any one of claims 1 to 3, wherein the card processing unit presents the alignment mark using a dedicated card with the inserted alignment mark.   The imaging system according to claim 6, wherein the card processing unit presents the alignment mark by exposing a portion of the dedicated card to which the alignment mark is attached to the outside of a card handling opening.   The imaging system according to claim 6, wherein the card processing unit processes a card for information processing used by a user.   The imaging system according to any one of claims 1 to 3, wherein the presentation unit presents the alignment mark by a partial operation or modification of the information processing apparatus.   The imaging system according to claim 1, further comprising a mode control unit that switches between the adjustment mode and a non-adjustment mode in which the presentation unit does not present the alignment mark. The information processing apparatus is a cash processing apparatus,
The cash processing apparatus further includes a card detection unit that detects that a dedicated card is inserted into the card handling port,
11. The imaging system according to claim 10, wherein the mode control unit switches to the adjustment mode when insertion of the dedicated card is detected by the card detection unit.   An adjustment unit that specifies the target region based on information on the relative relationship between the alignment mark and the analysis target region in the captured image and the captured alignment mark, and performs the adjustment using the target region The imaging system according to claim 1, further comprising:   The imaging system according to claim 12, wherein the adjustment unit performs the adjustment by setting the analysis region as the target region.   The said adjustment part eliminates the said shift | offset | difference by performing the said adjustment, when the shift | offset | difference has arisen between the said object area | region and the said analysis area | region, The any one of Claim 12 or 13 characterized by the above-mentioned. The imaging system described in 1.   The imaging system according to claim 12, wherein the adjustment unit eliminates the shift by moving the imaging device.   The imaging system according to any one of claims 12 to 15, wherein the adjustment unit eliminates the shift by editing the captured image.   The imaging system according to claim 1, wherein there are a plurality of analysis regions.   The imaging system according to claim 1, further comprising a model specifying unit that analyzes the captured alignment mark and specifies a model of the information processing apparatus. It further comprises an image analysis unit that determines whether the imaged operation or state is normal by comparing the analysis result of the analysis region and the learning result of the normal operation or state in the analysis region. The imaging system according to any one of claims 1 to 18.

Images