JP2004112227A - Infrared communication apparatus, cellular telephone, and control method of operation - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To monitor an abnormal infrared output from a non-regular external infrared device and a normal infrared output from a regular external infrared device, and to appropriately control the operation of an infrared communication means according to the result of monitoring. <P>SOLUTION: An image pickup section is kept on while executing target infrared communication to continue to monitor the external infrared device of a malicious user (S05). That is, the result of image pickup by an image pickup section is subjected to image processing (S06), and it is determined whether or not the other external infrared device is present (S07) on the basis of image data obtained by the image processing. If it is determined that the other external infrared device is present, since it is possible that the other external infrared device is the external infrared device of a malicious user, an infrared communication section is immediately turned off to stop the infrared communication (S10), and the user is notified that the infrared communication has been stopped (S11) by displaying the effect on a displaying section of the cellular telephone. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention provides an infrared communication unit for performing infrared communication with a target external infrared device, and is capable of capturing an image with a wider viewing angle than the infrared communication unit having sensitivity in a light wavelength region including an infrared region. The present invention relates to an infrared communication device, a mobile phone, and an operation control method for controlling the operation of the infrared communication device in the infrared communication device. Note that the external infrared device means an infrared device installed at a predetermined place in an urban area, such as an electronic payment terminal using IrDA.
[0002]
[Prior art]
In recent years, infrared communication (IrDA) has attracted much attention, and various technologies related to infrared communication have been proposed (for example, see Patent Document 1 below). Many types of mobile phones equipped with an infrared interface have been put on the market even for PDC, which is a Japanese standard, and many mobile phones have an infrared interface, even for the GSM standard, which is a global standard. In recent years, a wireless electronic payment system using IrDA has been standardized, and its importance has been further increased.
[0003]
[Patent Document 1]
JP 10-105484 A
[Problems to be solved by the invention]
However, since infrared rays are outside the visible region, they have a characteristic that they cannot be recognized by human eyes. For this reason, even when a malicious third party attempts to falsify any data related to electronic payment using a strong IrDA signal while performing electronic payment (exchanging credit card number information) using IrDA. It is difficult for the user during the settlement to notice the tampering except for using a special device.
[0005]
For this reason, during infrared communication, it is desired to take measures such as monitoring abnormal infrared output from devices other than the authorized external infrared device, and stopping infrared communication when abnormal infrared output is detected. Was.
[0006]
The present invention has been made to solve the above problems, and monitors abnormal infrared output from a device other than a regular external infrared device and normal infrared output from a regular external infrared device. It is an object of the present invention to provide an infrared communication device, a mobile phone, and an operation control method capable of appropriately controlling the operation of the infrared communication means according to the result.
[0007]
[Means for Solving the Problems]
To achieve the above object, an infrared communication device according to the present invention includes an infrared communication unit for performing infrared communication with a target external infrared device, and an infrared region. An imaging unit having sensitivity in the wavelength range of light and capable of imaging with a wider viewing angle than the infrared communication unit; and an external infrared device based on image data obtained by the imaging unit. Determination means for determining whether or not the external infrared device is an external infrared device for outputting infrared light in a predetermined blinking pattern; and Control means for controlling activation or stop of the means.
[0008]
That is, in the infrared communication apparatus according to the present invention, an area including the target external infrared device is imaged by the imaging means having sensitivity in a light wavelength region including the infrared region. At this time, it is possible to take an image with a wider viewing angle than the infrared communication means.
[0009]
That is, since the imaging unit has sensitivity in the light wavelength region including the infrared region, by imaging the area including the target external infrared device, the infrared light output from the target external infrared device in a predetermined blinking pattern is obtained. Can be captured. Therefore, based on the image data obtained by the imaging, whether or not an external infrared device is present is determined by the determining means, and the external infrared device that is present outputs the infrared light in a predetermined blinking pattern. Is determined. At this time, by identifying the blinking pattern of the infrared ray, it can be determined whether or not the device that outputs the infrared ray is the target external infrared ray device.
[0010]
Then, the control means controls starting or stopping of the infrared communication means based on the determination result. Specifically, as set forth in claim 2, the control means controls to activate the infrared communication means when it is determined that an external infrared device is present and the external infrared device is the target external infrared device. It can be configured. Further, as set forth in claim 3, the control means is configured to control to stop the infrared communication means when it is determined that an external infrared device is present and the external infrared device is not the target external infrared device. Can be.
[0011]
As described above, according to the present invention, an abnormal infrared output from a device other than a proper external infrared device or a normal infrared output from a proper external infrared device is monitored, and infrared communication is performed according to the monitoring result. The operation of the means can be appropriately controlled. Accordingly, when a malicious third party attempts to falsify any data related to electronic payment or the like with a strong IrDA signal or the like, abnormal infrared output related to the falsification is promptly detected, and infrared communication is immediately performed. You can take defensive measures such as canceling.
[0012]
The infrared communication device according to the first to third aspects described above can be mounted on a mobile phone. That is, a mobile phone according to a fourth aspect is provided with the infrared communication device according to any one of the first to third aspects. By mounting the infrared communication device according to the present invention on a widely used mobile phone, the effects of the present invention can be widely and generally spread. Of course, the infrared communication device according to the present invention can be mounted on, for example, a multimedia kiosk (MMK) terminal, a PDA, a PHS, a portable personal computer, and the like, in addition to the mobile phone.
[0013]
Further, the inventions according to the first to third aspects of the infrared communication device can be described as inventions relating to the operation control method as in the fifth to seventh aspects, and the same operation and effect can be obtained.
[0014]
That is, the operation control method according to claim 5, wherein the infrared communication means for performing infrared communication with a target external infrared device, and the infrared communication means having sensitivity in a light wavelength region including the infrared region. An operation control method for controlling the operation of the infrared communication unit in an infrared communication device including an imaging unit capable of imaging with a wider viewing angle, wherein the imaging unit is configured to control the target external infrared device. An imaging step of imaging the included area, and based on the image data obtained in the imaging step, whether or not an external infrared device is present, and the existing external infrared device outputs infrared light in a predetermined blinking pattern And a control step of controlling the start or stop of the infrared communication unit based on the result of the determination. To.
[0015]
Further, in the operation control method according to the sixth aspect, in the control step, when the external infrared device is present and the determination result is that the external infrared device is the target external infrared device, the infrared communication unit is activated. It is characterized by the following control.
[0016]
Further, in the operation control method according to the seventh aspect, in the control step, when an external infrared device is present and the determination result indicates that the external infrared device is not the target external infrared device, the infrared communication unit is stopped. It is characterized by controlling.
[0017]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0018]
[Configuration of mobile phone]
FIG. 1 shows components related to the present invention extracted from a mobile phone 10 equipped with an infrared communication device according to the present invention. Hereinafter, the components will be described.
[0019]
As shown in FIG. 1, a mobile phone 10 has an infrared communication unit 11 for performing infrared communication with a target external infrared device, and has a sensitivity in a light wavelength region including the infrared region. An imaging unit 12 capable of imaging with a wider viewing angle than the unit 11, and based on image data obtained by imaging by the imaging unit 12, whether or not an external infrared device exists, A determination unit 13 for determining whether the device is an external infrared device for outputting infrared light in a predetermined blinking pattern, and a control unit 14 for controlling activation or stop of the infrared communication unit 11 based on the determination result. It is comprised including.
[0020]
Although details will be described later, the control unit 14 controls the infrared communication unit 11 to be activated when an external infrared device is present and the external infrared device is determined to be the target external infrared device. If it is determined that the external infrared device exists and is not the target external infrared device, the infrared communication unit 11 is controlled to stop.
[0021]
The infrared communication device according to the present invention can be mounted not only on a mobile phone but also on, for example, a multimedia kiosk (MMK) terminal, a PDA, a PHS, a portable personal computer, and the like. An example of a telephone will be described.
[0022]
[Operation Control Processing of FIG. 2]
Next, an operation control process according to the present embodiment will be described. In the mobile phone 10, the processing of FIG. 2 is executed under the control of the control unit 14.
[0023]
In the mobile phone 10, first, the imaging unit 12 having sensitivity in a light wavelength region including an infrared region is turned on (S01). Thus, the imaging unit 12 captures an image of the area including the target external infrared device. At this time, the imaging unit 12 can image the area with a wider viewing angle than the infrared communication unit 11. For example, as shown in FIG. 4, with respect to the viewing angle α of the infrared communication unit 11, the imaging unit 12 determines the imaging area 22 including the target external infrared device 20 by the viewing angle β (β> α) of the imaging unit 12. Can be imaged.
[0024]
Then, the imaging result is subjected to image processing (S02). Based on the image data obtained by the image processing, the determination unit 13 determines whether or not an external infrared device is present, and determines whether the external infrared device is present at a predetermined level. It is determined whether or not the external infrared device is for outputting infrared light in a blinking pattern (S03). If the external infrared device does not exist or is not the intended external infrared device, the new imaging result is subjected to image processing again (S02), and the determination is made again (S03).
[0025]
On the other hand, when it is determined in S03 that the target external infrared device is present, the infrared communication unit 11 is automatically turned on (S04), and the infrared communication unit 11 communicates with the target external infrared device. Infrared communication (for example, electronic settlement (exchange of credit card number information) using IrDA) is executed (S05).
[0026]
In the present embodiment, the imaging unit 12 is turned on even during the execution of the target infrared communication, and the malicious external infrared device is continuously monitored. That is, the imaging result of the imaging unit 12 during the execution of the infrared communication is subjected to image processing (S06), and the determination unit 13 determines whether another external infrared device exists based on the image data obtained by the image processing. Is determined (S07). Here, it is determined that another external infrared device is present based on the fact that an image with an infrared output of a predetermined value or more that can be estimated to be present is present in the image data. This is to avoid confusion with a general heat generating object or the like that is not an external infrared device.
[0027]
If there is no other external infrared device, the processing of S05 to S08 is continued until the intended infrared communication ends (S08). Then, when the target infrared communication is completed, the infrared communication unit 11 is turned off (S09), the imaging unit 12 is turned off (S12), and the processing in FIG. 2 ends.
[0028]
On the other hand, in S07, for example, while the infrared communication unit 11 of the mobile phone 10 is performing infrared communication with the target external infrared device 20 as shown in FIG. 5, it is determined that another external infrared device 30 exists. In this case, since the other external infrared device 30 may be a malicious external infrared device, the infrared communication is stopped immediately by turning off the infrared communication unit 11 (S10), and the fact that the infrared communication has been stopped is notified. The information is reported to the user by display on the display unit of the mobile phone 10 or by voice notification (S11). Then, the imaging unit 12 is turned off (S12), and the processing in FIG. 2 ends.
[0029]
[Detection processing of external infrared device]
Next, the detection processing of the external infrared device (S03 in FIG. 2) will be outlined with reference to FIGS.
[0030]
The external infrared device transmits a signal for finding a communication partner as shown in FIG. The ON / OFF cycle of the light at this time is 9600 to 115000 times per second when the external infrared device is a mobile phone, and 9600 to 4000000 times per second when the external infrared device is a personal computer. Times.
[0031]
When the light from the external infrared device in FIG. 6A is imaged by the imaging unit 12, the response of the light receiving element of the imaging unit 12 does not catch up with the ON / OFF cycle of the light, and therefore, as shown in FIG. It is sensed as light. That is, the fine light pulse becomes invisible due to the afterimage.
[0032]
Then, in the mobile phone 10, the screen taken by the imaging unit 12 is divided into a plurality of small areas as shown in FIG. 7A, and a small area having a certain amount of infrared light or more is examined. FIG. 7A shows an example of a screen when an image of an ATM installation place of a financial institution is taken. However, the dotted line in FIG. There is no need to show the dotted line. In addition, camera shake of the user may be corrected for the captured image data.
[0033]
Here, it is assumed that, for example, as shown in FIG. 7B, small areas A, B, and C having a light amount equal to or more than a predetermined infrared light amount are detected. If the small areas A and B are detected as the small areas in which the light is turned on and off among the small areas A, B and C, it is determined that the external infrared device exists in the small areas A and B. it can. Therefore, it is determined whether the external infrared device is the target external infrared device or another (malicious) external infrared device based on whether or not the flashing pattern matches the flashing pattern relating to the target external infrared device.
[0034]
At the time of warning to the user, for example, the ellipses indicating the small areas A and B in FIG. 7C blink, thereby indicating that the small area is likely to be the small area where the external infrared device exists. Can be warned. On the other hand, in the small area C, since the light is only strong and the light is not blinking, there is no possibility that the small area is the small area where the external infrared device is present, so that the warning to the user is avoided. .
[0035]
When the imaging unit 12 and the infrared communication unit 11 are installed on the same side surface of the mobile phone 10, the guide message is displayed on the liquid crystal screen of the mobile phone 10 as shown in FIG. It is also possible to guide the user to bring the infrared receiving unit of the partner device closer to the circled part of the image. That is, the user can easily start the infrared communication by adjusting the circle displayed on the liquid crystal screen of the mobile phone to the blinking light emitting unit.
[0036]
[Operation Control Processing of FIG. 3]
By the way, the above-described processing in FIG. 2 can adopt an embodiment as shown in FIG. In the mobile phone 10, the processing of FIG. 3 is executed under the control of the control unit 14.
[0037]
In the mobile phone 10, first, the imaging unit 12 having sensitivity in a light wavelength region including an infrared region is turned on (S21). Thus, the imaging unit 12 captures an image of the area including the target external infrared device. At this time, the imaging unit 12 can image the area with a wider viewing angle than the infrared communication unit 11. For example, as shown in FIG. 4, with respect to the viewing angle α of the infrared communication unit 11, the imaging unit 12 determines the imaging area 22 including the target external infrared device 20 by the viewing angle β (β> α) of the imaging unit 12. Can be imaged.
[0038]
Then, the imaging result is subjected to image processing (S22). Based on the image data obtained by the image processing, the determination unit 13 determines whether or not an external infrared device is present, and determines whether the external infrared device is present at a predetermined level. It is determined whether or not the external infrared device is to output infrared light in a blinking pattern (S23). If the external infrared device does not exist or is not the target external infrared device, the new imaging result is subjected to image processing again (S22), and the determination is made again (S23).
[0039]
On the other hand, when it is determined in S23 that the target external infrared device is present, the user is notified that the target external infrared device is present (S24), and the user is urged to turn on the infrared communication unit 11. In addition, the notification to the user can be notified to the user by displaying a message on the display unit of the mobile phone 10 or outputting sound. Here, when the infrared communication unit 11 is turned on by the user (S25), the infrared communication unit 11 communicates with a target external infrared device (for example, electronic settlement using IrDA (credit card number) Information exchange)) is performed (S26).
[0040]
In the present embodiment, the imaging unit 12 is turned on even during the execution of the target infrared communication, and the malicious external infrared device is continuously monitored. That is, the imaging result of the imaging unit 12 during the execution of the infrared communication is subjected to image processing (S27), and the determination unit 13 determines whether another external infrared device exists based on the image data obtained by the image processing. Is determined (S28). Here, it is determined that another external infrared device is present based on the fact that an image with an infrared output of a predetermined value or more that can be estimated to be present is present in the image data. This is to avoid confusion with a general heat generating object or the like that is not an external infrared device.
[0041]
If there is no other external infrared device, the processing of S26 to S29 is continued until the intended infrared communication ends (S29). Then, when the target infrared communication ends, the infrared communication unit 11 is turned off (S30), the imaging unit 12 is turned off (S34), and the processing in FIG. 3 ends.
[0042]
On the other hand, in S28, for example, while the infrared communication unit 11 of the mobile phone 10 is performing infrared communication with the target external infrared device 20 as shown in FIG. 5, it is determined that another external infrared device 30 exists. In this case, since the other external infrared device 30 may be a malicious external infrared device, the user is immediately alerted to the possibility that a malicious external infrared device is present (S31). The user is urged to stop the infrared communication. Note that the user can be warned by displaying a warning message on the display unit of the mobile phone 10 or outputting a warning sound. Here, when the user instructs to stop the infrared communication (S32), the infrared communication unit 11 is turned off (S33), the imaging unit 12 is also turned off (S34), and the processing in FIG.
[0043]
In S31 of FIG. 3 described above, for example, the ellipses indicating the small areas A and B in FIG. 7C blink, indicating that the small area is highly likely to be the small area where the external infrared device exists. The user can be warned. On the other hand, as for the small area C, since the light is only strong and the light is not blinking, the user is not warned because there is no possibility that the small area is the small area where the external infrared device exists.
[0044]
By the processing of FIGS. 2 and 3 described above, abnormal infrared output from a device other than the proper external infrared device and normal infrared output from the proper external infrared device are monitored, and infrared communication is performed according to the monitoring result. The operation of the means can be appropriately controlled. Thus, when a malicious third party attempts to falsify any data related to electronic payment or the like with a strong IrDA signal or the like, abnormal infrared output related to the falsification is promptly detected, and infrared communication is immediately performed. You can take defensive measures such as canceling.
[0045]
Some recent mobile phones have an imaging unit installed on both the front and back surfaces of the housing. In such a mobile phone, an area seen from the front side of the housing and an area seen from the back side can be simultaneously monitored. In the case of a rotary camera, it is also possible for the camera to automatically orbit and monitor the entire 360 degrees around the mobile phone.
[0046]
[Application example of infrared communication]
Incidentally, the infrared communication according to the present embodiment can be applied to notification of service type information and the like. An overview is given below.
[0047]
In general, a CCD camera or the like has a slow reaction speed, and cannot read a normal infrared signal such as IrDA. However, by turning on / off the infrared output at such a slow speed as to be able to be read by the CCD camera, it is possible to receive information represented by a combination of on / off of the infrared output.
[0048]
Therefore, by notifying the information of the service type (a ticket gate, a cash register, an advertisement distribution) of the POS terminal or the like to the mobile phone 10 by a combination of ON / OFF of the infrared output, the mobile phone 10 automatically determines the service type. It is possible to recognize and automatically start the software corresponding to the service type.
[0049]
Further, the above-described technology relating to information notification by infrared communication can be applied to communication between mobile phones. For example, short information such as your name is transmitted from a device equipped with IrDA (infrared communication unit) (a mobile phone or any device) to a device equipped with a CCD camera by the same low-speed data communication as described above. can do. By reading the on / off combination of the infrared output, the device equipped with the CCD camera can recognize information (own name and the like) corresponding to the on / off combination.
【The invention's effect】
As described above, according to the present invention, an abnormal infrared output from a device other than a proper external infrared device or a normal infrared output from a proper external infrared device is monitored, and infrared communication is performed according to the monitoring result. The operation of the means can be appropriately controlled. Thus, when a malicious third party attempts to falsify any data related to electronic payment or the like with a strong IrDA signal or the like, abnormal infrared output related to the falsification is promptly detected, and infrared communication is immediately performed. You can take defensive measures such as canceling.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of a mobile phone 10 equipped with an infrared communication device according to the present invention.
FIG. 2 is a flowchart illustrating an operation control process according to the embodiment.
FIG. 3 is a flowchart showing another embodiment of the operation control process.
FIG. 4 is a diagram for explaining an imaging area 22 and a viewing angle β by an imaging unit of the mobile phone 10.
5 is a diagram illustrating a case where another external infrared device 30 is detected in the imaging area 22. FIG.
FIG. 6A is a diagram illustrating a signal transmitted by an external infrared device for detecting a partner, and FIG. 6B is a diagram illustrating a signal sensed by an imaging unit.
FIG. 7A is a view showing an example of a screen when an image of an ATM installation place of a financial institution is taken, and FIG. It is a figure which shows the example of a screen where C was detected, and (c) is a figure which shows the example of a screen which notifies a user that small area A and B are likely to be the small area where an external infrared device exists. .
FIG. 8 is a diagram illustrating a display example of a guide message on a liquid crystal screen when an imaging unit and an infrared communication unit are installed on the same side of a mobile phone.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 10 ... Cellular phone, 11 ... Infrared communication part, 12 ... Imaging part, 13 ... Judgment part, 14 ... Control part, 20 ... External infrared device, 22 ... Imaging area, 30 ... Other external infrared devices.

Claims (7)

An infrared communication means for performing infrared communication with a target external infrared device;
Imaging means having sensitivity in a light wavelength region including an infrared region and capable of imaging with a wider viewing angle than the infrared communication means,
Based on the image data obtained by the imaging by the imaging unit, whether or not an external infrared device is present, and the external infrared device that is present is a target external infrared device that outputs infrared light in a predetermined blinking pattern. Determining means for determining whether or not there is;
Control means for controlling the start or stop of the infrared communication means based on the determination result;
Infrared communication device equipped with. 2. The infrared device according to claim 1, wherein the control unit controls to activate the infrared communication unit when an external infrared device is present and the external infrared device is determined to be the target external infrared device. Communication device. 3. The control unit according to claim 1, wherein the control unit controls to stop the infrared communication unit when an external infrared device is present and the external infrared device is not the target external infrared device. Infrared communication device. A mobile phone comprising the infrared communication device according to claim 1. Infrared communication means for performing infrared communication with a target external infrared device, and has a sensitivity in a light wavelength region including the infrared region, it is possible to image with a wider viewing angle than the infrared communication means An operation control method for controlling the operation of the infrared communication unit in an infrared communication device including an imaging unit,
An imaging step of imaging the area including the target external infrared device by the imaging means;
Based on the image data obtained in the imaging step, whether an external infrared device is present, and whether the existing external infrared device is the target external infrared device that outputs infrared light in a predetermined blinking pattern A determination step of determining whether or not
A control step of controlling the start or stop of the infrared communication means based on the determination result,
An operation control method comprising: 6. The control method according to claim 5, wherein when the external infrared device is present and the external infrared device is determined to be the target external infrared device, the infrared communication unit is controlled to be activated. Operation control method. 7. The method according to claim 5, wherein in the control step, if an external infrared device is present and the external infrared device is not the target external infrared device, the infrared communication unit is controlled to stop. 4. The operation control method according to 1.

Images