JP6288166B2 - Mobile terminal and program - Google Patents

Description

  The present invention relates to a mobile terminal and a program.

  2. Description of the Related Art Conventionally, RFID technology is known in which an RFID (Radio Frequency IDentification) reader / writer reads information from an RFID tag by radio communication via a radio wave or electromagnetic field at a short distance. RFID technology is widely used for train tickets, bus tickets, electronic money, employee ID cards, and the like.

  An advantage of the RFID tag is that it can be read even in an invisible place such as a box. However, this advantage can be read even if it is not visible, but conversely, it can be taken as a disadvantage that it is difficult to know where the RFID tag exists.

  A technique using RFID technology for position measurement is also known. For example, using a video camera that includes a plurality of wireless receivers that communicate with a wireless tag attached to a subject, the subject is photographed, and a wireless signal arrival time difference from the wireless tag to each wireless receiver is used. A configuration is known in which the position of a subject is measured based on the principle of edge surveying (see Patent Document 1). As another example of this configuration, three or more wireless receivers are arranged around the wireless tag attached to the subject, and the video camera has a difference in arrival time of the wireless signal from the wireless tag to each wireless receiver. A configuration is also known in which the position of a subject is measured by the principle of trilateral surveying using the. Information about the position of the measured subject is displayed on the display unit of the video camera.

JP 2008-227877 A

  RFID tags are affixed to articles as an alternative to barcodes, and are used for inspection and article management. For example, the user manages the inventory of the equipment by reading the RFID tag attached to the equipment as an object to be read in a warehouse with an RFID reader / writer. Since the range in which the RFID tag can be read is a short distance, it is necessary for the user to move and specify the equipment with the RFID tag to be read. However, since a user who has little experience in equipment management does not know the approximate position of the equipment and needs to search for the equipment, there is a risk that the work load is large and the work time is long.

  In addition, the conventional configuration for positioning the subject to which the wireless tag is attached can display the position information of the wireless tag, but the video camera is provided with a plurality of wireless receiving units or a plurality of wireless receiving units are read. The device had to be arranged around the wireless tag, and in any case, the device configuration was complicated.

An object of the present invention is to guide a display position in a captured image to be captured .

A first aspect of the present invention is a portable terminal that displays a picked-up image picked up by the image pickup means, the first obtaining means for obtaining the terminal position information of the portable terminal detected by the sensor, and the image pickup direction by the image pickup means. When the information is read from the second acquisition means to acquire and the predetermined object, the position information of the object is calculated based on the terminal position information at the time of reading and the reading direction at the time of reading , Storage control means for storing in the storage means as the position information of the target object, and the target stored in the past by referring to the storage means when searching for the target object to be searched The position information of the object is acquired, and the specific image indicating the position of the object is captured based on the position information of the object, the terminal position information at the time of the search, and the imaging direction. Characterized by comprising display control means for controlling so that superimposed on the corresponding display position of the image.
A sixth aspect of the present invention is a portable terminal that displays a picked-up image picked up by the image pickup means, the first obtaining means for obtaining the terminal position information of the portable terminal detected by the sensor, and the image pickup direction by the image pickup means. When searching for a second acquisition means to acquire and a target object to be searched, information is read from the terminal position information and the target object when the information is read from the target object in association with the target object. The position information calculated based on the reading direction at the time of reading is stored as the object position information, and further, the terminal position information at the time of reading the information is stored as the reading position information. Third acquisition means for acquiring object position information and reading position information of the object, the object position information and the reading position information, the terminal position information at the time of the search, and the imaging direction. And display control means for controlling the first specific information indicating the position of the object and the second specific information indicating the reading position to be superimposed on the corresponding display position of the captured image. It is characterized by .

According to the present invention , a display position can be guided in a captured image to be captured .

It is a block diagram which shows the function structure of the portable terminal of embodiment of this invention. (A) is a figure which shows the structure of a reading information table. (B) is a figure which shows the structure of a tag position information table. It is a flowchart which shows a 1st information reading process. It is a figure which shows the example of an information reading in a 1st information reading process. It is a flowchart which shows a 2nd information reading process. 6 is a flowchart subsequent to the second information reading process in FIG. 5. (A) is a figure which shows the mode of the imaging before RFID tag reading. (B) shows a preview image including a mark at the previous reading position and the previous reading direction, and a mark at the tag position. It is a figure which shows the mode of reading of the guided RFID tag. It is a figure which shows the preview image containing the mark which shows the last reading position outside a screen. It is a figure which shows the preview image containing the mark of the instruction | indication which approaches the reading position last time. It is a figure which shows the preview image containing the mark and message of a tag position. It is a block diagram which shows the function structure of the portable terminal of a modification.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments and modifications according to the present invention will be described in detail with reference to the accompanying drawings. The present invention is not limited to the illustrated example.

(Embodiment)
Embodiments according to the present invention will be described with reference to FIGS. First, the apparatus configuration of the present embodiment will be described with reference to FIG. FIG. 1 is a block diagram illustrating a functional configuration of the mobile terminal 10 according to the present embodiment.

  The mobile terminal 10 according to the present embodiment reads information stored in an RFID tag 30 attached to an article as a reading object, displays the position of the RFID tag, a reading position for performing the reading, This is a handy terminal that performs guidance display of the reading direction.

  In the present embodiment, an example will be described in which the mobile terminal 10 is used for management of equipment in a warehouse every predetermined period (for example, 6 months). This is an example in which the user uses the mobile terminal 10 to read information stored in the RFID tag 30 attached to the equipment in the warehouse and inventory the equipment. However, it is not limited to this example.

  The RFID tag 30 is a radio wave type or electromagnetic induction type RFID tag. The RFID tag 30 includes a communication unit including an antenna or a coil antenna, a control unit, and an EEPROM (Electrically Erasable Programmable Read Only Memory). In the RFID tag 30, the control unit wirelessly communicates with the mobile terminal 10 via the radio wave or electromagnetic field by the communication unit, reads out data stored in the EEPROM in response to a read request received from the mobile terminal 10, and carries the mobile phone. Transmit to the terminal 10. The control unit of the RFID tag 30 writes or rewrites data received from the mobile terminal 10 in the EEPROM.

  It is assumed that a tag ID as individual identification information of the RFID tag 30 is stored in the EEPROM of the RFID tag 30. In addition, the RFID tag 30 is a passive RFID tag (passive tag) that obtains power by radio waves or electromagnetic fields from the mobile terminal 10. However, the RFID tag 30 may include an active RFID tag (active tag) that includes a power supply unit and outputs a radio wave or an electromagnetic field by the power of the power supply unit.

  The portable terminal 10 includes a CPU (Central Processing Unit) 11 as a measurement unit, a storage control unit, and a notification control unit, an operation unit 12, a RAM (Random Access Memory) 13, a display unit 14 as a notification unit, and a ROM 15 A wireless communication unit 16, a storage unit 17, an RFID reader / writer unit 18 as a reading unit, a motion sensor 19 as a position information acquisition unit, an imaging unit 20, and an azimuth magnetic needle unit 21 as an azimuth information acquisition unit. And a timer unit 22 as a measuring unit and a power source unit 23. Each unit of the mobile terminal 10 except the power supply unit 23 is connected to each other via a bus 24.

  The CPU 11 controls each unit of the mobile terminal 10. The CPU 11 reads a designated program out of various programs from the ROM 15 and expands it in the RAM 13 and executes various processes in cooperation with the expanded program.

  In accordance with the first information reading program 151, the CPU 11 repeatedly reads the tag ID of the RFID tag 30 by the RFID reader / writer unit 18, acquires response time, reading position information, and reading direction information when reading the tag ID, and stores the storage unit 17 stored. Then, the CPU 11 calculates tag position information indicating the position of the RFID tag 30 of the tag ID based on a plurality of response times, reading position information, and reading direction information stored in the storage unit 17 and stores the tag position information in the storage unit 17. To do.

  Further, the CPU 11 accepts a selection input of the RFID tag 30 to be read from the user according to the second information reading program 152, and is imaged by the imaging unit 20 according to the information stored in the storage unit 17 and displayed on the display unit 14. In the displayed preview image, the tag position information corresponding to the tag ID of the selected RFID tag 30, the mark of the previous reading position information, and the previous reading direction information are displayed and guided. Then, when the CPU 11 enters the information readable range of the RFID tag 30, the RFID reader / writer unit 18 reads information such as the tag ID of the RFID tag 30, calculates the tag position information, and the response time at the time of reading, The information is stored in the storage unit 17 together with the reading position information and the reading direction information.

  The operation unit 12 includes a key group including various keys such as a character input key, and outputs operation information corresponding to a pressing input of each key from the user to the CPU 11.

  The RAM 13 is a volatile semiconductor memory and has a work area for storing various data and various programs.

  The display unit 14 includes a display panel such as an LCD (Liquid Crystal Display) or an EL (ElectroLuminescent) display, and performs various displays on the display panel according to display information input from the CPU 11.

  The ROM 15 is a read-only semiconductor memory that stores various data and various programs. The ROM 15 stores a first information reading program 151 and a second information reading program 152.

  The wireless communication unit 16 is a wireless communication unit of a wireless LAN (Local Area Network) communication method. The wireless communication unit 16 includes an antenna, a modulation unit, a demodulation unit, a signal processing unit, and the like, and performs wireless communication with the access point. The wireless communication unit 16 processes a signal of information to be transmitted by the signal processing unit, modulates the signal by the modulation unit, and transmits the signal from the antenna to the access point. This access point is connected to a communication destination device via, for example, a wired LAN. In addition, the wireless communication unit 16 demodulates a radio wave reception signal received from an access point by an antenna by a demodulation unit, and performs signal processing by a signal processing unit to obtain reception information. In this way, the wireless communication unit 16 communicates with a communication destination device via the access point. The wireless communication unit 16 may be configured to perform wireless communication using another communication method.

  The storage unit 17 is a non-volatile memory such as a flash memory or an EEPROM (Electrically Erasable Programmable ROM) that stores information in a readable and writable manner. The storage unit 17 stores a read information table 41 and a tag position information table 42 which will be described later.

  The RFID reader / writer unit 18 is a radio wave type or electromagnetic induction type reader / writer unit that reads and writes information stored in the RFID tag 30. The RFID reader / writer unit 18 modulates an electric signal of transmission data input from the CPU 11 and transmits it as a radio wave or an electromagnetic field from an antenna or a coil antenna. The RFID tag 30 receives a radio wave or an electromagnetic field output from the RFID reader / writer unit 18 and transmits data to be transmitted to the RFID reader / writer unit 18 as a radio wave or an electromagnetic field. The RFID reader / writer unit 18 receives a radio wave or an electromagnetic field transmitted from the RFID tag 30 by an antenna or a coil antenna, and receives data by demodulating the obtained electric signal.

  The communication of the RFID reader / writer unit 18 has directivity. The information of the RFID tag 30 is read in the direction in which the RFID reader / writer unit 18 of the portable terminal 10 has good communication. The direction in which the RFID reader / writer unit 18 reads information from the RFID tag 30 is defined as a reading direction. Information indicating the direction of the reading direction of the RFID reader / writer unit 18 is referred to as reading direction information.

  The motion sensor 19 is a sensor that detects position information of the mobile terminal 10. The motion sensor 19 includes an acceleration sensor, a ground axis sensor, and a control unit (CPU). The acceleration sensor is a sensor that detects acceleration information of the mobile terminal 10. The earth axis sensor is an electronic compass, and is a sensor that detects azimuth information of the mobile terminal 10. The control unit calculates position information (coordinate information) on the horizontal plane of the mobile terminal 10 using the acceleration information detected by the acceleration sensor and the azimuth information detected by the earth axis sensor, and outputs the position information (coordinate information) to the CPU 11. For this reason, the motion sensor 19 can detect the position information of the mobile terminal 10 not only outdoors but also in an indoor facility such as a warehouse.

  The imaging unit 20 is an imaging unit that captures a digital image of a subject. The imaging unit 20 includes an optical system, an imaging element, and the like. Under the control of the CPU 11, the imaging unit 20 photoelectrically converts the light of the subject image incident via the optical system by the imaging device, and outputs it as an image signal of the subject. Further, the direction in which the imaging unit 20 captures the subject is defined as the imaging direction, and information indicating the imaging direction is defined as the imaging direction information.

  The azimuth magnetic needle unit 21 is a ground axis sensor that detects azimuth information of the mobile terminal 10 and outputs it to the CPU 11. The azimuth needle unit 21 may use a ground axis sensor in the motion sensor 19.

  The timer unit 22 includes a timer circuit, and outputs the current time information timed by the timer circuit to the CPU 11.

  The power supply unit 23 is a secondary battery such as a lithium battery, and supplies power to each unit of the mobile terminal 10. The power supply unit 23 may be a primary battery such as an alkaline battery.

  Next, information stored in the mobile terminal 10 will be described with reference to FIGS. 2 (a) and 2 (b). FIG. 2A is a diagram showing the configuration of the read information table 41. FIG. 2B is a diagram showing the configuration of the tag position information table 42.

  By execution of a first information reading process described later, the record of the reading information table 41 shown in FIG. 2A is added to the storage unit 17 and shown in FIG. 2B based on the calculated tag position information. Records in the tag position information table 42 are rewritten.

  The read information table 41 has fields of a tag ID 411, a response time 412, read position information 413, and read direction information 414.

  The tag ID 411 is individual identification information that identifies the RFID tag 30. The tag ID 411 is a tag ID of a plurality of different RFID tags 30. The response time 412 is a response time from when the RFID reader / writer unit 18 outputs a radio wave or an electromagnetic field to reading information in reading information of the RFID tag 30 corresponding to the tag ID 411. The read position information 413 is position information of the mobile terminal 10 when the RFID tag 30 corresponding to the tag ID 411 is read. The reading direction information 414 is reading direction information of the RFID reader / writer unit 18 when the RFID tag 30 corresponding to the tag ID 411 is read.

  In the reading information table 41, a plurality of values can be stored in the response time 412, the reading position information 413, and the reading direction information 414 corresponding to one tag ID 411. The response time 412, the reading position information 413, and the reading direction information 414 are such that the latest value can be identified as the value of the previous reading, for example, depending on the storage order.

  The tag position information table 42 has fields of a tag ID 421 and tag position information 422.

  The tag ID 421 is individual identification information for identifying the RFID tag 30 as with the tag ID 411. The tag position information 422 is position information of the RFID tag 30 corresponding to the tag ID 421.

  Next, the operation of the mobile terminal 10 will be described with reference to FIGS. FIG. 3 is a flowchart showing the first information reading process. FIG. 4 is a diagram illustrating an example of reading information in the first information reading process. FIG. 5 is a flowchart showing the second information reading process. FIG. 6 is a flowchart subsequent to the second information reading process of FIG. FIG. 7A is a diagram illustrating a state of imaging before reading the RFID tag. FIG. 7B shows a preview image 141 including marks 81 and 82 in the previous reading position and the previous reading direction, and a mark 91 in the tag position. FIG. 8 is a diagram showing a state of reading of the guided RFID tag 31. FIG. 9 is a diagram showing a preview image 142 including a mark 83 indicating the previous reading position outside the screen. FIG. 10 is a diagram showing a preview image 143 including the previous reading position and the approaching marks 84 and 85. FIG. 11 is a diagram showing a preview image 143 including a tag position mark 92 and a message 93.

  With reference to FIG. 3, the 1st information reading process performed with the portable terminal 10 is demonstrated. In the first information reading process, while the mobile terminal 10 is powered on, the information of the RFID tag 30 is repeatedly read, and various information on the reading state is acquired and stored in the reading information table 41, and the tag position information is calculated. It is processing to do. The first information reading process is a process executed in parallel with, for example, a main program process that executes various processes in response to a user operation.

  In the mobile terminal 10, for example, triggered by a power-on operation input from the user via the operation unit 12, the CPU 11 is read from the ROM 15 and is first expanded as appropriate in the RAM 13. The first information reading process is executed in cooperation with 151. The trigger of the first information reading process may be, for example, that an operation input for executing the first information reading process is performed from the user via the operation unit 12.

  As shown in FIG. 3, first, the CPU 11 acquires read position information as position information of the mobile terminal 10 (user) detected by the motion sensor 19, and responds to the direction information detected by the direction magnetic needle unit 21. Reading direction information as direction information of the reading direction of the RFID reader / writer unit 18 is calculated and acquired (step S11). Then, the CPU 11 causes the RFID reader / writer unit 18 to output a radio wave or an electromagnetic field for reading the RFID tag 30, and starts counting the response time of reading using the time information of the time measuring unit 22 (step S12).

  Whether the CPU 11 has successfully read the information stored in the RFID tag 30 by receiving the radio wave or electromagnetic field from the RFID tag 30 by the RFID reader / writer unit 18 in accordance with the output of the radio wave or electromagnetic field in step S12. It is determined whether or not (step S13). When reading of information from the RFID tag 30 has failed (step S13; NO), the CPU 11 clears the count of response time being counted (step S14). Then, the CPU 11 waits for a predetermined time tw (for example, a predetermined second) set in advance using the time information of the time measuring unit 22 (step S15), and proceeds to step S11.

  When the reading of the information from the RFID tag 30 is successful (step S13; YES), the CPU 11 ends the counting of the response time being counted (step S16).

  Then, the CPU 11 acquires the tag ID from the information read from the RFID tag 30 by the RFID reader / writer unit 18, acquires the response time counted in step S16, and the response time and the read position information acquired in step S11. And the reading direction information are associated with the tag ID and stored in the reading information table 41 in the storage unit 17 (step S17). In step S17, the acquired tag ID, response time, reading position information, and reading direction information are stored in addition to the tag ID 411, response time 412, reading position information 413, and reading direction information 414 of the reading information table 41.

  Then, the CPU 11 refers to the reading information table 41, and stores information (response time 412, reading position information 413, reading direction information 414) before step S17 of the same tag ID 411 as the tag ID acquired in step S17. It is determined whether or not (step S18). That is, in step S18, it is determined whether or not there are a plurality of records of information (response time 412, reading position information 413, reading direction information 414) for the tag ID 411 acquired in step S17.

  When information of the same tag ID 411 is stored (step S18; YES), the CPU 11 in the reading information table 41, a plurality of response times 412, reading position information 413, and reading direction corresponding to the tag ID 411 acquired in step S17. Using the information 414, the position information (coordinate information) of the RFID tag 30 of the tag ID is calculated by a technique such as triangulation, and the tag position in the storage unit 17 is associated with the tag ID. It memorize | stores in the information table 42 (step S19). The information used in step S19 is, for example, the most recent predetermined number of response times 412, read position information 413, and read direction information 414 of the same tag ID, but is not limited thereto. In step S19, the acquired tag ID and the calculated tag position information corresponding thereto are updated and stored in the tag ID 421 and tag position information 422 of the tag position information table 42.

  Then, the CPU 11 determines whether or not there is a power-off operation input from the user via the operation unit 12 (step S20). When the information of the same tag ID 411 is not stored (step S18; NO), the process proceeds to step S20.

  If there is an operation input for turning off the power (step S20; YES), the first information reading process ends. When there is no power-off operation input (step S20; NO), the process proceeds to step S15. In step S20, for example, it may be determined whether or not an operation input for ending the first information reading process has been performed from the user via the operation unit 12.

  Here, an example of the first information reading process will be described with reference to FIG. As shown in FIG. 4, consider a case where the user 50 has the mobile terminal 10, executes the first information reading process, and moves the user 50 in the direction of the white arrow. It is assumed that the RFID tag 31 as the RFID tag 30 is fixedly disposed at the position P4.

  It is assumed that the information of the RFID tag 31 can be read at positions P1, P2, and P3 which are different points by the movement of the user 50. At the position P1, the response time T1, the reading position information P1, and the reading direction information A1 are acquired in steps S11, S16, and S17. At position P2, response time T2, reading position information P2, and reading direction information A2 are acquired. At position P3, response time T3, reading position information P3, and reading direction information A3 are acquired.

  When the user 50 moves to the position P2, in step S19, the tag position information of the position P4 is calculated using the response times T1, T2, the reading position information P1, P2, and the reading direction information A1, A2. When the user 50 moves to the position P3, the tag position of the position P4 is used in step S19 by using the response times T1, T2, T3, the reading position information P1, P2, P3, and the reading direction information A1, A2, A3. Information is calculated.

  Next, the second information reading process will be described with reference to FIGS. In the second information reading process, the RFID tag 30 to be read is selected, the mark at the tag position, the mark indicating the previous reading position information and the previous reading direction information, and the RFID tag 30 are displayed to the user. This is a process of guiding the reading of the information and reading the information of the guided RFID tag 30.

  In the mobile terminal 10, for example, triggered by the input of the execution instruction of the second information reading process from the user via the operation unit 12, the CPU 11 is read from the ROM 15 and appropriately expanded in the RAM 13. The second information reading process is executed in cooperation with the second information reading program 152.

  As shown in FIGS. 5 and 6, first, the CPU 11 activates the imaging unit 20 (step S31). Then, the CPU 11 refers to the reading information table 41 stored in the storage unit 17, displays a list of RFID tags 30 corresponding to all the records of the tag ID 411 on the display unit 14, and reads the RFID tag to be read from the user. 30 selection inputs are received via the operation unit 12 (step S32).

  Then, the CPU 11 starts displaying the preview image captured by the imaging unit 20 on the display unit 14 (step S33). Then, the CPU 11 refers to the reading information table 41 and the tag position information table 42 stored in the storage unit 17, and reads the latest reading position information 413 and the reading corresponding to the tag ID 411 of the RFID tag 30 selected in step S32. The azimuth information 414 and the tag position information 422 corresponding to the tag ID 421 inputted in the same manner are read (step S34). The reading position information 413 and the reading direction information 414 read in step S34 are set as the previous reading position information and the previous reading direction information.

  Then, the CPU 11 acquires reading position information as position information of the mobile terminal 10 (user) detected by the motion sensor 19, and reads the RFID reader / writer unit 18 according to the direction information detected by the direction magnetic needle unit 21. Reading direction information as direction direction information is calculated and acquired, and imaging direction information as direction information of the imaging direction of the imaging unit 20 corresponding to the direction information detected by the direction magnetic needle unit 21 is calculated and acquired ( Step S35).

  Then, the CPU 11 uses the reading position information acquired in step S35, and the tag position of the tag position information acquired in step S34 within the angle of view of the preview image in the imaging direction corresponding to the imaging direction information acquired in step S35. It is determined whether or not there is (step S36).

  When the tag position is within the angle of view of the preview image (step S36; YES), the CPU 11 determines the tag position of the tag position information acquired in step S34 and the mobile terminal 10 (user) of the read position information acquired in step S35. The distance to the position is calculated, and a mark such as a flag indicating the tag position is superimposed on the tag position with a size in perspective according to the calculated distance on the preview image being displayed on the display unit 14. Are displayed (step S37).

  Then, the CPU 11 uses the reading position information acquired in step S35 to set the previous reading position of the previous reading position information acquired in step S34 within the angle of view of the preview image corresponding to the imaging direction information acquired in step S35. It is determined whether or not there is (step S38). If there is no tag position within the angle of view of the preview image (step S36; NO), the process proceeds to step S38.

  When the previous reading position is not within the angle of view of the preview image (step S38; NO), the CPU 11 is the previous acquired in step S34 outside the screen of the preview image in the imaging direction corresponding to the imaging direction information acquired in step S14. A mark such as an arrow indicating the previous reading position of the reading position information is displayed in the preview image being displayed on the display unit 14 (step S39), and the process proceeds to step S35.

  When the previous reading position is within the angle of view of the preview image (step S38; YES), the CPU 11 determines the previous reading position of the previous reading position information acquired in step S34 and the mobile terminal 10 of the reading position information acquired in step S35. The distance to the position is calculated, and a flag such as a flag indicating the previous reading position is superimposed on the preview image being displayed on the display unit 14 with a perspective size corresponding to the calculated distance. A mark such as an arrow indicating the previous reading azimuth of the previous reading azimuth information acquired in step S35 is superimposed and displayed (step S40).

  Then, the CPU 11 determines that the current reading position information and reading direction are RFID based on the previous reading position information and previous reading direction information acquired in step S34 and the reading position information and reading direction information acquired in step S35. It is determined whether or not the reader / writer unit 18 (portable terminal 10) is in a range in which the RFID tag 30 can be read (previous reading position and previous reading orientation) (step S41).

  When the RFID tag 30 is not within the readable range (step S41; NO), the CPU 11 reads the previous reading position information acquired in step S34, the distance calculated in step S40, the reading position information acquired in step S35, Based on the above, a mark such as an arrow for instructing the user to approach the previous reading position is superimposed on the preview image being displayed on the display unit 14 (step S42), and the process proceeds to step S35.

  When the RFID tag 30 is within the readable range (step S41; YES), the CPU 11 causes the RFID reader / writer unit 18 to output a radio wave or an electromagnetic field for reading the RFID tag 30, and uses the time information of the time measuring unit 22. Then, counting of the response time for reading is started (step S43).

  Whether the CPU 11 has successfully read the information stored in the RFID tag 30 by receiving the radio wave or electromagnetic field from the RFID tag 30 by the RFID reader / writer unit 18 in accordance with the output of the radio wave or electromagnetic field in step S12. It is determined whether or not (step S44). When the reading of information from the RFID tag 30 has failed (step S44; NO), the CPU 11 clears the response time count being counted (step S45). Then, the CPU 11 determines whether or not there is an operation input for ending the second information reading process from the user via the operation unit 12 (step S46).

  When there is no operation input for ending the second information reading process (step S46; NO), the CPU 11 changes the reading position of the RFID reader / writer unit 18 in the preview image being displayed on the display unit 14, and searches for the tag. The information such as a message for instructing the message is superimposed and displayed (step S47).

  Then, the CPU 11 acquires the reading position information of the portable terminal 10 detected by the motion sensor 19, and calculates and acquires the reading direction information of the RFID reader / writer unit 18 according to the direction information detected by the direction magnetic needle unit 21. Then, the imaging direction information of the imaging unit 20 corresponding to the orientation information detected by the orientation magnetic needle unit 21 is calculated and acquired (step S48).

  Then, the CPU 11 uses the reading position information acquired in step S48 to set the previous reading position of the previous reading position information acquired in step S34 within the angle of view of the preview image corresponding to the imaging direction information acquired in step S48. It is determined whether or not there is (step S49).

  When the previous reading position is within the angle of view of the preview image (step S49; YES), the CPU 11 determines the previous reading position of the previous reading position information acquired in step S34 and the mobile terminal 10 of the reading position information acquired in step S48. The distance to the position is calculated, and a flag such as a flag indicating the previous reading position is superimposed on the preview image being displayed on the display unit 14 with a perspective size corresponding to the calculated distance. A mark such as an arrow indicating the previous reading azimuth of the previous reading azimuth information acquired in step S35 is superimposed and displayed (step S50).

  Then, the CPU 11 uses the reading position information acquired in step S48, and the tag position of the tag position information acquired in step S34 within the angle of view of the preview image in the imaging direction corresponding to the imaging direction information acquired in step S48. It is determined whether or not there is (step S51). If there is no previous reading position within the angle of view of the preview image (step S49; NO), the process proceeds to step S51.

  When the tag position is within the angle of view of the preview image (step S51; YES), the CPU 11 determines the tag position of the tag position information acquired in step S34 and the mobile terminal 10 (user) of the read position information acquired in step S48. The distance to the position is calculated, and a mark such as a flag indicating the tag position is superimposed on the tag position in the perspective according to the calculated distance on the preview image being displayed on the display unit 14. Displayed (step S52), the process proceeds to step S43. If there is no tag position within the angle of view of the preview image (step S51; NO), the process proceeds to step S43.

  When the reading of the information from the RFID tag 30 is successful (step S44; YES), the CPU 11 ends the counting of the response time being counted (step S53). Then, the CPU 11 displays on the display unit 14 that the reading of the information of the RFID tag 30 has been completed, displays the information (tag ID, etc.) read from the RFID tag 30 in steps S43 and S44 on the display unit 14, and displays the RAM 13 or It memorize | stores in the memory | storage part 17 (step S54).

  Then, similarly to step S17 of the first information reading process, the CPU 11 acquires the tag ID from the information read from the RFID tag 30 by the RFID reader / writer unit 18, acquires the response time that has been counted in step S51, The response time and the latest reading position information and reading direction information acquired in step S35 or S48 are stored in the reading information table 41 in the storage unit 17 in association with the tag ID (step S55).

  Then, similarly to step S19 of the first information reading process, the CPU 11 stores a plurality of response times 412, reading position information 413, and reading direction information 414 corresponding to the tag ID 411 acquired in step S55 in the reading information table 41. The position information (coordinate information) of the RFID tag 30 with the tag ID is calculated by a method such as triangulation, and the tag position information table 42 in the storage unit 17 is associated with the tag ID. (Step S56).

  Then, the CPU 11 ends the reading function of the RFID reader / writer unit 18, ends the preview image display on the display unit 14 (step S57), and ends the second information reading process. When there is an operation input for ending the second information reading process (step S46; YES), the process proceeds to step S57.

  Here, a specific example of the display screen in the second information reading process will be described. As shown in FIG. 7A, an example in which the user 50 reads and manages the RFID tag 31 and the like attached to the desk 60 as equipment for the reading object stored in the warehouse using the mobile terminal 10. explain.

  It is assumed that the RFID tag 31 of the desk 60 has been read a plurality of times by the first information reading process. In addition, the previous reading position of the RFID tag 31 is a previous reading position 71, and the previous reading direction of the RFID tag 31 is a previous reading direction 72. Further, the reading information table 41 includes a tag ID 411 of the RFID tag 31, a response time 412, reading position information 413 including information on the previous reading position 71, reading direction information 414 including information on the previous reading direction 72, Is stored. Also, it is assumed that the tag ID information 421 of the RFID tag 31 and the tag position information 422 are stored in the tag position information table 42.

  The second information reading process is executed by the portable terminal 10, and the RFID tag 31 attached to the desk 60 is selected and input by the user 50 in step S32. Then, the user 50 points the imaging direction 201 of the mobile terminal 10 in a direction in which the previous reading position is likely. As shown in FIG. 7A, when the previous reading position 71 is included in the angle of view corresponding to the imaging direction 201, the preview image 141 shown in FIG. 7B is displayed on the display unit 14 in step S40. Is displayed.

  The preview image 141 includes a flag mark 81 having a position and a size corresponding to the previous reading position 71 and a distance to the previous reading position, an arrow mark 82 indicating the previous reading direction 72, and the tag position of the RFID tag 31 and the distance to the mark 81. The flag mark 91 having a position and a size corresponding to the distance is included.

  The user 50 proceeds to the position of the mark 81 while visually confirming the preview image 141 displayed on the display unit 14, and moves the RFID reader / writer of the mobile terminal 10 in a direction corresponding to the mark 82 facing the direction of the mark 91. The reading direction of the unit 18 is directed. Then, in steps S43 and S44, as shown in FIG. 8, the tag ID stored in the RFID tag 31 attached to the desk 60 is read by the RFID reader / writer unit 18 of the portable terminal 10.

  Also, in step S32, when an RFID tag corresponding to equipment on the left side of the desk 60 is selected and input, the imaging direction of the mobile terminal 10 faces the imaging direction 201, and the previous reading position is not in the preview image As shown in FIG. 9, a preview image 142 is displayed on the display unit 14 in step S39. The preview image 142 includes an arrow mark 83 indicating that the previous reading position is outside the left screen of the preview image.

  In step S32, the RFID tag corresponding to the desk 60 is selected and input, and the imaging direction of the mobile terminal 10 faces the imaging direction 201, but the previous reading position is further to the back than the previous reading position 71. When the distance to is far, the preview image 143 is displayed on the display unit 14 in step S42 as shown in FIG. The preview image 143 includes a flag mark 84 smaller than the mark 81 indicating the previous reading position, and a three-dimensional wide arrow mark 85 for giving an instruction to approach the mark 84.

  In addition, as shown in FIG. 11, in step S32, the user 50 selects and inputs the RFID tag 32 as the RFID tag 30 attached to the shelf, and the user 50 approaches the reading position of the RFID tag 32. When reading of the information of the tag 32 fails, the preview image 144 is displayed on the display unit 14 in steps S47 to S52. For example, there is a case where a shield is newly provided between the previous reading position and the RFID tag 32 after the previous reading, or the RFID tag 32 is removed after the previous reading.

  The preview image 144 includes a flag mark 92 indicating the tag position of the RFID tag 32 and a message 93. The message 93 is a message indicating that the information of the tag (RFID tag 32) cannot be read and that the change of the reading position and the search for the tag (RFID tag 32) are urged. Since the preview image 144 includes the mark 92, the user can estimate the direction toward the mark 92 as the reading direction even if the reading position is moved. Further, depending on the position of the mobile terminal 10 and the angle of view in the imaging direction, the preview image 144 may include an image that does not include the mark 92, an image that includes a mark indicating the previous reading position and the previous reading direction, and the previous reading position and the previous reading. Either an orientation mark or an image including the mark 92 can be used.

  As described above, according to the present embodiment, the CPU 11 of the mobile terminal 10 causes the RFID reader / writer unit 18 to read the tag ID of the RFID tag 30 multiple times, and the read tag ID and the tag ID A plurality of response times measured corresponding to the reading, a plurality of reading position information of the mobile terminal 10 acquired by the motion sensor 19, and a plurality of reading direction information of the RFID reader / writer unit 18 acquired by the azimuth magnetic needle unit 21 Are stored in the read information table 41 of the storage unit 17 in association with each other. Then, the CPU 11 calculates tag position information of the RFID tag of the tag ID based on a plurality of response times, reading position information, and reading direction information corresponding to the tag ID stored in the storage unit 17, and displays it on the display unit 14. indicate. For this reason, the RFID reader / writer unit 18 as one reading unit of the RFID tag can be used to calculate tag position information of the RFID tag and guide the tag position.

  Further, the CPU 11 causes the RFID reader / writer unit 18 to read the tag ID of the RFID tag 30 by the first information reading process, and the tag ID corresponding to the reading, the response time, the reading position information, and the reading direction information. Storage in the read information table 41 of the storage unit 17 is automatically performed at predetermined time intervals tw. For this reason, tag ID, response time, reading position information, and reading direction information can be easily acquired.

  Further, the CPU 11 determines the RFID tag of the tag ID based on a plurality of response times, reading position information, and reading direction information corresponding to the tag ID of the RFID tag selected according to the user's operation input via the operation unit 12. Tag position information is calculated. For this reason, the tag position information of the RFID tag desired by the user can be displayed.

  Further, the CPU 11 displays a preview image captured by the imaging unit 20 on the display unit 14 and displays the calculated tag position information of the RFID tag on the preview image. For this reason, the user can easily recognize the tag position information of the RFID tag visually.

  Further, the CPU 11 displays a mark indicating the tag position of the calculated tag position information of the RFID tag on the preview image. For this reason, the user can more easily recognize the tag position information of the RFID tag by visually observing the mark.

  Further, the CPU 11 displays the tag position information mark at the tag position in the preview image in a size corresponding to the distance from the position of the current position information acquired by the motion sensor 19 to the tag position. For this reason, the user can easily recognize the tag position and distance of the RFID tag by visually observing the mark.

  Further, the CPU 11 previews the calculated tag position information mark of the RFID tag, the previously read tag position information mark and the previous orientation information mark corresponding to the tag ID of the RFID tag stored in the storage unit 17. Display on the image. For this reason, the user can easily recognize the tag position of the RFID tag, the previous reading position, and the previous orientation information by visually observing the mark.

(Modification)
A modification of the above embodiment will be described with reference to FIG. FIG. 12 is a block diagram illustrating a functional configuration of the mobile terminal 10A according to the present modification.

  In this modification, 10 A of portable terminals shown in FIG. 12 are used instead of the portable terminal 10 of the said embodiment. Of the respective parts of the mobile terminal 10A, parts similar to those of the mobile terminal 10 are denoted by the same reference numerals, and description thereof is omitted.

  The mobile terminal 10A includes a CPU 11, an operation unit 12, a RAM 13, a display unit 14, a ROM 15, a wireless communication unit 16, a storage unit 17, an RFID reader / writer unit 18, and a GPS (Global Positioning System) unit 19A. An imaging unit 20, a compass unit 21, a time measuring unit 22, and a power supply unit 23. Each unit of the mobile terminal 10 </ b> A except the power supply unit 23 is connected to each other via a bus 24.

  The GPS unit 19A receives a GPS signal from a GPS satellite, calculates the position information (latitude and longitude information) of the horizontal plane of the portable terminal 10A using the information of the GPS signal, detects this position information, and sends it to the CPU 11. Output.

  GPS signals from GPS satellites can be used outdoors. The portable terminal 10A is used, for example, for the purpose of reading and managing the RFID tag 30 attached to an outdoor reading object.

  For example, as an object to be read, an RFID tag 30 is attached to an outdoor water meter, an electric meter, etc., and a worker (user) carrying the portable terminal 10A reads information on the RFID tag 30 such as a water meter, Manage the location and presence of In addition, an operator who carries the portable terminal 10A by attaching the RFID tag 30 to a container as a reading object at a port or the like can manage the position and presence of the container.

  In other words, in the present modification, instead of the motion sensor 19 of the mobile terminal 10 of the above embodiment, the location information of the mobile terminal 10A (user) is acquired by the GPS unit 19A, and the mobile terminal 10A is the same as the mobile terminal 10 In addition, the first information reading process and the second information reading process are executed.

  As described above, according to the present modification, the mobile terminal 10 acquires the reading position information of the mobile terminal 10A by the GPS unit 19A. For this reason, the tag position information of the RFID tag attached to the reading object in the outdoor facility can be calculated and the tag position can be guided by using one reading unit of the RFID tag.

In the above description, the example in which the ROM 15 is used as the computer-readable medium of the program according to the present invention is disclosed, but the present invention is not limited to this example.
As other computer-readable media, a non-volatile memory such as a flash memory and a portable recording medium such as a CD-ROM can be applied.
A carrier wave is also applied to the present invention as a medium for providing program data according to the present invention via a communication line.

  Note that the descriptions in the above-described embodiments and modifications are examples of the mobile terminal and the program according to the present invention, and the present invention is not limited to this.

  In the embodiment and the modification described above, the mobile terminals 10 and 10A are the handy terminals including the RFID reader / writer unit 18, but the present invention is not limited to this. As the portable terminal, other portable terminals such as a PDA (Personal Digital Assistant), a cellular phone, and a portable personal computer may be used.

  In the embodiment and the modification described above, the RFID tag 30 includes an RFID card (non-contact IC card).

  In the embodiment and the modification described above, the mobile terminals 10 and 10A display the preview image captured by the imaging unit 20 on the display unit 14, and display the previous reading position information and the previous reading direction information in the preview image. Although the mark as the guide information to be displayed is displayed, the present invention is not limited to this. For example, in a state where no preview image is displayed, a mark as guide information indicating the previous reading position information and the previous reading direction information may be displayed on the display unit 14. Furthermore, it is good also as a structure which alert | reports the guidance information which shows the last reading position information, the last reading azimuth | direction information, etc. by the other alerting | reporting methods, such as an audio | voice output, a character display, and a printing, with or without a preview image display.

  Moreover, in the said embodiment and modification, although the positional information on the portable terminals 10 and 10A was acquired using the motion sensor 19 or GPS part 19A as a positional information acquisition part, it is not limited to this. The position information acquisition unit may be a position information acquisition unit that uses the wireless communication unit 16 of the mobile terminal and acquires the position information of the mobile terminal by triangulation using radio wave reception from the access point.

  Moreover, in the said embodiment and modification, although it was set as the structure which acquires the positional information on the portable terminals 10 and 10A as two-dimensional positional information on a horizontal surface, it is not limited to this. The position information acquisition unit may include an altimeter in addition to the two-dimensional position information acquisition unit of the motion sensor or the GPS unit, and may acquire the position information of the three-dimensional space of the mobile terminals 10 and 10A.

  Moreover, in the said embodiment and modification, although it was the structure which does not change the output level of the electromagnetic wave or electromagnetic field at the time of reading of the RFID reader / writer part 18, it is not limited to this. For example, when the reading position information and reading direction information of the mobile terminals 10 and 10A cannot be read even in the vicinity of the previous reading position information and the previous reading direction information, the output level of the radio wave or electromagnetic field of the RFID reader / writer unit 18 is set. It is good also as a structure made high.

  Moreover, in the said embodiment and modification, although it was the structure which displays the mark corresponding to one RFID tag in a preview image, it is not limited to this. For example, all marks corresponding to a plurality of RFID tags may be displayed in the preview image, and the marks may be displayed so as to be distinguishable from each other by color coding or the like.

  Moreover, in the said embodiment and modification, although it was the structure by which tag position information is calculated by a 1st information reading process, it is not limited to this. For example, tag position information is not calculated in the first information reading process, and in the second information reading process, the CPU 11 selects the RFID tag selected in the reading information table 41 after the RFID tag to be read is selected. The tag position information may be calculated using the response time 412, the reading position information 413, and the reading direction information 414 corresponding to the tag ID 411.

  In addition, it is needless to say that the detailed configuration and detailed operation of each component of the mobile terminals 10 and 10A in the above-described embodiments and modifications can be appropriately changed without departing from the gist of the present invention. .

Although the embodiments and modifications of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments and modifications, and the scope of the invention described in the claims and equivalents thereof are described. Includes range.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
[Appendix]
<Claim 1>
A reading unit that reads the individual identification information stored in the RFID tag via a radio wave or an electromagnetic field;
A location information acquisition unit that acquires location information of the terminal itself;
An orientation information acquisition unit for acquiring orientation information of a reading direction of the reading unit;
A measuring unit for measuring a response time from the output of radio waves or electromagnetic fields in the reading unit to information reading;
A storage unit for storing information;
An informing unit for informing information;
The reading unit is made to read the individual identification information of the RFID tag a plurality of times, the read individual identification information, the plurality of measured response times corresponding to the reading of the individual identification information, and the acquired A plurality of position information and azimuth information stored in the storage unit in association with each other,
Based on a plurality of response times, position information, and orientation information corresponding to the individual identification information stored in the storage unit, tag position information indicating the position of the RFID tag of the individual identification information is calculated and notified to the notification unit. A portable terminal comprising: a notification control unit;
<Claim 2>
The storage control unit causes the reading unit to read individual identification information of the RFID tag and stores the individual identification information, response time, position information, and orientation information corresponding to the reading in the storage unit for a predetermined time. The portable terminal according to claim 1, which is automatically performed at intervals.
<Claim 3>
It has an operation unit that accepts selection input of an RFID tag to be read,
The notification control unit calculates RFID tag tag position information of the individual identification information based on a plurality of response times, position information, and orientation information corresponding to the individual identification information of the selected RFID tag. 2. The mobile terminal according to 2.
<Claim 4>
An imaging unit for imaging a subject;
The notification unit is a display unit that displays an image,
The said notification control part displays the preview image imaged by the said imaging part on the said display part, and displays the calculated tag position information of the RFID tag on the said preview image. The portable terminal as described in.
<Claim 5>
The mobile terminal according to claim 4, wherein the notification control unit displays a mark indicating the tag position of the calculated tag position information of the RFID tag on the preview image.
<Claim 6>
The notification control unit displays the mark at the tag position on the preview image in a size corresponding to the distance from the position of the current position information acquired by the position information acquisition unit to the tag position. Item 6. The mobile terminal according to Item 5.
<Claim 7>
The notification control unit displays the calculated tag position information of the RFID tag and position information and direction information corresponding to the individual identification information of the RFID tag stored in the storage unit on the preview image. The portable terminal as described in any one of from 6.
<Claim 8>
The computer on your mobile device
A reading unit that reads the individual identification information stored in the RFID tag via a radio wave or an electromagnetic field;
A location information acquisition unit that acquires location information of the terminal itself;
An orientation information acquisition unit for acquiring orientation information of a reading direction of the reading unit;
A measuring unit for measuring a response time from output of radio waves or electromagnetic fields in the reading unit to information reading;
A storage unit for storing information;
An informing unit for informing information,
The reading unit is made to read the individual identification information of the RFID tag a plurality of times, the read individual identification information, the plurality of measured response times corresponding to the reading of the individual identification information, and the acquired A plurality of position information and azimuth information stored in the storage unit in association with each other,
Based on a plurality of response times, position information, and orientation information corresponding to the individual identification information stored in the storage unit, tag position information indicating the position of the RFID tag of the individual identification information is calculated and notified to the notification unit. Notification control unit,
Program to function as.

10, 10A portable terminal 11 CPU
12 Operation unit 13 RAM
14 Display 15 ROM
Reference Signs List 16 wireless communication unit 17 storage unit 18 RFID reader / writer unit 19 motion sensor 19A GPS unit 20 imaging unit 21 azimuth magnetic needle unit 22 timing unit 23 power source unit 24 bus 30, 31, 32 RFID tag

Claims (11)

A portable terminal that displays a captured image captured by an imaging means,
First acquisition means for acquiring terminal position information of the mobile terminal detected by the sensor;
Second acquisition means for acquiring an imaging direction by the imaging means;
When reading information from a predetermined object, the position information of the object is calculated based on the terminal position information at the time of reading and the reading direction at the time of reading , and the calculated position information is used as the object. Storage control means for storing in the storage means as position information of the object;
When searching for an object to be searched, the position information of the object stored in the past by referring to the storage means is acquired, and the position information of the object and the terminal position at the time of the search Display control means for controlling to superimpose and display a specific image indicating the position of the target object on a corresponding display position of the captured image based on the information and the imaging direction;
A portable terminal comprising: The storage means stores identification information of a plurality of objects to be searched, and stores position information of each object,
The display control means controls to acquire position information of the selected object when any one of the plurality of objects stored in the storage means is selected.
The mobile terminal according to claim 1. The display control means controls to superimpose and display a specific image having a size corresponding to a distance based on the terminal position information and the position information of the object at the time of the search on the position of the object in the captured image. To
The mobile terminal according to claim 1, wherein the mobile terminal is a mobile terminal. When the information is read from the object, the storage control unit acquires a reading position when the information is read, and further stores reading position information indicating the acquired reading position in association with the object. Control,
The portable terminal according to claim 1, wherein the portable terminal is a portable terminal. The display control means controls to superimpose and display a second specific image corresponding to a distance based on the terminal position information and the reading position information at the time of the search, on the reading position of the captured image;
The mobile terminal according to claim 4. A portable terminal that displays a captured image captured by an imaging means,
First acquisition means for acquiring terminal position information of the mobile terminal detected by the sensor;
Second acquisition means for acquiring an imaging direction by the imaging means;
When searching for a target object to be searched, the terminal position information when the information is read from the target object and the reading direction when the information is read from the target object are associated with the target object. The position information calculated in the above is stored as object position information, and further, the terminal position information at the time of reading the information is stored as read position information, so that the stored position information and the object position information of the object are read. Third acquisition means for acquiring position information;
Based on the object position information, the reading position information, the terminal position information at the time of the search, and the imaging direction, first specifying information indicating the position of the object and second specifying the reading position Display control means for controlling information to be superimposed and displayed at a corresponding display position of the captured image;
A portable terminal comprising: The display control means includes first specifying information having a size corresponding to a distance based on the terminal position information and the object position information at the time of the search, the terminal position information and the reading position information at the time of the search, Controlling the second specific information having a size corresponding to the distance based on the corresponding superimposed display of the captured image;
The mobile terminal according to claim 6. Reading means for reading information from the object;
Storage control means for controlling the storage means to store the terminal position information at the time of reading the information as read position information when the information is read by the reading means;
The mobile terminal according to claim 6 or 7, further comprising: The display control unit controls the direction in which the reading position exists to be displayed on the imaging screen in a guided manner when the reading position does not exist within the imaging range captured by the imaging unit.
The mobile terminal according to claim 6-8, characterized in that. A program for controlling a computer of a portable terminal that displays a captured image captured by an imaging means,
The computer,
First acquisition means for acquiring terminal position information of the mobile terminal detected by the sensor;
Second acquisition means for acquiring an imaging direction by the imaging means;
When reading information from a predetermined object, the position information of the object is calculated based on the terminal position information at the time of reading and the reading direction at the time of reading , and the calculated position information is used as the object. Storage control means for storing in the storage means as position information of the object,
When searching for an object to be searched, the position information of the object stored in the past by referring to the storage means is acquired, and the position information of the object and the terminal position at the time of the search Display control means for controlling to superimpose and display a specific image indicating the position of the object on the corresponding display position of the captured image based on the information and the imaging direction;
A program designed to function as A program for controlling a computer of a portable terminal that displays a captured image captured by an imaging means,
The computer,
First acquisition means for acquiring terminal position information of the mobile terminal detected by the sensor;
Second acquisition means for acquiring an imaging direction by the imaging means;
When searching for a target object to be searched, the terminal position information when the information is read from the target object and the reading direction when the information is read from the target object are associated with the target object. The position information calculated in the above is stored as object position information, and further, the terminal position information at the time of reading the information is stored as read position information, so that the stored position information and the object position information of the object are read. Third acquisition means for acquiring position information;
Based on the object position information, the reading position information, the terminal position information at the time of the search, and the imaging direction, first specifying information indicating the position of the object and second specifying the reading position Display control means for controlling information to be superimposed and displayed at a corresponding display position of the captured image;
A program designed to function as

Images