JP2010191723A - Position detection method, portable terminal, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enhance the accuracy of detecting the position of a portable terminal that an operator carries when the operator performs an operation while carrying the portable terminal, without having to install a number of RFID (radio frequency identification) tags or requiring a reader to approach the RFID tag more than necessary. <P>SOLUTION: A position detection method includes: a voice information acquisition step S21 for acquiring sounds from a microphone 232, subjecting the sounds to voice recognition, and acquiring voice information; a selection step S22 for selecting correction position information corresponding to the acquired voice information from a correction position information table 260 having correction position information related to the voice information stored in an operator's terminal 2; a position information acquisition step S24 for acquiring data on the present position of the operator's terminal 2 that the operator A carries; and a determination step S25 for determining position information based on the data on the present position and the correction position information selected. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a position detection method, a portable terminal, and a program for detecting the position of a portable terminal carried by an operator.

  Conventionally, a position detection system for detecting the position of a moving body has been proposed. In Patent Document 1, the distance between a terminal and a base station is measured by comparing transmission / reception power using a location information communication network between a mobile terminal equipped with a short-range wireless communication device and a base station, and the principle of three-point surveying Describes a technique for determining the position of the user by the above-described method and distributing position information content such as a map and store information to the user by the short-range wireless communication.

Patent Document 2 discloses a car navigation device that includes a position detection unit that detects the position of a vehicle by GPS (Global Positioning System) or the like, and that can check and correct the vehicle position detected by the position detection unit. Are listed.
Further, Patent Document 3 proposes a technique for detecting the position of an RFID tag with a relatively small device in an RFID (Radio Frequency Identification) system.

JP 2008-082757 A JP 2000-097714 A JP 2007-155554 A

  However, it is difficult to use the position detection techniques described in Patent Document 1 and Patent Document 2 with low detection accuracy in order to identify the work position when working indoors. In addition, the position detection technique described in Patent Document 3 requires a large number of RFID tags to be installed in order to increase detection accuracy. Further, since it is necessary to communicate with the RFID tag by wireless communication at a relatively short distance (several centimeters to several meters depending on the frequency band), the reader side needs to approach the RFID tag.

  The present invention has been made to solve the above-described problems. When an operator carries a portable terminal and works indoors, the reader side is more than necessary for the RFID tag without installing a large number of RFID tags. An object of the present invention is to provide a position detection method, a terminal device, and a program capable of improving the accuracy of position detection of a portable terminal carried by an operator without approaching.

The present invention that can solve the above-mentioned problems is a sound information acquisition step of acquiring sound from a sound collector, recognizing the sound and acquiring sound information, and stored in the portable terminal, A selection step of selecting correction position information corresponding to the acquired voice information from a correction position information table including correction position information related to the voice information, and a position information acquisition step of acquiring position information of the mobile terminal And a confirming step for confirming the position information based on the position information and the selected corrected position information.
According to the above configuration, it is possible to acquire voice information obtained by voice recognition of a voice uttered by an operator and select correction position information corresponding to the voice information. For this reason, the detection accuracy of position information can be improved based on audio | voice information. Therefore, for example, in a form such as a restaurant or pachinko shop where a store clerk moves while moving in a large hall, even if RFID technology is adopted as an absolute position detection means, the reader side gets closer to the RFID tag than necessary. Even without this, the accuracy of position detection of the portable terminal carried by the worker can be improved.

Further, the present invention includes a transmitting step of transmitting the position information determined in the determining step to a server that instructs the portable terminal.
According to the above configuration, correctly recognized position information is transmitted to the work management server, so that it is possible to improve the accuracy of processing using the position information performed in the work management server. For example, it is possible to make the next work instruction transmitted to the mobile terminal more accurate and contribute to more accurately determining the work proficiency level of the worker.

In the present invention, the acquired position information is obtained based on absolute position information and relative position information of the mobile terminal.
According to the above configuration, since the relative position information can be acquired, the current position information of the mobile terminal can be acquired if only at least one absolute position information is given. Therefore, for example, it is not necessary to install a large number of position detection tags using RFID technology for detecting the absolute position.

The correction position information includes information related to audio information specified at a predetermined location.
According to the above configuration, since the correction position information corresponding to the voice information is provided, if the voice information is acquired, the position information that may be applicable can be automatically selected. Accordingly, the operator does not need to perform a conscious operation step, so that the operator is not forced to perform unnecessary operations. For this reason, the accuracy of position detection can be improved without reducing work efficiency. Therefore, the present invention can be easily applied to a form such as a restaurant or a pachinko parlor where a store clerk moves while moving in a large store hall.

Moreover, the present invention that can solve the above problems is a mobile terminal,
A position information acquisition unit that acquires position information, a sound information acquisition unit that acquires sound from a sound collector, recognizes the sound and acquires sound information, and the portable terminal stores the sound, A correction unit that selects correction position information corresponding to the acquired audio information from a correction position information table including correction position information related to the information, and the position information and the selected correction position information; And a position information determination unit for determining the position information.
The position information acquisition unit includes an absolute position detection unit that acquires absolute position information and a relative position detection unit that acquires relative position information.

  Moreover, this invention which can solve the said subject is a program characterized by making the said portable terminal perform the positional information acquisition step of Claim 1, the audio | voice information acquisition step, the selection step, and the determination step. .

It is a figure showing a schematic structure of a work management system concerning an embodiment to which the present invention is applied. It is a figure which shows the structure of the terminal for workers. It is the figure which showed the structural example of the positional infomation table for correction. It is a figure which shows the structure of the control system of a work management server. It is a figure which shows the function which a work management server implement | achieves. It is a figure which shows the structural example of a proficiency level criteria database. It is a figure which shows the structural example of the skill level database classified by operator. It is a figure which shows the structural example of a standard workflow database (1). It is a figure which shows the structural example of a standard workflow database (2). It is the figure which showed the coordinate of the store floor of this embodiment, and is a top view of a store. It is a flowchart which shows the process of the operator and the terminal for workers in a position detection process and the proficiency level judgment process classified by work. It is a flowchart which shows the process of a work management server.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram showing a schematic configuration of a work management system 1 according to an embodiment to which the present invention is applied.
The work management system 1 uses a worker terminal 2 (mobile terminal) carried by a worker in a work area where a plurality of workers work, and the worker management terminal 5 (server) uses the worker terminal. 2 is a system for supporting and managing the work of the worker by detecting the position of 2 and transmitting information to the worker terminal 2. In this embodiment, an example in which the present invention is applied to a store that operates a restaurant business will be described as a work area. In this store, a worker carries the worker's terminal 2 and supports and manages work including customer service for a plurality of workers by the function of the work management server 5.

As shown in FIG. 1, the work management system 1 includes a worker terminal 2 as a terminal device used by a worker, at least one position detection tag 4 installed in a store as a work area, And a work management server 5.
The position detection tag 4 in the figure is given unique identification information (ID). The position detection tag 4 is configured to be able to communicate with the worker terminal 2, and in response to a request from the worker terminal 2, ID information including an ID assigned to the worker is received by the worker. To the mobile terminal 2.
The worker terminal 2 and the position detection tag 4 transmit and receive various types of information such as ID information in accordance with an RFID (Radio Frequency Identification) communication method using a frequency of, for example, 900 MHz band or 2.45 GHz band.

In addition, although one worker terminal 2 is illustrated in FIG. 1, actually, a plurality of workers engaged in work in the store respectively carry and use the worker terminal 2. The plurality of worker terminals 2 and the work management server 5 constitute a wireless LAN conforming to, for example, the IEEE 802.11 standard, and can transmit and receive various types of information to and from each other. For example, the worker terminal 2 sends various commands to the work management server 5, and in response to this command, the work management server 5 sends work instructions and the like to the worker terminal 2. Assist workers. When receiving the instruction from the work management server 5, the worker terminal 2 transmits this instruction as a voice to the worker.
For example, the worker uses the terminal 2 for the worker to report the current work status, request that support for work is required, request for guidance on the work procedure, report the occurrence of an abnormality, and broadcast in the store. Request, a notification to get a break, etc. In response to this, the work management server 5 grasps the work status of each worker who uses the worker terminal 2, directs the work procedure to the worker, and directs another worker to the position where support is requested. Instructions, warnings for abnormalities, execution of in-store broadcasting, work management processing associated with breaks, etc.

The work management server 5 outputs sound under the control of the main body 51, a display device 52 that is connected to the main body 51 and displays various images (including videos) and information, and the main body 51. A speaker 53 and a wireless LAN access point 55 for performing wireless communication between the worker terminal 2 are provided. In addition, the work management server 5 includes a database (DB) unit 6 provided virtually or logically in a large-capacity storage device such as a hard disk device built in the work management server 5. The database unit 6 includes a proficiency level determination standard database 600 that is a criterion for determining the proficiency level of workers, a proficiency level database 601 for each worker storing information indicating the proficiency level for each worker, a standard workflow database 602, and the like. A number of databases including are created.
The work management server 5 has a database management function for creating a database, updating information, deleting, extracting, and the like for each database in the database unit 6.
Hereinafter, each part which comprises the work management system 1 is demonstrated in detail.

<Configuration of worker terminal>
First, the worker terminal 2 will be described with reference to FIGS. 1 and 2. FIG. 2 is a diagram illustrating a configuration of the worker terminal 2.
As shown in FIG. 1, the worker terminal 2 includes a headset that is worn on the worker's head and a main body 25 that is held by the worker's waist, arms, or clothes.
As shown in FIG. 2, the internal configuration of the worker terminal 2 mainly includes an absolute position detection unit 210, a relative position detection unit 220, a voice recognition unit 230, a wireless LAN antenna 240, a main CPU 250, and a correction position information table 260. Is provided.

The absolute position detection unit 210 includes an RFID tag reader antenna 211, and communicates with the position detection tag 4 located within a predetermined distance from the worker terminal 2 via the RFID tag reader antenna 211. Execute. Specifically, the short-range communication dedicated CPU 212 analyzes the short-range communication radio wave transmitted from the position detection tag 4 arranged on the store floor, and assigns a unique ID to each display terminal and each position detection tag. Obtained as the absolute position where the worker terminal 2 is present. The acquired ID is transmitted to the main CPU 250.
As short-range communication usable in the present invention, in addition to the above-mentioned short-range communication by RFID, “Bluetooth” (10M to 100M), [ZigBee] (10M to 70M), [Wibre] (10M), [ UWB] (10M).

The relative position detection unit 220 includes a triaxial gyro sensor 221 (angular velocity sensor) and a triaxial acceleration sensor 222 as relative position detection sensors. The worker terminal 2 of the present embodiment is provided with two types of relative position detection sensors. However, depending on the application field of the work management system 1, a GPS or the like different from the two types of relative position detection sensors may be used. It is also possible to use position detecting means such as The position detection CPU 225 optimizes the relative position data detected by the relative position detection sensors 221 and 222 according to each data characteristic. The optimized relative position data is transmitted to the main CPU 250.
A memory 227 including a RAM and a ROM stores a program for calculating relative position data. The position detection CPU reads a calculation program stored in the ROM onto the RAM, and executes a relative position calculation process. The calculation result is stored in the memory 227 as necessary.

The voice recognition unit 230 includes a speaker 231 that outputs voice based on the voice signal output from the work management server 5, a microphone 232 that collects voice generated by the worker and converts the voice into a voice signal, and is dedicated to voice recognition. IC233.
The voice recognition IC 233 includes a voice recognition processing unit 235 and a voice utterance processing unit 236. The voice recognition processing unit 235 collects the voice uttered by the worker from the microphone 232 of the headset set on the head of the worker, and converts the collected voice data into digital data (text data or code data). Then, the data is transmitted to the main CPU 250.
The sound generation processing unit 236 converts the digital data (text data, code data, etc.) transmitted from the main CPU 250 into sound data, and transmits the sound data from the headset speaker 231 set on the operator's head. Can do.
A memory 234 including a RAM and a ROM stores a voice recognition program and a voice generation program. The dedicated speech recognition IC reads out a computation program stored in the ROM onto the RAM, and executes computation processing for speech recognition and speech generation. The calculation result is stored in the memory 234 as necessary.

The wireless LAN antenna 240 performs wireless communication with the work management server 5 as described above.
In the correction position information table 260, for each work place where the worker in the store is engaged in work (for each correction position information), related term examples that may be used in the work place are set.

FIG. 3 is a diagram illustrating a configuration example of the correction position information table 260.
For example, “full seat”, “wait”, “some people”, “no smoking”, “smoking”, etc. are set as examples of related terms that may be spoken when an operator works at the entrance / exit. .
In addition, examples of related terms that may be spoken when an operator works at a table (table) include “menu”, “○ table-like”, “dish”, “drink”, “drink”, “ "Order", "Washing towel", etc. are set.
In addition, “○ table”, “cooking”, “drink”, and the like are set as examples of related terms that may be uttered when an operator works in a restaurant.
In addition, examples of related terms that may be spoken when an operator works at a cash register include “accounting”, “receipt”, “receipt”, “change”, “yen”, “discount ticket”, “service” Ticket "etc. are set.

  As described above, by providing related term examples that may be used for each work place (for each corrected position information) in advance, if the voice recognition unit 230 acquires the voice of the worker, the correction corresponding to the voice data is performed. Work information can be automatically selected.

The main CPU 250 calculates the movement distance of the worker carrying the worker's portable terminal by integrating the acceleration data obtained from the three-axis acceleration sensor 222 twice (hereinafter referred to as an integration model). Alternatively, it is also possible to use a method of calculating the movement distance based on the number of steps of the worker by measuring the intensity of the acceleration data obtained from the three-axis acceleration sensor 222 and determining whether the worker is walking (hereinafter referred to as a walking model). Called). Further, the main CPU 250 calculates the orientation of the worker terminal 2, that is, the orientation of the worker by integrating the angular velocity data obtained from the three-axis gyro sensor 221 once. Then, based on the movement distance of the pedestrian calculated by the integral model or the walking model, the orientation of the terminal, and the absolute position data received from the short-range communication CPU 212, the current position data of the worker terminal 2 and the worker Calculate the direction that is facing.
The calculated current position data of the worker terminal 2 and the direction in which the worker is facing are transmitted to the work management server 5 via the wireless LAN antenna 240.

  Further, the main CPU 250 controls the voice recognition unit 230 and transmits the digital data received from the voice recognition dedicated IC 233 to the work management server 5 via the wireless LAN antenna 240.

  Further, the main CPU 250 of this embodiment supplements the correction position information to the current position data calculated with reference to the correction position information table 260. That is, the related term that matches the voice data recognized by the voice recognition IC 233 is searched from the correction position information table 260, and the corrected position information corresponding to the matching related term is selected. When a plurality of pieces of correction position information are selected, the current position data is complemented with the correction position information closest to the calculated current position data among the plurality of pieces of correction position information. As described above, in this embodiment, not only the detection values obtained by the position detection units 210 and 220 but also the position information is confirmed by complementing the detection value with the corrected position information linked with the audio data, and the work place Is identified.

  For example, it is assumed that the acquired voice data is “○ table-like food delivery is included”. The main CPU 250 refers to the correction position information table 260 and searches for related terms that match the speech-recognized data “○ table-like, dish”. The correction position information including “○ table, cooking” is “table” and “cooking place”, and at this time, two correction position information is selected. Then, if the acquired current position data indicates coordinates around the cooking place and the washing place, the correction position information closest to the coordinates, in this case, “cooking place” is determined as the work place, and the current position data is determined. Complement.

<Configuration of work management server>
Next, the work management server 5 will be described. FIG. 4 is a diagram showing the configuration of the control system of the work management server 5.
As shown in FIG. 4, the work management server 5 includes a control unit 501 that controls each unit of the work management server 5, and a memory 502 that stores programs and data processed by the control unit 501 in a volatile or non-volatile manner. Is provided. The control unit 501 stores information including a display processing unit 503 for displaying various screens by the display device 52, an audio output unit 504 for outputting audio from the speaker 53, and the database unit 6 shown in FIG. The unit 505 is connected. Further, a key input device 56 is connected to the control unit 501.

The display processing unit 503 generates a video signal for displaying various screens on the display device 52 under the control of the control unit 501 and outputs the video signal to the display device 52. The display device 52 includes an LCD (liquid crystal display) panel and the like, and displays various screens based on the video signal input from the display processing unit 503.
The audio output unit 504 generates an audio signal according to the control of the control unit 501 and outputs the audio signal to the speaker 53. The speaker 53 reproduces sound based on the sound signal output from the sound output unit 504. The speaker 53 is installed in a store as a business area, for example, and outputs sound for the purpose of in-store broadcasting.
The storage unit 505 is a storage device using a recording medium or a semiconductor storage element capable of recording and reading information magnetically or optically, and stores various programs and data in a nonvolatile manner.
The storage unit 505 is provided with storage areas that are virtually, logically, or physically partitioned, and these storage areas include a proficiency level judgment reference database 600, a worker-specific proficiency level database 601, and a standard workflow database 602. It is used as each database.

The network interface unit 506 is connected to the wireless LAN access point 55 and receives information from the worker terminal 2 using the wireless LAN access point 55 under the control of the control unit 501 or to the worker terminal 2. Send information.
The wireless LAN access point 55 is a device that constitutes a LAN including the work management server 5 in a store as a work area. The wireless LAN access point 55 includes an antenna, an RF unit, a modem unit, a base for performing communication compliant with the wireless LAN standard. Built-in band.

  The key input device 56 is a device having character keys including numbers and function keys to which various functions are assigned. The key input device 56 generates an operation signal corresponding to the key operated by the operator and outputs the operation signal to the control unit 501. To do.

FIG. 5 is a diagram illustrating functions realized by the work management server 5. The function unit illustrated in FIG. 5 is realized by the cooperation of hardware and software by the work management server 5.
As shown in FIG. 5, the work management server 5 includes a network input unit 511, a position information processing unit 512, a voice information processing unit 513, and a work to be performed that are operated by receiving input of information wirelessly transmitted from the worker terminal 2. It functions as a determination unit 516 and a network output unit 517.

The network input unit 511 receives and demodulates information wirelessly transmitted from the worker terminal 2 by the wireless LAN access point 55. The network input unit 511 is realized by the control unit 501 and the network interface unit 506.
When the information received by the network input unit 511 is information transmitted from the worker terminal 2, the position information processing unit 512 extracts position information included in this information. In the present embodiment, current position data and correction position information that complements the current position data are extracted. Note that the position information processing unit 512 is realized by the control unit 501.
When receiving information transmitted from the worker terminal 2 by the network input unit 511, the voice information processing unit 513 extracts voice information from the received information. The voice information processing unit 513 is realized by the function of the control unit 501.

The execution work determination unit 516 includes a work content specification unit 521, a required work time measurement unit 523, a proficiency level database creation unit 524, and a work instruction command creation unit 525.
The work content specifying unit 521 and the work time measuring unit 523 acquire the work status performed by each worker, and the work history such as the work place, the number of times of execution for each work, the start time and the end time of each work, and the work history. The information is recorded in the database 603 and reflected in the skill level database 601 for each worker. The work results can include the break start time and end time, and can also include the scheduled end time. The work history database stores information related to work results for each worker and for each work day.

  The proficiency level database creation unit 524 compares the above-described work location, the number of executions for each work, the work results such as the start time and the end time for each work, and the proficiency level determination reference data database 600, for example, rank The work proficiency level of each worker represented by the four stages A to D is determined and reflected in the proficiency level database 601 for each worker.

FIG. 6 is a diagram illustrating a configuration example of the proficiency level determination reference database 600.
The proficiency level determination criterion database 600 illustrated in FIG. 6 defines determination criteria for determining the proficiency level of an operator in four stages (rank A to rank D). Specifically, when accounting proficiency level is measured by “accounting average work time” and “number of accounting work”, if the time required for accounting work of a worker is within 2 minutes, the accounting average of that worker The rank regarding the working time is determined as A. Further, if the number of accounting operations performed by the worker in the past exceeds 100, the rank regarding the number of accounting operations of the worker is determined as A.
Furthermore, when the hall work proficiency level is measured by “delivery average work time”, “delivery work frequency”, “number of complaints” and “cumulative hall work time”, the average delivery time required for a certain worker to deliver dishes Is within 60 seconds / person, the rank regarding the delivery average work time of the worker is determined as C. Further, if the number of times of the dish delivery work that the worker has performed in the past is 200 times or less, the rank regarding the number of delivery work of the worker is determined as B. Similarly, if the number of complaints received by the worker in the past (per 30 hours of work) exceeds 1.0, the rank related to the number of complaints of the worker is determined as D, and the cumulative hall work time is 500. If it is less than or equal to the time, the rank regarding the accumulated hall work time is determined as C.

FIG. 7 is a diagram illustrating a configuration example of the worker-specific proficiency level database 601 created by the proficiency level database creation unit 524 based on the work history database and the proficiency level determination reference database 600.
In the worker proficiency level database 601 shown in FIG. 7, accounting work proficiency levels and hall work proficiency levels are stored for three workers. As for the accounting work, the measurement values of “accounting work time” and “number of accounting work” and the proficiency level determined based on the proficiency level determination standard database 600 are stored. For hall work, the proficiency level determined based on the measured values of “average delivery work time”, “delivery work number”, “number of complaints”, and “cumulative hall work time” and the proficiency level judgment reference database 600 Is stored. For example, the number of accounting operations for worker A is 21 and is determined to be rank C. Further, the accumulated hall work time of the worker A is 1300 hours, and is determined to be rank A.

Returning to FIG. 5, the work instruction command unit 525 creates a work instruction command for giving a work instruction to the worker terminal 2. The work instruction command creation unit 525 refers to the standard workflow database 602 based on the position information and audio information, determines the work to be directed next, and creates a work instruction command. The work instruction command is modulated by the network output unit 517 by the wireless LAN access point 55 and transmitted to the worker terminal 2.
The network output unit 517 is realized by the control unit 501 and the network interface unit 506.

FIG. 8A is a diagram illustrating a configuration example of the standard workflow database, and FIG. 8B is a diagram illustrating a configuration example of the standard workflow database indicating the end position with respect to the start position of each task. 9 is a diagram showing coordinates of the store floor according to the present embodiment, and is a plan view of the store.
In the standard workflow database 602 (1) shown in FIG. 8A, work contents, a position (work place) where the work is performed, and voice instructions or voice recognition information corresponding to the work place are associated with each other. . The standard work flow is a set of standard work flow in the store. The work management server 5 identifies the work being performed by the worker based on the position information, the voice information, and the standard workflow database 602 (1) transmitted from the worker terminal 2. When the work according to the standard work flow database 602 (1) is not performed, a correction instruction is transmitted to the worker terminal 2.

  As shown in FIG. 9, a store as a business area where the business management system 1 is installed has a customer service area including a doorway, a cash register, tables 1 to 5, a toilet and a cooking place, a washing area, a range, and a flyer. And a kitchen area that performs cooking operations including a refrigerator and a stove, and an office area that performs management operations including a PC (personal computer) and a break table. The office area is also used as a resting place for workers. The work management server 5 is installed on a desk for management work in the office area.

As shown in FIG. 8B, a work start location and a work end location for each work content are set in the standard workflow database 602 (2).
Specifically, the work start location of the cash register work is set as a cash register, and the work end location is also set as a cash register. In addition, the tables 1 to 5 are set as the cooking place as the work start place and the work end place of the cooking delivery work, respectively. Furthermore, tables 1 to 5 are set as the work start places for the table cleaning work, and a washing place is set as the work end place.
For example, when the position information and audio information transmitted from the worker terminal 2 determines that the worker terminal 2 is located at the cooking place to start the cooking delivery work, the work management server 5 It can be determined that the work end location of the delivery work is one of the tables 1-5. For this reason, when the work place determined based on the position information and the sound information transmitted from the worker terminal 2 next is a cooking place or a cash register other than the tables 1 to 5, the standard work flow database 602 is used. It can be determined that a different work is being performed. In such a case, a work correction instruction is transmitted to the worker terminal 2 that performed the work that was performed incorrectly.

As described above, the worker terminal 2 of the present embodiment transmits the current position data and the work location information calculated based on the absolute position data and the relative position data of the worker terminal 2.
The current position data is coordinate data and can be shown on the position coordinates of the store shown in FIG. For example, when the coordinates indicating the current position received from the operator terminal 2 are (X, Y) = (125, 175), it can be seen that the coordinates are located around the table 4 or the table 5. Further, when (X, Y) = (150, 275), it can be seen that it is located around the cooking place. Further, when (X, Y) = (125, 325), it can be seen that it is located around the cooking place or the washing place.

<Voice recognition processing and worker-specific proficiency level determination processing>
Next, the position detection process performed by the worker terminal 2 and the task-specific proficiency level determination process performed by the work management system 1 will be described. FIG. 10 is a flowchart showing the processes of the worker A and the worker terminal 2 in the position detection process and the task-specific proficiency determination process, and FIG. 11 is a flowchart showing the process of the work management server 5. Below, the process which determines a skill level about the dish delivery work which the operator A implements is illustrated and demonstrated.

First, when the worker terminal 2 receives a work instruction from the work management server 5, the worker terminal 2 generates an instruction from the speaker 231 (step S20). Here, it is assumed that a cooking delivery operation for delivering food to the fourth table is instructed.
When the worker A starts the cooking delivery work, when the worker A speaks to the microphone 232 that “4 table-like drinks will be provided” (step S11), the worker terminal 2 receives the worker's terminal 2 via the microphone 232. The voice is collected and the voice recognition unit 230 recognizes the voice (step S21).
Correction position information corresponding to the term obtained through speech recognition in step S21 is selected from the correction position information table 260 (step S22).
Next, the current position of the operator terminal 2 is specified by adding the relative position to the absolute position data or the previous current position data (steps S23 and S24).
As a method for calculating the current position, if the absolute position can be detected, the absolute position detection unit 210 detects the absolute position, and corrects the absolute position with the relative position data detected by the relative position detection unit 220. If the absolute position information cannot be acquired, for example, the current position data calculated last time stored in the memory 227 in the worker terminal is used, and the current position is acquired by adding the calculated relative position. .

  Here, the main CPU 250 refers to the correction position information table 260 based on the voice recognition result when the worker A says “I will provide 4 drinks” in step S11. As the correction position information including the related term “”, “table (table)” and “cooking place” are selected. It is assumed that the position of the worker terminal 2 at that time is (X, Y) = (125, 325) according to the current position data. The main CPU 250 of the operator terminal 2 knows that the coordinates (X, Y) = (125, 325) are around the cooking place and the washing place.

  The main CPU 250 supplements the current position data with “cooking place”, which is correction position information closer to the current position data (X, Y) = (125, 325), and confirms this as work place information (step). S25). That is, the position information includes current position data and work place information. When the work information is confirmed, the work information is transmitted to the work management server 5 through the wireless LAN antenna 240 together with the voice information (step S26).

Moving to FIG. 11, the work management server 5 receives audio information and position information from the worker terminal 2 (step S41). The work management server 5 temporarily stores the received information, and registers the work history of the cooking delivery work of the worker A and the work time measurement process of the cooking delivery work based on the transmitted voice information and position information. Execute.
The work content identification unit 521 identifies the work content based on the received position information, audio information, and standard workflow database 602 (1).
According to the position information, the position of the worker terminal 2 when the worker A utters "4 drinks will be provided" in step S11 is (X, Y) = (125, 325), According to the corrected position information, since it is a “cooking place”, the worker A can determine that he is located at the cooking place.
Moreover, according to the voice information, the voice recognition result “4 table drinks can be provided” can be recognized. As shown in FIG. 8A, it is possible to specify that the work content corresponding to the work place “cooking place” and the speech recognition result “4 table-like drinks are provided” is “cooking delivery”. Furthermore, it can be recognized that “cooking has started”.

  When the work content specifying unit 521 determines the start of the delivery work, the work required time measurement unit 523 starts measuring the work time of the delivery work (step S42). Further, a process of increasing the number of delivery operations of worker A by 1 is performed (step S43).

  In step S42, if the worker A cannot be detected from the transmitted position information and is located at another place, the work instruction command creating unit 525 will display the dish place. A correction instruction command for instructing to move to can be created and transmitted to the operator terminal 2. When receiving the correction instruction command, the worker terminal 2 generates this from the speaker.

Next, the worker A moves to the 4th table (step S12), and when delivery of the drink is finished, he / she utters “I have provided 4 table-like drinks” (step S13). The worker terminal 2 collects the voice of the worker A through the microphone 232, and the voice recognition unit 230 recognizes the voice (step S27).
Correction position information corresponding to the term obtained through speech recognition in step S27 is selected from the correction position information table 260 (step S28).
Next, the current position of the operator terminal 2 is specified by adding the relative position to the absolute position data or the previous current position data (steps S29 and S30).
As a method for calculating the current position, if the absolute position can be detected, the absolute position detection unit 210 detects the absolute position, and corrects the absolute position with the relative position data detected by the relative position detection unit 220. If the absolute position information cannot be acquired, for example, the current position data calculated last time stored in the memory 227 in the worker terminal is used, and the current position is acquired by adding the calculated relative position. .

  Here, from step S13, the main CPU 250 refers to the correction position information table 260 based on the voice recognition result when the worker A utters “I have provided 4 table drinks” and “4 tables, drink”. As the correction position information including the related terms, “table” and “cooking place” are selected. It is assumed that the position of the worker terminal 2 at that time is (X, Y) = (125, 175) according to the current position data. The main CPU 250 of the worker terminal 2 knows that the coordinates (X, Y) = (125, 175) are around the fourth table and the fifth table.

  The main CPU 250 complements the current position data with a table that is correction position information closer to the current position data (X, Y) = (125, 175), and determines this as work place information ( Step S31). When the work location information is confirmed, the work location information is transmitted to the work management server 5 through the wireless LAN antenna 240 together with the voice information (step S32).

  Moving to FIG. 11, when the work management server 5 receives the voice information and the position information from the worker terminal 2, the work management server 5 temporarily stores the received information, and the standard workflow database 602 (1). Based on the transmitted voice information and position information, it is determined whether the cooking delivery work has been completed (step S44). In other words, the work content identification unit 521 has the work performed by the worker A as “cooking delivery work” based on the standard work flow, work place (table), and voice information “cooking, delivery, end”. It is determined that the delivery has been completed (step S44).

In step S13, the corrected position information when the worker A says "I have provided 4 table-like drinks" is "table (table)" and "cooking place", and the position of the operator terminal 2 is According to the position information, (X, Y) = (125, 175), and according to the corrected position information, the work place is a table (table), so it can be determined that the worker A is located at the fourth table. .
If the correction position information selected from the voice recognition result and the current position data calculated from the absolute position detection and the relative position detection do not match, the work management server 5 is notified of the mismatch. In this case, the work management server 5 assumes that the work is performed according to the standard work flow, and sets the work place assigned to the standard work flow as the current work place.

  In other words, based on the standard work flow database 602 (1), the work content specifying unit 521 is performed by the worker A from the work place (table) “No. 4 table” and the voice information “4 tables like drinks provided”. It is determined that the work being performed is “cooking delivery work”. In addition, according to FIG. 8A, it can also be recognized that “cooking has ended”.

  After that, when 3 minutes have passed since the start of the measurement of the work time in step S42, when a voice corresponding to “provided” is received (step S44: No, step S45: No, step S44: Yes), the work required time measurement unit 523 determines the end of the delivery work and ends the work time measurement (step S46). When the work location, the number of times of accounting work, the start time and end time of the accounting work, and the time required for the work are specified, they are reflected in the work history database. Further, the proficiency level database creation unit 524 calculates the average value of the delivery work time of the worker A and reflects it in the proficiency level database 601 for each worker together with the number of times of delivery work (steps S47 and S48).

  On the other hand, if the voice corresponding to “provided” is not received before 3 minutes have elapsed since the start of the measurement of the work time in step S42 (step S44: No, step S45: Yes), It is determined that the accounting work has not been completed. In such a case, for example, it can be determined that the worker A is called by another customer and engaged in work other than the delivery work. (Step S49).

  In step S44, if it is not detected from the transmitted position information that the worker A is located in the fourth table and the worker A is located in another place, the work instruction command creating unit 525 displays 4 It is possible to create a correction instruction command for instructing delivery of food to the turn table and transmit it to the worker terminal 2. When receiving the correction instruction command, the worker terminal 2 generates this from the speaker.

When the number of delivery operations and the average delivery time for the worker A are reflected in the worker-specific proficiency level database 601, the proficiency level database creation unit 524 refers to the proficiency level determination reference database 600 to determine the average delivery operation of the worker A. The proficiency level of the time is determined and reflected in the proficiency level database 601 for each worker (step S50). As shown in FIG. 7, the average delivery work time of worker A is 4 minutes and 20 seconds, and is determined as rank D.
Similarly, the proficiency level database creation unit 524 refers to the proficiency level determination reference database 600 to determine the proficiency level of the delivery work number of the worker A and reflects it in the proficiency level database 601 for each worker (step S51). As shown in FIG. 7, the number of accounting operations of worker A is 21 and is determined as rank C.

  In this manner, the worker-specific proficiency level database 601 is created by performing the worker-specific proficiency level determination process for each work content. The accounting work proficiency database shown in FIG. 7 can also be created by performing proficiency level determination processing for accounting work.

  As described above, when the delivery work of the worker A is completed, the next work instruction is transmitted to the worker terminal 2 based on the standard work flow database 602 (1) (step S52).

  As described above, according to the present embodiment, it is possible to acquire voice information obtained by voice recognition of a voice uttered by the worker A and select correction position information corresponding to the voice information. For this reason, the current position data can be complemented based on the voice information. Further, since the position information supplemented by the correction position information is transmitted to the work management server 5, it is possible to improve the accuracy of processing using the work place information performed in the work management server 5. In this embodiment, it contributes to determining worker A's work proficiency more accurately.

  Since the worker terminal 2 can acquire the relative position data, the current position data of the worker terminal 2 can be acquired if at least one absolute position data is given. Therefore, it is not necessary to install a large number of position detection tags 4 for detecting the absolute position in the store. Since the current position data can be complemented by the correction position information, the detection accuracy does not deteriorate even if a large number of position detection tags 4 are not installed.

  Moreover, since the correction position information corresponding to the related terms that may be used in advance is provided, the position information that may be applicable can be automatically selected if the voice information is acquired. Accordingly, the operator does not need to perform a conscious operation step, so that the operator is not forced to perform unnecessary operations. For this reason, the accuracy of position detection can be improved without reducing work efficiency. In particular, the present invention can be effectively applied to a restaurant-like form in which a worker moves while working in a large in-store hall as in this embodiment.

DESCRIPTION OF SYMBOLS 1 ... Work management system, 2 ... Worker terminal (terminal terminal), 4 ... Position detection tag, 5 ... Work management server, 6 ... Database part, 25 ... Main part, 51 ... Main part, 52 ... Display device, 53 ... Speaker, 55 ... Wireless LAN access point, 56 ... Key input device, 210 ... Absolute position detector, 211 ... RFID tag reader antenna, 212 ... CPU for short range communication, 220 ... Relative position detector, 221 ... 3-axis Gyro sensor, 222 ... 3-axis acceleration sensor, 225 ... Position detection CPU, 227 ... Memory, 230 ... Voice recognition unit, 231 ... Speaker, 232 ... Microphone, 233 ... Voice recognition IC, 234 ... Memory, 235 ... Voice recognition processing , 236 ... sound generation processing part, 240 ... wireless LAN antenna, 250 ... main CPU, 260 ... position information for correction 501 ... Control unit 502 ... Memory 503 ... Display processing unit 504 ... Audio output unit 506 ... Network interface 511 ... Network input unit 512 ... Position information processing unit 513 ... Audio information processing unit 516 ... Implementation work determination unit, 517 ... network output unit, 521 ... work content specification unit, 523 ... work required time measurement unit, 524 ... skill level database creation unit, 525 ... work instruction command creation unit, 600 ... skill level judgment reference database, 601: Proficiency level database by worker, 602 (1), 602 (2): Standard work flow database, work history database.

Claims (7)

A sound information acquisition step of acquiring sound from a sound collector, recognizing the sound and acquiring sound information;
A selection step of selecting correction position information corresponding to the acquired voice information from a correction position information table that is stored in the mobile terminal and includes correction position information related to the voice information;
A location information acquisition step of acquiring location information of the mobile terminal;
A position determining method for determining the position information based on the position information and the selected corrected position information.   The position detecting method according to claim 1, further comprising: a transmitting step of transmitting the determined position information in the determining step to a server that instructs the portable terminal.   The speech recognition method according to claim 1, wherein the acquired position information is obtained based on absolute position information and relative position information of the mobile terminal.   The position detection method according to claim 1, wherein the correction position information includes information related to audio information specified at a predetermined location. A mobile device,
A location information acquisition unit for acquiring location information;
A sound information acquisition unit that acquires sound from a sound collector, recognizes the sound and acquires sound information;
A selection unit for selecting correction position information corresponding to the acquired voice information from a correction position information table that is stored in the portable terminal and includes correction position information related to the voice information;
A portable terminal comprising: a position information determination unit that determines the position information based on the position information and the selected correction position information.   The mobile terminal according to claim 5, wherein the position information acquisition unit includes an absolute position detection unit that acquires absolute position information and a relative position detection unit that acquires relative position information.   The program which makes the said portable terminal perform the positional information acquisition step, audio | voice information acquisition step, selection step, and confirmation step of Claim 1 characterized by the above-mentioned.

Images