WO2021131465A1 - 業務管理システム、業務管理方法、及び業務管理プログラム - Google Patents
業務管理システム、業務管理方法、及び業務管理プログラム Download PDFInfo
- Publication number
- WO2021131465A1 WO2021131465A1 PCT/JP2020/043793 JP2020043793W WO2021131465A1 WO 2021131465 A1 WO2021131465 A1 WO 2021131465A1 JP 2020043793 W JP2020043793 W JP 2020043793W WO 2021131465 A1 WO2021131465 A1 WO 2021131465A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- application
- user
- screen
- time
- captured image
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
- G06Q10/06311—Scheduling, planning or task assignment for a person or group
- G06Q10/063114—Status monitoring or status determination for a person or group
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06398—Performance of employee with respect to a job function
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
Definitions
- the present invention relates to a business management system, a business management method, and a business management program, and in particular, a business management system for grasping the actual business conditions of a worker who uses an application program (hereinafter, simply referred to as "application"). Regarding business management methods and business management programs.
- Patent Document 1 the remote work status monitoring system disclosed in Patent Document 1 is intended to monitor the work status of a worker based on the operating state of the worker's PC (Personal Computer).
- PC Personal Computer
- An object of the present invention is to provide a business management system, a business management method, and a business management program capable of grasping the actual business conditions of a worker who uses an application in view of the above-mentioned problems.
- the analysis unit that analyzes the captured image to detect the user's black eye and the position of the user's black eye in the captured image when the user's black eye is detected are applications.
- the application identification unit, the application determination unit that determines whether the specified application is the default application used in business, and the default application if the specified application is determined to be the default application. Includes a time calculation unit that calculates the usage time of the application determined to be.
- FIG. 1 is a schematic view showing an embodiment of the business management system 1 of the present invention.
- the business management system 1 includes a user PC 10, a management server 20, an administrator PC 30, a user PC 50, and a photographing device 60.
- the user PC 10, the management server 20, and the administrator PC 30 can be installed at the work place of the worker to be managed, for example, a company.
- the user PC 10, the management server 20, and the administrator PC 30 can communicate data with each other via an in-house network 40 such as a LAN (Local Area Network).
- an in-house network 40 such as a LAN (Local Area Network).
- the user PC 10 is an information processing device that supports a remote desktop function that can be operated remotely, and a managed worker can use the user PC 50 to use applications and data possessed by the user PC 10. Details of the functions of the user PC 10 will be described later with reference to FIG.
- the management server 20 is an information processing device that calculates the usage time, non-business work time, and time when the managed worker is absent for each application by using the information provided by the user PC 10. Details of the functions of the management server 20 will be described later with reference to FIG.
- the administrator PC 30 is an information processing device used by the administrator of the worker to be managed.
- the administrator PC 30 requests the management server 20 for an image showing the usage time, non-business work time, and time when the managed worker is away from the management server 20, and the administrator PC 30 obtains the image acquired from the management server 20. It is displayed on the display device of the PC 30.
- the user PC 50 and the photographing device 60 are installed in a work space such as the home of the worker to be managed.
- the user PC 50 has a remote desktop function capable of remotely operating the user PC 10, accesses the user PC 10 in the company via a VPN (Virtual Private Network) 70, and uses the applications and data possessed by the user PC 10. can do.
- VPN Virtual Private Network
- the photographing device 60 is communicatively connected to the user PC 50, and is installed at a position where the user's face, particularly the user's eyes, can be photographed.
- the photographing device 60 executes the photographing process at predetermined time intervals.
- the predetermined time interval can generally be the time (200 milliseconds, etc.) that a person keeps an eye on when reading a sentence.
- the photographing device 60 transmits the photographed image to the user PC 50.
- a photographing device integrally incorporated in the user PC 50 may be used instead of the photographing device 60.
- the user PC 50 is a photographed image provided by the photographing device 60, coordinate information of a screen provided by an application used by a user who is a managed worker (hereinafter referred to as an “application screen”), and an application screen.
- Information indicating the context is transmitted to the user PC 10 in the company via the VPN 70 and the in-house network 40.
- the coordinate information of the application screen includes information indicating the coordinates of the application screen displayed on the display device of the user PC 50, identification information of the application that provides the application screen, and date and time information when the application screen is displayed. ..
- the information indicating the context of the application screen includes the information indicating the context of the application screen that is virtually duplicated, the identification information of the application that provides the application screen, and the date and time information that the application screen was displayed. included.
- the user PC 50 can transmit this information to the user PC 10 at the predetermined time intervals described above.
- FIG. 2 is a block diagram showing a detailed configuration of the user PC 10 according to the embodiment of the present invention.
- the user PC 10 includes an arithmetic unit 100, a communication interface (I / F) 110, and a storage device 120.
- the arithmetic unit 100 is an arithmetic unit such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and relates to an embodiment of the present invention by executing a business management program according to the embodiment of the present invention. Execute the business management method.
- a CPU Central Processing Unit
- MPU Micro Processing Unit
- the programs executed by the arithmetic unit 100 include a monitoring unit 101, an analysis unit 102, a position calculation unit 103, a position determination unit 104, a viewpoint coordinate calculation unit 105, an application (AP) specific unit 106, a database (DB) processing unit 107, and the like. And the information providing unit 108 is included.
- These program modules can be implemented as a function of a UC (Unified Communications) application.
- the monitoring unit 101 is a program module that determines whether or not the photographed image, the coordinate information of the application screen, and the information indicating the context are received from the user PC 50. When the monitoring unit 101 receives such information, it stores it in the storage device 120.
- the analysis unit 102 is a program module that analyzes the captured image stored in the storage device 120 and detects the user's black eyes.
- the analysis unit 102 acquires the captured image from the storage device 120, and determines whether or not the user's black eyes are included in the captured image.
- the position calculation unit 103 is a program module that calculates the position of the user's black eye in the captured image. As shown in FIG. 10, the position calculation unit 103 can calculate the center position C of the user's black eye, that is, the center position of the pupil.
- the position determination unit 104 is a program module that determines whether or not the center position C of the user's black eye is in the area corresponding to the display screen of the display device of the user PC 50 (hereinafter, referred to as “screen compatible area”). is there.
- the upper left end portion Ptl, the left lower end portion Pbl, the upper right end portion Ptr, and the right lower end portion Pbr of the screen corresponding area are the upper right end portion and the right lower end portion of the display screen of the user PC 50, respectively.
- the left upper end and the left lower end corresponds to the left upper end and the left lower end.
- the upper left end Ptl of the screen corresponding area corresponds to the center position C of the black eye when the user is looking at the upper right end of the display screen of the display device of the user PC 50.
- the left lower end Pbl of the screen corresponding area corresponds to the center position C of the black eye when the user is looking at the right lower end of the display screen.
- the upper right end Ptr of the screen corresponding area corresponds to the center position C of the black eye when the user is looking at the upper left end of the display screen.
- the right lower end Pbr of the screen corresponding area corresponds to the center position C of the black eye when the user is looking at the left lower end of the display screen.
- Each end of the screen corresponding area Ptl, Pbl, Ptr, Pbr individually lights each end of the display screen of the display device of the user PC 50, and is a captured image when the user is looking at each end of the display screen. Can be determined using.
- the viewpoint coordinate calculation unit 105 is a program module that calculates the viewpoint coordinates indicating the user's viewpoint on the display screen of the display device of the user PC 50 based on the center position C of the user's black eye in the screen corresponding area. Specifically, as shown in FIG. 11, when the origin is the left lower end of the display screen of the display device of the user PC 50, the viewpoint coordinate calculation unit 105 sets the right lower end Pbr of the screen corresponding area corresponding to the origin. The distances in the X and Y directions from the center position C to the center position C are calculated. For example, assuming that the lengths of the screen corresponding area in the X direction and the Y direction are 1, respectively, the distances of the center position C shown in FIG.
- the AP identification unit 106 is a program module that identifies an application that provides an application screen that the user is viewing by using the coordinate information of the application screen displayed on the display screen of the user PC 50 and the viewpoint coordinates of the user.
- the AP identification unit 106 acquires the coordinate information of the application screen from the storage device 120, and determines whether or not the viewpoint coordinates of the user are included in the area defined by the coordinate information, that is, in the application screen. When the user's viewpoint coordinates are included in the application screen, the AP identification unit 106 identifies the application that provides the application screen.
- the AP identification unit 106 acquires information indicating the context of the application screen in addition to the coordinate information of the application screen from the storage device 120.
- the AP identification unit 106 provides an application that provides the frontmost application screen based on the information indicating the context of the application screen. Can be identified.
- the DB processing unit 107 is a program module that registers information in a data storage table generated in the storage device 120 in response to a request from another program module. As shown in FIG. 5, in the data storage table, date and time information indicating the generation date and time of the captured image, the determination result regarding the user's black eye and the viewpoint, the viewpoint coordinates, and the identification information of the application are registered.
- the judgment results regarding the user's black eyes and the viewpoint include a judgment result that the center position C of the user's black eyes is within the screen compatible area, a judgment result that the center position C of the user's black eyes is outside the screen compatible area, and the user. There is a judgment result that the black eye of is not detected.
- the determination result that the center position C of the black eye of the user is in the screen corresponding area means that the user is looking at the display screen of the display device of the user PC 50.
- the determination result that the center position C of the black eye of the user is outside the screen corresponding area means that the user is looking at a screen other than the display screen of the display device of the user PC 50.
- the application identification information is the identification information of the application that provides the application screen that the user is viewing.
- the center position C of the user's black eye When the center position C of the user's black eye is within the screen compatible area, the judgment result indicating that fact, the viewpoint coordinates, and the application identification information are registered in association with the date and time information.
- the center position C of the user's black eye When the center position C of the user's black eye is outside the screen corresponding area, a determination result indicating that fact is registered in association with the date and time information. If the user's black eyes are not detected, a determination result indicating that fact is registered in association with the date and time information.
- the information providing unit 108 is a program module that provides the information recorded in the data storage table to the management server 20.
- the information providing unit 108 can provide the information recorded in the data storage table to the management server 20 at an arbitrary timing such as when the user's business is completed.
- the communication I / F 110 is a device that transmits and receives various data between the user PC 10 and the user PC 50 and the management server 20 via the in-house network 40 and the VPN 70.
- the storage device 120 is a storage device that stores various information such as a program according to an embodiment of the present invention, a photographed image provided by the user PC 50, coordinate information of an application screen and information indicating a context, and a data recording table. Is.
- FIG. 3 is a block diagram showing a detailed configuration of the management server 20 according to the embodiment of the present invention.
- the management server 20 includes an arithmetic unit 200, a communication interface (I / F) 210, and a storage device 220.
- the arithmetic unit 200 is an arithmetic unit such as a CPU or an MPU, and by executing the program according to the embodiment of the present invention, the method according to the embodiment of the present invention is executed.
- the program executed by the arithmetic unit 200 includes a monitoring unit 201, an application (AP) determination unit 202, a browsing determination unit 203, a time calculation unit 204, and a display image generation unit 205.
- AP application
- the monitoring unit 201 is a program module that determines whether or not the information transmitted by the user PC 10 has been received. When the monitoring unit 201 receives the information from the user PC 10, that is, the information recorded in the data storage table of the user PC 10, the monitoring unit 201 registers the information in the data recording table of the storage device 220.
- the AP determination unit 202 is a program module that determines whether or not the application in which the identification information is registered in the data recording table of the storage device 220 is the default application used by the user of the user PC 50 in business.
- the default application can be determined in advance by a person who manages the business of the user.
- the AP determination unit 202 determines whether or not the application identification information registered in the data recording table of the storage device 220 matches the identification information of the default application, so that the identification information is registered in the data recording table. It can be determined whether or not the application is the default application.
- the browsing determination unit 203 is a program module that determines whether or not the user of the user PC 50 has viewed the application screen in the past specific period based on the generation date and time of the captured image.
- the specific period in the past can be, for example, a period 10 seconds back from the time indicated by the date and time information which is the generation date and time of the captured image.
- the browsing determination unit 203 refers to the data recording table of the storage device 220, determines whether or not the identification information of the application is associated with the date and time information corresponding to the specific period in the past, and thereby determines whether or not the identification information of the application is associated with the user PC 50 in the specific period. It is possible to determine whether or not the user of the user is viewing the application screen.
- the time calculation unit 204 is a program module that calculates the usage time of the application, the non-business work time, and the time during leaving the desk by the user of the user PC 50.
- the time calculation unit 204 calculates the application usage time, the non-business work time, and the time while leaving by adding a predetermined time (for example, 200 milliseconds) based on the execution cycle of the shooting process of the shooting device 60. can do.
- the display image generation unit 205 includes at least one of the usage time for each application determined to be the default application and the usage rate for each application per unit time (for example, working hours per day), and non-business. It is a program module that generates an image to display the working time and the time spent leaving the desk. The application usage rate can be calculated based on the application usage time.
- the display image generation unit 205 generates the image in response to the request from the administrator PC 30, and provides the image to the administrator PC 30. An image as shown in FIG. 12 is displayed on the display device of the administrator PC 30. The image shown in FIG. 12 displays the usage time, the non-business work time, and the time during leaving the desk for each application.
- the communication I / F 210 is a device that transmits and receives various data between the management server 20, the user PC 10 and the administrator PC 30 via the in-house network 40.
- the storage device 220 is a storage device that stores various information such as a program and a data recording table according to an embodiment of the present invention.
- FIG. 4 is a block diagram showing the main components included in the user PC 10 and the management server 20 according to the embodiment of the present invention.
- the user PC 10 includes an analysis unit 102, a position determination unit 104, a viewpoint coordinate calculation unit 105, and an AP identification unit 106.
- the management server 20 includes an AP determination unit 202, a browsing determination unit 203, and a time calculation unit 204.
- FIG. 6 is a flowchart showing an example of processing executed by the user PC 10 according to the embodiment of the present invention.
- the user PC 10 executes the process of FIG. 6 for all the captured images stored in the storage device 120.
- the analysis unit 102 of the user PC 10 acquires the captured image provided by the user PC 50 from the storage device 120 and analyzes it.
- the analysis unit 102 determines whether or not the user's black eyes have been detected. When the user's black eyes are not detected (NO), the analysis unit 102 uses the DB processing unit 107 to register the determination result that the black eyes are not detected in the data recording table in step S103, and the result of the determination is registered in the data recording table.
- NO the user's black eyes
- step S104 the position calculation unit 103 calculates the center position C of the user's black eye in the captured image.
- step S105 the position determination unit 104 determines whether or not the center position C of the black eye is within the screen corresponding area. When the center position C of the black eye is outside the screen compatible area (NO), the position determination unit 104 uses the DB processing unit 107 in step S106 to determine that the center position C of the black eye is outside the screen compatible area. Is registered in the data recording table, and the process of FIG. 6 is completed.
- the viewpoint coordinate calculation unit 105 displays the display device of the user PC 50 based on the center position C of the user's black eye in the screen compatible area in step S107. Calculate the user's viewpoint coordinates on the screen.
- the AP identification unit 106 acquires from the storage device 120 the coordinate information of the application screen displayed on the display device of the user PC 50 and the information indicating the context related to the captured image acquired in step S101. ..
- the AP specifying unit 106 can specify the coordinate information of the application screen related to the captured image and the information indicating the context based on the generation date and time of the captured image and the date and time information when the application screen is displayed.
- step S109 the AP identification unit 106 identifies the application that provides the application screen that the user is viewing, based on the user's viewpoint coordinates, the coordinate information of the application screen, and the information indicating the context.
- step S110 the AP identification unit 106 uses the DB processing unit 107 to store the determination result that the center position C of the black eye is in the screen corresponding area and the identification information of the application that the user is viewing in the data recording table. Registration is completed, and the process of FIG. 6 is completed.
- FIG. 7 is a flowchart showing an example of processing executed by the management server 20 according to the embodiment of the present invention.
- the AP determination unit 202 selects the recorded data related to one time from the recorded data stored in the storage device 220.
- the AP determination unit 202 branches the process according to the content of the selected recorded data based on the determination result. Specifically, in the case of a determination result that the center position C of the user's black eye is within the screen corresponding area, the process branches to step S203. If it is a determination result that the center position C of the user's black eye is outside the screen corresponding area, the process branches to step S207. If the result is a determination that the user's black eyes have not been detected, the process branches to step S209.
- step S203 the AP determination unit 202 determines whether or not the application indicated by the AP identification information of the selected recorded data is the default application.
- the time calculation unit 204 adds the default time to the usage time of the application in step S204.
- the time calculation unit 204 adds the default time to the non-business work time in step S205.
- step S206 the AP determination unit 202 determines whether or not there is recorded data that has not yet been selected. If there is recorded data that has not yet been selected (YES), the process returns to step S201, and the above process is executed for the recorded data related to the next one time. On the other hand, if there is no recorded data that has not yet been selected (NO), the process of FIG. 7 ends.
- step S207 the browsing determination unit 203 refers to the data recording table of the storage device 220, and determines whether or not the application identification information is associated with the date and time information indicating the date and time corresponding to the specific period in the past. This past specific period is a period based on the date and time indicated by the date and time information of the recorded data selected in step S201.
- the process branches to step S203.
- the AP determination unit 202 determines whether or not the application is the default application.
- the time calculation unit 204 adds the default time to the usage time of the application. That is, the time calculation unit 204 adds the period during which the center position C of the user's black eye is outside the screen corresponding area to the usage time of the application determined to be the default application.
- step S208 the time calculation unit 204 adds a predetermined time to the non-business work time, and the process proceeds to step S206.
- step S209 the browsing determination unit 203 refers to the data recording table of the storage device 220 as in step S207, and is the application identification information associated with the date and time information indicating the date and time corresponding to the specific period in the past? Judge whether or not.
- the process branches to step S203.
- the AP determination unit 202 determines whether or not the application is the default application.
- the time calculation unit 204 adds the default time to the usage time of the application. That is, the time calculation unit 204 adds the period during which the user's black eyes are not detected to the usage time of the application determined to be the default application.
- step S210 the time calculation unit 204 adds a predetermined time to the time while leaving the desk, and the process proceeds to step S206.
- the analysis unit 102 of the user PC 10 analyzes the captured image generated by the photographing device 60 and determines whether or not the user's black eye is detected.
- the position determination unit 104 determines whether or not the position of the user's black eye in the captured image is within the screen corresponding area, and registers the determination result in the data recording table.
- the viewpoint coordinate calculation unit 105 calculates the viewpoint coordinate based on the position of the black eye in the screen-compatible area and registers it in the data recording table.
- the AP identification unit 106 identifies the application that provides the application screen that the user is viewing by using the coordinate information and the viewpoint coordinates of the application screen displayed on the display screen, and records the identification information of the application as data. Register in the table. Then, the information providing unit 108 transmits the information registered in the data recording table to the management server 20.
- the AP determination unit 202 determines whether or not the application indicated by the identification information included in the information is the default application.
- the time calculation unit 204 calculates the usage time of the application determined to be the default application. As a result, the usage time of the application used in the business is calculated, so that the administrator can grasp the actual business situation of the worker who uses the application used in the business.
- the viewing determination unit 203 allows the user to view the screen of the application in the past specific period based on the generation date and time of the captured image. Determine if it was.
- the AP determination unit 202 determines whether or not the application is the default application.
- the time calculation unit 204 adds the period during which the user's black eyes are not detected to the usage time of the application.
- the usage time of the application by the user can be accurately recorded, and the administrator can accurately grasp the actual business condition of the worker to be managed.
- the viewing determination unit 203 allows the user to apply the application in the past specific period based on the generation date and time of the captured image. Judge whether or not you were looking at the screen of.
- the AP determination unit 202 determines whether or not the application is the default application.
- the time calculation unit 204 adds the period during which the position of the user's black eye is outside the screen corresponding area to the usage time of the application.
- the position of the user's black eye is outside the screen compatible area by looking at the keyboard, mouse, document, etc. at hand, the position of the black eye is changed.
- the period outside the screen compatible area can be added to the usage time of the application. Therefore, it is possible to record the actual usage time of the application by the user, and the administrator can accurately grasp the actual business condition of the worker to be managed.
- the display image generation unit 205 determines at least one of the usage time of the application determined to be the default application and the usage rate of the application per unit time based on the usage time of the application. , Generate an image to be displayed for each application. As a result, the manager can easily grasp the actual work condition of the worker to be managed.
- Non-temporary computer-readable media include various types of tangible storage media.
- Examples of non-temporary computer-readable media include magnetic recording media (eg, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (eg, magneto-optical disks), CD-ROMs, CD-Rs, CD-Rs. / W, including semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM).
- the program may also be provided to the computer by various types of temporary computer readable medium. Examples of temporary computer-readable media include electrical, optical, and electromagnetic waves.
- the temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.
- a virtual PC such as a VPC (Virtual Personal Computer) may be mounted on an information processing device such as a management server 20 instead of the user PC 10.
- a single information processing device such as the management server 20 executes the program according to the embodiment of the present invention including the above-mentioned program module included in the user PC 10 and the management server 20, and the embodiment of the present invention is obtained. Perform such a method.
- the user PC 50 transmits the photographed image, the coordinate information of the application screen, and the information indicating the context to the information processing apparatus via the VPNN 70 and the in-house network 40. Then, the arithmetic unit included in the information processing apparatus executes the processes shown in FIGS. 6 to 8.
- the user PC 10 may have a face recognition function for identifying a worker to be managed.
- the date and time information of the captured image, the determination result, the viewpoint coordinates, and the identification information of the application described above are registered in the data recording table only when the user is recognized as a genuine user. As a result, spoofing can be prevented, and the administrator can grasp the actual business conditions of the managed worker in detail.
- the management server 20 may be an external server installed at a place other than the work place of the worker to be managed.
- the functions of the program module included in the user PC 10 and the management server 20 may be realized by circuits such as FPGA (Field-Programmable Gate Array) and ASIC (Application Specific Integrated Circuit).
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Human Resources & Organizations (AREA)
- Theoretical Computer Science (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Economics (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Development Economics (AREA)
- Operations Research (AREA)
- General Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- Game Theory and Decision Science (AREA)
- Quality & Reliability (AREA)
- Marketing (AREA)
- Human Computer Interaction (AREA)
- Ophthalmology & Optometry (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- User Interface Of Digital Computer (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)
Abstract
Description
10 ユーザPC
100 演算装置
102 解析部
104 位置判定部
105 視点座標算出部
106 AP特定部
20 管理サーバ
200 演算装置
202 AP判定部
204 時間算出部
203 閲覧判定部
205 表示画像生成部
Claims (13)
- 撮影画像を解析してユーザの黒目を検出する解析部と、
前記ユーザの黒目が検出された場合に、前記撮影画像における前記ユーザの黒目の位置が、アプリケーション画面が表示される表示画面に対応する画面対応領域内にあるか否か判定する位置判定部と、
前記ユーザの黒目の位置が前記画面対応領域内にある場合に、前記黒目の位置に基づき、前記表示画面における前記ユーザの視点を示す視点座標を算出する視点座標算出部と、
前記表示画面に表示されているアプリケーション画面の座標情報と、前記視点座標を用いて、前記ユーザが見ているアプリケーション画面を提供するアプリケーションを特定するアプリケーション特定部と、
特定された前記アプリケーションが、業務で使用される既定のアプリケーションであるか否か判定するアプリケーション判定部と、
特定された前記アプリケーションが前記既定のアプリケーションであると判定された場合、前記既定のアプリケーションであると判定されたアプリケーションの使用時間を算出する時間算出部と
を含む、業務管理システム。 - 前記ユーザの黒目が検出されなかった場合、前記撮影画像の生成日時を基準とする過去の特定期間において前記ユーザが、特定された前記アプリケーションの画面を見ていたか否か判定する閲覧判定部を含み、
前記アプリケーション判定部は、前記過去の特定期間において前記ユーザが、特定された前記アプリケーションの画面を見ていたと判定された場合、特定された前記アプリケーションが前記既定のアプリケーションであるか否か判定し、
前記時間算出部は、前記ユーザの黒目が検出されなかった期間を、前記既定のアプリケーションであると判定されたアプリケーションの使用時間に加算する、請求項1に記載の業務管理システム。 - 前記ユーザの黒目の位置が前記画面対応領域外にある場合、前記撮影画像の生成日時を基準とする過去の特定期間において前記ユーザが、特定された前記アプリケーションの画面を見ていたか否か判定する閲覧判定部を含み、
前記アプリケーション判定部は、前記過去の特定期間において前記ユーザが、特定された前記アプリケーションの画面を見ていたと判定された場合、特定された前記アプリケーションが前記既定のアプリケーションであるか否か判定し、
前記時間算出部は、前記ユーザの黒目の位置が前記画面対応領域外にあった期間を、前記既定のアプリケーションであると判定されたアプリケーションの使用時間に加算する、請求項1又は2に記載の業務管理システム。 - 前記アプリケーション特定部は、
前記ユーザの黒目が検出された場合、特定された前記アプリケーションの識別情報と、前記撮影画像の日時情報とを関連付け、
前記ユーザの黒目が検出されなかった場合、特定された前記アプリケーションの識別情報と、前記撮影画像の日時情報とを関連付けず、
前記閲覧判定部は、特定された前記アプリケーションの識別情報が、前記過去の特定期間に対応する前記撮影画像の日時情報に関連付けられているか否か判定することにより、前記過去の特定期間において前記ユーザが、特定された前記アプリケーションの画面を見ていたか否か判定する、請求項2に記載の業務管理システム。 - 前記アプリケーション特定部は、
前記ユーザの黒目の位置が前記画面対応領域内にある場合、特定された前記アプリケーションの識別情報と、前記撮影画像の日時情報とを関連付け、
前記ユーザの黒目の位置が前記画面対応領域外にある場合、特定された前記アプリケーションの識別情報と、前記撮影画像の日時情報とを関連付けず、
前記閲覧判定部は、特定された前記アプリケーションの識別情報が、前記過去の特定期間に対応する前記撮影画像の日時情報に関連付けられているか否か判定することにより、前記過去の特定期間において前記ユーザが、特定された前記アプリケーションの画面を見ていたか否か判定する、請求項3に記載の業務管理システム。 - 前記既定のアプリケーションであると判定されたアプリケーションの使用時間、及び当該アプリケーションの使用時間に基づく単位時間当たりの当該アプリケーションの使用率の少なくとも一方を、アプリケーション毎に表示する画像を生成する表示画像生成部をさらに含む、請求項1~5のいずれか1項に記載の業務管理システム。
- 撮影画像を解析してユーザの黒目を検出し、
前記ユーザの黒目が検出された場合に、前記撮影画像における前記ユーザの黒目の位置が、アプリケーション画面が表示される表示画面に対応する画面対応領域内にあるか否か判定し、
前記ユーザの黒目の位置が前記画面対応領域内にある場合に、前記ユーザの黒目の位置に基づき、前記表示画面における前記ユーザの視点を示す視点座標を算出し、
前記表示画面に表示されているアプリケーション画面の座標情報と、前記視点座標を用いて、前記ユーザが見ているアプリケーション画面を提供するアプリケーションを特定し、
特定された前記アプリケーションが、業務で使用される既定のアプリケーションであるか否か判定し、
特定された前記アプリケーションが前記既定のアプリケーションであると判定された場合、前記既定のアプリケーションであると判定されたアプリケーションの使用時間を算出する、業務管理方法。 - 前記ユーザの黒目が検出されなかった場合、前記撮影画像の生成日時を基準とする過去の特定期間において前記ユーザが、特定された前記アプリケーションの画面を見ていたか否か判定し、
前記過去の特定期間において前記ユーザが、特定された前記アプリケーションの画面を見ていたと判定された場合、特定された前記アプリケーションが前記既定のアプリケーションであるか否か判定し、
前記ユーザの黒目が検出されなかった期間を、前記既定のアプリケーションであると判定されたアプリケーションの使用時間に加算する、
請求項7に記載の業務管理方法。 - 前記ユーザの黒目の位置が前記画面対応領域外にある場合、前記撮影画像の生成日時を基準とする過去の特定期間において前記ユーザが、特定された前記アプリケーションの画面を見ていたか否か判定し、
前記過去の特定期間において前記ユーザが、特定された前記アプリケーションの画面を見ていたと判定された場合、特定された前記アプリケーションが前記既定のアプリケーションであるか否か判定し、
前記ユーザの黒目の位置が前記画面対応領域外にあった期間を、前記既定のアプリケーションであると判定されたアプリケーションの使用時間に加算する、
請求項7又は8に記載の業務管理方法。 - 前記ユーザの黒目が検出された場合、特定された前記アプリケーションの識別情報と、前記撮影画像の日時情報とを関連付け、
前記ユーザの黒目が検出されなかった場合、特定された前記アプリケーションの識別情報と、前記撮影画像の日時情報とを関連付けず、
特定された前記アプリケーションの識別情報が、前記過去の特定期間に対応する前記撮影画像の日時情報に関連付けられているか否か判定することにより、前記過去の特定期間において前記ユーザが、特定された前記アプリケーションの画面を見ていたか否か判定する、
請求項8に記載の業務管理方法。 - 前記ユーザの黒目の位置が前記画面対応領域内にある場合、特定された前記アプリケーションの識別情報と、前記撮影画像の日時情報とを関連付け、
前記ユーザの黒目の位置が前記画面対応領域外にある場合、特定された前記アプリケーションの識別情報と、前記撮影画像の日時情報とを関連付けず、
特定された前記アプリケーションの識別情報が、前記過去の特定期間に対応する前記撮影画像の日時情報に関連付けられているか否か判定することにより、前記過去の特定期間において前記ユーザが、特定された前記アプリケーションの画面を見ていたか否か判定する、
請求項9に記載の業務管理方法。 - 前記既定のアプリケーションであると判定されたアプリケーションの使用時間、及び当該アプリケーションの使用時間に基づく単位時間当たりの当該アプリケーションの使用率の少なくとも一方を、アプリケーション毎に表示する画像を生成する、
請求項7~11のいずれか1項に記載の業務管理方法。 - コンピュータに、請求項7~12のいずれか1項に記載の業務管理方法を実行させる、業務管理プログラム。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA3165931A CA3165931A1 (en) | 2019-12-25 | 2020-11-25 | Business management system, business management method, and business management program |
EP20907591.0A EP4064153B1 (en) | 2019-12-25 | 2020-11-25 | Business management system, business management method, and business management program |
AU2020414584A AU2020414584A1 (en) | 2019-12-25 | 2020-11-25 | Business management system, business management method, and business management program |
CN202080090242.8A CN114846489A (zh) | 2019-12-25 | 2020-11-25 | 业务管理系统、业务管理方法和业务管理程序 |
US17/787,790 US20230025023A1 (en) | 2019-12-25 | 2020-11-25 | Business management system, business management method, and business management program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2019234345A JP6908297B2 (ja) | 2019-12-25 | 2019-12-25 | 業務管理システム、業務管理方法、及び業務管理プログラム |
JP2019-234345 | 2019-12-25 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021131465A1 true WO2021131465A1 (ja) | 2021-07-01 |
Family
ID=76574332
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2020/043793 WO2021131465A1 (ja) | 2019-12-25 | 2020-11-25 | 業務管理システム、業務管理方法、及び業務管理プログラム |
Country Status (7)
Country | Link |
---|---|
US (1) | US20230025023A1 (ja) |
EP (1) | EP4064153B1 (ja) |
JP (1) | JP6908297B2 (ja) |
CN (1) | CN114846489A (ja) |
AU (1) | AU2020414584A1 (ja) |
CA (1) | CA3165931A1 (ja) |
WO (1) | WO2021131465A1 (ja) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000048078A (ja) | 1998-07-30 | 2000-02-18 | Hitachi Ltd | 遠隔作業状況監視システム |
JP2012063885A (ja) * | 2010-09-14 | 2012-03-29 | Canon Electronics Inc | 情報分析装置、情報分析方法、情報分析システムおよびプログラム |
JP2015079498A (ja) * | 2013-10-04 | 2015-04-23 | 由田新技股▲ふん▼有限公司 | 閲覧行動の記録方法および装置 |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5831594A (en) * | 1996-06-25 | 1998-11-03 | Sun Microsystems, Inc. | Method and apparatus for eyetrack derived backtrack |
US8260008B2 (en) * | 2005-11-11 | 2012-09-04 | Eyelock, Inc. | Methods for performing biometric recognition of a human eye and corroboration of same |
US20090317019A1 (en) * | 2008-06-19 | 2009-12-24 | Venkatesh Rangarajan Puliur | Placement of advertisements on electronic documents containing images |
US9240011B2 (en) * | 2011-07-13 | 2016-01-19 | Visa International Service Association | Systems and methods to communicate with transaction terminals |
US10139987B2 (en) * | 2014-07-18 | 2018-11-27 | Google Llc | Automated group recommendation |
US9509825B2 (en) * | 2014-12-07 | 2016-11-29 | Chon Hock LEOW | System and method of secure personal identification |
CN105843376A (zh) * | 2016-03-07 | 2016-08-10 | 乐视移动智能信息技术(北京)有限公司 | 一种移动终端应用操作方法及移动终端 |
US10740409B2 (en) * | 2016-05-20 | 2020-08-11 | Magnet Forensics Inc. | Systems and methods for graphical exploration of forensic data |
EP3447684A1 (en) * | 2017-08-22 | 2019-02-27 | Eyn Limited | Verification method and system |
-
2019
- 2019-12-25 JP JP2019234345A patent/JP6908297B2/ja active Active
-
2020
- 2020-11-25 CA CA3165931A patent/CA3165931A1/en active Pending
- 2020-11-25 AU AU2020414584A patent/AU2020414584A1/en active Pending
- 2020-11-25 EP EP20907591.0A patent/EP4064153B1/en active Active
- 2020-11-25 WO PCT/JP2020/043793 patent/WO2021131465A1/ja unknown
- 2020-11-25 CN CN202080090242.8A patent/CN114846489A/zh active Pending
- 2020-11-25 US US17/787,790 patent/US20230025023A1/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000048078A (ja) | 1998-07-30 | 2000-02-18 | Hitachi Ltd | 遠隔作業状況監視システム |
JP2012063885A (ja) * | 2010-09-14 | 2012-03-29 | Canon Electronics Inc | 情報分析装置、情報分析方法、情報分析システムおよびプログラム |
JP2015079498A (ja) * | 2013-10-04 | 2015-04-23 | 由田新技股▲ふん▼有限公司 | 閲覧行動の記録方法および装置 |
Non-Patent Citations (1)
Title |
---|
See also references of EP4064153A4 |
Also Published As
Publication number | Publication date |
---|---|
EP4064153A4 (en) | 2023-01-18 |
JP2021103425A (ja) | 2021-07-15 |
US20230025023A1 (en) | 2023-01-26 |
EP4064153A1 (en) | 2022-09-28 |
CN114846489A (zh) | 2022-08-02 |
JP6908297B2 (ja) | 2021-07-21 |
AU2020414584A1 (en) | 2022-06-16 |
EP4064153B1 (en) | 2024-09-04 |
CA3165931A1 (en) | 2021-07-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106708712B (zh) | 用于对便携式计算机测试工具进行云服务资产管理的系统和方法 | |
JP6945373B2 (ja) | 作業改善支援システム | |
US10937241B2 (en) | Systems, methods, and apparatus for identifying an augmented reality service | |
JP6442751B2 (ja) | 情報処理装置、情報処理システム、制御方法、及びプログラム | |
JP6823267B2 (ja) | 情報処理装置、情報処理システム、制御方法、及びプログラム | |
US20160330217A1 (en) | Security breach prediction based on emotional analysis | |
JP2017504121A (ja) | 端末デバイスにおけるユーザインタフェースを用いたユーザ行動および関与の計測機 | |
CN104137028A (zh) | 控制被显示图像的旋转的设备和方法 | |
US11915519B2 (en) | Information processing system, method for managing object to be authenticated, and program | |
US20200374202A1 (en) | Industrial field services automation platform | |
WO2017054705A1 (zh) | 一种局域网内基于物理位置的终端监控方法及系统 | |
JP2017182294A (ja) | 情報処理装置、情報処理方法、プログラム | |
CN109831358A (zh) | 一种客户端流量统计方法、装置、服务器及可读存储介质 | |
RU2018115965A (ru) | Система проверки летательного аппарата с визуализацией и записью | |
CN113447128A (zh) | 一种多人体温检测方法、装置、电子设备及存储介质 | |
WO2021131465A1 (ja) | 業務管理システム、業務管理方法、及び業務管理プログラム | |
KR102231648B1 (ko) | 소방시설의 점검 이력 정보 관리 방법, 장치 및 컴퓨터-판독가능 기록 매체 | |
JP2018142137A (ja) | 情報処理装置、情報処理方法、及びプログラム | |
JP6780326B2 (ja) | 情報処理装置及びプログラム | |
JP7067593B2 (ja) | 情報処理システム、認証対象の管理方法、及びプログラム | |
CN108052555A (zh) | 一种照片分类方法和系统 | |
CN111481177A (zh) | 头戴设备、投屏系统及方法、计算机可读的存储介质 | |
JP2022036825A (ja) | 画像処理装置、画像処理方法およびプログラム | |
JP6473059B2 (ja) | 査定装置、査定方法、および査定プログラム | |
JP2019139491A (ja) | 位置情報管理装置、位置情報管理システム、位置情報管理方法、およびプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20907591 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2020414584 Country of ref document: AU Date of ref document: 20201125 Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 3165931 Country of ref document: CA |
|
ENP | Entry into the national phase |
Ref document number: 2020907591 Country of ref document: EP Effective date: 20220624 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |