JP6895748B2 - Information processing equipment, data management methods for information processing equipment, and programs - Google Patents

Description

The present invention, information processing apparatus, a data management method of the information processing apparatus, and a program.

Manufacturers that provide electronic devices such as cameras and smartphones equipped with multiple functions as products display multiple types of products at exhibitions so that visitors can directly operate them, and take pictures of the exhibition. To investigate the needs of the market. When photographing the state of an exhibition, a data management system equipped with a camera as an imaging device and a server as an information processing device is used. In the data management system, the camera takes a picture of the venue, and the server analyzes the picture taken by the camera. The server detects the visitor from the captured image and identifies the age and gender of the visitor (see, for example, Patent Document 1). The server aggregates the identified information and presents the aggregated results as statistical data of the age group and gender of the visitors to the exhibition.

Japanese Unexamined Patent Publication No. 2015-162241

However, with a conventional data management system, it is difficult to identify what kind of function of the exhibited product the visitor was interested in from the photographed image, and statistical data on the operation content of the product is easily presented. Can't.

An object of the present invention, information processing apparatus that can be easily presented statistical data about the operation contents of the electronic device, there is provided a data management method for the information processing apparatus, and a program.

In order to achieve the above object, the information processing device of the present invention is an information processing device to which a photographing device and an electronic device not provided with the photographing device are connected, and can photograph a user who operates the electronic device. from the imaging device installed in position, a first acquisition means acquire the imaged image obtained by imaging the user, identification means for identifying an attribute of a user taken by the captured image, the user said electronic device It is characterized by including a second acquisition means for acquiring the operation content obtained by operating the above from the electronic device, and a storage means for storing the operation content in association with the attribute of the user. Further, the data management method of the information processing device of the present invention is a data management method of an information processing device to which a photographing device and an electronic device not provided with the photographing device are connected, and the information processing device is the electronic device. The first acquisition step of acquiring a photographed image of the user from the photographing device installed at a position where the user who operates the user can be photographed, and the information processing device of the user photographed by the photographed image. An identification step for identifying an attribute, a second acquisition step in which the information processing device acquires an operation content in which the user operates the electronic device from the electronic device, and a second acquisition step in which the information processing device obtains the operation content. It is characterized by having a storage step for storing in association with a user's attribute. Further, the program of the present invention is a program for causing a computer to execute a data management method of a photographing device and an information processing device to which an electronic device not provided with the photographing device is connected, and the data management method is the electronic device. A first acquisition step of acquiring a photographed image of the user from the photographing device installed at a position where the user can be photographed, and an identification step of identifying the attributes of the user photographed by the photographed image. It is characterized by having a second acquisition step of acquiring the operation content of the user operating the electronic device from the electronic device, and a storage step of storing the operation content in association with the attribute of the user. And.

According to the present invention, statistical data regarding the operation content of an electronic device can be easily presented.

It is a network diagram which shows roughly the structure of the data management system which concerns on embodiment of this invention. It is a block diagram which shows schematic the structure of the server of FIG. It is a flowchart which shows the procedure of the shooting data transmission processing executed by the camera of FIG. It is a flowchart which shows the procedure of the operation data transmission processing executed by the electronic device of FIG. It is a flowchart which shows the procedure of the integrated analysis data update process executed by the server of FIG. It is a figure which shows an example of the person attribute table stored in the server of FIG. It is a figure which shows an example of the person attribute log managed by the server of FIG. It is a figure which shows an example of the key operation table stored in the server of FIG. It is a figure which shows an example of the key operation log managed by the server of FIG. It is a figure which shows an example of the integrated analysis data managed by the server of FIG. It is a flowchart which shows the procedure of the statistical data presentation processing executed by the server of FIG.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a network diagram schematically showing a configuration of a data management system 100 according to an embodiment of the present invention.

In FIG. 1, the data management system 100 includes a camera 101 as a photographing device, an electronic device 102, and a server 103 as an information processing device, and the camera 101, the electronic device 102, and the server 103 are communication standards such as Wi-fi. Is connected to enable wireless LAN communication.

The data management system 100 manages data related to the operation contents of the electronic device 102. In the present embodiment, as an example, a case where the data management system 100 is used for photographing an exhibition in which the electronic device 102 is exhibited so that the visitor can directly operate the device 102 will be described. In this case, the data management system 100 manages the captured image taken by the camera 101 and the operation content of the user operating the electronic device 102 by the server 103, and presents statistical data regarding the operation content of the electronic device 102. The camera 101 photographs a user who operates the electronic device 102, and transmits the captured image to the server 103. The electronic device 102 is a smartphone, a PC, a digital camera, or the like equipped with a plurality of functions, and transmits the operation content operated by the user to the server 103. For example, when the electronic device 102 is a PC, the PC transmits the operation content by the user to the server 103 when the Enter key is pressed, the text is input, the connected mouse is operated, or the like. The server 103 analyzes the captured image received from the camera 101 and the operation content received from the electronic device 102, and presents statistical data based on the analysis result. The electronic device 102 is not limited to the above-mentioned device, and may be an image forming device (printer, scanner, fax device), a medical digital camera, or the like.

FIG. 2 is a block diagram schematically showing the configuration of the server 103 of FIG.

In FIG. 2, the server 103 includes a CPU 201, a ROM 202, a RAM 203, a storage unit 204, a display unit I / F 205, a display unit 206, an operation unit I / F 207, and an operation unit 208. The CPU 201, ROM 202, RAM 203, storage unit 204, display unit I / F 205, and operation unit I / F 207 are connected to each other via the system bus 209. The display unit 206 is connected to the display unit I / F 205, and the operation unit 208 is connected to the operation unit I / F 207.

The CPU 201 comprehensively controls the entire server 103, executes programs stored in the ROM 202 and the storage unit 204, and performs each control. The ROM 202 stores the boot program executed by the CPU 201 and each data. The RAM 203 is used as a work area of the CPU 201, and is also used as a temporary storage area for each data. The storage unit 204 stores the control program executed by the CPU 201 and each data. For example, the storage unit 204 stores the integrated analysis data 1001 of FIG. 10, which will be described later, for presenting statistical data regarding the operation contents of the electronic device 102. The display unit I / F 205 transmits a control signal for controlling the display of the display unit 206 to the display unit 206, and the display unit 206 displays each information based on the received control signal. The operation unit I / F 207 acquires the input information input by the operation of the operation unit 208 from the operation unit 208. The operation unit 208 is a keyboard or the like, and receives an execution instruction or the like of each process by the user. When a display instruction regarding the operation content of one function of the electronic device 102 is given by the operation of the operation unit 208, for example, statistical data corresponding to the display instruction is presented based on the integrated analysis data 1001 described later. To do.

Next, in the data management system 100, each process from the operation of the electronic device 102 by the user to the presentation of statistical data regarding the operation content of the electronic device 102 will be described.

FIG. 3 is a flowchart showing a procedure of shooting data transmission processing executed by the camera 101 of FIG.

In the process of FIG. 3, it is premised that the camera 101 is installed at a position where the face of the user who operates the electronic device can be photographed, and the camera 101 is instructed to execute the image in advance.

In FIG. 3, first, the camera 101 photographs the periphery of the electronic device 102 (step S301), and transmits the captured image and the captured data including the captured date and time to the server 103 (step S302). The camera 101 performs the process of step S302 at predetermined intervals set in advance, for example. Further, when the camera 101 is equipped with a function of detecting the user from the captured image, the camera 101 performs the process of step S302 according to the detection of the user from the captured image. Next, the camera 101 determines whether or not the shooting end instruction has been given (step S303).

As a result of the determination in step S303, when the end instruction of shooting is not given, the camera 101 returns to the process of step S301. On the other hand, as a result of the determination in step S303, when an instruction to end shooting is given, the camera 101 ends this process.

FIG. 4 is a flowchart showing a procedure of operation data transmission processing executed by the electronic device 102 of FIG.

In FIG. 4, first, the electronic device 102 accepts an operation by the user (step S401), and transmits the operation data including the operation content of the electronic device 102 by the user and the operation time when the operation of the operation content is performed to the server 103. (Step S402), it is determined whether or not the end instruction of the operation data transmission process has been given (step S403).

As a result of the determination in step S403, when the end instruction of the operation data transmission process is not given, the electronic device 102 returns to the process of step S401. On the other hand, as a result of the determination in step S403, when the end instruction of the operation data transmission process is given, the electronic device 102 ends this process.

FIG. 5 is a flowchart showing a procedure of the integrated analysis data update process executed by the server 103 of FIG.

The process of FIG. 5 is performed by the CPU 201 executing a program stored in the ROM 202 or the storage unit 204. In the process of FIG. 5, a first process for performing the processes of steps S501 to S503 described later, a second process for performing the processes of steps S504 to S507 described later, and a third process for performing the processes of steps S508 to S510 described later. , And the fourth process of performing the processes of steps S511 to S514 described later are executed in parallel.

In FIG. 5, the CPU 201 performs the processes of steps S501 to S503 in the first process. Specifically, the CPU 201 acquires shooting data from the camera 101 (step S501), stores the acquired shooting data in the storage unit 204 (step S502), and whether or not an instruction to end the integrated analysis data update process is given. Is determined (step S503). As a result of the determination in step S503, when the end instruction of the integrated analysis data update process is not given, the CPU 201 returns to the process of step S501. On the other hand, as a result of the determination in step S503, when the end instruction of the integrated analysis data update process is given, the CPU 201 ends this process.

Further, the CPU 201 performs the processes of steps S504 to S507 in the second process in parallel with the first process. First, the CPU 201 identifies the user photographed by the camera 101 (steps S504 and S505). Specifically, the CPU 201 reads the shooting data stored in the storage unit 204 (step S504), detects the user from the shooting image included in the shooting data, and attributes of the detected user, specifically, the user's. The age and gender are identified (step S505), and the person ID corresponding to the identified result is determined from the person attribute table 601 of FIG. The person attribute table 601 manages the attributes of the user and includes a person ID 602, an age 603, and a gender 604. A unique character string corresponding to the user's attribute is set in the person ID 602, a number indicating the age is set in the age 603, and either a man or a woman is set in the gender 604. In step S505, the CPU 201 determines the person ID 602 of the age and gender combination corresponding to the identified result. Next, the CPU 201 updates the person attribute log 701 of FIG. 7 stored in advance in the storage unit 204 (step S506). Specifically, the CPU 201 adds the determined person ID 602, the age and gender corresponding to the person ID 602, and the shooting date and time included in the shooting data to the person attribute log 701. The person attribute log 701 manages the shooting date and time when the camera 101 shoots the user who operated the electronic device 102, and the age and gender of the user. In the present embodiment, the case where the person attribute log 701 is stored in the storage unit 204 in advance has been described. However, when the person attribute log 701 is not stored in the storage unit 204 in advance, the CPU 201 in step S506 A person attribute log 701 is newly generated, and the person attribute log 701 is stored in the storage unit 204. Next, the CPU 201 determines whether or not the end instruction of the integrated analysis data update process has been given (step S507). As a result of the determination in step S507, when the end instruction of the integrated analysis data update process is not given, the CPU 201 returns to the process of step S504. On the other hand, as a result of the determination in step S507, when the end instruction of the integrated analysis data update process is given, the CPU 201 ends this process.

The CPU 201 performs the processes of steps S508 to S510 in the third process in parallel with the first process and the second process. Specifically, the CPU 201 acquires operation data from the electronic device 102 (step S508), and determines an operation ID corresponding to the operation content included in the acquired operation data from the key operation table 801 of FIG. In the key operation table 801, a plurality of operation contents assumed in the electronic device 102 are set, and a unique operation ID is set for each operation content. Next, the CPU 201 updates the key operation log 901 of FIG. 9 stored in advance in the storage unit 204 (step S509). Specifically, the CPU 201 adds each information regarding the operation date and time, the determined operation ID, and the operation content included in the acquired operation data to the key operation log 901. The key operation log 901 manages the operation content of the electronic device 102 by the user and the operation time when the operation content is performed. In the present embodiment, the case where the key operation log 901 is stored in the storage unit 204 in advance has been described. However, when the key operation log 901 is not stored in the storage unit 204 in advance, the CPU 201 in step S509 A key operation log 901 is newly generated, and the key operation log 901 is stored in the storage unit 204. Next, the CPU 201 determines whether or not the end instruction of the integrated analysis data update process has been given (step S510). As a result of the determination in step S510, when the end instruction of the integrated analysis data update process is not given, the CPU 201 returns to the process of step S508. On the other hand, as a result of the determination in step S510, when the end instruction of the integrated analysis data update process is given, the CPU 201 ends this process.

Further, the CPU 201 performs the processes of steps S511 to S514 in the fourth process in parallel with the first process to the third process. Specifically, the CPU 201 reads the person attribute log 701 (step S511), reads the key operation log 901 (step S512), and corresponds to the person ID and the operation ID at the same time in the person attribute log 701 and the key operation log 901. Attach. As a result, the shooting data and the operation data transmitted at different timings from different devices such as the camera 101 and the electronic device 102 are associated with each other. Next, the CPU 201 updates the integrated analysis data 1001 of FIG. 10 stored in advance in the storage unit 204 (step S513). Specifically, the CPU 201 adds each information of the associated person ID and operation ID to the integrated analysis data 1001. The integrated analysis data 1001 manages the age and gender of the user who operated the electronic device 102, the operation content of the electronic device 102 by the user, and the operation time when the operation content is operated. In the present embodiment, the case where the integrated analysis data 1001 is stored in the storage unit 204 in advance has been described. However, when the integrated analysis data 1001 is not stored in the storage unit 204 in advance, the CPU 201 in step S513 The integrated analysis data 1001 is newly generated, and the integrated analysis data 1001 is stored in the storage unit 204. Next, the CPU 201 determines whether or not the end instruction of the integrated analysis data update process has been given (step S514). As a result of the determination in step S514, when the end instruction of the integrated analysis data update process is not given, the CPU 201 returns to the process of step S511. On the other hand, as a result of the determination in step S514, when the end instruction of the integrated analysis data update process is given, the CPU 201 ends this process.

FIG. 11 is a flowchart showing a procedure of statistical data presentation processing executed by the server 103 of FIG.

The process of FIG. 11 is performed by the CPU 201 executing a program stored in the ROM 202 or the storage unit 204.

In FIG. 11, first, the CPU 201 accepts the presentation instruction of the statistical data (step S1101), reads the integrated analysis data 1001 based on the received presentation instruction (step S1102), and presents the information corresponding to the received presentation instruction (step S1102). Step S1103). For example, in step S1101, when a male user information display instruction using a certain function of the electronic device 102 is received, the CPU 201 classifies the aggregated value of the male user using a certain function of the electronic device 102 by age. The statistical graph is displayed on the display unit 206. After that, the CPU 201 ends this process. Here, the display form of the statistical graph is not limited as long as it can be compared with a user who has used a certain function of the electronic device 102 by age group and gender. For example, the statistical graph can be a pie chart or bar graph that can be compared by age.

According to the above-described embodiment, a photographed image of a user operating the electronic device 102 is acquired from the camera 101, the attributes of the user photographed by the photographed image are identified, and the user operates the electronic device 102. The operation content is acquired from the electronic device 102, and the operation content is stored in association with the user's attribute. That is, without specifying the operation content of the electronic device 102 from the captured image, the user who operated the electronic device 102 and the operation content of the user operating the electronic device 102 are associated with each other, and the associated data is retained. .. As a result, statistical data regarding the operation content of the electronic device 102 can be easily presented.

Further, in the above-described embodiment, the shooting time at which the shot image was shot and the operation time at which the operation content was operated are acquired, and the operation content is associated with the user's attribute based on the shooting time and the operation time. Will be done. As a result, even if the shooting data including the shot image for identifying the user's attribute and the operation data including the operation content of the electronic device 102 by the user are acquired from different devices at different timings, the operation content becomes the user's attribute. It can be easily associated.

Although the present invention has been described above with reference to the above-described embodiments, the present invention is not limited to the above-described embodiments. For example, among the plurality of functions mounted on the electronic device 102, the function used by the user may be specified based on the operation content, and the specified function may be associated with the attribute of the user. For example, in the selection operation in which the electronic device 102 is a smartphone and the operation content acquired from the electronic device 102 is a selection operation for selecting an icon of the camera function from a plurality of icons displayed on the main menu of the electronic device 102. When the operation is a series of the setting operation for setting the setting information of the still image shooting condition and the start instruction operation for instructing the start of the still image shooting, the CPU 201 determines that the function used by the user is the still image shooting function. Then, the still image shooting function is associated with the user's attribute. As a result, statistical data regarding the functions of the electronic device 102 that the user is interested in can be easily presented for each generation and gender.

In the present embodiment described above, the operation time when the user operates the electronic device 102 may be acquired and the operation time may be associated with the attribute of the user. For example, the CPU 201 acquires and acquires the operation time of a series of operations from the user selecting the camera function icon to performing the still image shooting condition setting operation and performing the still image shooting start instruction operation. Associate the operation time with the user's attribute. As a result, statistical data regarding the time required from selecting a certain function of the electronic device 102 to executing the process can be easily presented for each generation and gender.

Further, in the above-described embodiment, the number of electronic devices 102 may be plural, and the server 103 manages the data of the plurality of types of electronic devices 102 exhibited at the exhibition, and the plurality of types of electronic devices 102. Of the 102, the staying time of the user in one type of electronic device 102 in which the user stayed in the vicinity may be acquired, and the staying time may be associated with the attribute of the user. As a result, statistical data regarding the types of electronic devices 102 that the user is interested in can be easily presented for each generation and gender.

Further, in the above-described embodiment, identification data for identifying the explainer of the electronic device 102 at the exhibition is stored in advance in the storage unit 204, and whether the user photographed in the captured image is the explainer of the electronic device 102. Whether or not it is identified, and the data corresponding to the explainer of the electronic device 102 may be excluded from the integrated analysis data 1001 stored in the storage unit 204. As a result, statistical data regarding the operation content of the electronic device 102 excluding the data corresponding to the explainer can be easily presented.

In the above-described embodiment, the camera 101 may execute the process of step S302 when detecting a person from the captured image, and may notify the electronic device 102 of the operation data transmission request via the server 103. Further, the electronic device 102 may execute the process of step S402 and notify the camera 101 of the transmission request of the shooting data via the server 103. As a result, it is possible to suppress the occurrence of a situation in which either the operation data or the shooting data is lost and the operation content cannot be associated with the user's attribute.

Further, in the above-described embodiment, the case where the communication method between the camera 101, the electronic device 102, and the server 103 is wireless LAN communication has been described, but the communication method between the camera 101, the electronic device 102, and the server 103 has been described. Is not limited to wireless LAN communication, and may be, for example, wired LAN communication via a LAN cable.

The present invention can be, for example, an embodiment as a system, an apparatus, a method, a program, a storage medium, or the like, and specifically, may be applied to a system composed of a plurality of devices, or 1 It may be applied to a device consisting of two devices. The present invention includes a software program that realizes the functions of the above-described embodiments, which is directly or remotely supplied to a system or an apparatus. The present invention also includes a case where the information processing device of the system or the device is also achieved by reading and executing the supplied program code.

Therefore, in order to realize the functional processing of the present invention in the information processing device, the program code itself installed in the information processing device also realizes the present invention. That is, the present invention also includes a computer program itself for realizing the functional processing of the present invention.

In that case, as long as it has a program function, it may be in the form of an object code, a program executed by an interpreter, script data supplied to the OS, or the like.

Recording media for supplying programs include, for example, flexible disks, hard disks, optical disks, optical magnetic disks, MOs, CD-ROMs, CD-Rs, CD-RWs, and the like. There are also magnetic tapes, non-volatile memory cards, ROMs, DVDs (DVD-ROM, DVD-R) and the like.

In addition, as a program supply method, a browser of a client computer is used to connect to an Internet homepage. Then, the computer program itself of the present invention or a compressed file including the automatic installation function can be supplied from the homepage by downloading it to a recording medium such as a hard disk.

It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from different homepages. That is, the present invention also includes a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention in the information processing apparatus.

In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and the key information for decrypting the encryption is downloaded from the homepage to the user who clears the predetermined conditions. Let me. Then, by using the downloaded key information, it is also possible to execute an encrypted program and install it in the information processing device.

Further, the function of the above-described embodiment is realized by the information processing apparatus executing the read program. In addition, based on the instruction of the program, the OS or the like running on the information processing apparatus performs a part or all of the actual processing, and the function of the above-described embodiment can be realized by the processing.

Further, the program read from the recording medium is written to the memory provided in the function expansion board inserted in the information processing device and the function expansion unit connected to the information processing device. After that, based on the instruction of the program, the function expansion board, the CPU provided in the function expansion unit, or the like performs a part or all of the actual processing, and the function of the above-described embodiment is also realized by the processing.

It should be noted that the above-described embodiments merely show examples of embodiment in carrying out the present invention, and the technical scope of the present invention should not be construed in a limited manner by these. That is, the present invention can be implemented in various forms without departing from the technical idea or its main features.

100 Data management system 101 Camera 102 Electronic device 103 Server 201 CPU
204 Storage 1001 Integrated analysis data

Claims (10)

An information processing device to which a photographing device and an electronic device not provided with the photographing device are connected.
From the photographing apparatus the installed position that allows imaging user operating the electronic device, a first acquisition means acquire the imaged image obtained by imaging the user,
An identification means for identifying the attributes of the user captured in the captured image, and
A second acquisition means for acquiring the operation content of the user operating the electronic device from the electronic device, and
An information processing device including a storage means for storing the operation contents in association with the attributes of the user. The shooting time at which the shot image was shot and the operation time at which the operation of the operation content was performed are acquired.
The storage unit, the imaging time and the information processing apparatus according to claim 1, wherein the storing in association with the operation content to an attribute of the user based on the operation time. Further provided with specific means for specifying the function used by the user among the plurality of functions mounted on the electronic device based on the acquired operation content.
The information processing device according to claim 1 or 2 , wherein the storage means stores the functions used by the user in association with the attributes of the user. The operation time when the user operated the electronic device is acquired, and the operation time is acquired.
The information processing device according to any one of claims 1 to 3 , wherein the storage means stores the operation time in association with an attribute of the user. Manages data of multiple types of electronic devices,
The staying time of the user in the electronic device of one type in which the user stayed in the vicinity of the electronic devices of a plurality of types is acquired.
The information processing device according to any one of claims 1 to 4 , wherein the storage means stores the staying time in association with an attribute of the user. The identification means identifies whether or not the user photographed in the captured image is an explanatory member of the electronic device.
The information processing apparatus according to any one of claims 1 to 5 , wherein the data corresponding to the explainer of the electronic device is excluded from the data stored in association with the storage means. The information processing device according to any one of claims 1 to 6 , wherein the user attribute includes at least the age and gender of the user. The method according to any one of claims 1 to 7, wherein the information processing device is connected to the photographing device by communicating with an electronic device that is not connected to the photographing device by wireless LAN. Information processing equipment. Electronic device that does not have an imaging device and the imaging device is a data management method for an information processing apparatus connected to,
The information processing apparatus, from the photographing apparatus the user is installed in photographable position for operating the electronic device, a first acquisition step of retrieve the captured image obtained by photographing the said user,
An identification step in which the information processing device identifies the attributes of the user captured in the captured image,
A second acquisition step in which the information processing device acquires the operation content of the user operating the electronic device from the electronic device.
The information processing apparatus, a data management method for an information processing apparatus characterized by comprising a storage step of storing in association with the operation content to an attribute of the user. A program that causes a computer to execute a data management method of an information processing device to which a photographing device and an electronic device not provided with the photographing device are connected.
The data management method is
From the photographing apparatus the installed position that allows imaging user operating the electronic device, a first acquisition step of retrieve the captured image obtained by photographing the said user,
An identification step that identifies the attributes of the user captured in the captured image, and
A second acquisition step of acquiring the operation content of the user operating the electronic device from the electronic device, and
A program characterized by having a storage step of associating the operation contents with the attributes of the user and storing the operation contents.

Images