JP7349766B1 - Information processing system and information processing method - Google Patents

Abstract

The information processing system includes a first acquisition means for acquiring a time-series change in a 3D model of a user, a second acquisition means for acquiring an analysis result of a behavioral analysis or a mental analysis of the user, and a first acquisition means for acquiring a time-series change in a 3D model of a user, a second acquisition means for acquiring an analysis result of a behavioral analysis or a mental analysis of the user, and a first acquisition means for acquiring a time-series change in a 3D model of a user; The present invention includes a selection means for selecting a menu suitable for the user from among a plurality of menus included in a plurality of cooperation services using an analysis result, and a presentation means for presenting the selected menu to the user.

Description

The present invention relates to information processing system technology.

2. Description of the Related Art Techniques for analyzing user information and proposing optimal services are known. For example, Patent Document 1 discloses a content providing system that generates a service list from the user's environment, terminal, biological situation information, attribute information, and history information and provides the service list to the user.

Patent No. 5665612

However, the invention according to Patent Document 1 is limited to the generation and provision of a service list, and although it has sufficient functionality to serve as an appropriate selection aid in response to user demand that will further increase in the future. do not have. Furthermore, information related to the users themselves does not contain enough information value to enable detailed analysis of the users' behavior or mental state and to provide appropriate services according to each user's condition. Furthermore, the invention cannot be said to be sufficient as an invention that can respond to changes in service systems and user demands that change due to technological advances, such as the use of 3D models of the users themselves not only in the real space but also in the virtual space.

In view of the above-mentioned background, the present invention provides an improved technique for assisting a user in selecting a suitable service from among various affiliated services.

One aspect of the present disclosure includes a first acquisition unit that acquires a time-series change in a 3D model of a user, a second acquisition unit that acquires an analysis result of a behavioral analysis or a mental analysis of the user, and a first acquisition unit that acquires a time-series change in a 3D model of a user; or information processing comprising a selection means for selecting a menu suitable for the user from among a plurality of menus included in a plurality of linked services using the analysis result, and a presentation means for presenting the selected menu to the user. provide the system.

The information processing apparatus may include a reward/punishment awarding means for awarding a reward/punishment to the user who has been presented with the menu in accordance with a track record of actually using any of the plurality of linked services.

The linked service may include means for using the rewards and punishments.

The reward/penalty awarding means may award the reward/punishment to the use performed via the usage means.

The reward/penalty award unit may award a reward/punishment in a cooperative service selected from among the plurality of cooperative services according to the time-series change and/or the analysis result.

The reward/punishment awarding means may award the reward/punishment to each of the plurality of linked services using an independently set algorithm.

It may include an analysis means for performing behavioral analysis or mental analysis of the user, and the second acquisition means may acquire the analysis result of the behavioral analysis or mental analysis from the analysis means.

The analysis means may perform the behavior analysis or the mental analysis using a history of behavior performed by the user in a virtual space using the 3D model.

The analysis means may perform the behavior analysis or the mental analysis using a history of behavior performed by the user in real space.

The analysis means may perform the behavior analysis or the mental analysis using relationships between the user and other users who use the same cooperation service.

The analysis means may perform the behavior analysis or the mental analysis using an evaluation of the user from a user other than the user.

The cooperative service is classified into a plurality of types, and the selection means provides the user with a menu included in a cooperative service of a type selected from among the plurality of types according to the time-series change and/or the analysis result. You may select from the appropriate menu.

Another aspect of the present disclosure includes the steps of acquiring time-series changes in a 3D model of a user, acquiring analysis results of a behavioral analysis or mental analysis of the user, and analyzing the time-series changes and/or the analysis results. and selecting a menu suitable for the user from among a plurality of menus included in a plurality of linked services, and presenting the selected menu to the user.

According to the present invention, it is possible to provide an improved technique for assisting a user in selecting a suitable service from among various affiliated services.

1 is a diagram illustrating an overview of an information processing system 1. FIG. 1 is a diagram illustrating a hardware configuration and a network configuration of an information processing system 1. FIG. 1 is a diagram illustrating a functional configuration of an information processing system 1. FIG. FIG. 2 is a diagram illustrating the hardware configurations of a server device 20 and a user terminal 40, respectively. 1 is a flowchart illustrating an operational concept of the information processing system 1. 5 is a sequence chart illustrating data analysis in the information processing system 1. The figure which illustrates the 3D database which the server device 20 has. The figure which illustrates the action database which the server device 20 has. 5 is a flowchart illustrating a service proposal in the information processing system 1. 5 is a sequence chart illustrating evaluation in the information processing system 1.

1. Configuration FIG. 1 is a diagram illustrating an overview of an information processing system 1. As shown in FIG. The information processing system 1 acts as a support system (or simply a system) for both partner businesses (or simply businesses) and end users (or simply users), and this system is for example In the service business, the aim is to make such services more convenient and beneficial for users.

Next, in this example, the partner business is a business that provides services to end users. The services provided by the business include, for example, fitness instruction, provision of food and drink (e.g. restaurant or cafe), retail (e.g. bookstore or clothing store), provision of games, provision of movies, and provision of music. etc. These services are generally operated by independent entities, each of which provides information about the service, such as a service menu (or simply a menu) or information about the products or services offered, to the system. Can be registered. In this example, the service menu refers to the content of the service that the partner business has prepared in advance to provide to the end user, such as the content of a course at a fitness gym (for example, a 1-hour boxercise course, one-on-one instruction; a 50-minute dance lesson). , group instruction, etc.). Information regarding the product includes attribute information such as the name, specifications, model number, and size of the product. Note that the service provided by the business operator (business entity) can be provided in either real space or virtual space. Businesses may include a mixture of businesses that provide services in real space, businesses that provide services in virtual space, and businesses that provide services in both real space and virtual space.

Furthermore, in this example, the end user refers to the user who uses the service. The end user receives a service menu proposal from the system, and can select and use the service that he/she actually receives from among the proposed services. Further, when a user uses a service, the user's behavior history within the service is provided to the system as behavior data. In this example, behavior data includes concepts such as behavior history (behavior record) recorded as data by a user via a system (for example, a user terminal, etc.). For example, the behavioral data may be related to various types of detailed information related to a meal at a restaurant, such as when, where, with whom, what kind of menu was ordered, and how much it cost. Note that in order to receive a more optimal service for the user, the user can provide the system with behavioral data unrelated to the partner business, and the behavioral data provided by the user is recorded in the system.

In addition, users can receive more suitable services by providing their physical data to the system. In this example, the body data is 3D model data and biometric data. 3D model data refers to data representing a 3D model in virtual space. In order to generate a 3D model of the user himself/herself, data (RGB and distance) taken by, for example, a 3D scanner is used. Biometric data is information regarding a living body, and includes information such as blood pressure, weight, and pulse rate that can be obtained by a sensor or the like. Note that the system records not only data acquired at a specific single timing, but also changes over time in the body data. In this example, time-series changes refer to the data string itself of physical data acquired and recorded along the time axis, or the user's body shape is "getting fatter (thinner)" or the condition of the user's skin is "improving." The information may be information indicating a trend of change, such as "It has gotten worse."

Additionally, users provide their attribute information to the system. The attribute information indicates attributes of the user, such as age, gender, place of residence, occupation, and income.

FIG. 2 is a diagram illustrating the hardware configuration and network configuration of the information processing system 1. The information processing system 1 includes a scanner device 10, a server device 20, a server device 30, a user terminal 40, and a business terminal 50. Further, each device is integrally connected via a network 9 as shown in FIG. In this example, the network is a computer network such as the Internet.

In this example, the scanner device 10 is an information processing device for acquiring physical data of a user, and is, for example, a 3D scanner. In particular, in order to generate a 3D model of the human body, by using a booth-type 3D scanner, the scanner device 10 acquires (photographs) data of photographs (RGB and distance) from a photographing device installed in the booth. do. This allows the scanner device 10 to acquire information such as 3D geometry, skin texture, and skin condition (color). Furthermore, by using various sensors that cooperate, the scanner device 10 can acquire not only a photograph of the subject but also biological data (an example of physical data) such as a body temperature map, blood pressure, weight, body fat, and pulse. be. Note that the user can provide these physical data to the information processing system 1. Furthermore, the information processing system 1 can acquire changes in the user's body (for example, body shape and/or skin condition) by recording and managing the body data in chronological order.

In this example, the server device 20 performs analysis based on various data provided by the user, and executes processing to propose the optimal service for the user from among the services operated by the partner businesses that cooperate with the server device 20. It is an information processing device. The server device 20 functions, for example, as a management server. More specifically, for example, the server device 20 can manage the data by acquiring the user's 3D model data from the scanner device 10, generating the user's 3D model, and recording it in a database. Alternatively, the user's own hobbies and preferences and/or mental status can be analyzed based on behavioral data provided by the user.

In this example, the server device 30 is a single information processing device or a plurality of information processing devices for each partner business to provide services to users, and refers to service servers independently set up by various partner businesses. In this example, the functions that can be realized by the server device 30 include those that provide services in real space (restaurant, fitness, apparel, etc.) and those that provide services in virtual space (such as Metaverse). Examples of services in real space include restaurant reservations and review input, or fitness gym membership and course selection. The virtual space service is, for example, a VR (Virtual Reality) experience or an NFT (Non-Fungible Token) game. The user can use various services through the server device 30. Note that various data related to services are recorded in the server device 30.

In this example, the user terminal 40 is a terminal device (or simply a terminal) used by an end user, and the user can use various services provided by a business operator via this terminal device. In this example, the user terminal 40 records the user's own actions based on the history of terminal operations by the user. In this example, terminal operations refer to, for example, inputting exercise records at a gym in real space, or payment processing when eating at a restaurant, etc., and each history includes the training time (for example, 2 hours) and the amount to be paid. Details such as (for example, 10,000 yen) or the content of the meal (for example, that steak and wine were consumed) are recorded. Note that the records of these actions (action records) are recorded and provided to the system as various data via an application in the user terminal 40, etc., with the consent of the user. Furthermore, the services that can be used via the user terminal 40 are not limited to the real space, but may also be services such as games in the virtual space.

In this example, the operator terminal 50 is a terminal device (or simply a terminal) used by a partner operator that provides services. In this example, the partner business operator who operates the service can freely access various data related to the service recorded in the server device 30 via the business terminal 50. In addition, by acquiring and utilizing such data, it can be used to further improve service quality.

FIG. 3 is a diagram illustrating the functional configuration of the information processing system 1. As shown in FIG. In this embodiment, it is assumed that each function of the information processing system 1 is mainly implemented in the server device 20. The information processing system 1 includes an acquisition means 21 , a selection means 22 , a presentation means 23 , a reward/punishment provision means 24 , a utilization means 25 , and an analysis means 26 .

In this example, the acquisition means 21 acquires various data. Further, the acquisition means 21 includes a first acquisition means 211 and a second acquisition means 212. In this example, the first acquisition means 211 acquires the user's physical data. In particular, when acquiring 3D model data (an example of body data), in addition to individual data, the first acquisition means 211 can acquire time-series changes in the user's 3D model. Note that this time-series change may include information indicating a tendency of change, such as, for example, that the user's body shape has "become fatter (or thinner)."

On the other hand, the second acquisition means 212 acquires the analysis results of the user's behavior analysis or mental analysis. In this example, behavioral analysis and mental analysis refer to the types of analysis performed by the server device 20 based on the user's behavioral data provided to the information processing system 1. Therefore, in this example, the server device 20 performs behavioral analysis based on items (for example, exercise, diet, music, etc.) that appear frequently in the acquired user's behavioral history (an example of behavioral data). Or, based on the purchase history of books (an example of behavioral data), such as the frequency of purchases of books on self-improvement, mental analysis can be performed to determine the user's mental state. It can be estimated. Note that in this example, the analysis result refers to the user's preferred behavior (for example, he likes exercise) or the estimated mental state (for example, he is starting to develop depression) as determined by the server device 20.

In this example, the selection means 22 selects a service menu suitable for the user from among the service menus provided by the partner business, using at least one of the time-series changes in the user's 3D model and the analysis results. do. Further, the presentation means 23 presents the service menu selected by the selection means 22 to the user. Further, when the user who has received the service menu presented by the presentation means 23 actually uses any of the multiple linked service menus, the reward/punishment granting means 24 gives the user a reward or penalty according to the user's performance. . "Reward and punishment" here is a concept that includes both things that have a positive influence on the user (ie, benefits) and things that have a negative influence on the user (ie, punishment). Things that have a positive impact on the user include, for example, giving points, issuing coupons, giving the right to participate in events, and giving titles. Things that have a negative impact on the user include, for example, the deprivation of points, the deprivation of coupons, the deprivation of titles, and the imposition of behavioral restrictions. Further, regarding the rewards and punishments given to the users, the utilization means 25 utilizes the rewards and punishments (mainly benefits) in accordance with the user's instructions in the cooperative service. Furthermore, the analysis means 26 performs behavioral analysis or mental analysis of each user based on the behavioral data.

FIG. 4 is a diagram illustrating the hardware configurations of the server device 20 and the user terminal 40, respectively. The server device 20 is a computer having a CPU (Central Processing Unit) 201, a memory 202, a storage 203, and a communication IF 204, and is, for example, a personal computer or a mainframe. The CPU 201 is a processor that performs various calculations according to programs. The memory 202 is a main storage device that functions as a work area when the CPU 201 executes a program, and includes, for example, RAM (Random Access Memory). The storage 203 is an auxiliary storage device that stores various data and programs, and includes, for example, an SSD (Solid State Drive) or an HDD (Hard Disc Drive). The communication IF 204 is a device that communicates with other devices according to a predetermined communication standard, and includes, for example, a NIC (Network Interface Card).

In this example, the programs stored in the storage 203 include a program for causing a computer to function as a server in the information processing system 1 (hereinafter referred to as a "server program"). In a state where the CPU 201 is executing the server program, the CPU 201 executes the acquisition means 21, the first acquisition means 211, the second acquisition means 212, the selection means 22, the presentation means 23, the reward/punishment provision means 24, the utilization means 25, and the analysis means. This is an example of 26.

The user terminal 40 is a computer having a CPU 401, a memory 402, a storage 403, a communication IF 404, an input device 405, and a display device 406, and is, for example, a smartphone, a tablet, or a personal computer. The CPU 401 is a processor that performs various calculations according to programs. The memory 402 is a main storage device that functions as a work area when the CPU 401 executes a program, and includes, for example, a RAM. The storage 403 is an auxiliary storage device that stores various data and programs, and includes, for example, an SSD or an HDD. The communication IF 404 is a device that communicates with other devices according to a predetermined communication standard, and includes a wireless chip when communicating wirelessly, for example. The input device 405 is a device for inputting information to the user terminal 40, and includes, for example, a touch screen, a keyboard, a mouse, or a pointing device. The display device 406 is a device that displays information, and includes, for example, an organic EL (Electro Luminescence) display or a liquid crystal display.

Further, the user terminal 40 includes a device that can be operated by the user in order to use services in a virtual space or a mixed reality (MR) space, such as a VR headset or smart glasses. . In this case, the input device 405 includes, for example, a VR controller. Further, the display device 406 includes, for example, a head mounted display.

In this example, the programs stored in the storage 403 include a program for causing a computer to function as a client in the information processing system 1 (hereinafter referred to as a "client program"). In a state where the CPU 401 is executing a client program, the CPU 401, memory 402, storage 403, communication IF 404, input device 405, and display device 406 are examples of functions for operating the user terminal 40.

2. Operation FIG. 5 is a flowchart illustrating the operational concept of the information processing system 1. In this example, the operational concept or operational conceptual diagram refers to the information processing system 1 that cooperates with the individual devices such as the scanner device 10, the server device 20, the server device 30, the user terminal 40, and the operator terminal 50. , is a diagram (diagram) that represents, as a simple concept, the operation of the system as a whole, or the operation of the system by intervention of a user or a partner business. Therefore, the operation of the entire information processing system 1 is controlled based on the flow of the operational conceptual diagram. On the other hand, details of each operation are controlled based on sequence processing or operation flow by individual devices. The main operational concepts will be explained below along with the flowchart in FIG.

In step S1, the information processing system 1 uses a 3D scanner or the like to obtain time-series changes in the 3D model of the user. In this example, the time-series changes include analysis results such as, for example, that the user's body shape has "become fatter" or "the condition of the user's skin has improved." The information processing system 1 also acquires the user's behavior history (an example of behavior data) in the real space and virtual space, and performs a behavior analysis or mental analysis of the user from the behavior data. Alternatively, the information processing system 1 may acquire the analysis results of the user's behavior analysis or mental analysis.

In step S2, the information processing system 1 uses at least one of the analyzed or acquired time-series changes in the 3D model of the user and the behavioral analysis and mental analysis results provided by the partner business. A service menu suitable for the user is selected from the service menu and proposed. Specifically, for example, based on data such as a certain user's ``preference for sports (behavioral analysis)'', ``gaining weight (chronological change in 3D model)'', and ``stress accumulation (mental analysis)'', The information processing system 1 can propose a "boxercise course" provided by a cooperating fitness gym to the user.

In step S3, the information processing system 1 executes the service menu finally selected by the user. Note that the term "execution" here includes, for example, the concept of a user voluntarily going to a fitness gym and performing boxercise.

In step S4, the information processing system 1 evaluates the executed service menu. In this example, "evaluation" refers to the evaluation of the behavior of the user who executed the service. Alternatively, when a user actually uses the proposed service, it includes a concept such as a subjective evaluation by the user such as "it was fun" or "it was boring". Note that when the evaluation is completed in step S4, the information processing system 1 analyzes the user again based on the evaluation (returns to step S1). Alternatively, in addition to the evaluation, the information processing system 1 may analyze the user, for example, along with behavioral data in the "boxercise course."

The above is the operational concept of the information processing system 1. Next, details of the operation will be explained. The details of each operation are controlled based on, for example, sequence processing or operation flow by individual devices. Therefore, below, the explanation will be mainly divided into three operation items: "data analysis", "service proposal", and "evaluation".

2-1. Data Analysis FIG. 6 is a sequence chart illustrating data analysis in the information processing system 1. Note that, in the following, when the information processing system 1 performs analysis processing, acquisition of data necessary for analysis will also be described. In step SA1, in order to generate a 3D model of the user, the scanner device 10 uses a photographing device to photograph the subject (user) and acquires the image data as image data. The image data acquired in this example includes RGB data and distance data. Note that by using various sensors that cooperate with each other, the scanner device 10 may acquire biological data (an example of physical data) such as a body temperature map, blood pressure, weight, body fat, and pulse.

In step SA2, the scanner device 10 transmits the acquired image data of the user to the server device 20. Note that in this example, when the scanner device 10 transmits the image data to the server device 20, it may also transmit the above-mentioned biological data such as blood pressure, weight, and pulse rate.

In step SA3, the server device 20 generates a 3D model of the user from the acquired image data. In this example, generation of the 3D model includes processing for reproducing the 3D geometry, skin texture, and skin condition (color) to be equivalent to that of the user himself. Note that reproduction here does not have to be the same as the user himself, but may be the generation of a 3D model that has been subjected to correction processing, or the generation of a 3D model that is a deformed version of the user himself using an avatar or the like. It's okay.

In step SA4, the server device 20 records the generated 3D model in the database. In this example, the server device 20 distributes the generated 3D models to each user and records them in chronological order. Note that the user updates the 3D model with the scanner device 10 periodically (for example, once a year or once every six months, etc.), and data is recorded in the database in chronological order each time.

Here, in step SA4, the database possessed by the server device 20 will be explained. FIG. 7 is a diagram illustrating a 3D database that the server device 20 has. In this example, the 3D database 2001 includes a user ID, time stamp T, 3D model data DD, biometric data LL, and attribute information. Furthermore, the attribute information includes identification information ID of the scanner and biometric information type ID. In this example, the user ID is unique ID information for identifying each user. The time stamp T is time information in the computer that represents the time when each data was recorded and changed in the 3D database 2001. In this example, as in the time stamp T[1], the numbers placed in "O" in [O] represent the order of data given along the time series.

Further, the 3D model data DD is data representing a 3D model in a virtual space, and includes shape (geometry such as a mesh, curve, surface, or metaball) data and texture data. The biometric data LL includes the user's biometric information (blood pressure, weight, body fat percentage, blood sugar level, etc.). The scanner identification information ID is unique ID information for identifying the scanner that photographed the user, and the biometric information type ID is unique ID information for identifying the type of biometric information of the acquired user. .

In addition, the 3D database 2001 may include additional data attached to the 3D model data DD. For example, the attached data is not used directly when generating a 3D model of the user and displaying it on a display, etc., but it includes the user's attributes (age, gender, place of residence, etc.) related to the 3D model. etc.) and/or behavior data representing the user's action history (combination of actions and locations in real space or virtual space).

Additionally, the server device 20 can freely access the 3D database 2001 and acquire various data. Furthermore, in this example, the first acquisition means 211 of the server device 20 can acquire data recorded in the 3D database 2001 as time-series changes in the user's 3D model. In this example, the time-series change may include, for example, changes in the user's body shape such as "I'm getting fatter (I'm getting thinner)" or "My skin is getting better (worse)." The determination may be made by the server device 20 based on data recorded in the 3D database 2001. Note that the contents of these changes are information used by the system to propose optimal services to each user, and may be defined using any judgment criteria and judgment means.

Returning to FIG. 6, in step SA5, the user terminal 40 records the user's own actions based on the history of terminal operations by the user. In this example, terminal operations refer to, for example, inputting exercise records at a gym in real space, or processing payments when eating at a restaurant, etc., and each includes training time (for example, 2 hours) and expenses (for example, 2 hours) as history. For example, details such as 10,000 yen) or the contents of the meal (for example, that I ate steak and wine) may also be included. Note that these action records are recorded as various data via an application or the like in the user terminal 40 with the consent of the user. Further, as an example, an action record by the user terminal 40 in a real space has been described, but an action record in a virtual space may also be used.For example, if the user terminal 40 is a VR headset, an adventure record in a game such as a metaverse, etc. The content may be about exterminating the monsters in the village.

In step SA6, user terminal 40 transmits behavior data to server device 20. In this example, behavior data includes the user's behavior history (or behavior record) recorded as data via the user terminal 40, such as when, where, with whom, and how the user ate at the restaurant mentioned above. This refers to information that includes various types of detailed information, such as how much a person ordered from a menu and how much it cost. Additionally, in this example, the user can provide behavioral data to the system via the user terminal 40 in order to receive more optimal service.

In step SA7, the server device 20 records the received behavior data in the database. Regarding the behavior data recorded in this example, it is preferable that detailed information be recorded for each user's behavior (or time, etc.) in various relationships, and in this case, in what format is recorded? , is defined in the database of the server device 20.

Here, in step SA7, the database possessed by the server device 20 will be explained. FIG. 8 is a diagram illustrating the behavior database that the server device 20 has. In this example, the behavior database 2002 has behavior history in real space and virtual space as data for a user identified as a unique user ID (1234567). In the case of action history in real space, this data includes items such as time stamp, category, location, action, object/content, and notes. Furthermore, in the case of an action history in a virtual space, it further includes a virtual space name. Regarding these items, FIG. 8 is just an example, and any items may be set.

Returning to FIG. 6, in step SA8, the server device 20 starts analysis processing in response to the trigger event. In this example, the trigger event includes the concept of a specific program processing within a predetermined computer, such as when a predetermined time has passed since the previous analysis or when the amount of unanalyzed data exceeds a threshold.

Regarding the process in step SA8, the analysis means 26 of the server device 20 analyzes each user based on the behavior data recorded in the behavior database 2002. This analysis is particularly divided into behavioral analysis and mental analysis, and each analysis will be explained below. Note that the behavior data used by the analysis means 26 when performing each analysis is based on data recorded in the behavior database 2002; Based on predetermined viewpoints such as action history, action history performed by the user in real space, relationship with other users who use the same linked service as the user, or evaluation of a certain user by another user, The analysis means 26 may perform behavioral analysis and mental analysis. Therefore, the specific examples used in the following explanation are merely examples based on these viewpoints.

In this example, behavior analysis is an analysis method for analyzing a user's behavior history and estimating the user's preferences. For example, the analysis means 26 refers to the behavior database 2002, and if there is a behavior (such as muscle training) that appears frequently in the history, the analysis unit 26 estimates that behavior as the behavior preferred by the user. In addition, in real space or virtual space, actions preferred by others who visit the same or similar places as the user (for example, drawing pictures in 〇〇 park) can be indirectly analyzed as actions preferred by the user. 26 may be estimated. Furthermore, the analysis means 26 may estimate a behavior that is preferred by another person who has attributes similar to the user (such as age or gender) as a behavior that is also preferred by the user.

Further, for example, after an action in a real space or a virtual space, a certain user may input data on his or her own emotions (pleasant, boring, happy, sad, etc.) via the user terminal 40. Then, the server device 20 associates the acquired behavior history (an example of behavior data) with this emotional data and records it in the behavior database 2002. In this example, the analysis means 26 may refer to the behavior database 2002 and estimate the user's preferred behavior based on positive emotions such as fun and happiness from emotion data associated with the behavior history. Note that the user's preferred behavior estimated by the analysis means 26 is divided into items such as exercise, eating, music, movies, or reading, and further divided into detailed genres such as muscle training, sushi, or pop music. Good too.

In this example, mental analysis is an analysis method for analyzing a user's behavior history and estimating the user's mental state. For example, after a certain user takes an action in a real space or a virtual space, the user inputs data on his or her own emotions (pleasant, boring, happy, sad, etc.) via the user terminal 40, The server device 20 associates the acquired behavior history (an example of behavior data) with this emotional data and records it in the behavior database 2002. In this example, the analysis means 26 refers to the behavior database 2002 and estimates the current or future mental state from emotion data linked to the behavior history, for example, based on time-series changes in emotions.

In addition, for example, other users may input evaluations (likes, etc.) regarding the user's actions in the real space or the virtual space, and the server device 20 receives the acquired action history (an example of action data) and this evaluation. data is linked and recorded in the behavior database 2002. In this example, the analysis means 26 refers to the behavior database 2002 and estimates the current or future mental state based on, for example, time-series changes in evaluations from other users from evaluation data linked to the behavior history.

Furthermore, the analysis means 26 may estimate the user's mental state from the relationship with other users who have performed the same action in real space or virtual space (comparison of actions with other users). For example, if a user who uses a fitness service selects the same exercise course with multiple people and his friend loses weight but he is the only one whose weight has not changed, it may be assumed that the user's mental state is depressed. The analysis means 26 may estimate the user's mental state. In this example, the behavior database 2002 adds items such as friends, lovers, or family members about other users who are highly related to the user, associates each user ID with the item, and stores the information in the database. It can be managed by That is, by mutually linking these databases, the analysis means 26 can compare the behavior of the user and other users and estimate the mental state of the user.

The behavioral analysis and mental analysis by the server device 20 described above are just examples, and the analysis may be performed by any method.For example, by utilizing AI or machine learning, from among a huge amount of data, An analysis method that allows more accurate user behavior analysis and mental analysis may be adopted. Furthermore, in the server device 20, the second acquisition means 212 acquires the analysis results of the behavioral analysis or mental analysis performed by the analysis means 26. Thereby, the server device 20 can acquire necessary information that serves as a selection criterion when proposing the optimal service to the user. Next, a more detailed embodiment of the service proposal operation in the information processing system 1 will be described.

2-2. Service Proposal FIG. 9 is a flowchart illustrating a service proposal in the information processing system 1. The service proposal flow is started, for example, in response to a request from a user. Alternatively, the service proposal may be automatically started by the server device 20. In step SB1, the server device 20 acquires time-series changes in the user's 3D model. More specifically, the first acquisition means 211 acquires time-series changes in the user's 3D model recorded in the 3D database 2001. In this example, the time-series changes include, for example, changes in the user's 3D model, such as the body shape becoming fatter (thinner) or the skin condition becoming better (worse). Alternatively, the determination may be made by the first acquisition means 211 based on data recorded in the 3D database 2001.

In step SB2, the server device 20 acquires the analysis results of the user's behavior analysis and mental analysis. More specifically, the second acquisition means 212 acquires the analysis results of behavior analysis and mental analysis for each user's analysis performed by the analysis means 26 based on the behavior data recorded in the behavior database 2002. do. In this regard, the second acquisition means 212 may directly acquire the analysis results from the analysis means 26. In this example, the analysis result of the behavior analysis includes the user's hobbies and preferences, such as, for example, "The user named XX likes the behavior named XX," so the second acquisition means 212 preliminarily acquires information about this "XX". Identify defined categories. In this example, the categories include exercise, meals, entertainment, etc., and are used to narrow down the service content in order to suggest the optimal service to the user. Note that this category may be directly linked to the "category" included in the behavior data in the behavior database 2002.

In step SB3, the server device 20 selects a menu of cooperative services suitable for the user. More specifically, the selection means 22 selects a service suitable for the user from a service menu provided by a partner business, using at least one of the time-series changes in the user's 3D model and the analysis results. Select menu. In this example, regarding the method of selecting the service menu by the selection means 22, for example, for a certain user, "I like sports (behavioral analysis)", "I'm getting fatter (change in 3D model)", and "Stress accumulation (mental analysis)" )", the selection means 22 selects the "boxercise course" provided by the affiliated fitness gym for the user. For example, the server device 20 stores in a database (not shown) the conditions of the behavior history and the conditions of the service menu to be selected when the conditions are met. The server device 20 refers to this database and selects a service menu suitable for the user. Note that the selection method is not limited to this, and for example, AI or machine learning may be used. For example, a machine learning model is used in which a behavior history of a certain user, a service received by the user, and feedback (or impressions) of the user after receiving the service are given as training data, and machine learning is performed. Data other than these may be used as the training data. For example, data such as day of the week, time, weather, or location, or unique data such as the user's routine may be further taken into account to provide a more optimal service for the user. A method of selection may also be adopted.

In step SB4, the server device 20 presents (proposes) the selected service menu to the user. More specifically, the presenting means 23 presents the selected service menu to the user. In this example, the user can receive service menu suggestions from the server device 20 via the user terminal 40 or the like.

Further, when the user actually uses the proposed service, the server device 20 may record the behavior data in a database such as the behavior database 2002 via the user terminal 40 or the like. At that time, the user may be asked to input data regarding his or her own emotions (pleasant, boring, happy, sad, etc.) via the user terminal 40. The server device 20 associates the acquired behavior history (an example of behavior data) with this emotional data and records it in the behavior database 2002 or the like.

In this example, the emotion data may be used as teacher data for AI learning by the server device 20, for example, in order to select or evaluate the service itself. Furthermore, regarding this teacher data, the server device 20 also analyzes the behavioral and mental analysis results after the user has used the service (I started going to fitness regularly, my stress level decreased, etc.). It may be utilized for AI learning in order to select or evaluate itself.

Note that the use of services by these users and the control that is executed in conjunction may be employed as a trigger for processing such as step SA5 in the data analysis of FIG. 6, for example. This allows the server device 20 to further re-analyze the user based on the user's behavior. Next, a more detailed embodiment of the evaluation operation in the information processing system 1 will be described.

2-3. Evaluation FIG. 10 is a sequence chart illustrating evaluation in the information processing system 1. In this example, evaluation refers to the process of awarding rewards and punishments to a user based on the user's behavior history. This process is mainly executed by the server device 20. That is, when a user who has been presented with a service menu by the presentation means 23 actually uses one of the plurality of linked service menus, the reward and punishment giving means 24 gives a reward and punishment to the user according to the performance. Here, we will explain an example in which special benefits are given among rewards and punishments.

Note that in this example, points given as benefits include points that have value that can be exchanged by the user for other services, products, etc. within the system or within a specific service. Further, in this example, the user grade includes a class or hierarchy for ranking users according to their usage history in the system itself or in a specific service. Below, specific processing steps will be explained.

In step SC1, the user terminal 40 transmits the user's service usage history to the server device 20. In this example, the service usage record includes the user's behavior history (behavior record) provided by the user via the user terminal 40. That is, the service usage record is an example of behavior data, and actually refers to the user's behavior history. For example, when a user trains at a fitness gym, the service usage history (behavior history) includes detailed information such as when, where, with whom, what kind of training course was selected, and the level of satisfaction. includes various related items.

In step SC2, the server device 20 records the service usage history received from the user terminal 40 in the database. In this example, the server device 20 records the service usage record in the behavior database 2002 as behavior data.

In step SC3, the business terminal 50 transmits the service usage record to the server device 20. In this example, the service usage record transmitted from the business terminal 50 is data associated with the service usage record (behavior data) provided by the user via the user terminal 40 in step SC1. Regarding this point, more specifically, the service menu proposed by the server device 20 is mainly a service operated by a partner business, and for example, if the user actually uses the proposed service menu, Similarly to the user terminal 40, a user's service usage history is recorded as data in the server device 30, which is a service server.

To illustrate again the above-mentioned user's training at the fitness gym in this example, the server device 30 records information such as which user reserved what training course, when, what the satisfaction level was after the training, and the estimated calorie consumption. Information such as how much is recorded. Note that this information is not necessarily limited to the behavior data recorded on the user terminal 40 or is not necessarily the same, and may be unique data corresponding to various services.

The data recorded in the server device 30 is freely acquired, for example, by a partner business operating the service via the business terminal 50, and is used to further improve service quality. In this example, the data acquired by the business terminal 50 is finally transmitted to the server device 20 as a service usage record (step SC3).

In step SC4, the server device 20 records the service usage record received from the operator terminal 50 in the database. In this example, the server device 20 may record the service usage record as behavior data in the behavior database 2002 or in a database different from the behavior database 2002, or may record service usage records received from the user terminal 40 as behavior data. After defining (linking) the relationship with actual results, it may be recorded in various databases.

In step SC5, the server device 20 detects a trigger event before starting the evaluation process. In this example, the trigger event includes the concept of a specific program processing in a predetermined computer, such as when a predetermined time has passed since the previous evaluation or when the amount of unevaluated data exceeds a threshold.

In step SC6, the server device 20 evaluates the user. More specifically, the reward/punishment granting means 24 calculates points to be given to the user. In this example, points are divided into two types: common points that can be used by all partner businesses, and unique points that can only be used by specific partner businesses. It is possible to exchange points for unique points. In this example, common points include, for example, points that can be used to purchase products or services at multiple physical stores or online stores operated by different businesses, while unique points include, An example is points that can be applied to the purchase price of products or services operated by a specific single business operator (an example is airline mileage).

First, regarding the calculation of common points, the reward/penalty granting means 24 calculates common points based on the user's service usage history and according to an algorithm and calculation formula predetermined within the system. In this example, the reward/punishment granting means 24 refers to behavior data in the behavior database 2002, awards 100 points to the user for exercising at a fitness gym, or eating at a restaurant, and via the music distribution application. Various calculation methods may be adopted, such as giving the user 3 points for each music listening session.

Next, regarding the calculation of unique points, the algorithm and calculation formula that are the basis of the calculation method are provided by the system. Furthermore, parameters in the algorithm and calculation formula can be freely set by each partner business. As an example, consider a case where a user uses a service menu for overseas travel by airplane. In this example, the reward/punishment awarding means 24 can calculate mileage, which is unique points, based on the user's service usage history using an algorithm and calculation formula customized by the airline company, and can award the mileage to the user.

Regarding the evaluation process described above, the same process is applied not only to points but also to user grade. Note that in this example, the user grade may be ranked according to a class such as gold member, silver member, or bronze member. Further, the user grade may have two classifications: a common grade by the system and a unique grade by each partner business. Furthermore, the method for determining each grade is similar to the method for calculating points, in which the reward and punishment awarding means 24 adopts a method in which it is determined according to an algorithm and calculation formula predetermined within the system, based on the user's service usage record. Ru.

Note that regarding the rewards and punishments including these points and user grades, the utilization means 25 can use the rewards and punishments in accordance with the user's instructions in the cooperative service. In this example, the use of rewards and punishments by the usage means 25 includes processing such as exchanging points for other services or products, etc. in the case of points, and in the case of user grades, the use of rewards and punishments by the usage means 25 includes processing such as exchanging them for other services or products, etc. etc.). Further, when these rewards and punishments are used by a user via the usage means 25, the reward and punishment giving means 24 may evaluate the user for the use and may further give rewards and punishments to the user.

3. Modifications The present invention is not limited to the above-described embodiments, and various modifications are possible. Some modified examples will be explained below. Two or more of the matters described below may be applied in combination.

(1) Information processing system 1
The hardware configuration in the information processing system 1 is not limited to that illustrated in the embodiment. The information processing system 1 may have any hardware configuration as long as it can realize the required functions. For example, a plurality of physical devices (for example, the scanner device 10, etc.) may work together to function as the server device 20.

Furthermore, the network configuration in the information processing system 1 is not limited to that illustrated in the embodiment. For example, if the scanner device 10 is included as one of the services provided by the partner business to the user, the scanner device 10 and the server device 30 may be connected via a network to provide the service.

The correspondence between functions and hardware is not limited to that illustrated in the embodiment. For example, the function of generating 3D model data from image data may be implemented in the scanner device 10. In this case, the server device 20 acquires 3D model data from the scanner device 10.

(2) Server device 20
The server device 20 may be a physical server or a virtual server (including a so-called cloud server). Further, the correspondence between functional elements and hardware is not limited to that illustrated in the embodiment. For example, in the embodiment, at least a part of the functions described as being implemented in the server device 20 may be implemented in another device (for example, the scanner device 10), or conversely, the functions described as being implemented in the server device 20 may be implemented in another device (for example, the scanner device 10). At least a part of the functions described as being implemented in 10) may be implemented in the server device 20. In this example, instead of the configuration in which the 3D model of the user is generated by the server device 20, a configuration in which the 3D model of the user is generated by the scanner device 10 may be used.

(3) Operation steps (operation concept)
The flowchart shown in FIG. 5 merely shows an example of the operation, and the operation of the information processing system 1 is not limited thereto. Some of the illustrated operations may be omitted, the order may be changed, or new operations may be added. In this example, in step S1, the information processing system 1 executes analysis processing related to time-series changes in the 3D model of the user, behavioral analysis, or mental analysis. It may be replaced by an operation of collaborating and acquiring only the data necessary for service selection (proposal), that is, the analysis results.

(4) Data analysis 2-1. In data analysis, the operation of the information processing system 1 is merely an example, and is not limited to what is described above. In this example, regarding the analysis method of mental analysis, for example, the user's psychological state is determined by recording the user's voice tone, tone, or speaking content through a voice interface such as Siri (registered trademark) and Alexa (registered trademark). Speech analysis may be employed to estimate the .

Alternatively, analysis methods that include feedback from others related to the user may be employed. In this example, feedback means, if the user is a student, feedback from a school teacher such as his attitude in class or his daily life, or if the user is an office worker, feedback such as his work attitude or situation at work from his boss or colleague. Feedback, or if the user is a patient with some symptoms, refers to feedback such as symptoms or physical condition diagnosed by a doctor at a hospital, and mental analysis may be performed in conjunction with a system that records these.

Further, the type of analysis performed by the server device 20 is not limited to the behavioral analysis and mental analysis described above. In this example, the analysis means 26 may analyze the user's personality based on the behavior history (an example of behavior data). For example, if an activity (service) that lasts for a long time is detected from a user's behavior history, the user may have a predetermined personality type (personality classification A), such as a personality that "works diligently and continuously" (personality classification A). You can also classify them by applying their characteristics. Furthermore, the server device 20 may analyze the user's lifestyle habits based on the history of health-related behaviors such as eating, exercising, drinking, or smoking. may be set up to manage users.

Note that, using these analysis results, the selection means 22 may select a menu suitable for the user from among a plurality of menus included in a plurality of cooperative services. For example, the selection means 22 selects a certain user based on data such as "loves music (behavioral analysis)," "likes new things (personality analysis)," and "state of high motivation for action (mental analysis)." The menu item ``Instrument lessons at music school'' may be selected and suggested to the user.

(5) Service Proposal In the service proposal, the operation of the information processing system 1 is merely an example, and is not limited to what is described above. For example, the server device 20 does not need to present to the user a specific service menu affiliated with a specific affiliated service provider. For example, the server device 20 refers to data indicating the target user's schedule (or activity schedule) and proposes a service menu according to the activity schedule. Specifically, when the target user is planning to attend a party, the purpose of the party and attire appropriate for the participants (for example, ``We recommend wearing a gray hoodie.'' ”, etc.) to the user. At this time, even if the sale of gray hoodies is not defined in advance as a service menu of a specific service provider, the server device 20 makes this proposal. That is, in this case, it can be said that the server device 20 generates a new service menu by referring to the service menu data acquired from the service provider or other data, and presents the new service menu to the user. .

In addition to the user's 3D model data and behavior data, the server device 20 may also acquire data indicating trends (or fads) in the world, and refer to this data to suggest a service menu.
In addition, in the embodiment, an example has been described in which the server device 20 proposes a service menu by taking into consideration all the time-series changes in the user's 3D model and the analysis results of behavioral analysis and mental analysis. A service menu may be proposed taking only at least one of these into consideration. That is, the server device 20 takes into consideration at least one of (a) the chronological changes in the user's 3D model and (b) the analysis results (in other words, the chronological changes and/or the analysis results in the user's 3D model). Suggest a service menu. The analysis results include the results of at least one of behavioral analysis and mental analysis (in other words, the results of behavioral analysis and/or mental analysis of the user).

(6) Evaluation 2-3. In the evaluation, the operation of the information processing system 1 is merely an example, and is not limited to the above-mentioned operation. In this example, the conditions for awarding points may be set freely. Conditions for awarding points are conditions related to the user's behavior history. For example, even if multiple users use the same service, a user with a higher user grade will be awarded more points than a user with a lower grade. Conditions may be set. Alternatively, if a user who has used a service proposed by the information processing system 1 continues to use the service, additional points will be awarded or the point grant rate will be increased depending on the continuation period, etc. Conditions may be set.

Benefits may be classified into multiple types, such as awarding points, issuing coupons, granting the right to participate in an event, and awarding titles. Coupons can be used for services provided by affiliated service providers. The right to participate in an event is a ticket to participate in an event (eg, a party, a concert, a meeting, a workshop, etc.) that takes place in a real space or a virtual space. A title is an honor given to a user. The user may decide which type of benefit will be given to the user, or the server device 20 may decide automatically. These conditions are held, for example, in a database stored in the server device 20.

Although the above example specifically deals with benefits among rewards and punishments, it is also applicable to punishments. For example, the server device 20 stores a database in which conditions for imposing punishment are recorded. This condition may include relationships between multiple different types of behavior. Examples of different types of behavior are exercise and eating. Specifically, if you ingest a prescribed food or drink (for example, a food or drink containing a lot of sugar or a food or drink containing a lot of carbohydrates) within a predetermined time (for example, within one hour) after exercising at a fitness gym, It is a condition that punishment is given.

(7) Data format The data format of the 3D model data handled by the information processing system 1 may be any format. For example, the 3D model data may be in a data format that includes biological data or past 3D model data.

(8) Others The various programs executed by the CPU 201, CPU 401, and each device may be provided by downloading via a network such as the Internet, or may be provided on a computer-readable non-temporary disk such as a DVD-ROM. It may also be provided in a state recorded on a digital recording medium. Note that each processor may be, for example, an MPU (Micro Processing Unit) instead of a CPU.

DESCRIPTION OF SYMBOLS 1... Information processing system, 10... Scanner device, 20... Server device, 30... Server device, 40... User terminal, 50... Business terminal, 9... Network, 21... Acquisition means, 211... First acquisition means, 212... 2nd acquisition means, 22... selection means, 23... presentation means, 24... reward/punishment provision means, 25... utilization means, 26... analysis means, 201... CPU, 202... memory, 203... storage, 204... communication IF, 401... CPU, 402...Memory, 403...Storage, 404...Communication IF, 405...Input device, 406...Display device, 2001...3D database, 2002...Behavior database

Claims (11)

a first acquisition means for acquiring time-series changes in the user's 3D model;
an analysis means for performing behavioral analysis or mental analysis of the user;
a second acquisition means for acquiring the analysis result of the behavioral analysis or the mental analysis of the user from the analysis means;
a selection means for selecting a menu suitable for the user from among a plurality of menus included in a plurality of linked services, using the time-series changes and/or the analysis results;
Presentation means for presenting the selected menu to the user;
has
The analysis means performs the behavioral analysis or the mental analysis using a behavioral history performed by the user in a virtual space using the 3D model.
Information processing system. 2. The information processing system according to claim 1, further comprising: a reward/penalty granting unit that gives a reward/punishment to the user according to a track record of actually using any of the plurality of cooperation services by the user who has been presented with the menu. The information processing system according to claim 2, further comprising means for using the reward and punishment in accordance with a user's instruction in the cooperation service. The information processing system according to claim 3, wherein the reward/penalty granting means grants the reward/penalty to the use performed via the usage means. 3. The information processing system according to claim 2, wherein the reward/penalty awarding unit awards a reward/punishment in a cooperative service selected from among the plurality of cooperative services according to the time-series change and/or the analysis result. The information processing system according to claim 5, wherein the reward/punishment granting means gives the reward/punishment to each of the plurality of cooperative services using an independently set algorithm. The information processing system according to claim 1, wherein the analysis means performs the behavior analysis or the mental analysis using a history of behavior performed by the user in real space. The information processing system according to claim 1, wherein the analysis means performs the behavior analysis or the mental analysis using relationships between the user and other users who use the same cooperative service. The information processing system according to claim 1, wherein the analysis means performs the behavior analysis or the mental analysis using an evaluation of the user from a user other than the user. The linked service is classified into multiple types,
The selection means selects, as a menu suitable for the user, a menu included in a type of cooperation service selected from among the plurality of types according to the time-series change and/or the analysis result. Information processing system. An information processing method implemented by a computer, the method comprising:
obtaining time-series changes in the user's 3D model;
performing a behavioral analysis or mental analysis of the user;
a step of obtaining an analysis result of the behavioral analysis or the mental analysis performed in the step of performing the behavioral analysis or mental analysis of the user ;
selecting a menu suitable for the user from a plurality of menus included in a plurality of linked services using the time-series changes and/or the analysis results;
presenting the selected menu to the user;
has
In the step of performing behavioral analysis or mental analysis of the user, the behavioral analysis or mental analysis of the user is performed using a history of actions performed by the user in a virtual space using the 3D model.
Information processing method.

Images