WO2019171592A1

WO2019171592A1 - Information processing system, information processing device, information processing method, and program

Info

Publication number: WO2019171592A1
Application number: PCT/JP2018/009291
Authority: WO
Inventors: 良雄宮崎
Original assignee: 株式会社ソニー・インタラクティブエンタテインメント
Priority date: 2018-03-09
Filing date: 2018-03-09
Publication date: 2019-09-12
Also published as: JP6831492B2; JPWO2019171592A1

Abstract

Provided is an information processing device which: is connected to a device which comprises an apparatus mounted on a user and outputs information relating to the height of the user; estimates, on the basis of the information acquired from the device, height characteristic information relating to the height of the user whereon the apparatus of the device is mounted; and uses the estimated height characteristic information to execute a prescribed process to be executed of an application.

Description

Information processing system, information processing apparatus, information processing method, and program

The present invention relates to an information processing system, an information processing apparatus, an information processing method, and a program.

In recent years, devices that are mounted on the user's head and display information, such as a head-mounted display, have become widespread. When using such a device and displaying information on an image of a virtual space generated by processing of an application such as a game, the position of the viewpoint in the virtual space is related to the actual height of the user, etc. However, the present situation is that it can be arbitrarily set in the game.

Because of the current situation described above, at least at the initial time such as the start of the game, the user sees an image in the virtual space from a viewpoint different from the viewpoint from the actual height, which causes a sense of incongruity. Yes.

The present invention has been made in view of the above circumstances, and it is an object of the present invention to provide an information processing system, an information processing apparatus, an information processing method, and a program capable of executing information processing using the height information of a user. One.

The present invention for solving the problems of the above conventional example is an information processing apparatus that is attached to a user and connected to a device that outputs information related to the height of the user, and is based on information acquired from the device And estimating means for estimating height characteristic information related to the body length of the user wearing the device, and processing means for executing predetermined processing of an application to be executed using the estimated height characteristic information The processing means executes processing at the time of initialization of the application using at least the height characteristic information.

According to the present invention, information processing using the user's height information can be executed.

It is a block diagram showing an example of an information processing system according to an embodiment of the present invention. It is a functional block diagram showing the example of the information processing apparatus which concerns on embodiment of this invention. It is a flowchart figure showing the operation example of the information processing apparatus which concerns on embodiment of this invention.

Embodiments of the present invention will be described with reference to the drawings. As illustrated in FIG. 1, an information processing system 1 according to an embodiment of the present invention includes a device 10 that includes an apparatus worn by a user and a controller CTL, and an information processing apparatus that is communicably connected to the device 10. 20.

In the example of FIG. 1, the device 10 includes a head mounted display (HMD) that is a device worn on the user's head and a controller CTL. As will be described later, the device 10 outputs information related to the height of the user.

Further, as illustrated in FIG. 1, the information processing apparatus 20 includes a control unit 21, a storage unit 22, an operation unit 23, and a display control unit 24. In an example of the present embodiment, a display device 30 and a controller device 40 are further connected to the information processing apparatus 20 so as to communicate with each other.

Here, the control unit 21 of the information processing apparatus 20 is a program control device such as a CPU, and operates according to a program stored in the storage unit 22. The control unit 21 according to the present embodiment executes the program, and relates to the height of the user who wears the HMD that is the device related to the device 10 based on the information related to the height of the user acquired from the device 10. Estimate height feature information. And the control part 21 performs the predetermined | prescribed process of the application used as execution object using the height characteristic information estimated here. At this time, the control unit 21 executes processing at the time of initialization of the application to be executed using at least the height characteristic information. An example of specific processing of the control unit 21 will be described later.

The storage unit 22 includes a memory device and a disk device, and stores a program executed by the control unit 21. The program may be provided by being stored in a computer-readable and non-transitory storage medium such as a DVD-ROM, and copied and stored in the storage unit 22. The storage unit 22 also operates as a work memory for the control unit 21.

The operation unit 23 outputs information representing the content of the user's instruction operation input from the controller device 40 such as a game controller, a keyboard, or a mouse to the control unit 21. The display control unit 24 controls at least one of the display device 30 such as a display and an HMD, or the HMD included in the device 10 in this example of the present embodiment, according to an instruction input from the control unit 21. , Display the information.

[Acquisition of height information of user by device including HMD]
Here, an example of processing for acquiring information relating to the height of the user using the device 10 including the HMD will be described.

In an example of the present embodiment, the HMD of the device 10 includes an imaging unit C such as a plurality of cameras in its housing. The device 10 (assuming to have a processor such as a microcomputer) acquires image data obtained by imaging with the plurality of imaging units C of the HMD. It is assumed that at least a pair of the plurality of imaging units C is imaging the front of the user (the direction of the user's eyes) from the position of the user's head when the user wears the HMD.

Therefore, the image data captured by the pair of image capturing units C is an object in front of the user (in the direction of the user's eyes) (a floor surface, a wall in the case of a room, a desk placed in a room, etc.) The image is taken. The device 10 recognizes the floor surface based on the image data captured by the pair of imaging units C (the process of recognizing the floor surface from the image data can employ various well-known processes. The detailed description of is omitted), and the distance to the floor is obtained. The method for obtaining the distance to the imaged object based on the pair of image data obtained by the pair of image capturing units C is also the difference in position of the feature points of the same object imaged in each image data (parallax). ) Can be used, and a detailed description thereof is omitted here.

Thus, the device 10 obtains the distance from the position of the user's head to the floor, and outputs the distance to the information processing apparatus 20 as information related to the user's height.

Further, another device 10 includes an HMD and a plurality of cameras R separate from the HMD. In this example, an LED (light emitter), a marker, or the like is attached to the surface of the HMD in advance, and the position of the light emitter or marker is detected from an image captured by the camera R.

Furthermore, also in the device 10 of this example, the floor surface is recognized from the image data captured by the pair of cameras R, and the distance between the camera R and the HMD (based on the parallax information of the image data captured by the pair of cameras R). And the difference in angle between the HMD and the floor surface (which can be obtained by the distance within the angle of view), the distance from the HMD to the floor surface is obtained, and the information on the distance is related to the height of the user. It outputs to the information processing apparatus 20 as information (information on the distance from the position of the user's head to the floor).

In addition, the process illustrated here is an example. For example, when a gyro sensor, an acceleration sensor, or the like is mounted on the HMD, information such as a moving distance from the floor surface by the gyro sensor or the acceleration sensor may be used. Good (the HMD is placed on the floor surface to the user and then guided to be worn on the head, and the movement distance of the HMD in the vertical (gravity acceleration) direction therebetween is measured). An atmospheric pressure sensor may be used. The accuracy of the height information here may have an error of about several centimeters.

Furthermore, in an example of the present embodiment, an angle sensor is attached to the HMD, or the device 10 detects the inclination of the HMD from the image of the HMD captured by the imaging unit C arranged outside the HMD. The device 10 may acquire information on the angle of the elevation angle (or depression angle) of the user's head, and output the information as information related to the user's posture together with information related to the user's height.

[Operation of control unit]
Next, the operation of the control unit 21 of the information processing apparatus 20 will be described. In the present embodiment, the control unit 21 executes the program stored in the storage unit 22 to functionally receive the reception unit 31, the estimation unit 32, and the application execution as illustrated in FIG. A configuration including the unit 33 is realized.

Here, the receiving unit 31 receives information such as information relating to the height of the user output from the device 10. Based on the information received by the receiving unit 31, the estimating unit 32 estimates the height characteristic information related to the height of the user wearing the device (here, the HMD) according to the device 10.

Specifically, the estimation unit 32 may output the information itself of the distance between the user's head and the floor, which is output by the device 10 as the height characteristic information. In addition, the estimation unit 32 may obtain the height characteristic information by adding a predetermined value to the value of the distance between the user's head and the floor represented by the information output from the device 10. This is a case where the distance between the user's head and the floor represented by the information output from the device 10 is actually the distance between the HMD and the floor, and the user's head is above the HMD mounting position. Is taken into account.

Further, the estimation unit 32 may estimate the user's height characteristic information as follows when the receiving unit 31 accepts information on the user's posture from the device 10 together with information on the user's height.

That is, the estimation unit 32 determines that the elevation angle of the user's head exceeds a predetermined angle (for example, 60 degrees) or the depression angle exceeds a predetermined angle (for example, 60 degrees) based on information on the user's posture. When the distance between the user's head and the floor represented by the information related to the user's height falls below a predetermined threshold (for example, 60 cm), the user is lying down Judgment is in posture).

In this case (when it is determined that the user is in a prone position), since the user's height is unknown, the estimation unit 32 determines a preset value (for example, a height value set as a default by the user, or a general A value published as the average height of a normal adult) is output as the height characteristic information of the user.

Further, the estimation unit 32 determines that the elevation angle (and depression angle) of the user's head is below a predetermined angle (for example, 60 degrees) based on the information related to the user's posture, and information related to the user's height is determined in advance. If the user is in a sitting position (sitting posture), for example, a value that is considered to be significantly lower than a value published as the average height of a general adult, such as 120 cm, for example, to decide.

In this case (when it is determined that the user is in the sitting position), the estimating unit 32 assumes that the value represented by the information related to the user's height output from the device 10 is substantially equivalent to the user's sitting height. Alternatively, a predetermined value (proportional value) may be multiplied by a value represented by information related to the user's height, and the result may be output as estimated height characteristic information. Here, it is assumed that the proportional value is a ratio (average value) of height to a general adult's sitting height.

Furthermore, the estimation unit 32 determines that the elevation angle (and depression angle) of the user's head is below a predetermined angle (for example, 60 degrees) based on the information related to the user's posture, and information related to the user's height is determined in advance. The user is in a standing position (standing posture, such as 120 cm, for example, a value determined to be significantly lower than the value published as the average adult average height). Judge.

In this case (when it is determined that the user is standing), the estimation unit 32 outputs the value represented by the information related to the user's height output from the device 10 as it is as the estimated height characteristic information.

As described above, the estimation unit 32 estimates whether the user is in the standing position, the sitting position, or the lying position, and the information relating to the height of the user output from the device 10 is represented according to the estimation result. The estimation method of the height characteristic information based on the value may be varied.

Further, the estimation unit 32 may record the estimation result of past height feature information. In this case, the maximum value among the values represented by the height characteristic information estimated in the past may be used as the height information of the user (in the standing position). In this case, the threshold value by which the estimation unit 32 determines whether the user is in the sitting position or the standing position may be determined according to the recorded height information. For example, the estimation unit 32 may determine that the user is in the sitting position when the value represented by the height information of the user output from the device 10 is 15 cm or more lower than the recorded maximum height information. .

The application execution unit 33 executes an application program stored in the storage unit 22 in accordance with a user instruction. This application program is, for example, a game program when the information processing apparatus 20 is a consumer game machine or the like. Further, when the information processing apparatus 20 is a general personal computer or the like, it may be a virtual reality application or the like that simulates the situation inside the building.

The application execution unit 33 uses the height characteristic information estimated by the estimation unit 32 to execute processing of an application to be executed.

Specifically, when executing an application that displays an image in a three-dimensional virtual space, the application execution unit 33 uses the height characteristic information estimated by the estimation unit 32 at the start of execution (during initialization processing). Thus, the initial position of the virtual viewpoint of the user in the virtual space (the initial position of the virtual camera when rendering the image) is set.

For example, when the length L ′ in the virtual space with respect to the length L in the real space is set to L ′ = α · L using the ratio α, the application execution unit 33 estimates the estimation unit 32. A virtual camera is set at a position of height H ′ = α · H corresponding to a value obtained by multiplying the height H of the user represented by the height feature information estimated by the ratio α.

In addition, during the processing, the application execution unit 33 determines the viewpoint position (virtual camera position) and field of view (virtual camera position) based on the amount of movement of the position of the HMD worn by the user and the amount of change in angle. Change the imaging direction and range). Further, when the user performs a predetermined operation (operation to reset the viewpoint), at least the height of the viewpoint (the height of the virtual camera from the virtual floor) is estimated by the estimation unit 32. It is set using information (the height H 'as described above), and the field of view is set to a predetermined direction and angle of view.

[Operation]
The information processing system according to the present embodiment has the above configuration and operates as follows.

When a user wears a head mounted display (HMD) included in the device 10 and starts an application program, the device 10 determines the floor surface of the user's feet and the distance from the floor surface to the user's head. Estimated and output as information related to the height of the user.

The information processing apparatus 20 performs the processing shown in FIG. 3, accepts information related to the height of the user output from the device 10 (S1), and estimates height characteristic information related to the height of the user wearing the HMD (S2). As an example, the information processing apparatus 20 records an estimation result of past height feature information, and among the values represented by the past height feature information, the maximum value is the height information of the user (in the standing position). And

The information processing apparatus 20 determines that the user is in the sitting position when the value represented by the user's height information output by the device 10 is 15 cm or more lower than the maximum recorded height value. If not, it is determined to be standing.

When it is determined that the user is standing, the information processing apparatus 20 outputs the value represented by the information related to the height of the user output from the device 10 as it is as the height characteristic information. Further, when the information processing apparatus 20 determines that the user is in the sitting position, the value represented by the information related to the height of the user output from the device 10 is multiplied by β using the predetermined ratio value β, and the multiplication is performed. The result is output as height characteristic information.

Further, the information processing apparatus 20 executes an application program stored in the storage unit 22 in accordance with a user instruction (S3). In the following example, it is assumed that this application program is a game program that operates in a virtual space by operating a character.

The information processing apparatus 20 uses the estimated height feature information at the start of execution of the game program (during initialization processing), and uses the estimated height feature information in the initial position of the user's virtual viewpoint (when rendering an image). The initial position of the virtual camera is set (S4).

Thereafter, the information processing apparatus 20 detects the amount of movement of the position of the HMD worn by the user and the amount of change in angle (this detection process can be performed using a widely known method, and detailed description thereof is omitted here). The viewpoint position (virtual camera position) and field of view (virtual camera imaging direction, imaging range) are changed based on the detected information (S5).

This allows the user to see the image of the virtual space from a viewpoint corresponding to the viewpoint from his actual height, and the uncomfortable feeling is reduced.

[Other examples]
Here, the initial position of the viewpoint in the virtual space is determined based on the estimated height feature information, but the present embodiment is not limited to this.

For example, the information processing apparatus 20 may perform the following process as an example of an application program process using the estimated height characteristic information. That is, the information processing apparatus 20 may vary the parameters of processing used by the application program according to the height characteristic information. In addition, when a plurality of types of processing can be selected, options (selection candidates) to be presented to the user may be presented to the user after narrowing down in advance according to the height characteristic information.

For example, when the application program is a game program, the difficulty level of the game (high probability of hit determination or high probability of being selected as an attack target from the enemy) is determined based on the estimated height characteristic information. May be. For example, the higher the actual height, the higher the difficulty level may be set.

In addition, when the game program is to select and use one of a plurality of predetermined scenarios, the scenario to be selected is determined based on the estimated height characteristic information. May be.

In another example, when a user arbitrarily selects a scenario from a plurality of scenarios, the type of scenario to be presented as the selection target may be determined based on the estimated height characteristic information. For example, the user A who is 150 cm tall is asked to select one of the prepared scenarios a, b, c, d, and e by presenting the scenarios a, b, and c. The user B who is 170 cm tall is asked to select one of the prepared scenarios a, b, c, d, e by presenting the scenario b, c, d, e. It may be. In this process, for example, information regarding the range of values represented by the height feature information may be associated as a condition to be presented as a selection candidate for each scenario. For example,
Scenario a: Height is less than 160 cm Scenario b: Height is 170 cm or less Scenario c: Height is between 140 cm and 180 cm Scenario d: Height is between 160 cm and 180 cm Scenario e: If the height is set to 160 cm or more, the above An example will be presented.

In this way, the story of the game and the selectable story are changed according to the measurement result at the time when the information related to the height is measured by wearing the HMD, and the content of the game is changed to the user. It will be changed by the height of the.

When executing an application program that displays a virtual character corresponding to the user in a virtual space, the body shape such as the height of the virtual character may be determined using the estimated height feature information. . When the user selects a virtual character, the selection candidates may be presented to the user after narrowing down using the estimated height characteristic information.

As an example, an application that reproduces the interior of a house to be sold in a virtual space and allows the user to virtually move the interior can be displayed by displaying a virtual character of the height corresponding to the height of the user. The user's convenience in the house can be examined.

As another example, when some recommendation (recommendation / recommendation) is performed in the processing of the application program, the information processing apparatus 20 recommends or recommends using the estimated height characteristic information in the recommendation processing. Target options and the like may be set.

For example, in an application program for selecting one of a plurality of game applications (such as an application program for displaying a game application sales site), the information processing apparatus 20 uses the estimated height characteristic information to select a recommended game application. You may choose.

Also, when changing virtual character costumes, weapons, and other items in game applications, and in application programs that access sites selling clothing, clothing, etc., recommend using the estimated height feature information. Items such as costumes to be selected and recommended clothing items may be selected and presented to the user.

Further, when processing is intermittently performed, for example, in the case of a game story, when saving the process progress information, the height characteristic information estimated at the time of starting the process related to the story is saved. Include in the information.

In this case, when the saved information (save information) is read and the process is continued, the information processing apparatus 20 is included in the read save information instead of the height characteristic information estimated at the time of the continuation of the process. The processing is continued using the height characteristic information. Thereby, in the process performed intermittently, the consistent process is attained.

For example, when a user who operates a character who adventures in a virtual space selects a scenario and starts a story, the information processing apparatus 20 uses the height characteristic information of the user estimated at that time to generate a virtual character. In the subsequent processing, for example, increase the probability of finding an item placed at a relatively high place, and reduce the discovery probability of an item placed relatively near the ground. Do.

After that, when the user temporarily stops the game and performs a save operation of information, the information processing apparatus 20 is necessary to execute the process from the continuation of the story according to the process of the game so far. Along with the parameter information, the height characteristic information of the user estimated at the start of the story is stored in the storage unit 22 as save information.

When the user instructs the continuation of processing, the information processing apparatus 20 reads the save information stored in the storage unit 22, and is recorded in the read save information, and the user's height characteristic information estimated at the start of the story Execute the process from the continuation of the story using.

In this way, even when the user starts the story in a standing position at the start of the story, for example, and resumes the story in the sitting position at the next timing, the height of the virtual character changes. The feeling of discomfort is reduced.

In yet another example, the information processing apparatus 20 may, when the generation of a random number is necessary for the process of the application program, as the information on the seed of the random number (seed), the user's height characteristic information estimated immediately before the process. May be used.

[unit]
In the examples so far, the estimated value is used as it is for the user's height characteristic information, but the present embodiment is not limited to this example. For example, the information processing apparatus 20 may output the user's height characteristic information as range information for every 10 cm. In this example, the information processing apparatus 20 outputs the user's height characteristic information as information representing which of the range information predetermined for every 10 cm.

Specifically, when the estimated value is 162 cm, the information processing apparatus 20 outputs range information that specifies a predetermined range of “160 cm or more and less than 170 cm” as the height characteristic information of the user. It is good to do.

Furthermore, this unit may be varied depending on the type of application program. For example, it may be set individually such as 10 cm for game applications and 5 cm for fitness application programs.

Also, it may be varied depending on the processing stage of the application program. For example, the processing may be set to be in units of 10 cm in the initialization process of the application program and in units of 5 cm in the subsequent processing.

[Expression Settings]
Furthermore, in the application program, the information processing apparatus 20 may change the setting of the expression content according to the estimated height characteristic information of the user when the contents of the expression of the information to be displayed can be set.

Specifically, for games that contain violent expressions or grotesque expressions (such as bloody expressions), a mode that suppresses violent expressions or does not perform grotesque expressions (first mode) and violence In some cases, a mode (second mode) in which grotesque expression is performed without suppressing typical expression can be set.

In this case, the information processing apparatus 20 sets the default display setting to the second mode when the value exceeds a predetermined threshold, for example, according to the value represented by the height characteristic information of the user, When the value represented by the height characteristic information falls below the predetermined threshold, the default display setting is set to the first mode.

[Example used for authentication]
Further, in an example of the present embodiment, the information processing apparatus 20 may authenticate the user with a user name and a password. In this case, the information processing apparatus 20 may record the height characteristic information estimated for the user for each authenticated user.

For example, when the height characteristic information is estimated for the authenticated user, the information processing apparatus 20 stores the estimated maximum value of the height characteristic information in association with information (such as a user name) that identifies the authenticated user. .

Then, after authenticating the user, a guidance such as “Please stand up after wearing the HMD” is displayed, and when the user stands up with the HMD attached according to the guidance, the device including the HMD at that time 10 estimates the height characteristic information based on the information related to the height of the user, and outputs the estimation result and the information on the result of the past estimation recorded in association with the information specifying the authenticated user. If the difference or ratio between the values represented by these pieces of information is within a predetermined range, processing continues as if authentication was successful. Then, it is also possible to perform processing such as presenting information to that effect and returning to the processing before authentication, or not permitting activation of a certain application program.

[Head circumference, etc.]
In addition, when the HMD is mounted on the head, when the belt is fastened and fixed to the head, the length of the range in which the fastened belt is fixed (the range wrapped around the head) is measured. The circumference of the user's head can be estimated. Therefore, the device 10 may output the information related to the circumference of the user's head instead of the information related to the height of the user or together with the information.

In this case, the information processing apparatus 20 acquires information about the circumference of the head instead of the information related to the height or together with the information related to the height, and instead of the height characteristic information of the user or along with the height characteristic information, The feature information of the circumference of the part may be estimated and used for the processing of the application program similar to the above.

Similarly, when the distance between the left eye and the right eye of the user wearing the HMD can be measured in the device 10, the information processing device 20 generates a physical feature amount based on the information on the distance, and the same application program as described above It may be used for the processing.

[Limitation of use of some information]
Further, depending on the setting of the device 10, it may be determined whether or not to output information on the height of the user and information on the angle of the user's head. For example, when it is set not to measure or output information related to the height of the user, the information processing apparatus 20 does not accept the information. Therefore, the information processing apparatus 20 in this case uses height characteristic information or the like that is previously determined as a default value.

DESCRIPTION OF SYMBOLS 10 Device, 20 Information processing apparatus, 21 Control part, 22 Storage part, 23 Operation part, 24 Display control part, 30 Display device, 31 Reception part, 32 Estimation part, 33 Application execution part, 40 Controller device.

Claims

A device that includes an apparatus worn by the user and that outputs information relating to the height of the user;
An information processing system including an information processing device,
The information processing apparatus includes:
Based on information acquired from the device, estimating means for estimating height characteristic information related to the height of the user wearing the apparatus according to the device;
Processing means for executing a predetermined process of an application to be executed using the estimated height characteristic information;
Including
The information processing system for executing processing at the time of initialization of the application using at least the height characteristic information.
Height characteristic information relating to the height of the user who wears an apparatus related to the device is connected to a device that outputs information related to the height of the user, including an apparatus worn by the user, based on information acquired from the device. Estimating means for estimating;
Processing means for executing a predetermined process of an application to be executed using the estimated height characteristic information;
Including
An information processing apparatus that executes processing at the time of initialization of the application using at least the height characteristic information.
The information processing apparatus according to claim 2,
The processing means is an information processing apparatus that presents a candidate for a process to be presented to the user after narrowing down using the height feature information when a plurality of candidates for the process are presented to the user for selection.
The information processing apparatus according to claim 2 or 3,
The information processing apparatus in which the processing means changes the content of expression of information to be displayed according to the height characteristic information.
Using an information processing device connected to a device that outputs information related to the height of the user, including a device worn by the user,
Estimating means based on information acquired from the device, estimating height characteristic information about the height of the user wearing the device related to the device;
A step of executing a predetermined process of an application to be executed using the estimated height characteristic information;
Including
An information processing method for executing processing at the time of initialization of the application using at least the height characteristic information.
In an information processing apparatus including a device worn by a user and connected to a device that outputs information related to the height of the user,
Based on information acquired from the device, estimating height characteristic information about the height of the user wearing the device according to the device; and
A step of executing a predetermined process of an application to be executed using the estimated height characteristic information; and
A program for executing a process at the time of initializing the application using at least the height characteristic information in the step of executing a predetermined process of the application.