JP7433847B2 - Program, information processing method, and information processing device - Google Patents

Description

The present disclosure relates to a program, an information processing method, and an information processing device.

In recent years, with the spread of technologies for creating virtual spaces such as VR (Virtual Reality), AR (Augmented Reality), and MR (Mixed Reality), the number of games that use virtual spaces has been increasing. (For example, see Patent Document 1).

JP 2017-144038 Publication

Conventional games that utilize virtual spaces such as VR provide a high sense of immersion in the video world and have the effect of increasing entertainment, but further improvements in entertainment for players are expected.

An object of the present disclosure is to provide a new mechanism that improves the entertainment value of a game that uses images in a virtual space.

According to one aspect of the present disclosure, an information processing device includes an analysis unit for analyzing information in a real space from photographed data, a reflection unit for reflecting the analyzed information on image data in a virtual space, and an image data in the virtual space. A program is provided for functioning as a display means for displaying the image data of the virtual space, and a progress control means for controlling the progress of the game according to the information reflected in the image data of the virtual space.

According to one aspect, it is possible to provide a new mechanism that improves the entertainment value of a game that uses images in virtual space.

FIG. 1 is a diagram illustrating an example of an information processing system according to an embodiment. FIG. 1 is a diagram illustrating an example of a hardware configuration of a mobile terminal according to an embodiment. FIG. 2 is a diagram illustrating an example of a hardware configuration of a server according to an embodiment. FIG. 1 is a diagram illustrating an example of a functional configuration of a mobile terminal according to an embodiment. FIG. 2 is a diagram illustrating an example of a functional configuration of a server according to an embodiment. FIG. 1 is a diagram illustrating an example of a processing outline of an information processing system according to an embodiment. FIG. 1 is a diagram illustrating an example of a processing outline of an information processing system according to an embodiment. It is a figure showing an example of the functional composition of a control part. FIG. 3 is a diagram illustrating an example of a functional configuration of a server control unit. It is a flow chart which shows an example of processing of S20 concerning one embodiment. It is a flow chart which shows an example of processing of S20 concerning one embodiment. It is a flow chart which shows an example of processing of S20 concerning one embodiment. It is a flow chart which shows an example of processing of S20 concerning one embodiment. 2 is a flowchart of an example of a game to which lighting determination processing according to an embodiment is applied. FIG. 3 is a screen image diagram of an example of a game to which lighting determination processing according to an embodiment is applied. 2 is a flowchart of an example of a game to which reflection characteristic determination processing according to an embodiment is applied. FIG. 3 is a screen image diagram of an example of a game to which reflection characteristic determination processing according to an embodiment is applied.

Hereinafter, embodiments for implementing the present disclosure will be described with reference to the drawings.

[Information processing system]
First, an information processing system 10 according to an embodiment will be described with reference to FIG. 1. The information processing system 10 according to one embodiment has a configuration in which mobile terminals 20a, 20b, and 20c and a server 30 are communicably connected via a network 40 such as the Internet or a LAN (local area network). Note that the mobile terminals 20a, 20b, and 20c are also collectively referred to as the "mobile terminal 20."

The mobile terminal 20 is an example of an information processing device operated by a user. The information processing device includes a mobile phone such as a smartphone with a photographing function, a portable game machine, a personal computer, a tablet terminal, a home game device, an arcade game device, and the like. The photographing function may be realized by a built-in camera or an external camera. The mobile terminal 20 receives operations from the user through a touch panel or the like, and performs information processing according to the operations. Note that the number of mobile terminals 20 is not limited to three, and may be other than three.

The server 30 is an example of an information processing device that implements various functions described below by transmitting and receiving data to and from the mobile terminal 20. The server 30 may be realized by a cloud computer. Note that the number of servers 30 shown in FIG. 1 is not limited to one, and distributed processing may be performed using two or more.

Although the information processing system 10 in FIG. 1 shows an example in which the server 30 is included, the server 30 may be omitted as long as the mobile terminal 20 can implement the various processes performed by the server 30. 40 may not be connected.

FIG. 2 is a diagram showing an example of the hardware configuration of the mobile terminal 20. The mobile terminal 20 includes a CPU (Central Processing Unit) 121, a storage device 122, a communication device 123, an input device 124, a display device 125, and a photographing device 126. CPU 121 controls mobile terminal 20 . The storage device 122 is, for example, a memory such as a ROM (Read Only Memory) or a RAM (Random Access Memory), or a storage such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive).

The communication device 123 is a communication device such as a network circuit that controls communication. The input device 124 is an input device such as a touch pad (position input device) of a touch panel, a camera, or a microphone. The display device 125 is an output device such as a touch panel display or a speaker. A touch panel is realized by combining a touch pad and a display. The photographing device 126 is a camera that photographs in response to user operations and outputs photographic data of real space.

FIG. 3 is a diagram showing an example of the hardware configuration of the server 30. The server 30 includes a CPU 131, a storage device 132, and a communication device 133. CPU 131 controls server 30 . The storage device 132 is, for example, a memory such as ROM or RAM, or a storage such as HDD or SSD. The communication device 133 is a communication device such as a network card that controls communication.

FIG. 4 is a diagram showing an example of the functional configuration of the mobile terminal 20. The mobile terminal 20 in FIG. 4 includes a storage section 21, a control section 22, an operation section 23, a display section 24, a terminal-side communication section 25, and a photographing section 26. The storage unit 21 stores a program 27, data used by the program 27, and the like. Note that the storage unit 21 may be realized by the storage device 122 or may be realized by a storage device connected via the network 40.

Returning to FIG. 4, the control unit 22 performs overall control of the mobile terminal 20. The control unit 22 is realized by the CPU 121 executing the processing described in the program 27. The operation unit 23 receives various user operations on the input device 124. The display unit 24 displays, for example, an image of a virtual space such as a game space on the display device 125. Note that the operation unit 23 is realized by the CPU 121 controlling the input device 124. Further, the display unit 24 is realized by the CPU 121 controlling the display device 125.

Images in virtual space are not limited to images in virtual reality, but also include images in augmented reality and mixed reality. The control unit 22 advances processing such as a game based on various operations received from the user. The display unit 24 displays an image of a virtual space generated by the control unit 22 as described below. The terminal side communication unit 25 communicates with the server 30. The terminal side communication unit 25 is realized by the CPU 121 controlling the communication device 123 according to the program 27.

FIG. 5 is a diagram showing an example of the functional configuration of the server 30. The server 30 in FIG. 5 includes a storage section 31, a server control section 32, and a server-side communication section 33. The storage unit 31 stores a server program 35, data used by the server program 35, and the like. Note that the storage unit 31 may be realized by the storage device 132 or may be realized by a storage device connected via the network 40.

Returning to FIG. 5, the server control unit 32 performs overall control of the server 30. The server control unit 32 is realized by the CPU 131 executing processing described in the server program 35. The server-side communication unit 33 communicates with the mobile terminal 20. The server-side communication unit 33 is realized by the CPU 131 executing the server program 35 and controlling the communication device 133 according to the server program 35.

[Outline of processing]
Hereinafter, an overview of the processing of the information processing system 10 according to one embodiment will be described using FIGS. 6 and 7. 6 and 7 are diagrams illustrating an example of a processing outline of an information processing system according to an embodiment. FIG. 6 shows an outline of processing realized by the mobile terminal 20. In the example of the information processing system 10 in FIG. 6, the server 30 may be omitted. FIG. 7 shows an outline of processing realized by the cooperation of the mobile terminal 20 and the server 30.

In step S10 of FIG. 6, a user operating the mobile terminal 20 such as a smart device photographs people, objects, lighting environments, etc. in the real space using the photographing unit 26. In step S20, the control unit 22 of the mobile terminal 20 analyzes real space information (movement and position of a person, movement of an object, lighting environment, reflection characteristics, elasticity, inertia, position, etc.) from the received photographic data. A process is performed to reflect the obtained information in the image data of the virtual space output by the display unit 24. In step S30, the display unit 24 outputs image data of the virtual space on which the information analyzed in step S20 is reflected.

Further, in step S10 of FIG. 7, the user operating the mobile terminal 20 such as a smart device photographs people, objects, lighting environments, etc. in the real space using the photographing unit 26. The mobile terminal 20 transmits the photographing data to the server 30.

In step S20, the server 30 analyzes real space information from the received photographic data, and performs processing to reflect the analyzed information in the virtual space image data output by the mobile terminal 20. The server 30 transmits virtual space image data reflecting the analyzed information to the mobile terminal 20. The mobile terminal 20 that has received the virtual space image data outputs the virtual space image data received from the server 30 in step S30.

Note that the processing outline of the information processing system 10 shown in FIGS. 6 and 7 is an example, and for example, the process of "analyzing information in the real space from photographic data and reflecting the analyzed information in the virtual space" in step S20 may be performed in a distributed manner between the mobile terminal 20 and the server 30.

In the case of the processing outline of the information processing system 10 shown in FIG. 6, the control unit 22 of the mobile terminal 20 has the functional configuration shown in FIG. 8, for example. FIG. 8 is a diagram showing an example of the functional configuration of the control section. The control section 22 in FIG. 8 includes an analysis section 50, a reflection section 52, and a progress control section 54. The analysis unit 50 analyzes real space information from the photographic data. The reflection unit 52 reflects the analyzed information on the image data of the virtual space output by the mobile terminal 20.

The progress control unit 54 controls the progress of a game that uses images in virtual space. The progress control unit 54 controls the progress of the game according to the information of the real space analyzed from the photographed data and reflected in the image data of the virtual space.

Furthermore, in the case of the processing overview of the information processing system 10 shown in FIG. 7, the server control unit 32 of the server 30 has the functional configuration shown in FIG. 9, for example. FIG. 9 is a diagram showing an example of the functional configuration of the server control section. The server control unit 32 in FIG. 9 includes an analysis unit 60, a reflection unit 62, and a progress control unit 64. The analysis section 60, the reflection section 62, and the progress control section 64 in FIG. 9 are the same as the analysis section 50, the reflection section 52, and the progress control section 54 in FIG. 8, so a description thereof will be omitted.

[Details of processing in step S20]
An example of the processing outline of the information processing system 10 shown in FIG. 7 will be described below.

FIG. 10 is a flowchart illustrating an example of the process of S20 according to an embodiment. FIG. 10 is an example of processing to analyze real space information from photographic data and reproduce the movement of people and objects, reflection characteristics, clothing, elasticity, inertia, position, lighting environment, etc. in virtual space.

In step S51, the server 30 performs a process of analyzing the state of the real space (movement and position of a person, movement of an object, reflection characteristics, elasticity, inertia or position, lighting environment, etc.) from the received photographic data. Proceeding to step S52, the server 30 performs the following processes (1) to (7) to reproduce the analysis results with objects such as characters and objects in the virtual space.

(1) Movement Reproduction Movement reproduction is the application of movement to an object such as a character in a virtual space in accordance with the result of photographing the real space. For example, information directly captured in real space (such as the movement of a person) is applied to the movement of an object such as a 3D model character in virtual space.

(2) Lighting Reproduction Lighting reproduction is the application of a lighting environment to an object such as a character in a virtual space according to the result of photographing a real space. For example, the lighting environment such as the brightness of the real space, the direction of light, and the condition of indirect lighting is applied as the lighting environment to an object such as a 3D model character in the virtual space.

(3) Reflection characteristic reproduction Reflection characteristic reproduction is the application of illumination reflection characteristics to an object such as a character in a virtual space according to the result of photographing the real space. For example, the way light is reflected, such as reflection from a chandelier or reflection from shiny cloth, is applied to an object such as a 3D model character. Furthermore, it is applied to express the "smoothness" or "roughness" of objects such as 3D model characters based on the surface material that can be measured from the reflection characteristics.

(4) Clothes Reproduction Clothes reproduction is the application of movement to the clothes of an object such as a character in a virtual space in accordance with the photographic result of the real space. For example, a video of a person wearing clothes is taken in real space, and information about the movement of the clothes obtained from the video is applied to the movement of the clothes in virtual space. For example, the differences in sway due to materials such as linen and silk, as well as the differences in sway due to the thickness and weight of cloth, are applied to the sway of clothes in virtual space.

(5) Elastic Reproduction Elastic reproduction is the application of elasticity to an object such as a character in a virtual space according to the result of photographing the real space. For example, by photographing a falling ball in real space and applying the way the ball falls, bounces, and swings obtained from the video to a weapon in virtual space, the behavior of a dropped weapon can be recreated. can. In addition, for example, by taking a picture of jelly shaking in real space and applying the way the jelly shakes obtained from that video to, for example, a plastic bottle in virtual space, it is possible to create a plastic bottle that shakes like jelly in virtual space. It can be reproduced with

(6) Inertial reproduction Inertial reproduction is the application of difficulty in movement to objects such as characters in virtual space according to the result of shooting in real space. For example, by photographing the movement of an object in real space and applying the difficulty of object movement obtained from the video to the movement of the object in virtual space, the difficulty of movement of the object in real space is reproduced with the object in virtual space. can. For example, by photographing the movement of a rotating object in real space and applying the difficulty of rotating the object obtained from the video to the movement of the object in virtual space, we can measure the difficulty of rotating the object in real space. can be reproduced with objects in virtual space.

(7) Position Reproduction Position reproduction is an application to the movement of the position of an object such as a character in a virtual space according to the result of photographing the real space. For example, by photographing a person or a ball moving in real space and applying the movement of the position of the person or ball obtained from the video to the movement of the position of an object such as a 3D model character in virtual space, it is possible to It is possible to reproduce the movement of the position of objects such as or balls using objects such as 3D model characters in virtual space.

FIG. 11 is a flowchart illustrating an example of the process of S20 according to an embodiment. FIG. 11 is an example of processing in which real space information is analyzed from photographic data and the movement of people and objects, clothing, elasticity, inertia, etc. are reapplied in virtual space.

In step S61, the server 30 performs a process of analyzing the state of the real space (movement of a person, movement of an object, elasticity, inertia, etc.) from the received photographic data. Proceeding to step S62, the server 30 performs the following processes (8) to (11) to reapply the analysis results in the virtual space.

(8) Motion reapplication Motion reapplication is the reapplication of motion to another object, such as another character, in the virtual space in accordance with the photographing result of the real space. For example, user A, who is bad at dancing, and user B, who is good at dancing, are each photographed dancing in real space. By correcting user A's dance movements obtained from the video with user B's dance movements, and then applying it to the movements of the 3D model character in virtual space, user A's individuality is preserved while user B's skill is improved. User A's dance movement corrected by the dance movement can be reproduced with a 3D model character or the like in a virtual space.

For example, when applied to a game of Ikki Tousen where a player character exhilaratingly defeats an enemy character (a so-called Musou game), a player A who is bad at the game and a player B who is good at the game are each photographed playing the game. Player A's play movements obtained from the video are corrected with Player B's play movements, and then applied to the movement of the player character in the virtual space to improve Player B's skillful play while preserving Player A's individuality. The movement of player A corrected by the movement can be reproduced with the player character in the virtual space.

(9) Clothes reapplication Clothes reapplication is reapplying the movement of clothes to another character in the virtual space according to the photographing result of the real space. For example, the movement (sway) of user A's clothing and the movement of user B are each photographed in real space. By applying the movement characteristics of user A's clothes obtained from the video and the movements of user B to the 3D model character in the virtual space, the movement of the clothes of the 3D model character in the virtual space that moves in accordance with user B, This can be reproduced using the movement characteristics of user A's clothes.

(10) Re-application of elasticity Re-application of elasticity is re-application of elasticity to another object such as another character in the virtual space according to the photographing result of the real space. For example, images of both a falling iron ball and a jelly are shot in real space. By applying the movement of the iron ball and the jelly obtained from the video to the iron ball object in virtual space, it is possible to reproduce a falling iron ball shaking like jelly in virtual space. Further, by applying, for example, the movement of a person and the movement of a jelly obtained from a video to a 3D model character in a virtual space, a 3D model character that moves while shaking like a jelly can be reproduced in the virtual space.

(11) Re-application of inertia Re-application of inertia is re-applying the difficulty of movement to another object such as another character in the virtual space in accordance with the photographing result of the real space. For example, by photographing the movement of object A and object B in real space and applying the difficulty of movement of object A obtained from the video to the movement of object B in virtual space, the movement of object A in real space can be calculated. The difficulty can be reproduced using object B in virtual space. Furthermore, for example, by applying the movements of a monster and the movements of a person obtained from a video to a 3D model character in a virtual space, a 3D model character of a person that moves like a monster can be reproduced in the virtual space.

FIG. 12 is a flowchart illustrating an example of the process of S20 according to an embodiment. FIG. 12 is an example in which a position pointed to by a person or object in real space is detected from photographic data, and a 3D model character or the like in virtual space performs UI selection processing based on the detection result.

In step S71, the server 30 performs a process of analyzing the state of the real space (the position of a person's fingertip, the position of the tip of a pointing stick held by a person, etc.) from the received photographic data. Proceeding to step S72, the server 30 performs the following processes (12) and (13) to apply the analysis result to UI selection in the virtual space.

(12) UI selection (single)
UI selection (single) applies to a single UI selection by a character in the virtual space according to the photographing result in the real space. For example, the position of a part of a person's body (such as a fingertip) or a part of an object held by a person (such as a tip) photographed in real space is detected from a video image, and the detected position is set as the display position of a pointer in virtual space, for example. By applying this method, it is possible to select a single UI by a 3D model character in a virtual space by moving a person's fingertip in a real space.

(13) UI selection (multiple)
UI selection (plurality) is applied to a plurality of UI selections by a character in the virtual space according to the photographing result of the real space. For example, the movement of a part of a person's body (such as a fingertip) or a part of an object held by a person (such as a tip) photographed in real space is detected from a video image, and the movement of the detected position is transferred to a pointer in virtual space, for example. By applying this method to range selection, it is possible to select multiple UIs using a 3D model character in virtual space by moving a person's fingertip in real space.

FIG. 13 is a flowchart illustrating an example of the process of S20 according to an embodiment. FIG. 13 is an example of processing in which the analysis results of photographic data are applied to determination and motion correction in virtual space.

In step S81, the server 30 performs processing to analyze the state of the real space (movement and position of people and objects, lighting environment, reflection characteristics, etc.) from the photographic data. Proceeding to step S82, the server 30 performs the following processes (14) to (18) to apply the analysis result to determination or motion correction in the virtual space.

(14) Position Determination Position determination is applied to determination based on the position of an object such as a character in a virtual space according to the result of photographing the real space. For example, position determination can be used to advance a game based on the position of an object such as a character in a virtual space according to the result of photographing the real space. For example, by photographing the movement of a user in real space while instructing them to move a little further to the left, etc., and moving objects such as characters in virtual space in conjunction with the movement of the user in real space, the floor of virtual space can be An example of the process is to turn on a switch and proceed with the game.

(15) Collision Determination Collision determination is applied to determination based on collision between objects such as characters in a virtual space according to the result of photographing the real space. For example, in the collision determination, collisions between objects such as characters in the virtual space according to the photographed results of the real space can be used to advance the game. For example, by filming an object being thrown in real space and applying the movement of the object obtained from the video to an object such as a 3D model character in virtual space, it can collide with another object such as a 3D model character that is not in real space. An example of this is processing to advance the game.

(16) Illumination Judgment Illumination judgment is applied to judgment based on the lighting environment according to the result of photographing the real space. For example, an example of lighting determination may be a process in which the lighting environment in the virtual space is changed to a specified lighting environment by applying the lighting environment according to the photographing result of the real space to the virtual space, and the game progresses. Note that an application example of the above-described lighting determination to a game will be described later.

(17) Reflection Characteristic Determination Reflection characteristic determination is applied to determining the specificity of illumination reflection on objects such as characters in virtual space according to the photographing results of real space. For example, to determine reflection characteristics, there is a "dull mirror" in virtual space, and an object such as a sparkling mirror or a polished metal ball in real space is photographed and applied to the "dull mirror" in virtual space to make it sparkle. An example of processing that advances the game by changing it into a mirror can be considered. Note that an example of application of the above-mentioned reflection characteristic determination to a game will be described later.

(18) Motion Correction Motion correction is an application to correcting the movement of a character in a virtual space in accordance with the result of photographing the real space. For example, in motion correction, when a character in a virtual space reproduces the player's punching movement photographed in the real space, the player's punching movement is corrected using the punching movement of a professional boxer or the like.

[Example of application of lighting judgment to games]
FIG. 14 is a flowchart of an example of a game to which the lighting determination process according to the embodiment is applied. FIG. 15 is a screen image diagram of an example of a game to which the lighting determination process according to the embodiment is applied. FIGS. 14 and 15 show an example of a game in which a hidden object is discovered by applying the lighting environment of the real space to a virtual space covered in darkness, and the game progresses using the hidden object.

In step S100, the mobile terminal 20 displays a screen 1000 as shown in FIG. 15(A), for example. A screen 1000 in FIG. 15A represents an example in which the illuminance of the virtual space 1002 is low and the user cannot recognize objects (door 1008, key 1010, etc.) existing in the virtual space 1002.

The screen 1000 also includes a "change lighting environment" button 1004 that accepts the user's selection of an operation to change the lighting environment of the virtual space 1002 from among multiple options, and a A "Change reflection characteristics" button 1006 is provided to accept from the user a selection of an operation for changing the reflection characteristics.

When the "change lighting environment" button 1004, which accepts a user's selection of an operation for changing the lighting environment of the virtual space 1002, is pressed, the mobile terminal 20 proceeds to step S104 following step S102, and changes the lighting environment according to the user's operation. The photographing device 126 is activated so that the space can be photographed. A user photographs a real space with high illuminance, such as a surrounding landscape.

The photographed data of the real space is transmitted to the server 30. The server 30 proceeds to step S106, and analyzes the illumination environment (illuminance, direction of light, color, etc.) of the real space by calculation from the received photographic data of the real space. Note that existing technology may be used for the process of calculating the illumination environment of the real space from the photographic data of the real space.

Proceeding to step S108, the server 30 reapplies (reflects) the analyzed lighting environment of the real space to the image data of the virtual space 1002. Proceeding to step S110, the server 30 determines whether the illuminance of the objects (door 1008, key 1010) existing in the virtual space 1002 is within a certain range that allows the user to recognize the objects.

If the illuminance of an object existing in the virtual space 1002 is within a certain range that allows the user to recognize the object, the server 30 causes the mobile terminal 20 to display a screen 1000 as shown in FIG. 15(B), for example. The image data of the virtual space 1002 is transmitted, and the process proceeds to step S112.

A screen 1000 in FIG. 15B represents an example in which the illuminance of the virtual space 1002 is high and the user can recognize objects (door 1008, key 1010, etc.) existing in the virtual space 1002. The door 1008 and the key 1010 are examples of objects that the user uses to advance the game.

In step S112, the user can recognize the door 1008 and the key 1010 that are present on the screen 1000 of FIG. can proceed.

In this way, in a game to which the lighting determination process according to the embodiment is applied, the lighting environment of the real space can be applied to the virtual space 1002, so a new method that improves the entertainment value of the game that uses images of the virtual space 1002 can be created. We can provide a mechanism.

[Example of application of reflection characteristic judgment to games]
FIG. 16 is a flowchart of an example of a game to which reflection characteristic determination processing according to an embodiment is applied. FIG. 17 is a screen image diagram of an example of a game to which reflection characteristic determination processing according to an embodiment is applied. Figures 16 and 17 show that by applying the reflection characteristics of metals with strong specular reflection characteristics existing in the real world to objects with weak reflection characteristics existing in virtual space, the light hitting the object is reflected. This shows an example of a game that uses light to progress.

In step S200, the mobile terminal 20 displays a screen 2000 as shown in FIG. 17(A), for example. A screen 2000 in FIG. 17A shows an example in which the reflection characteristics of a mirror object 2008 existing in a virtual space 2002 are weak, for example because the mirror is dull, and the light 2012 hitting the object 2008 cannot be reflected. There is.

The screen 2000 also includes a "Change lighting environment" button 2004 that accepts the user's selection of an operation to change the lighting environment of the virtual space 1002 from among multiple options, and a A “change reflection characteristics” button 2006 is provided to accept a selection of an operation for changing reflection characteristics from the user.

When the "change reflection characteristics" button 2006, which accepts from the user a selection of an operation for changing the reflection characteristics of an object existing in the virtual space 2002, is pressed, the mobile terminal 20 proceeds to step S204 following step S202, The photographing device 126 is activated to photograph the real space in response to the user's operation. Users photograph objects in real space that have strong reflective properties, such as polished metal balls or mirrors.

The photographed data of the real space is transmitted to the server 30. The server 30 proceeds to step S206, and analyzes the reflection characteristics of objects in the real space by calculation from the received photographic data of the real space. Note that the process of calculating and analyzing the reflection characteristics of objects in real space from shooting data in real space uses existing technology, such as technology that uses machine learning to estimate surface materials from shooting data. It is sufficient to adopt the reflection characteristics of the surface material.

Proceeding to step S208, the server 30 reapplies (reflects) the analyzed reflection characteristics of the object in the real space to the mirror object 2008 existing in the image data of the virtual space 2002. Proceeding to step S210, the server 30 determines whether the reflection characteristic (reflectance) of the mirror object 2008 existing in the virtual space 1002 has a certain reflection characteristic that can reflect the light 2012.

If the mirror object 2008 existing in the virtual space 2002 has a certain reflection characteristic that can reflect the light 2012, the server 30 displays a screen on the mobile terminal 20, for example, as shown in FIG. 17(B). The image data of the virtual space 2002 for displaying the virtual space 2000 is transmitted, and the process proceeds to step S212.

In the screen 2000 of FIG. 17(B), the reflection characteristics of the mirror object 2008 existing in the virtual space 2002 change from a dull state to a polished state, and the light 2012 hitting the mirror object 2008 becomes more intense. This shows an example of reflection. An example is shown in which the light 2012 reflected by the mirror object 2008 passes through the ring of the object 2010. Objects 2008 and 2010 are examples of objects that the user uses to progress the game.

In step S212, the user can change the reflection characteristics of the mirror object 2008 that exists on the screen 2000 of FIG. You can progress through the game by completing tasks such as passing through objects or illuminating other objects.

In this way, in a game to which the reflection characteristic determination process according to the embodiment is applied, the reflection characteristics of an object in the real space can be applied to the object 2008 in the virtual space 2002. It is possible to provide a new mechanism to improve the entertainment quality of

The information processing system 10, mobile terminal 20, and server 30 according to the disclosed embodiment should be considered to be illustrative and not restrictive. The embodiments described above can be modified and improved in various ways without departing from the scope and spirit of the appended claims. Moreover, the matters described in the plurality of embodiments described above can be adopted in other configurations within a consistent range, and can be combined within a consistent range.

Further, the information processing system 10 according to the disclosed embodiment can be applied to games of various genres, such as a mystery-solving scene in an adventure game such as an escape game, and a task-clearing scene in a role-playing game.

According to the present disclosure, information in the real space can be analyzed from photographic data photographed by the mobile terminal 20 such as a smart device, and the analyzed information can be reflected (transcribed) in the virtual space. For example, by providing a new mechanism that can easily reproduce the conditions of real space (movement, lighting environment, reflection characteristics, elasticity, inertia, position, etc.) in virtual space, it can enrich the experience of a wide range of users.

10 Information processing system 20 Mobile terminal 21 Storage unit 22 Control unit 23 Operation unit 24 Display unit 25 Terminal side communication unit 26 Photographing unit 27 Program 30 Server 31 Storage unit 32 Server control unit 33 Server side communication unit 35 Server program 40 Network 50, 60 Analysis section 52, 62 Reflection section 54, 64 Progress control section 1002, 2002 Virtual space 1008 Door object 1010 Key object 2008 Mirror object 2010 Ring-shaped object

Claims (6)

information processing equipment,
Analysis means for analyzing real space information from photographic data,
a reflection means for reflecting the analyzed information on image data of the virtual space;
display means for displaying image data of the virtual space;
functioning as a progress control means for controlling the progress of the game according to the information reflected in the image data of the virtual space ;
The analysis means calculates the lighting environment of the real space from the photographic data,
The reflecting means applies the calculated lighting environment to the image data of the virtual space,
The progress control means controls the progress of the game according to the lighting environment applied to the image data of the virtual space,
The information processing device is further caused to function as an operation means for accepting from a user a selection of an operation for applying the illumination environment of the real space calculated from the photographic data to the illumination environment of the virtual space from among a plurality of options. A program for information processing equipment,
Analysis means for analyzing real space information from photographic data,
a reflection means for reflecting the analyzed information on image data of the virtual space;
display means for displaying image data of the virtual space;
functioning as a progress control means for controlling the progress of the game according to the information reflected in the image data of the virtual space ;
The analysis means calculates reflection characteristics of the real space from the photographic data,
The reflection means applies the calculated reflection characteristic to an object included in the image data of the virtual space,
The progress control means controls the progress of the game according to the reflection characteristic applied to the object included in the image data of the virtual space,
Operating means for operating the information processing device to accept from a user a selection of an operation for providing the reflection characteristic of the real space calculated from the photographic data to the object included in the image data of the virtual space, from among a plurality of options. A program to further function as a . The information processing device
an analysis step for analyzing real space information from the photographic data;
a reflection step of reflecting the analyzed information on image data of the virtual space;
a display step of displaying image data of the virtual space;
a progress control step of controlling the progress of the game according to the information reflected in the image data of the virtual space ;
The analysis step calculates the lighting environment of the real space from the photographic data,
The reflecting step applies the calculated lighting environment to the image data of the virtual space,
The progress control step controls the progress of the game according to the lighting environment applied to the image data of the virtual space,
The information processing device
further performing an operation step of accepting from a user a selection of an operation for applying the illumination environment of the real space calculated from the photographic data to the illumination environment of the virtual space from among the plurality of options ;
Information processing method. an analysis means for analyzing real space information from photographic data;
a reflection means for reflecting the analyzed information on image data of a virtual space;
Display means for displaying image data of the virtual space;
a progress control means for controlling the progress of the game according to the information reflected in the image data of the virtual space;
has
The analysis means calculates the lighting environment of the real space from the photographic data,
The reflecting means applies the calculated lighting environment to the image data of the virtual space,
The progress control means controls the progress of the game according to the lighting environment applied to the image data of the virtual space,
further comprising an operation means for accepting from a user a selection of an operation for applying the illumination environment of the real space calculated from the photographic data to the illumination environment of the virtual space from among a plurality of options;
Information processing device. The information processing device
an analysis step for analyzing real space information from the photographic data;
a reflection step of reflecting the analyzed information on image data of the virtual space;
a display step of displaying image data of the virtual space;
a progress control step of controlling the progress of the game according to the information reflected in the image data of the virtual space ;
The analysis step calculates reflection characteristics of real space from the photographic data,
The reflecting step applies the calculated reflection characteristic to an object included in the image data of the virtual space,
The progress control step controls the progress of the game according to the reflection characteristics applied to the object included in the image data of the virtual space,
The information processing device
further performing an operation step of accepting from a user a selection of an operation for providing the object included in the image data of the virtual space with the reflection characteristic of the real space calculated from the photographic data, from among a plurality of options ;
Information processing method. an analysis means for analyzing real space information from photographic data;
a reflection means for reflecting the analyzed information on image data of a virtual space;
Display means for displaying image data of the virtual space;
a progress control means for controlling the progress of the game according to the information reflected in the image data of the virtual space;
has
The analysis means calculates reflection characteristics of the real space from the photographic data,
The reflection means applies the calculated reflection characteristic to an object included in the image data of the virtual space,
The progress control means controls the progress of the game according to the reflection characteristic applied to the object included in the image data of the virtual space,
further comprising an operation means for accepting from a user a selection of an operation for providing the object included in the image data of the virtual space with the reflection characteristic of the real space calculated from the photographic data, from among a plurality of options;
Information processing device.

Images