JP7302945B2 - Information processing device, information processing method and information processing program - Google Patents

Description

The present invention relates to an information processing device, an information processing method, and an information processing program.

Conventionally, HMDs (Head Mounted Devices) that cover the user's field of vision and provide images in virtual reality (VR) space based on binocular parallax have been used to cover the visual field and non-visual field other than the gaze area in the virtual space. Techniques for distributing content have been provided. For example, there is known a technique for distributing advertising content even in non-viewable areas.

Japanese Patent No. 5961736

However, the conventional technology described above cannot always improve the appealing effect of content. For example, the conventional technology described above only distributes advertising content to the non-visual area, and does not necessarily improve the appealing effect of the content.

The present application has been made in view of the above, and an object thereof is to provide an information processing apparatus, an information processing method, and an information processing program capable of improving the appealing effect of content.

An information processing apparatus according to the present application includes an acquisition unit that acquires reaction information about a user's reaction to a change in the virtual space, which is a reaction of a user experiencing a virtual space formed by an image, and acquisition by the acquisition unit. and an output unit for outputting the content based on the received reaction information.

According to one aspect of the embodiment, it is possible to improve the appealing effect of content.

FIG. 1 is a diagram illustrating an example of output processing executed by an information processing apparatus according to an embodiment; FIG. 2 is a diagram illustrating a configuration example of an information processing apparatus according to the embodiment; FIG. 3 is a diagram illustrating an example of a VR space component information storage unit according to the embodiment; 4 is a diagram illustrating an example of an advertising object storage unit according to the embodiment; FIG. FIG. 5 is a flowchart illustrating an example of the flow of output processing executed by the information processing apparatus according to the embodiment; FIG. 6 is a diagram illustrating an example of output processing executed by an information processing apparatus according to a modification; FIG. 7 is a diagram illustrating an example of an advertising object storage unit according to a modification; FIG. 8 is a diagram illustrating an example of output processing performed by an information processing apparatus according to a modification; FIG. 9 is a diagram illustrating an example of an advertising object storage unit according to a modification; FIG. 10 is a hardware configuration diagram showing an example of a computer that implements the functions of the information processing apparatus.

Hereinafter, modes for carrying out an information processing apparatus, an information processing method, and an information processing program according to the present application (hereinafter referred to as "embodiments") will be described in detail with reference to the drawings. The information processing apparatus, information processing method, and information processing program according to the present application are not limited to this embodiment. Further, each embodiment can be appropriately combined within a range that does not contradict the processing contents. Also, in each of the following embodiments, the same parts are denoted by the same reference numerals, and overlapping descriptions are omitted.

[1. Example of output processing indicated by information processing apparatus]
An example of output processing executed by the information processing apparatus according to the embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating an example of output processing executed by an information processing apparatus according to an embodiment; FIG. 1 shows an example in which an information processing apparatus 100 executes output processing.

As shown in FIG. 1 , the information processing system 1 includes an advertiser terminal 10 , an HMD 20 and an information processing device 100 . The advertiser terminal 10, the HMD 20, and the information processing device 100 are communicably connected by wire or wirelessly via a predetermined communication network (not shown). The information processing system 1 shown in FIG. 1 may include multiple advertiser terminals 10 , multiple HMDs 20 , and multiple information processing apparatuses 100 .

The advertiser terminal 10 is an information processing device used by advertisers. For example, the advertiser terminal 10 is a desktop PC (Personal Computer), a notebook PC, a tablet terminal, a mobile phone, a PDA (Personal Digital Assistant), or the like. Also, the advertiser terminal 10 submits an advertisement object to the information processing apparatus 100 according to an operation by the advertiser.

Note that the advertiser may request an agency to submit the advertisement object. In this case, the agency submits the advertisement object to the information processing apparatus 100 . Hereinafter, the notation "advertiser" is a concept that includes not only the advertiser but also the agency, and the notation "advertiser terminal" refers not only to the advertiser terminal 10 but also to the agency device used by the agency. It shall be a concept that includes

The HMD 20 is a wearable device worn by the user, and displays various images such as still images and moving images output from the information processing apparatus 100 within the field of view of the user. As a result, the HMD 20 provides the user with the sensation of living in the VR space, allowing the user to experience the VR space. The HMD 20 may also have a function of outputting audio, background music (BGM), etc. output from the information processing apparatus 100 .

For example, the HMD 20 provides the user with a VR space video that is a combination of the VR space video, audio, and BGM output by the information processing apparatus 100 . Also, for example, when the orientation of the user is changed, the HMD 20 provides the user with an image in the VR space corresponding to the orientation changed by the user. The processing of the HMD 20 can be realized, for example, by various well-known techniques related to automatic deformation of 3D (Dimension) models and various well-known techniques related to rendering of 3D models.

The information processing device 100 is an information processing device that outputs video in a VR space to the HMD 20, and is realized by, for example, a server device, a cloud system, a game machine, and the like. Specifically, the information processing apparatus 100 outputs an image including an advertisement object in the VR space to the HMD 20 based on the user's reaction to a predetermined object in the VR space.

An example of an advertisement object output process by the information processing apparatus 100 will be described below along the flow with reference to FIG. 1 .

First, as shown in FIG. 1, the advertiser terminal 10 submits an advertisement object to the information processing device 100 according to the advertiser's operation (step S1). For example, suppose an advertiser is a retailer that specializes in flowers. In this case, the advertiser terminal 10 submits a coupon or the like regarding the price of the bouquet as an advertisement object.

The information processing apparatus 100 outputs the video of the VR space VR1 to the HMD 20 when the HMD 20 requests acquisition of the video of the VR space (step S2). Thereby, the HMD 20 allows the user to experience a VR space VR1 in which, for example, video, audio, and BGM in the VR space VR1 based on binocular parallax are combined. In the example of FIG. 1, the user experiences the sensation of walking along a tree-lined street with large trees planted on both sides of the path.

Subsequently, the flower object OD1 appears as a change in the VR space, and the user visually recognizes the flower object OD1 while looking back (step S3). In this case, the information processing device 100 changes the video in the VR space VR1 output to the HMD 20 . For example, the information processing apparatus 100 causes a flower object OD1 to appear as a change in the VR space, and visually recognizes the flower object OD1 as the user turns around. Further, for example, as shown in FIG. 1, when the user suddenly turns around, the HMD 20 switches the image of the VR space VR1, and the background changes to a path with grasslands on both sides of the road. Experience the feeling of walking. Then, while the user is walking along the path, the user visually recognizes the flower object OD1 that suddenly appears on the side of the path. Here, it is assumed that the user perceives the appearance of the flower object OD1 as a change in the VR space VR1, visually recognizes the flower object OD1 as the user turns around, and reacts to the flower object OD1. . In this case, the HMD 20 transmits the action of the user looking back toward the flower object OD1 to the information processing apparatus 100 as reaction information regarding the user's reaction. As a result, the information processing apparatus 100 acquires from the HMD 20 the reaction information about the user's reaction to the flower object OD1 by the user in the VR space VR1 (step S4).

Subsequently, the information processing apparatus 100 outputs the video of the VR space VR2 including the advertising object C1 in the VR space to the HMD 20 based on the user's reaction (step S5). For example, it is assumed that an advertisement object C1 related to the action of turning around the flower object OD1 that has appeared in the VR space by the user is a coupon related to a bouquet. In this case, the information processing apparatus 100 outputs to the HMD 20 the image of the VR space VR2 including the coupon "Bouquet is 10% off now!" do. The HMD 20 then provides the user with an image of the VR space VR2 including the advertisement object C1. As a result, the HMD 20 allows the user to re-experience the VR space VR2 in which, for example, video, audio, and BGM in the VR space VR2 based on binocular parallax are combined. In this case, in the example of FIG. 1, the user sees a coupon C1 relating to a bouquet of flowers displayed beside a path whose background is overgrown with grass on both sides of the road.

As described above, the information processing apparatus 100 according to the embodiment acquires the user's reaction information to changes in the VR space VR1, and based on the reaction information, displays the image of the VR space VR2 including the advertising object C1 in the VR space. to output Thereby, the information processing apparatus 100 according to the embodiment can improve the appealing effect of the advertisement object. To explain using the example of FIG. 1, it is conceivable that the appealing effect of the content can be efficiently improved by providing an advertisement object related to the user's action of turning to the flower object OD1. As a result, the information processing apparatus 100 outputs the video of the VR space including the advertisement object related to the action performed by the user in response to the change in the VR space. Therefore, it is possible to infer from the reaction information the user's gazing action with respect to the object in the VR space or the action of showing interest in turning around to the object. The appealing effect of the included content can be enhanced.

[2. Configuration of Information Processing Device]
Next, the configuration of the information processing apparatus 100 according to the embodiment will be described using FIG. FIG. 2 is a diagram illustrating a configuration example of the information processing apparatus 100 according to the embodiment. As shown in FIG. 2, the information processing apparatus 100 has a communication section 110, a storage section 120, and a control section .

(Regarding communication unit 110)
The communication unit 110 is realized by, for example, a NIC (Network Interface Card) or the like. The communication unit 110 is connected to a network by wire or wirelessly, and transmits and receives information between the advertiser terminal 10 and the HMD 20 .

(Regarding storage unit 120)
The storage unit 120 is realized by, for example, a semiconductor memory device such as a RAM (Random Access Memory) or flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 120 has a VR space component information storage unit 121 and an advertising object storage unit 122 .

(Regarding the VR space component information storage unit 121)
The VR space component information storage unit 121 according to the embodiment stores information about various objects displayed in the VR space. Here, FIG. 3 shows an example of the VR space component information storage unit 121 according to the embodiment. In the example shown in FIG. 3, the VR space component information storage unit 121 has items such as "VR space component ID (Identifier)", "background information", "object information", and "object placement position information".

“VR space component ID” is an identifier that identifies a VR space component. “Background information” is information about the background of the VR space associated with the “VR space component ID”. "Object information" is information about an object associated with the "VR space component ID", and is information such as the shape and texture of the object. "Object placement position information" is information about the position in the VR space where the object associated with the "VR space component ID" is placed. For example, in FIG. 3, 'E1' identified by the VR space component ID has background information of 'path', object information of 'flower object', and object placement position information of 'OP1'.

Note that the VR space component information storage unit 121 may store various types of information for realizing the VR space, not limited to the above. For example, the VR space component information storage unit 121 may store audio, BGM, video data, and the like for realizing the VR space.

(Regarding the advertisement object storage unit 122)
The advertising object storage unit 122 according to the embodiment stores advertising objects submitted by advertisers. Here, FIG. 4 shows an example of the advertising object storage unit 122 according to the embodiment. In the example shown in FIG. 4, the advertising object storage unit 122 has items such as "advertiser ID", "advertising object", "user's part", and "user's action".

"Advertiser ID" indicates identification information for identifying an advertiser. "Advertising object" indicates an advertising object submitted by an advertiser. "User's part" indicates the part of the user's body set by the advertiser. Also, the "user's body part" is a predetermined condition set by the advertiser, and when it is determined that the predetermined condition is satisfied by moving the "user's body part", the VR space including the advertisement object is output. be done. "User action" indicates the user action set by the advertiser. Also, the "user's action" is a predetermined condition set by the advertiser, and when it is determined that the "user's action" is satisfied as the predetermined condition, the VR space including the advertisement object is output. For example, in FIG. 4, the advertisement object "coupon about bouquet" submitted by "CL1" identified by the advertiser ID indicates the user's body part "head" set by "CL1". It also shows the user action "look back" set by "CL1" identified by the advertiser ID.

Note that the advertisement object storage unit 122 may store various information related to conditions set by the advertiser, not limited to the above. For example, the advertisement object storage unit 122 may store objects, changes in the VR space, user reaction timings, user reactions, and the like. This point will be described in detail in a modified example.

(Regarding the control unit 130)
The control unit 130 is a controller, and for example, various programs (information processing programs) stored in a storage device inside the information processing apparatus 100 are controlled by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like. (equivalent to one example) is implemented by executing the RAM as a work area. Also, the control unit 130 is a controller, and is implemented by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

As shown in FIG. 2, the control unit 130 includes a manuscript reception unit 131, an acquisition unit 132, and an output unit 133, and implements or executes information processing functions and actions described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 2, and may be another configuration as long as it performs the information processing described later. Moreover, the connection relationship between the processing units of the control unit 130 is not limited to the connection relationship shown in FIG. 2, and may be another connection relationship.

(Regarding the manuscript receiving unit 131)
The submitted manuscript reception unit 131 receives a submitted advertisement object from the advertiser terminal 10 . Specifically, the submission reception unit 131 receives submission of an advertisement object from the advertiser terminal 10 and stores the advertisement object in the advertisement object storage unit 122 . Also, the submission reception unit 131 receives predetermined conditions set by the advertiser, and stores the predetermined conditions in the advertisement object storage unit 122 . Specifically, the submission reception unit 131 receives a user's body part, a user's motion, and the like as predetermined conditions, and stores the predetermined conditions in the advertisement object storage unit 122 .

(Regarding the acquisition unit 132)
The acquisition unit 132 acquires reaction information about a user's reaction to a change in the VR space, which is a user's reaction to experiencing a virtual space (corresponding to a VR space) formed by video. Specifically, the acquisition unit 132 acquires from the HMD 20 the user's reaction to the change in the VR space provided by the HMD 20 as reaction information. For example, assume that the user visually recognizes a flower object while turning around. In this case, the acquisition unit 132 acquires from the HMD 20 the reaction information regarding the action performed by the user on the flower object in the VR space based on the reaction information regarding the user's action transmitted from the HMD 20 .

Moreover, the user's reaction here includes a dynamic reaction and a static reaction. A dynamic reaction is a reaction accompanied by action, such as a joyful reaction with a short run, a surprised reaction with the movement of raising both hands, a frustrating reaction with the foot repeatedly stamping on the ground, and a happy reaction with the movement of raising one hand. show reactions with behaviors that express emotions, including emotions. On the other hand, a static reaction is a reaction that does not involve any action, such as an angry reaction with a ghastly expression on the user's face, a sad reaction with a distorted expression on the user's face, and a smiling expression on the user's face. It shows a change in facial expression accompanied by emotions including emotions such as a happy reaction and a surprised reaction where the user's facial expression disappears.

Note that the processing of the acquisition unit 132 includes, for example, various well-known technologies such as sensors that detect that the user is staring at an object for a predetermined time, and various sensors that read facial expressions and actions by attaching sensors to parts of the user's body. and various peripheral technologies for distinguishing whether the user is calm or panicked by measuring the user's heart rate.

(Regarding the output unit 133)
The output unit 133 outputs content (corresponding to an advertisement object) based on the reaction information acquired by the acquisition unit 132 . Specifically, based on the VR space component information storage unit 121, the output unit 133 corresponds to the user's field of view in the VR space according to the change in orientation caused by the user's operation, the arrangement position of various objects, and the like. Images are output to the HMD 20 . Moreover, specifically, the output unit 133 stores the advertisement object in the advertisement object storage unit 122 when the reaction information acquired by the acquisition unit 132 satisfies a predetermined condition to be stored in the advertisement object storage unit 122 . Outputs the video of the VR space including

More specifically, in the example of FIG. 1, the output unit 133 outputs an image in the VR space when both the user's body part and the user's motion, which are predetermined conditions stored in the advertisement object storage unit 122, are satisfied. An image of the VR space VR2 in which the coupon related to the bouquet stored in the advertising object storage unit 122 is displayed instead of the predetermined object is output to the HMD20. For example, assume that the user performs an action of looking back. In this case, the output unit 133 determines that both the user's body part and the user's motion are satisfied as the predetermined condition by the user's turning motion. Then, the output unit 133 outputs to the HMD 20 an image of the VR space VR2 in which the coupon C1 related to the bouquet stored in the advertisement object storage unit 122 is displayed instead of the flower object OD1 in the VR space VR1. In addition, the output unit 133 appropriately changes the VR space and outputs the video in the VR space to the HMD 20 . For example, in the example of FIG. 1, the output unit 133 causes the flower object OD1 to appear on the side of a path or the like as a change in the VR space periodically at a rate such as once every 10 minutes, and the VR space including the flower object OD1 appears. A spatial image is output to the HMD 20 .

In the above description, the output processing is performed when both the user's body part and the user's motion are satisfied as predetermined conditions. may be output to the HMD 20 in the VR space. For example, in the example of FIG. 1, the output unit 133 outputs the bouquet stored in the advertisement object storage unit 122 instead of the flower object OD1 in the VR space VR1 even if only the user's body parts or the user's actions are satisfied. You may output the image|video of VR space VR2 which displayed the coupon C1 to HMD20.

[3. Flowchart of output processing]
Next, a procedure of output processing executed by the information processing apparatus 100 according to the embodiment will be described with reference to FIG. FIG. 5 is a flowchart illustrating an example of the flow of output processing executed by the information processing apparatus according to the embodiment;

As shown in FIG. 5, the output unit 133 outputs the video in the VR space to the HMD 20 (step S101). Then, the acquiring unit 132 acquires reaction information about the reaction of the user when the reaction of the user experiencing the VR space satisfies a predetermined condition set by the advertiser (step S102). Then, if the user's reaction does not satisfy the predetermined condition (step S102; No), the acquisition unit 132 waits until reaction information about the user's reaction that satisfies the predetermined condition is acquired.

On the other hand, if the acquisition unit 132 determines that the user's reaction satisfies the predetermined condition (step S102; Yes), the output unit 133 outputs an image including the advertisement object in the VR space to the HMD 20 (step S103).

[4. Modification]
The information processing apparatus 100 described above may be embodied in various forms other than the above embodiment. Therefore, other embodiments of the information processing apparatus 100 will be described below.

[4-1. Output processing (1)]
In the above-described embodiment, an example of output processing in which the output unit 133 of the information processing apparatus 100 outputs a VR space video including an advertisement object based on the user's reaction has been described. An image of the VR space including different advertising objects may be output depending on the action taken after reacting to the change in the VR space. For example, suppose a user reacts to a change in the VR space and then takes a calm action such as staring at a point. In this case, if the reaction information acquired by the acquisition unit 132 indicates that the user's reaction has calmed down after the user reacted to the change in the VR space, the output unit 133 converts the reaction information to the reaction information indicating that the user's reaction has calmed down. You may output the image|video of VR space containing a corresponding advertising object to HMD20. On the other hand, after the user reacts to the change in the VR space, the user takes a hasty action such as looking around and looking in various directions. In this case, when the reaction information acquired by the acquisition unit 132 indicates that the user's reaction was flustered after the user reacted to the change in the VR space, the output unit 133 outputs a reaction indicating that the user's reaction was flustered. The video in the VR space including the advertisement object corresponding to the information is not output to the HMD 20.

An example of output processing executed by the information processing apparatus according to the modification will be described with reference to FIG. FIG. 6 is a diagram illustrating an example of output processing performed by an information processing apparatus according to a modification; An example of an advertisement object output process by the information processing apparatus 100 will be described below along the flow with reference to FIG. 6 .

First, as shown in FIG. 6, the user visually recognizes the flower object OD1 and reacts in surprise to the flower object OD1 (step S21). In this case, the information processing apparatus 100 changes the video in the VR space VR1 provided by the HMD 20. FIG. For example, the information processing apparatus 100 causes a flower object, which is the predetermined object OD1, to appear and causes the user to react to the flower object. Also, for example, in the example of FIG. 6, the user first experiences the sensation of walking along a tree-lined street with large trees planted on both sides of the path. Then, when the user suddenly turns around, the image of the VR space VR1 provided by the HMD 20 is switched, and the background changes to a path with grasslands growing on both sides of the road, thereby experiencing the sensation of walking along such a path. do. Then, while the user is walking along the path, the user visually recognizes the flower object OD1 that suddenly appears on the side of the path. Here, it is assumed that the user perceives the appearance of the flower object OD1 as a change in the VR space VR1, visually recognizes the flower object OD1 as the user turns around, and reacts in surprise to the flower object OD1. . Subsequently, the user shows an action of calming down (step S22). For example, it is assumed that the user reacts to the flower object OD1 in surprise and then makes a calming action. Then, the information processing apparatus 100 outputs to the HMD 20 the video of the VR space VR2 including the advertisement object C1 corresponding to the reaction information indicating that the user's reaction has calmed down (step S23). For example, it is assumed that the advertising object C1 corresponding to the reaction information indicating that the user's reaction has calmed down is a coupon related to hot spring bathing fees. In this case, the information processing apparatus 100 may acquire reaction information indicating that the user's reaction has calmed down, and output to the HMD 20 the VR space VR2 including the coupon "15% off if you take a bath now." Therefore, the user can read the advertising object slowly when the user's reaction indicates calmness, and the chances of getting interested in the advertising object are increased.

As a result, the output unit 133 of the information processing apparatus 100 according to the embodiment can output VR space video including advertising objects that differ depending on the user's behavior after reacting to the object in the VR space. Advertising objects can be served efficiently.

[4-2. Output processing (2)]
In the above-described embodiment, an example of output processing in which the output unit 133 of the information processing device 100 outputs a VR space image including an advertising object based on the user's reaction has been described. A video of the VR space including different advertising objects may be output according to the type of change in the VR space. Specifically, the output unit 133 outputs to the HMD 20 the video of the VR space including the advertisement object corresponding to the change in the VR space set by the advertiser, based on the advertisement object storage unit 123 shown in FIG. You may For example, it is assumed that the user reacts by staring at a character object (hereinafter referred to as a sandwich man advertisement object) having advertisement objects attached to the front and back of the character object. In this case, the acquisition unit 132 acquires information about the user's reaction to the behavior change of the Sandwichman advertisement object displayed in the VR space, and the output unit 133 outputs the information regarding the advertisement object included in the Sandwichman advertisement object reacted by the user. may be output to the HMD 20.

An example of output processing executed by the information processing apparatus according to the modification will be described with reference to FIG. 8 . FIG. 8 is a diagram illustrating an example of output processing performed by an information processing apparatus according to a modification; An example of an advertisement object output process by the information processing apparatus 100 will be described below along the flow with reference to FIG. 8 .

First, as shown in FIG. 8, the user visually recognizes the Sandwichman advertisement object OD2 (step S31). In this case, the information processing apparatus 100 changes the video in the VR space VR1 provided by the HMD 20. FIG. For example, the information processing device 100 causes the Sandwichman advertisement object OD2 to appear and allows the user to visually recognize the Sandwichman advertisement object OD2. Also, for example, in the example of FIG. 8, the user first experiences the sensation of walking along a tree-lined street with large trees planted on both sides of the path. The Sandwichman advertisement object OD2 is initially displayed in a small size, and then wanders around the street trees in the VR space VR1. The user is interested in the Sandwichman advertisement object OD2 showing such a characteristic behavior, and visually recognizes the Sandwichman advertisement object OD2. Subsequently, the information processing device 100 outputs to the HMD 20 the video of the VR space VR2 in which the content of the advertisement object included in the Sandwichman advertisement object OD2 is enlarged and displayed (step S32). For example, it is assumed that the content of the advertising object included in the Sandwichman advertising object OD2 is a coupon for karaoke fees. In this case, the information processing apparatus 100 acquires the reaction information indicating the behavior of the user viewing the Sandwichman advertisement object OD2, and the advertisement object "AA building 1 hour 50% off" included in the Sandwichman advertisement object OD2 is displayed. You may output the image|video of VR space VR2 displayed enlarged to HMD20.

As a result, the output unit 133 of the information processing apparatus 100 according to the embodiment can output video of the VR space including different advertising objects depending on the type of change in the VR space to which the user has reacted. You can improve the effect.

[4-3. Output processing (3)]
In the above-described embodiment, an example of output processing in which the output unit 133 of the information processing device 100 outputs a VR space video including an advertising object based on the user's reaction has been described. A video of the VR space including the advertisement object may be output when the predetermined condition is satisfied. Specifically, the output unit 133 outputs any one of the user reaction timing set by the advertiser, the change in the VR space, and the user reaction stored in the advertisement object storage unit 124 shown in FIG. When a predetermined condition is satisfied, the video of the VR space including the advertisement object is output to the HMD 20. FIG. For example, assume that the predetermined condition set by the advertiser is the timing of the user's reaction. In this case, the output unit 133 may output to the HMD 20 the VR space including the coupon regarding the bouquet as the advertisement object when the user immediately responds to the predetermined object. On the other hand, the output unit 133 may output, to the HMD 20, a VR space including a coupon related to movie viewing fees as an advertisement object when the user reacts slowly to a predetermined object.

As a result, the output unit 133 of the information processing apparatus 100 according to the embodiment can output the video of the VR space including the advertisement object when the predetermined condition set by the advertiser is satisfied. It is possible to provide advertisement objects beneficial to

[4-4. Ad Object]
In the above embodiments, still images, moving images, etc. can be applied instead of advertising objects. Further, the information processing apparatus 100 may output video in the VR space including various content objects, not limited to advertisement objects. For example, the information processing apparatus 100 may output to the HMD 20 a video in the VR space including a content object (for example, an article or the like included in the content object) that is not intended for advertisement.

[4-5. Advertisement objects corresponding to changes in the VR space]
In the above embodiment, an example of the output processing in which the information processing apparatus 100 outputs a VR space video including an advertisement object based on the user's reaction has been described. Advertisement object corresponding to changes in voice or BGM, Advertisement object corresponding to change in color of object projected in VR space, Advertisement object corresponding to change in brightness within VR space, Object projected within VR space You may output the advertisement object etc. which respond|correspond to the behavior change of.

[4-6. Virtual space〕
In the above embodiment, an example of the output process in which the information processing apparatus 100 outputs a VR space image including an advertising object based on the user's reaction has been described, but the information processing apparatus 100 outputs a VR space image. It is not limited to this. For example, the information processing apparatus 100 may output an image of a virtual space such as augmented reality including an advertisement object based on the user's reaction.

[4-7. Information processing device (1)]
In the above embodiment, an example of the output processing in which the information processing apparatus 100 outputs a video of the VR space including the advertisement object based on the user's reaction has been described, but the information processing apparatus 100 is not limited to this. do not have. For example, the acquisition process and the output process executed by the information processing apparatus 100 may be executed by the HMD 20 in a stand-alone manner.

[4-8. Information processing device (2)]
In the above-described embodiment, an example of the processing in which the information processing device 100 receives an advertisement object from the advertiser terminal 10 has been described. may For example, the information processing apparatus 100 may refer to an advertisement object received by the advertiser by the submission receiving unit 131 .

[5. Hardware configuration]
Also, the advertiser terminal 10, the HMD 20, and the information processing device 100 according to the above-described embodiments are implemented by a computer 1000 configured as shown in FIG. 10, for example. The information processing apparatus 100 will be described below as an example. FIG. 10 is a hardware configuration diagram showing an example of a computer 1000 that implements the functions of the information processing apparatus 100. As shown in FIG. The computer 1000 includes a CPU 1100, a RAM 1200, a ROM (Read Only Memory) 1300, a HDD (Hard Disk Drive) 1400, a communication interface (I/F) 1500, an input/output interface (I/F) 1600, and a media interface (I/F). ) 1700.

The CPU 1100 operates based on programs stored in the ROM 1300 or HDD 1400 and controls each section. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started up, a program depending on the hardware of the computer 1000, and the like.

The HDD 1400 stores programs executed by the CPU 1100, data used by the programs, and the like. Communication interface 1500 receives data from other devices via network N, sends the data to CPU 1100, and transmits data generated by CPU 1100 via network N to other devices.

The CPU 1100 controls output devices such as displays and printers, and input devices such as keyboards and mice, through an input/output interface 1600 . CPU 1100 acquires data from an input device via input/output interface 1600 . Also, CPU 1100 outputs the generated data to an output device via input/output interface 1600 .

Media interface 1700 reads programs or data stored in recording medium 1800 and provides them to CPU 1100 via RAM 1200 . CPU 1100 loads such a program from recording medium 1800 onto RAM 1200 via media interface 1700, and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. etc.

For example, when the computer 1000 functions as the information processing apparatus 100 according to the embodiment, the CPU 1100 of the computer 1000 implements the functions of the control unit 130 by executing programs loaded on the RAM 1200 . In addition, the data in storage unit 120 is stored in HDD 1400 . The CPU 1100 of the computer 1000 reads these programs from the recording medium 1800 and executes them, but as another example, these programs may be acquired via the network N from another device.

[6. others〕
Further, among the processes described in the above embodiments and modifications, all or part of the processes described as being performed automatically can be performed manually, or described as being performed manually. All or part of the processing can also be performed automatically by a known method. In addition, information including processing procedures, specific names, various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.

Also, each component of each device illustrated is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution and integration of each device is not limited to the one shown in the figure, and all or part of them can be functionally or physically distributed and integrated in arbitrary units according to various loads and usage conditions. Can be integrated and configured.

Also, the above-described embodiments and modifications can be appropriately combined within a range that does not contradict the processing content.

Also, the above-mentioned "section, module, unit" can be read as "means" or "circuit". For example, the acquisition unit can be read as acquisition means or an acquisition circuit.

[7. effect〕
As described above, the information processing apparatus 100 according to the embodiment has the acquisition unit 132 and the output unit 133 . The acquisition unit 132 acquires reaction information about the user's reaction to changes in the virtual space, which is the reaction of the user experiencing the virtual space (corresponding to the VR space) formed by the video. The output unit 133 outputs content (corresponding to an advertisement object) based on the reaction information acquired by the acquisition unit 132 .

As a result, the information processing apparatus 100 according to the embodiment can acquire the reaction information to the object that the user is interested in in the VR space. You can increase the effect.

Further, in the information processing apparatus 100 according to the embodiment, the acquisition unit 132 acquires reaction information regarding behavior based on the user's reaction to changes in the virtual space, and the output unit 133 outputs content that differs depending on the behavior based on the user's reaction. to output

As a result, the information processing apparatus 100 according to the embodiment can output a video of the VR space including the advertisement object related to the action performed by the user on the object in the VR space based on the reaction information. Therefore, the appealing effect of the advertisement object can be improved.

Further, in the information processing apparatus 100 according to the embodiment, the acquisition unit 132 acquires the reaction information related to the part of the user who has taken action when the user reacts, and the output unit 133 outputs the reaction information based on the part of the user who has taken the action. Output different content.

As a result, the information processing apparatus 100 according to the embodiment, based on the reaction information related to the user's body part motion caused by the user to the object in the VR space, creates a VR space containing the advertising object related to the user's body part motion. image can be output, the appealing effect of the advertising object can be improved.

Further, in the information processing apparatus 100 according to the embodiment, the acquisition unit 132 acquires reaction information related to actions performed by the user after reacting to changes in the virtual space, and the output unit 133 outputs Different contents are output depending on the action taken after reacting.

As a result, the information processing apparatus 100 according to the embodiment can output video in the VR space that includes different advertising objects depending on the user's behavior after reacting to the object in the VR space. can be provided in a timely manner.

Further, in the information processing apparatus 100 according to the embodiment, when the reaction information acquired by the acquisition unit 132 indicates that the user has calmed down after reacting to the change in the virtual space, the output unit 133 Output the corresponding content.

Further, in the information processing apparatus 100 according to the embodiment, the output unit 133 outputs the reaction information when the reaction information acquired by the acquisition unit 132 indicates that the user panicked after reacting to the change in the virtual space. Do not output content corresponding to .

Accordingly, the information processing apparatus 100 according to the embodiment can determine whether or not to output the video of the VR space including the advertisement object based on the user's action after reacting to the object in the VR space. , the advertising object can be served efficiently.

In addition, in the information processing apparatus 100 according to the embodiment, the output unit 133 outputs different content depending on the type of change in the virtual space to which the user reacts.

Further, in the information processing apparatus 100 according to the embodiment, the output unit 133 outputs, as changes in the virtual space, changes in voice or BGM, changes in the colors of objects projected in the virtual space, changes in brightness in the virtual space. , outputs content corresponding to any one of behavioral changes of the object projected in the virtual space.

As a result, the information processing apparatus 100 according to the embodiment can output video of the VR space including different advertising objects depending on the type of change in the VR space to which the user reacts, thereby improving the appealing effect of the advertising object. be able to.

In addition, in the information processing apparatus 100 according to the embodiment, the output unit 133 outputs content when a predetermined condition set by a content provider (corresponding to an advertiser) is satisfied.

Further, in the information processing apparatus 100 according to the embodiment, the output unit 133 outputs the content when any one of a change in the virtual space, a reaction of the user, and the timing of the reaction of the user is satisfied as a predetermined condition. Output.

As a result, the information processing apparatus 100 according to the embodiment can output a video in the VR space including the advertisement object when a predetermined condition set by the advertiser is satisfied. object can be provided.

As described above, some of the embodiments of the present application have been described in detail based on the drawings. It is possible to carry out the invention in other forms with modifications.

1 Information Processing System 10 Advertiser Terminal 20 HMD
100 information processing device 110 communication unit 120 storage unit 121 VR space component information storage unit 122 advertisement object storage unit 123 advertisement object storage unit 124 advertisement object storage unit 130 control unit 131 submission reception unit 132 acquisition unit 133 output unit

Claims (12)

an acquisition unit that acquires reaction information about a user's reaction to a change in the virtual space, which is a reaction of the user experiencing the virtual space formed by the video;
an output unit that outputs content related to the reaction of the user indicated by the reaction information acquired by the acquisition unit, the content appealing to an object caused by a change in the virtual space;
with
The acquisition unit
Acquiring reaction information regarding actions based on the user's reaction to changes in the virtual space;
The output unit
outputting different content depending on actions based on the user's reaction;
An information processing device characterized by: The output unit
outputting the content after the user reacts to a change in the virtual space;
The information processing apparatus according to claim 1, characterized by: The acquisition unit
Acquiring reaction information related to a part of the user who took action when the user reacted,
The output unit
outputting different content depending on the part of the user who has taken the action;
3. The information processing apparatus according to claim 1 , wherein: The acquisition unit
Acquiring reaction information about an action performed by the user after reacting to a change in the virtual space;
The output unit
outputting different contents depending on the actions performed by the user after reacting to changes in the virtual space;
The information processing apparatus according to any one of claims 1 to 3 , characterized by: The output unit
outputting content corresponding to the reaction information when the reaction information acquired by the acquisition unit indicates that the user has calmed down after reacting to a change in the virtual space;
The information processing apparatus according to any one of claims 1 to 4 , characterized in that: The output unit
not outputting content corresponding to the reaction information when the reaction information acquired by the acquisition unit indicates that the user panicked after reacting to a change in the virtual space;
The information processing apparatus according to any one of claims 1 to 5 , characterized by: The output unit
outputting different content according to the type of change in the virtual space to which the user reacted;
The information processing apparatus according to any one of claims 1 to 6 , characterized in that: The output unit
Changes in the virtual space include changes in voice or background music (BGM), changes in color of objects projected in the virtual space, changes in brightness in the virtual space, and objects projected in the virtual space. to output content corresponding to any one of the behavioral changes of
The information processing apparatus according to any one of claims 1 to 7 , characterized by: The output unit
outputting the content when a predetermined condition set by a content provider is satisfied;
The information processing apparatus according to any one of claims 1 to 8 , characterized by: The output unit
outputting the content when any one of a change in the virtual space, a user's reaction, and a timing of the user's reaction is satisfied as the predetermined condition;
10. The information processing apparatus according to claim 9 , characterized by: A computer-executed information processing method comprising:
an acquiring step of acquiring reaction information about a user's reaction to a change in the virtual space, which is a reaction of the user experiencing the virtual space formed by the video;
an output step of outputting content related to the reaction of the user indicated by the reaction information obtained in the obtaining step, the content appealing to an object caused by a change in the virtual space;
including
The obtaining step includes
Acquiring reaction information regarding actions based on the user's reaction to changes in the virtual space;
The output step includes
outputting different content depending on actions based on the user's reaction;
An information processing method characterized by: an acquisition procedure for acquiring reaction information about a user's reaction to a change in the virtual space, which is a reaction of the user experiencing the virtual space formed by the video;
an output step of outputting content related to the reaction of the user indicated by the reaction information obtained by the obtaining step, the content appealing to an object caused by a change in the virtual space;
on the computer , and
The acquisition procedure includes:
Acquiring reaction information regarding actions based on the user's reaction to changes in the virtual space;
The output procedure includes:
outputting different content depending on actions based on the user's reaction;
An information processing program characterized by:

Images