JP6832320B2 - Systems, methods, and programs for providing content using augmented reality technology - Google Patents

Description

The present invention relates to a system, a method, and a program for providing contents using the technology of Augmented Reality (AR).

Conventionally, various digital contents such as games to which AR is applied have been provided. For example, Patent Document 1 below discloses a shooting game using AR technology. In this game, when a player carrying a gun-type controller having a user terminal equipped with a touch panel and a camera unit advances through the AR experience facility, an enemy character corresponding to the target marker placed in the facility is displayed on the game screen. It appears, and an object corresponding to a bullet is fired and displayed according to the shooting operation by the player.

JP-A-2017-176635

However, in the content using the augmented reality technology, the characters operated by the user (for example, avatar and player character) are displayed on the screen as compared with the case where the first-person field of view as in the shooting game described above is adopted. When the third-person field of view shown above is adopted, the operation of the character tends to be complicated.

One of the objects of the embodiment of the present invention is to support good operation of a user character in content using augmented reality technology. Other objects of the embodiments of the present invention will become apparent by reference to the entire specification.

A system according to an embodiment of the present invention is a system including one or more computer processors for providing content using augmented reality technology, the one or more computer processors being readable. In response to the execution of the instruction, the image of the virtual space including the user character and the image of the virtual space via the virtual camera linked to the real camera with respect to the image of the real space through the real camera. The process of generating and displaying an augmented reality image in which images are superimposed and the process of controlling the progress of the content based on at least the movement of the user character are executed, and the process of controlling the progress of the content is described above. Arranging a designation object for designating a target object to be executed by a user character at a position in the virtual space based on at least the position and orientation of the virtual camera, and the designation. Includes controlling the execution of the predetermined action by the user character targeting the target object specified via the computer.

A method according to an embodiment of the present invention is a method executed by one or more computers to provide content using augmented reality technology, for an image in real space through a real camera. A step of generating and displaying an augmented reality image in which an image of the virtual space including the user character is superimposed and the image of the virtual space is superimposed via the virtual camera linked to the real camera, and the user character. A step of controlling the progress of the content based on at least the operation of the content is provided, and the step of controlling the progress of the content is for designating a target object to be a target of a predetermined action performed by the user character. The designation object is placed at a position in the virtual space based on at least the position and orientation of the virtual camera, and the predetermined action targeting the target object designated via the designation object is described. Includes controlling execution by the user character.

The program according to the embodiment of the present invention is a program for providing contents using the technique of augmented reality, and is executed on one or a plurality of computers to the one or a plurality of computers. Augmented reality in which the image of the virtual space including the user character is superimposed on the image of the real space through the real camera and the image of the virtual space through the virtual camera linked to the real camera is superimposed. The process of generating and displaying an image, the process of controlling the progress of the content based on at least the operation of the user character, and the process of controlling the progress of the content are predetermined to be executed by the user character. A designation object for designating a target object to be the target of the action of is placed at a position in the virtual space based on at least the position and orientation of the virtual camera, and is designated via the designation object. It includes controlling the execution of the predetermined action targeting the target object by the user character.

Various embodiments of the present invention support good manipulation of the user character in content using augmented reality techniques.

FIG. 6 is a configuration diagram schematically showing a configuration of a network including a user terminal 10 according to an embodiment of the present invention. The figure for demonstrating the state of the player PL playing a game. The flow chart which illustrates the process executed by the user terminal 10. The figure which illustrates the coin reading screen 50. The figure for demonstrating the method of arranging an enemy character and a player character in a virtual space. The figure for demonstrating how the enemy character 202 and the player character 204 are arranged in the virtual space 200. The figure which illustrates the game screen 60. The figure which illustrates the game screen 60 which displays the virtual controller 66. The figure for demonstrating the arrangement in the virtual space 200 of the aiming object 206. The figure for demonstrating the arrangement of the aiming object 206 in the state where the enemy character 202 is located in the center of the field of view of the virtual camera 220. The figure which illustrates the game screen 60 corresponding to the arrangement of the aiming object 206 illustrated in FIG. The figure for demonstrating the arrangement of the aiming object 206 when the virtual camera 220 approaches an enemy character 202. The figure which illustrates the game screen 60 corresponding to the arrangement of the aiming object 206 illustrated in FIG. The figure for demonstrating the arrangement of the aiming object 206 when the state which the enemy character 202 is positioned in the center of the field of view of a virtual camera is eliminated. The figure which illustrates the game screen 60 corresponding to the arrangement of the aiming object 206 illustrated in FIG. The figure for demonstrating how the enemy character 202 and the player characters 204A, 204B are arranged in the virtual space 200 when two players PLA and PLB play together.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a configuration diagram schematically showing a configuration of a network including a user terminal 10 according to an embodiment of the present invention. As shown in the figure, the user terminal 10 is communicably connected to the content management server 30 via a communication network 20 such as the Internet. The user terminal 10 has a function for providing contents such as a game using augmented reality (AR) technology, and is an example of a device that implements all or a part of the system of the present invention.

The user terminal 10 is configured as a general computer, and as shown in FIG. 1, a computer processor 11 such as a CPU and a GPU, a main memory 12, an input / output I / F13, a communication I / F14, and the like. A storage (storage device) 15 and various sensors 16 are provided, and each of these components is electrically connected via a bus or the like (not shown).

The computer processor 11 reads various programs stored in the storage 15 and the like into the main memory 12 and executes various instructions included in the programs. The main memory 12 is composed of, for example, a DRAM or the like.

The input / output I / F 13 includes, for example, an information input device such as a touch panel and a controller, a voice input device such as a microphone, and an image input device such as a camera 131. Further, the input / output I / F 13 includes an image output device (display device) such as a display and an audio output device such as a speaker.

The communication I / F 14 is implemented as hardware such as a network adapter, various communication software, and a combination thereof, and is configured to realize wired or wireless communication.

The storage 15 is composed of, for example, a magnetic disk, a flash memory, or the like. The storage 15 stores various programs including an operating system, various data, and the like. The program stored in the storage 15 can be downloaded and installed from the application market or the like. In the present embodiment, the program stored in the storage 15 includes the content program 40 according to the embodiment of the present invention. The content program 40 is a program for making the user terminal 10 function as a device for providing content using augmented reality technology.

The various sensors 16 include, for example, an acceleration sensor, a gyro sensor (angular velocity sensor), a geomagnetic sensor, and the like. The user terminal 10 can determine various movements of the user terminal 10 itself based on the information detected by these various sensors 16.

The content management server 30 has a configuration as a general computer. The content management server 30 stores and manages various information related to the content provided by the user terminal 10. For example, the content management server 30 manages the progress of the content for each user, various data for providing the content (for example, data in the virtual space, etc.) and the like. The content management server 30 may be configured by using a plurality of server devices, each of which has a configuration as a general computer.

For example, the user terminal 10 acquires the progress status of the content of the corresponding user, various data, and the like from the content management server 30 in response to the activation of the content program 40. Further, for example, the user terminal 10 acquires various data and the like from the content management server 30 while the content program 40 is being executed, and transmits the latest progress status of the user's content to the content management server 30. To do. In the present embodiment, the user terminal 10 can be configured to provide the content without communicating with the content management server 30, and in this case, the content management server 30 may be unnecessary.

Next, the function of the user terminal 10 of the present embodiment will be described. As shown in FIG. 1, the computer processor 11 of the user terminal 10 functions as an image generation display unit 111 and a content progress control unit 112 by executing an instruction included in a program read in the main memory 12. It is configured as follows.

The image generation display unit 111 executes various processes related to the generation and display of images related to the content. In the present embodiment, the image generation display unit 111 generates and displays an augmented reality image in which an image of a virtual space including a user character is superimposed on an image of the real space via the real camera 131. It is configured. In the present embodiment, the image in the virtual space is configured as an image through a virtual camera linked to the camera 131. For example, the image generation display unit 111 controls the virtual camera so as to move in the virtual space according to the actual movement (movement, rotation, etc.) of the user terminal 10 (camera 131).

The content progress control unit 112 executes various processes related to controlling the progress of the content. In the present embodiment, the content progress control unit 112 is configured to control the progress of the content based on at least the movement of the user character. For example, the content progress control unit 112 is configured to automatically control the operation of the user character in the virtual space according to the operation input by the user or without the operation input by the user.

In the present embodiment, the content progress control unit 112 arranges a designation object for designating a target object to be a target of a predetermined action executed by the user character in the virtual space, and designates the target object via the designation object. It is configured to control the execution of the predetermined action targeting the target object by the user character. The designated object is placed at a position in virtual space at least based on the position and orientation of the virtual camera. For example, the content progress control unit 112 is configured to change (move) the position of the designated object according to a change (movement) in the position and orientation of the virtual camera linked to the camera 131.

As described above, in the content using the augmented reality technology provided by the user terminal 10 in the present embodiment, the designation object is arranged at the position of the virtual camera linked to the real camera 131 and the position of the virtual space based on the orientation. Then, the execution of a predetermined action targeting the target object designated via the designation object by the user character is controlled. That is, the user can specify the target of the predetermined action executed by the user character included in the virtual space via the designation object arranged based on the movement of the user terminal 10 (camera 131). In this way, the user terminal 10 supports good operation of the user character in the content using the augmented reality technology.

In the present embodiment, the content progress control unit 112 may be configured to arrange a connected object connecting the user character and the designated object in the virtual space. The connected object is configured as, for example, an object that connects the user character and the designated object in a straight line or a predetermined curved line. Such a configuration helps the user to easily grasp the relative positional relationship between the user character and the designated object in the virtual space.

In the present embodiment, the content progress control unit 112 determines the specific target when the specific target object exists on a predetermined straight line (including a half straight line or a line segment) extending in the direction of the field of view of the virtual camera. A designation object may be placed at the position of the object, and the target object at the position where the designation object is placed may be configured to be the target of a predetermined action. For example, the content progress control unit 112 designates the position of the target object when a straight line passing through the viewpoint of the virtual camera and the center of the field of view (center of gravity, center of view) passes through the target object (intersects with the target object). It is configured to place objects for. Such a configuration supports easy designation of the target object according to the orientation of the virtual camera linked to the camera 131.

Further, the content progress control unit 112 arranges the designation object at a position on the predetermined straight line separated from the position of the virtual camera by a certain distance when none of the target objects exists on the predetermined straight line. Can be configured to. As a result, the designation object is fixed at a position separated by a certain distance from the user's viewpoint (the position of the virtual camera) in the augmented reality image. In such a configuration, since the designation object is fixedly displayed in the state where the target object is not specified, the operation of designating the target object is better than the case where the display position of the designation object changes.

Further, when the content progress control unit 112 shifts from the first state in which the specific target object exists on the predetermined straight line to the second state in which no target object exists on the predetermined straight line. In addition, the distance between the virtual camera and the designated object in the second state is defined as the distance between the virtual camera and the specific target object immediately before the transition to the second state (that is,). The designated object is moved from the position of the virtual camera to a position on the predetermined straight line separated by a certain distance, which is the distance between the virtual camera and the specific target object immediately before the transition to the second state. It can be configured to be arranged.) In such a configuration, when the state in which the specific target object is located on a predetermined straight line (in other words, the specific target object is specified) is resolved, the display mode (specifically, the specific target object) of the designation object is resolved. , The distance from the viewpoint, in other words, the display size.) Is suppressed from suddenly changing, and as a result, the discomfort that can be given to the user is reduced.

In the present embodiment, the content provided by the user terminal 10 may include various contents in which the user character appears in the virtual space. For example, the content includes a battle game in which a user character (player character) plays against an enemy character. In this case, the target object includes an enemy character, and the predetermined action includes an attack on the enemy character. That is, in this case, the user (player) specifies the enemy character to be the target of the attack executed by the player character via the designation object arranged based on the movement of the user terminal 10 (camera 131). Is possible.

Further, the content progress control unit 112 may be configured to change the appearance of the designating object according to the type of a predetermined action executed by the user character. For example, when the content provided by the user terminal 10 is a battle game, the content progress control unit 112 is configured to change the appearance of the designating object according to the type of attack on the enemy character. For example, the type of attack is set via the equipment of the weapon against the player character. For example, the content progress control unit 112 arranges the object for designating the first appearance when the player character is equipped with the first weapon, while the content progress control unit 112 is equipped with the second weapon for the player character. If so, it is configured to place a second appearance specification object. Such a configuration makes it possible to inform the user of the type of attack that has been set through the appearance of the designated object.

Further, the content progress control unit 112 may be configured to change the value of a predetermined parameter of the user character based on at least the relative positional relationship between the virtual camera and the user character in the virtual space. For example, the content progress control unit 112 fluctuates (increases or increases) the value of the predetermined parameter during a period in which the user character is included in a predetermined area corresponding to a part or all of the field of view of the virtual camera. It is configured to reduce). Further, for example, the content progress control unit 112 is configured so that the shorter (closer) the distance in the virtual space between the virtual camera and the user character, the faster the fluctuation speed of the value of the predetermined parameter. Predetermined parameters include, for example, the HP, physical strength, energy, and the like of the player character in the battle game. In such a configuration, the value of the parameter of the user character can be changed by the movement of the user terminal 10 (camera 131) in which the virtual camera is interlocked, and as a result, good operation of the user character is supported.

Next, a specific example of the user terminal 10 of the present embodiment having such a function will be described. In this specific example, the user terminal 10 provides a battle game in which a player character plays against an enemy character in a virtual space. The battle game is configured as a game using an augmented reality technique in which an image of a virtual space is superimposed on a real image passed through a camera 131 and displayed as an augmented reality image. Further, the image of the virtual space is configured as an image of a third person field of view including a player character.

FIG. 2 is a diagram for explaining a state of a player PL playing the game of this example. As shown in the figure, the game of this example is configured so that the player PL operating the user terminal 10 plays using one coin (real coin) CN placed on a plane such as a table TB. ing. The coin CN is placed so that the surface on which the year of issue is written is exposed (becomes the upper surface).

FIG. 3 is a flow chart illustrating the process executed by the user terminal 10 in this example. As shown in the figure, the user terminal 10 first recognizes coins included in an input image input via the camera 131, and determines the type and year of issue of the recognized coins, as well as the size and orientation of the images. (Step S100).

FIG. 4 illustrates a coin reading screen 50 displayed on the user terminal 10 when recognizing a coin. As shown in the figure, the screen 50 has an image display area 51 for displaying an input image input via the camera 131 of the user terminal 10 and a reading button 52 for displaying "scan". The player adjusts the position and orientation of the user terminal 10 so that the entire coin CN is included in the area 51.

When the reading button 52 is selected by the player, the user terminal 10 recognizes the coin CN included in the input image, determines the type and issue year of the recognized coin CN, and the size and orientation in the image. The type and year of issue of the coin CN are determined by analyzing the image of the surface portion of the coin CN. Further, the size of the coin CN is determined as the ratio of the size of the coin CN to the size of the entire image. Further, the orientation of the coin CN is determined as the orientation of the symbol in the image of the surface portion of the coin CN. When the user terminal 10 recognizes the coin CN included in the input image, the above-mentioned type of coin CN is automatically determined (without the player selecting the read button 52). You may.

Returning to the flow chart of FIG. 3, and determining the type of coin in this way, the user terminal 10 then determines the enemy character to appear based on the type of coin and the year of issue (step S110). In this example, different types of characters are preset as enemy characters to appear for each combination of coin type and issue year. For example, if the coin type is "1 yen coin" and the issue year is "2011-", "Character A" is set as the enemy character and the coin type is "5 yen coin". If the issue year is "2000", "character B" is set as an enemy character.

Subsequently, the user terminal 10 determines the relative positional relationship (direction and distance) between the enemy character and the player character in the virtual space based on the size and orientation of the coin (step S120), and the relative position is determined. The enemy character and the player character are arranged in the virtual space based on the positional relationship (step S130).

FIG. 5 is a diagram for explaining a method of arranging the enemy character and the player character in the virtual space. In FIG. 5, a state in which the coin CN placed on the table TB is viewed from above is schematically shown. In this example, a virtual space 200 for advancing the game is configured on the surface of a table TB or the like on which the coin CN is placed in the real space, and an enemy character and a player character are arranged in the virtual space 200.

In this example, the enemy character is placed at a position in the virtual space 200 corresponding to the position of the coin CN, while the player character is placed at a position in the virtual space 200 corresponding to the position between the coin CN and the user terminal 10. Be placed. Here, considering a plane orthogonal coordinate system in which the center of the coin CN is the origin O, the horizontal direction of the coin CN is the x-axis, and the vertical direction is the y-axis, the enemy character is placed at the origin O and the player The character is placed at position P1 where the distance from the origin O is Ln and the angle with respect to the x-axis is θ. The distance Ln of the position P1 from the origin O is set based on the size of the coin CN in the input image, and the angle θ of the position P1 with respect to the x-axis is set based on the orientation of the coin CN in the input image.

FIG. 6 is a diagram for explaining how the enemy character 202 and the player character 204 are arranged in the virtual space 200. In this way, the enemy character 202 is arranged at the position of the coin CN placed on the table TB, and the player character 204 is arranged between the enemy character 202 (coin CN) and the user terminal 10.

Returning to the flow chart of FIG. 3, when the enemy character and the player character are arranged in the virtual space in this way, the user terminal 10 then controls the progress of the battle between the enemy character and the player character (step S140).

FIG. 7 illustrates a game screen 60 displayed on the user terminal 10 during a battle between an enemy character and a player character. The game screen 60 is configured to display an augmented reality image in which an image of the virtual space 200 is superimposed on an image of the real space input via the camera 131 on the entire screen. The image of the virtual space 200 is an image of the virtual space 200 (included in the field of view of the virtual camera) seen from a virtual camera moving in the virtual space 200 according to the movement of the user terminal 10 (camera 131). Is.

As shown in FIG. 7, an enemy character 202 and a player character 204 are arranged in the virtual space 200. In the initial state, the enemy character 202 is arranged so that the downward direction of the coin CN (the downward direction of FIG. 5) faces the front (the downward direction of the coin CN faces downward).

Further, as shown in FIG. 7, on the game screen 60, an indicator 61 indicating the remaining amount of HP of the enemy character 202 is arranged in the upper right corner of the screen, and basic information about the enemy character is above the indicator 61. (For example, name, etc.) is displayed. Further, in the game screen 60, a physical attack button 62, a skill attack button 63, and an indicator 65 indicating the remaining amount of HP of the player character 204 are arranged in the lower right corner of the screen. The physical attack button 62 is a button for instructing the player character 204 to execute a physical attack on the enemy character 202. The skill attack button 63 is a button for instructing the player character 204 to execute a skill attack (special move) on the enemy character 202.

In this example, in order to execute a physical attack via the physical attack button 62, it is necessary to aim at the enemy character to be attacked (designate the enemy character). Then, in the virtual space 200, a spherical aiming object (designation object) 206 for aiming at the enemy character that is the target of the physical attack is arranged. Further, in the virtual space 200, a linear connecting object 208 that connects the aiming object 206 and the player character 204 is arranged. The physical attack button 62 is configured so that it cannot be selected when the enemy character is not aimed at.

In this example, the movement of the player character 204 is controlled by a touch operation on the game screen 60. FIG. 8 illustrates a game screen 60 on which a virtual controller 66 for instructing the movement of the player character 204 is displayed. The virtual controller 66 is configured to be displayed at the position of the touch operation when a touch operation is performed in an area other than the physical attack button 62 and the skill attack button 63 in the entire screen of the game screen 60. (In the example of FIG. 8, it is displayed below the indicator 61.). Further, the virtual controller 66 is configured to disappear when the touch state is canceled (that is, the player's finger or the like is separated from the touch panel). The player can move the player character 204 in the desired direction by performing a slide operation or the like in a desired direction after displaying the virtual controller 66 by a touch operation (in the example of FIG. 8, the player character 204 can be moved. Is moving from the state of FIG. 7 toward the upper left.) Further, as shown in the figure, as the player character 204 moves, the arrangement of the connecting object 208 connecting the player character 204 and the aiming object 206 also changes.

Here, the aiming object 206 will be described. As illustrated in FIGS. 7 and 8, in this example, the aiming object 206 is displayed at the center (center of gravity, center of gravity) of the field of view (in other words, the entire screen of the game screen 60) of the virtual camera. FIG. 9 is a diagram for explaining the arrangement of the aiming object 206 in the virtual space 200. As shown in the figure, the aiming object 206 is the virtual camera 220 in a state where the straight line SL extending from the position of the virtual camera 220 (user terminal 10) corresponding to the viewpoint of the player passes through the center of the field of view does not intersect with the enemy character 202. It is arranged at a position on the straight line SL whose distance from is L0. The value L0 is a preset fixed value. When the position on the straight line SL is below the ground (the surface of the table TB) (for example, it is assumed that the direction of the virtual camera 220 approaches vertically downward), the virtual camera 220. The aiming object 206 may be placed at a position above the ground (for example, the intersection of the straight line SL and the ground) regardless of the distance from the ground.

As described above, the aiming object 206 arranged in this way is an object for aiming at the enemy character that is the target of the physical attack. By moving the user terminal 10, the player changes the position and orientation of the virtual camera linked to the camera 131 so that the enemy character 202 is located at the center of the field of view of the virtual camera. FIG. 10 is a diagram for explaining the arrangement of the aiming object 206 when the enemy character 202 is located at the center of the field of view of the virtual camera. It can be said that the state in which the enemy character 202 is located at the center of the field of view of the virtual camera 220 is a state in which the straight line SL extending from the position of the virtual camera 220 so as to pass through the center of the field of view intersects with the enemy character 202. In this case, as shown, the aiming object 206 is placed at the position of the enemy character 202. For example, the position of the aiming object 206 is a position on the straight line SL whose distance from the virtual camera 220 is a value L1 larger than the above-mentioned value L0.

FIG. 11 illustrates a game screen 60 corresponding to the arrangement of the aiming object 206 illustrated in FIG. In this case, as shown in the figure, the enemy character 202 is arranged at the center of the entire screen of the game screen 60 (that is, the field of view of the virtual camera), and the aiming object 206 is (a specific part of) the enemy character 202. It is placed on top of each other. Further, since the aiming object 206 is away from the player's viewpoint (position of the virtual camera), the display size of the object 206 on the game screen 60 is compared with the display size on the game screen 60 illustrated in FIG. It's getting smaller. The physical attack button 62 can be selected in the state where the aiming object 206 is arranged so as to overlap the enemy character 202 in this way. Then, when the physical attack button 62 is selected by the player, the physical attack by the player character 204 against the enemy character 202 is executed. In addition, a physical attack is executed on the part (head, chest, etc.) of the enemy character 202 where the aiming object 206 is placed (aimed at) (identification of the part to be the target of the physical attack). It may be possible).

Here, even if the aiming object 206 is placed so as to overlap the enemy character 202, the enemy character 202 does not exist in the physical attack range of the player character 204 (between the player character 204 and the enemy character 202). If the distance is greater than or equal to a predetermined value), the physical attack button 62 may not be selectable. In this case, the display mode of the aiming object 206 is changed depending on whether or not the enemy character 202 exists in the physical attackable range (for example, when the enemy character 202 does not exist in the physical attackable range of the player character 204). The aiming object 206 may be blinked (for example).

FIG. 12 shows the virtual camera while maintaining the state in which the enemy character 202 is located at the center of the field of view of the virtual camera 220 by moving the user terminal 10 in the direction in which the enemy character 202 is located from the states of FIGS. It is a figure for demonstrating the arrangement of the aiming object 206 when 220 approaches an enemy character 202. In this case, as shown in the figure, the aiming object 206 is maintained at the position of the enemy character 202, and as a result, the distance between the virtual camera 220 and the aiming object 206 is shortened (the distance). However, the value L2 is smaller than the above-mentioned value L1).

FIG. 13 illustrates a game screen 60 corresponding to the arrangement of the aiming object 206 illustrated in FIG. In this case, as shown in FIG. 13, since the aiming object 206 approaches the player's viewpoint (position of the virtual camera), the display size of the object 206 on the game screen 60 is on the game screen 60 illustrated in FIG. It is larger than the display size in. In the game screen 60 of FIG. 13, the player character 204 is not displayed outside the field of view of the virtual camera, but the connected object 208 allows the player to move the player to a rough position of the player character 204 (FIG. 13). In the example, the left front direction of the field of view) can be inferred.

FIG. 14 shows a case where the state in which the enemy character 202 is located at the center of the field of view of the virtual camera 220 is eliminated by moving the direction of the user terminal 10 (camera 131) to the left from the state illustrated in FIGS. It is a figure for demonstrating the arrangement of the aiming object 206 of. In this case, as shown in the figure, the aiming object 206 is virtual while maintaining the distance (value L2) from the virtual camera 220 in the state immediately before the state where the enemy character 202 is located at the center of the field of view is eliminated. It is arranged at a position on a straight line SL extending from the position of the camera 220 so as to pass through the center of the field of view.

FIG. 15 illustrates a game screen 60 corresponding to the arrangement of the aiming object 206 illustrated in FIG. In this case, as shown in FIG. 15, the aiming object 206 is separated from the position of the enemy character 202, but the distance between the player's viewpoint (position of the virtual camera) and the aiming object 206 has not changed, so that the object is concerned. The display size of the 206 game screen 60 has not changed. In this way, by maintaining the display size of the aiming object 206 when the state in which the enemy character 202 is located at the center of the field of view is resolved, it is possible to prevent the display size of the object 206 from suddenly changing. As a result, good operability is realized. In the game screen 60 of FIG. 15, since the aiming object 206 is out of the position of the enemy character 202, the physical attack button 62 cannot be selected.

In this way, a physical attack is performed via the physical attack button 62, accompanied by an operation of aiming at the enemy character 202 via the aiming object 206. On the other hand, the skill attack via the skill attack button 63 does not require an operation of aiming and can be executed at any time. The player selects the physical attack button 62 or the skill attack button 63 to execute a physical attack or a skill attack on the enemy character 202 by the player character 204. When these attacks are made, damage is given to the enemy character 202. Similarly, the enemy character 202 damages the player character 204 by attacking the player character 204. The damage given is calculated based on the values of mutual parameters (attack power, skill level, defense power, etc.), and the HP decreases according to the damage received. The enemy character 202 also moves in the virtual space 200.

Then, when the HP of either the enemy character 202 or the player character 204 becomes zero, the battle ends (YES in step S150). When the player character 204 defeats the enemy character 202, a special item may be placed in the virtual space 200 as a reward for the player. The special item is materialized when the distance to the player terminal 10 becomes smaller than a predetermined value (when the player terminal 10 approaches the special item), and the player character 204 touches the materialized item. Then, the player acquires the item.

In the above example, the HP of the player character 204 is restored during the period when the player character 204 is included in the field of view of the virtual camera 220 (that is, the player character 204 is displayed on the game screen 60). Is also good. In this case, the shorter (closer) the distance between the position (viewpoint) of the virtual camera and the player character 204, the faster the HP recovery speed may be.

In the above-mentioned example, a weapon selected by the player from a plurality of weapons owned by the player may be set (equipped) for the player character 204. In this case, the type of physical attack changes according to the type of weapon set (for example, the attribute of physical attack changes according to the attribute of the weapon), and the aiming object depends on the type of physical attack. Change the appearance of 206 (for example, if the physical attack attribute is "water", the display color is blue, while if the physical attack attribute is "fire", the display color is red, etc. ) You may do it.

The battle game in the above-mentioned example is configured as a game in which one player plays against an enemy character, but the battle game in another example of the present embodiment allows cooperative play by a plurality of players. It is composed. For example, as illustrated in FIG. 16, when two players PLA and PLB play together, when the player PLA, which is one player, reads the coin CN in advance, the coin CN is displayed in the virtual space 200. The enemy character 202 corresponding to the type and issue year is placed at the position of the coin CN, and the player character 204A corresponding to the player PLA is based on the relative positional relationship between the user terminal 10A of the player PLA and the coin CN. Is placed at a position between the coin CN and the user terminal 10A. Information about the virtual space 200 in which the enemy character 202 and the player character 204A are arranged is managed by the content management server 30 or the like.

Then, when the player PLB, which is the other player, reads the coin CN after designating the player PLA (or the virtual space 200), which is the player performing cooperative play, the relative between the user terminal 10B of the player PLB and the coin CN. In the same virtual space 200, the player character 204B corresponding to the player PLB is arranged at a position between the coin CN and the user terminal 10B based on the positional relationship.

Then, in each of the user terminals 10A and 10B, control of movement of the player characters 204A and 204B via the virtual controller 66, aiming at the enemy character 202 via the aiming object 206, and physical attack and skill against the enemy character 202. When an operation such as an attack is performed, the content management server 30 or the like controls the battle. Here, the aiming object 206 of the other player is displayed, but the connected object 208 of the other player is hidden (for example, on the game screen 60 displayed on the user terminal 10A, the connected object 208 of the player character 204A is displayed. While it is displayed, the connected object 208 of the player character 204B may not be displayed). The hiding of the connected object 208 of the other player improves the visibility of the virtual space 200. Further, in the virtual space 200, when the aiming object 206 of the player PLA and the aiming object 206 of the player PLB overlap (for example, when aiming at the same part of the enemy character 202), "double attack" or the like. May be displayed so that a special effect (for example, an effect that enables a stronger attack (increased damage) than usual) is generated.

In the above example, the shape of the aiming object 206 is configured to be spherical, but the shape can be various shapes other than the spherical shape, for example, a coin-shaped shape. When the shape of the aiming object 206 is a coin shape in the above-mentioned game configured to enable cooperative play by a plurality of players, the outline of the aiming object 206 of the player itself is displayed as a circle (field of view). The orientation of the object 206 is controlled so that the straight line extending through the center of the coin-shaped aiming object 206 is orthogonal to the plane of the coin-shaped aiming object 206), and the other player's aiming object 206 is the player's viewpoint. It is displayed as an outline (oval, rectangular, etc.) according to the relative positional relationship (angle) between the objects.

In the above-mentioned example, the coin CN is read to determine and arrange the enemy character to appear, but in another example of the present embodiment, the enemy character is determined and arranged without reading the coin CN. This is done (for example, an enemy character determined based on a predetermined rule is placed at a predetermined coordinate in the virtual space).

In the above-mentioned example, a battle game in which a battle game is played against an enemy character is illustrated, but the game provided by the user terminal 10 of the present embodiment includes various games other than the battle game. For example, in another example of the present embodiment, the user terminal 10 provides a sports game, and a designation of an object to be an action to be executed by the player character via an object corresponding to the aiming object 206 (for example, a soccer game). In, designation of another player who is the target of the pass executed by the player character, etc.) is performed. Further, in another example of the present embodiment, the user terminal 10 may be configured to provide various contents other than the game, for example, the contents of a live moving image in which the user's avatar appears.

The user terminal 10 according to the present embodiment described above provides content using augmented reality technology (for example, a battle game), and in the content, the position and orientation of a virtual camera linked to the real camera 131 A designation object (eg, aiming object 206) is placed at a position in the virtual space based on it, and a predetermined action (eg, physical) targeting the target object (eg, enemy character 202) designated via the designation object. Execution by the user character (for example, player character 204) of the attack) is controlled. That is, the user can specify the target of the predetermined action executed by the user character included in the virtual space via the designation object arranged based on the movement of the user terminal 10 (camera 131). In this way, the user terminal 10 supports good operation of the user character in the content using the augmented reality technology.

The processes and procedures described herein are implemented by software, hardware, or any combination thereof, other than those expressly described. For example, the processes and procedures described herein are realized by implementing logic corresponding to the processes and procedures on a medium such as an integrated circuit, a volatile memory, a non-volatile memory, or a magnetic disk. Further, the processes and procedures described in the present specification can be implemented as a computer program corresponding to the processes and procedures and executed by various computers.

Even if it is explained that the processes and procedures described herein are performed by a single device, software, component, module, such processes or procedures are performed by multiple devices, multiple software, multiple devices. Can be executed by a component of, and / or multiple modules. The software and hardware elements described herein can also be achieved by integrating them into fewer components or by breaking them down into more components.

In the present specification, when the components of the invention are described as either one or more, or even if they are described without limitation to either one or more, they should be understood separately in the context. Except for, the component may be either singular or plural.

10 User terminal 11 Computer processor 111 Image generation display unit 112 Content progress control unit 131 Camera 30 Content management server 50 Coin reading screen 60 Game screen 200 Virtual space 202 Enemy character (target object)
204 Player character (user character)
206 Aiming object (designation object)
208 Concatenated object

Claims (13)

A system equipped with one or more computer processors to provide content using augmented reality technology.
The one or more computer processors depend on the execution of readable instructions.
Augmented reality image in which the image of the virtual space including the user character is superimposed on the image of the real space through the real camera and the image of the virtual space through the virtual camera linked to the real camera is superimposed. The process of generating and displaying images,
A process of controlling the progress of the content based on at least the movement of the user character is executed.
The process of controlling the progress of the content is
Placing a designating object for designating a target object for a predetermined action performed by the user character at a position in the virtual space at least based on the position and orientation of the virtual camera.
Arranging a connected object connecting the user character and the designated object in the virtual space, and
Including controlling the execution of the predetermined action by the user character targeting the target object designated via the designation object.
system. A system equipped with one or more computer processors to provide content using augmented reality technology.
The one or more computer processors depend on the execution of readable instructions.
Augmented reality image in which the image of the virtual space including the user character is superimposed on the image of the real space through the real camera and the image of the virtual space through the virtual camera linked to the real camera is superimposed. The process of generating and displaying images,
A process of controlling the progress of the content based on at least the movement of the user character is executed.
The process of controlling the progress of the content is
When a specific target object exists on a predetermined straight line extending in the direction of the field of view of the virtual camera as a specification object for designating a target object to be the target of a predetermined action executed by the user character. While arranging at the position of the specific target object, when none of the target objects exists on the predetermined straight line, the object is arranged at the position on the predetermined straight line separated from the position of the virtual camera by a certain distance. That and
Including controlling the execution of the predetermined action by the user character targeting the target object at the position where the designation object is arranged.
system. The process of controlling the progress of the content has shifted from the first state in which the specific target object exists on the predetermined straight line to the second state in which no target object exists on the predetermined straight line. In this case, only the certain distance, which is the distance between the virtual camera and the specific target object immediately before the transition from the position of the virtual camera to the second state. Including placing the designated object at a position on the predetermined straight line at a distance.
The system of claim 2. A system equipped with one or more computer processors to provide content using augmented reality technology.
The one or more computer processors depend on the execution of readable instructions.
Augmented reality image in which the image of the virtual space including the user character is superimposed on the image of the real space through the real camera and the image of the virtual space through the virtual camera linked to the real camera is superimposed. The process of generating and displaying images,
A process of controlling the progress of the content based on at least the movement of the user character is executed.
The process of controlling the progress of the content is
Placing a designating object for designating a target object for a predetermined action performed by the user character at a position in the virtual space at least based on the position and orientation of the virtual camera.
Controlling the execution of the predetermined action targeting the target object specified via the designation object by the user character, and
Including varying the value of a predetermined parameter of the user character based on at least the relative positional relationship in the virtual space between the virtual camera and the user character.
system. The process of controlling the progress of the content includes increasing the fluctuation speed of the value of the predetermined parameter as the distance in the virtual space between the virtual camera and the user character becomes shorter.
The system of claim 4. The content is a competitive game and
The target object includes an enemy character and
The predetermined action includes an attack on the enemy character.
The system according to any one of claims 1 to 5. The process of controlling the progress of the content includes changing the appearance of the designating object according to the type of the predetermined action.
The system according to any one of claims 1 to 6. A method of providing content that is run by one or more computers and uses augmented reality technology.
Augmented reality image in which the image of the virtual space including the user character is superimposed on the image of the real space through the real camera and the image of the virtual space through the virtual camera linked to the real camera is superimposed. Steps to generate and display images and
A step of controlling the progress of the content based on at least the movement of the user character.
The step of controlling the progress of the content is
Placing a designating object for designating a target object for a predetermined action performed by the user character at a position in the virtual space at least based on the position and orientation of the virtual camera.
Arranging a connected object connecting the user character and the designated object in the virtual space, and
Including controlling the execution of the predetermined action by the user character targeting the target object designated via the designation object.
Method. A method of providing content that is run by one or more computers and uses augmented reality technology.
Augmented reality image in which the image of the virtual space including the user character is superimposed on the image of the real space through the real camera and the image of the virtual space through the virtual camera linked to the real camera is superimposed. Steps to generate and display images and
A step of controlling the progress of the content based on at least the movement of the user character.
The step of controlling the progress of the content is
When a specific target object exists on a predetermined straight line extending in the direction of the field of view of the virtual camera as a specification object for designating a target object to be the target of a predetermined action executed by the user character. While arranging at the position of the specific target object, when none of the target objects exists on the predetermined straight line, the object is arranged at the position on the predetermined straight line separated from the position of the virtual camera by a certain distance. That and
Including controlling the execution of the predetermined action by the user character targeting the target object at the position where the designation object is arranged.
Method. A method of providing content that is run by one or more computers and uses augmented reality technology.
Augmented reality image in which the image of the virtual space including the user character is superimposed on the image of the real space through the real camera and the image of the virtual space through the virtual camera linked to the real camera is superimposed. Steps to generate and display images and
A step of controlling the progress of the content based on at least the movement of the user character.
The step of controlling the progress of the content is
Placing a designating object for designating a target object for a predetermined action performed by the user character at a position in the virtual space at least based on the position and orientation of the virtual camera.
Controlling the execution of the predetermined action targeting the target object specified via the designation object by the user character, and
Including varying the value of a predetermined parameter of the user character based on at least the relative positional relationship in the virtual space between the virtual camera and the user character.
Method. A program for providing content using augmented reality technology
Depending on the execution on one or more computers, the one or more computers
Augmented reality image in which the image of the virtual space including the user character is superimposed on the image of the real space through the real camera and the image of the virtual space through the virtual camera linked to the real camera is superimposed. The process of generating and displaying images,
A process of controlling the progress of the content based on at least the movement of the user character is executed.
The process of controlling the progress of the content is
Placing a designating object for designating a target object for a predetermined action performed by the user character at a position in the virtual space at least based on the position and orientation of the virtual camera.
Arranging a connected object connecting the user character and the designated object in the virtual space, and
Including controlling the execution of the predetermined action by the user character targeting the target object designated via the designation object.
program. A program for providing content using augmented reality technology
Depending on the execution on one or more computers, the one or more computers
Augmented reality image in which the image of the virtual space including the user character is superimposed on the image of the real space through the real camera and the image of the virtual space through the virtual camera linked to the real camera is superimposed. The process of generating and displaying images,
A process of controlling the progress of the content based on at least the movement of the user character is executed.
The process of controlling the progress of the content is
When a specific target object exists on a predetermined straight line extending in the direction of the field of view of the virtual camera as a specification object for designating a target object to be the target of a predetermined action executed by the user character. While arranging at the position of the specific target object, when none of the target objects exists on the predetermined straight line, the object is arranged at the position on the predetermined straight line separated from the position of the virtual camera by a certain distance. That and
Including controlling the execution of the predetermined action by the user character targeting the target object at the position where the designation object is arranged.
program. A program for providing content using augmented reality technology
Depending on the execution on one or more computers, the one or more computers
Augmented reality image in which the image of the virtual space including the user character is superimposed on the image of the real space through the real camera and the image of the virtual space through the virtual camera linked to the real camera is superimposed. The process of generating and displaying images,
A process of controlling the progress of the content based on at least the movement of the user character is executed.
The process of controlling the progress of the content is
Placing a designating object for designating a target object for a predetermined action performed by the user character at a position in the virtual space at least based on the position and orientation of the virtual camera.
Controlling the execution of the predetermined action targeting the target object specified via the designation object by the user character, and
Including varying the value of a predetermined parameter of the user character based on at least the relative positional relationship in the virtual space between the virtual camera and the user character.
program.

Images