JP7324801B2 - Program, information processing method, information processing apparatus, and system - Google Patents

Description

The present disclosure relates to programs, information processing methods, information processing apparatuses, and systems.

Patent Documents 1 and 2 disclose technologies related to AR (Augmented Reality).

JP 2020-58658 A JP 2020-77187 A

By the way, in the real world, various races such as boat races and horse races are held.

The techniques disclosed in Patent Documents 1 and 2 superimpose a virtual object unrelated to the real world on an image of the real world, and do not present any means for solving the above problem.

An object of one aspect of the present disclosure is to facilitate identification of each moving object corresponding to a participant in a race or a moving object in the real world.

According to one embodiment shown in the present disclosure,
A program executed in a first computer comprising a processor and an imaging unit,
The program causes the processor to:
receiving from a second computer first information about a given race in the real world;
generating, based on the first information, a virtual object for presenting second information about the predetermined race to a user of the first computer;
superimposing and displaying the virtual object on a real image of the surroundings of the first computer captured by the imaging unit;
The first information includes at least contestant information related to contestants and/or moving bodies in the predetermined race,
including at least a moving object corresponding to the contestant or the moving object as the virtual object;
In the displaying step, at least part of the contestant information is displayed in association with the moving object;
A program is provided.

According to an embodiment shown in the present disclosure, it is possible to make each moving object easier to discriminate with respect to moving objects corresponding to race participants and moving objects in the real world.

1 is a diagram showing a configuration example of a system according to an embodiment; FIG. 2 is a block diagram showing an example of functional configuration of a user terminal according to an embodiment; FIG. 3 is a block diagram showing an example of a functional configuration of a server according to one embodiment; FIG. 1 is a schematic diagram illustrating an example of a real-world race track according to an embodiment; FIG. FIG. 4 is a schematic diagram showing an example of a virtual object displayed on a user terminal according to an embodiment; FIG. 6 is a flow chart showing an example of display control processing according to an embodiment; FIG. 4 is a schematic diagram showing an example of a real image captured by an imaging unit according to an embodiment; FIG. 10 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image according to an embodiment; FIG. 4 is a schematic diagram showing an example of a method of displaying contestant information according to an embodiment; FIG. 4 is a schematic diagram showing an example of a method for displaying detailed contestant information according to an embodiment; FIG. 11 is a schematic diagram showing another example of a method for displaying detailed contestant information according to an embodiment; FIG. 11 is a schematic diagram showing another example of a method for displaying detailed contestant information according to an embodiment; FIG. 4 is a schematic diagram showing an example of a method of displaying contestant information during a virtual race according to an embodiment; FIG. 11 is a schematic diagram showing another example of how to display contestant information during a virtual race according to an embodiment;

Hereinafter, embodiments of this technical idea will be described in detail with reference to the drawings. In the following description, the same elements are denoted by the same reference numerals, and overlapping descriptions are omitted as appropriate. In one or more of the embodiments presented in this disclosure, elements of each embodiment may be combined with each other and the combined result shall also form part of the embodiments presented in this disclosure.

(System configuration)
FIG. 1 is a diagram showing the configuration of system 1 according to the present embodiment. The system 1 can display, for example, a predetermined race held in the real world as a virtual race using virtual objects on the information processing device used by the user. In this specification, the "predetermined race" is not particularly limited as long as it is a race that is held in the real world. Examples include car races such as F1, drone races, dog races, marathons, and relay road races.

As shown in FIG. 1, the system 1 includes a user terminal 10A, a user terminal 10B, and a user terminal 10C (hereinafter referred to as user terminals 10A, 10B, 10C, etc.), which are information processing apparatuses (first computers) used by users. a plurality of user terminals 10 , a first server device (second computer) 20 , a second server device 40 , and a network 30 .

The user terminals 10A and 10B are connected to the network 30 by communicating with the radio base station 31 . The user terminal 10C connects to the network 30 by communicating with a wireless router 32 installed in a facility such as a house. The user terminal 10 is, for example, a mobile terminal with a touch screen, and may be a smart phone, a phablet, a tablet, or the like.

The user terminal 10 executes, for example, a program installed via a platform that distributes applications or the like, or a program including pre-installed website browsing software. The user terminal 10 communicates with the first server device 20 by executing the above program, and transmits/receives data related to a predetermined race, data related to the user, etc. to/from the first server device 20, thereby allowing the user It is possible to display a virtual race on the terminal 10. - 特許庁

The first server device 20 receives data related to a given race from the second server device 40 . The first server device 20 appropriately transmits data related to a predetermined race to the user terminal 10 . The first server device 20 stores and manages data related to a predetermined race and data related to each user.

The first server device 20 includes a communication IF (Interface) 22, an input/output IF 23, a memory 25, a storage 26, and a processor (second processor) 29 as a hardware configuration. connected to each other through

The communication IF 22 is compatible with various communication standards such as the LAN (Local Area Network) standard, and functions as an interface for transmitting and receiving data to and from the user terminal 10, the second server device 40, and the like.

The input/output IF 23 functions as an interface for receiving input of information to the first server device 20 and outputting information to the outside of the first server device 20 . The input/output IF 23 can include an input receiving section that receives connection of information input devices such as a mouse and keyboard, and an output section that receives connection of information output devices such as a display for displaying images and the like.

The memory 25 is a storage device for storing data used for processing. The memory 25 provides the processor 29 with a work area for temporary use when the processor 29 performs processing, for example. The memory 25 includes ROM (Read Only Memory), RAM (Random
Access Memory) and other storage devices.

The storage 26 is a storage device for storing various programs and data for the processor 29 to read and execute. The information stored by the storage 26 includes data related to predetermined races, data related to each user, and the like. The storage 26 can be configured including a storage device such as an HDD (Hard Disk Drive) and flash memory. Note that the storage is not limited to being included in the server device, and a cloud service can also be used.

The processor 29 controls the operation of the first server device 20 by reading and executing programs and the like stored in the storage 26 . The processor 29 is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics
Processing Unit) and the like.

The second server device 40 stores and manages data related to predetermined races. The second server device 40 is, for example, a server device managed by an organizer of a predetermined race, or a server device managed by an organization (publisher of a race magazine, etc.) that transmits information about a predetermined race to the outside. The second server device 40 appropriately transmits data related to a predetermined race to the first server device 20 . In one aspect, the second server device 40 may transmit data related to a given race to the user terminal 10 . The hardware configuration of the second server device 40 may be the same as that of the first server device 20 as long as there is no contradiction.

(user terminal)
FIG. 2 is a block diagram showing an example of the functional configuration of the user terminal 10. As shown in FIG. As shown in FIG. 2, the user terminal 10 includes an antenna 110, a wireless communication IF 120, a touch screen 130, an input/output IF 140, a storage unit 150, an audio processing unit 160, a microphone 161, a speaker 162, It includes an imaging unit 170 and a control unit (first processor) 190 .

The antenna 110 radiates the signal emitted by the user terminal 10 into space as radio waves. Antenna 110 also receives radio waves from space and provides a received signal to wireless communication IF 120 .

The wireless communication IF 120 performs modulation/demodulation processing and the like for transmitting and receiving signals via the antenna 110 and the like in order for the user terminal 10 to communicate with other communication devices. The wireless communication IF 120 is a communication module for wireless communication including a tuner, a high-frequency circuit, and the like.

Touch screen 130 accepts input from a user and outputs information to display 132 for the user. Touch screen 130 includes a touch panel 131 and a display 132 for accepting user operation input. The touch panel 131 detects that a user's finger or the like approaches by using, for example, a capacitive touch panel. The display 132 is implemented by, for example, an LCD (Liquid Crystal Display), an organic EL (electroluminescence), or other display device.

The input/output IF 140 receives input of information to the user terminal 10 and functions as an interface for outputting information to the outside of the user terminal 10 .

The storage unit 150 is composed of a flash memory, an HDD, or the like, and stores programs used by the user terminal 10 and various data received by the user terminal 10 from the first server device 20 or the like.

The audio processing unit 160 modulates and demodulates an audio signal. Audio processing section 160 modulates the signal supplied from microphone 161 and supplies the modulated signal to control section 190 . Also, the audio processing unit 160 provides an audio signal to the speaker 162 . The audio processing unit 160 is implemented by, for example, a processor for audio processing. Microphone 161 functions as an audio input unit for receiving input of an audio signal and outputting it to control unit 190 . The speaker 162 functions as an audio output unit for outputting audio signals to the outside of the user terminal 10 .

The imaging unit 170 is a camera that captures a real image of the surroundings of the user terminal 10 . An image captured by the imaging unit 170 is subjected to image processing by the control unit 190 and output to the display 132 .

The control unit 190 controls the operation of the user terminal 10 by reading and executing programs stored in the storage unit 150 . The control unit 190 is implemented by, for example, an application processor.

A process of executing the application program 151 by the control unit 190 will be described in more detail. Storage unit 150 stores application program 151 , application information 152 , and user information 153 .

For example, the user terminal 10 downloads the application program 151 from the first server device 20 and stores it in the storage unit 150 . Also, the user terminal 10 communicates with the first server device 20 to transmit and receive various data such as application information 152 and user information 153 to and from the first server device 20 .

The application program 151 is a program for displaying virtual races on the user terminal 10 . The application information 152 includes various data referred to by the application program 151 . Application information 152 includes first information 152A.

The first information 152A is information regarding a predetermined race transmitted from the first server device 20 or the second server device 40 . The first information 152A includes, for example, at least contestant information regarding contestants and/or moving bodies (hereinafter also referred to as “contestants, etc.”) in a predetermined race. Contestant information includes, for example, names of contestants, popularity rankings and odds information of contestants in predetermined races, past race results of contestants, and the like.

As used herein, the term "contestant" is a concept that includes not only humans but also animals such as horses and dogs. A "moving object" is an object that moves in a given race, such as an animal or a machine that a contestant rides, or a machine that is remotely controlled by a contestant. In a marathon, a dog race, etc., the "participant" and the "moving object" are the same.

In addition to the above, the first information 152A includes, for example, race time information indicating the race time of a contestant, position information of a contestant during a predetermined race, and time information corresponding to the position information. can be included.

The first information 152A includes, for example, the name of a predetermined race, the date and time of the race, race track data, participant data other than the above, mobile object data, odds information, race forecast, race start chart, information just before the race, pit It may include reports, race results, race videos, race still images, past race information, and other information that can be published in information magazines and information sites related to predetermined races.

User information 153 includes information about the user of user terminal 10 . The user information 153 includes, for example, information identifying the user, location information of the user terminal 10, user's race purchase history and hit rate (for example, in the case of a boat race, the history of purchased boat tickets and the number of purchased boat tickets). Hit rate) and the like may be included.

By reading and executing the application program 151 , the control unit 190 operates an operation input reception unit 191 , a transmission/reception unit 192 , an object generation unit 193 , a display control unit 194 , a detection unit 195 , and a selection information acquisition unit 196 . and demonstrate each function.

The operation input receiving unit 191 receives user's operation input based on the output of the touch screen 130 . Specifically, the operation input receiving unit 191 detects that a user's finger or the like touches or approaches the touch panel 131 as coordinates of a coordinate system having a horizontal axis and a vertical axis on the surface forming the touch screen 130 .

Operation input reception unit 191 determines a user's operation on touch screen 130 . The operation input reception unit 191 performs, for example, “approach operation”, “release operation”, “tap operation”, “double tap operation”, “long press operation (long touch operation)”, “drag operation (swipe operation)”, User operations such as "move operation", "flick operation", "pinch-in operation", and "pinch-out operation" are determined.

The operation input receiving unit 191 may receive, as an operation input, movement of the user terminal 10 detected by an acceleration sensor or the like mounted on the user terminal 10 .

The transmission/reception unit 192 transmits and receives various types of information to and from external communication devices such as the first server device 20 and the second server device 40 via the wireless communication IF 120 and the network 30 . The transmitter/receiver 192 receives the first information 152A from the first server device 20 or the second server device 40, for example. Further, the transmission/reception unit 192 transmits, for example, information corresponding to the operation input received by the operation input reception unit 191, information stored in the user information 153, and the like to the first server device 20 or the second server device 40. .

The object generator 193 generates a virtual object for presenting the user with second information about a predetermined race, based on the first information. In this specification, "second information" is, for example, at least part of the first information 152A or information calculated from the first information 152A. In one aspect, the "second information" can be information that can be presented as text. In a certain aspect, the “second information” may be ranking information indicating the ranking of the contestants in a predetermined race or the ranking of the contestants as a result of the race.

The object generation unit 193 can generate, as virtual objects, a racetrack object representing a racetrack and a moving object representing a contestant or the like. Also, the object generation unit 193 generates a text object presenting contestant information as a virtual object.

The object generation unit 193 may generate a virtual display board for text-displaying the second information. In addition to the objects described above, the object generation unit 193 generates a virtual screen for displaying the second information as an image, various building objects, landscape objects such as trees that constitute the landscape, objects that become the user's avatar, and the like. may be generated.

The display control unit 194 superimposes a virtual object generated by the object generation unit 193 on a real image of the surroundings of the user terminal 10 captured by the imaging unit 70 (hereinafter also referred to as a “superimposed image”). displayed on the display 132. The display control unit 194 causes the text object presenting the contestant information to be displayed in association with the moving object.

In addition, the display control unit 194 moves the moving object on the racetrack object based on the race time information included in the first information 152A, for example, and displays a virtual race that virtually reproduces a predetermined race on the display 132. display. In addition to the race time information, the display control unit 194 preferably reproduces the virtual race based on the position information of the contestants included in the first information 152A and the time information corresponding to the position information. .

It is preferable that the display control unit 194 can change the viewpoint in the superimposed image according to the operation input received by the operation input reception unit 191 . The display control unit 194 causes the display 132 to display various menu screens and a GUI (Graphical User Interface) or changes the display contents of the display 132 in accordance with the operation input received by the operation input reception unit 191 .

The detection unit 195 detects flat surfaces in the real image captured by the imaging unit 170 . Detection of a flat surface is realized by conventionally known image recognition technology. For example, when the user performs an operation to select the flat surface detected by the detection unit 195, the display 132 displays a superimposed image in which the racetrack object is arranged on the flat surface.

Preferably, the flat surface is a horizontal surface. Also, the angle formed by the flat surface and the bottom surface forming the racetrack object may be 0 degrees, but is preferably an acute angle, and can be in the range of 15 degrees to 45 degrees, for example. The angle can also be adjusted by accepting a user's operation. In addition, even if there is a projection on a part of the flat surface in the real world, or even if there is an object on the flat surface, if the projection or the object is of a size that can be hidden by the racetrack object. , may be detected as a flat surface on which the racetrack object can be placed.

The selection information acquisition unit 196 acquires one or more pieces of selection information indicating one or more contestants selected by the user. The “selection information” is, for example, information indicating the contestants predicted by the user as the winners of a predetermined race. If the predetermined race is a boat race or a horse race, the "selection information" can be information indicating boat tickets or betting tickets purchased by the user.

The selection information acquisition unit 196 acquires selection information, for example, based on a user's operation input on a screen for selecting contestants. The selection information acquired by the selection information acquisition unit 196 is transmitted to the first server device 20 or the second server device 40, for example. If the predetermined race is a boat race or a horse race, the process of purchasing a boat ticket or a betting ticket can be performed in response to the transmission of the selection information to the second server device 40 .

(First server device)
FIG. 3 is a block diagram showing the functional configuration of the first server device 20. As shown in FIG. A detailed configuration of the first server device 20 will be described with reference to FIG. The first server device 20 functions as a communication unit 220, a storage unit 250, and a control unit 290 by operating according to a program.

The communication unit 220 functions as an interface for the first server device 20 to communicate with external communication devices such as the user terminal 10 and the second server device 40 via the network 30 .

The storage unit 250 stores various programs and data for realizing the system 1 . In one aspect, storage unit 250 stores program 251 , race information 252 , and user information 253 .

The program 251 is a program for realizing the system 1 by the first server device 20 communicating with the user terminal 10 and the second server device 40 . The program 251 is executed by the control unit 290 to perform processing for transmitting and receiving data to and from the user terminal 10 and the second server device 40, processing according to the operation content performed by the user of the user terminal 10, race information 252 and user The first server device 20 is caused to perform processing such as updating the information 253 .

Race information 252 includes various data related to a given race. Race information 252 includes, for example, first information 252A. The first information 252A is information from which the first information 152A is based, and the first information 152A can be part of the first information 252A. The first information 252A is information acquired from the second server device 40, for example.

User information 253 is information about the user of the user terminal 10 . User information 253 includes a user management table 253A. The user management table 253A stores, for each user, information for identifying the user, location information of the user terminal 10, user's race purchase history, hit rate, and the like.

The control unit 290 is implemented by the processor 29, and by executing the program 251, functions as a transmission/reception unit 291, a first information acquisition unit 292, a selection information acquisition unit 293, a data management unit 294, and a timer unit 295. .

The transmission/reception unit 291 transmits and receives various types of information to and from external communication devices such as the user terminal 10 and the second server device 40 via the communication unit 220 and the network 30 . The transmitting/receiving unit 291 transmits at least part of the first information 252A to the user terminal 10, for example. Also, the transmission/reception unit 291 receives the first information 252A from the second server device 40, for example.

The first information acquisition unit 292 acquires the first information 252A from the second server device 40 via the transmission/reception unit 291 . The selection information acquisition unit 293 acquires user selection information from the user terminal 10 or the second server device 40 via the transmission/reception unit 291 . The data management unit 294 updates various data stored in the storage unit 250 according to the processing results of the first information acquisition unit 292, the selection information acquisition unit 293, and the like. The timer 295 performs processing for measuring time. Various times displayed on the user terminal 10 (for example, the time until the start of the race, etc.) can be controlled based on the time measured by the timer 295 .

(Operation example)
Next, an operation example in the system 1 will be described with reference to FIGS. 4 to 14. FIG. Although the case where the predetermined race is a boat race will be described below as an example, the following description can be applied even if the predetermined race is another race. In the following description, data is transmitted and received between the user terminal 10 and the first server device 20, and between the first server device 20 and the second server device 40. The terminal 10 and the second server device 40 may be configured to directly transmit and receive data.

FIG. 4 is a schematic diagram showing an example of a boat race track in the real world. Two turn marks 403 are installed in a boat race course 401, and races are conducted by boats 402a to 402f on which boat racers ride. When the race ends, race time information indicating the race times of the boats 402a to 402f is transmitted from the second server device 40 to the first server device 20, and from the first server device 20 to the user terminal 10. FIG.

The boat race course 401 is provided with imaging devices (cameras) 404a to 404b. The imaging device 404a captures the boats 402a to 402f from above the boat race course 401 in its field of view. The imaging device 404b captures the boats 402a to 402f from the sides of the boat race course 401 in the field of view. The images of the boats 402 a - 402 f captured by the imaging devices 404 a - 404 b are transmitted to the second server device 40 . The second server device 40, for example, performs image analysis of each image, and calculates position information indicating the position of each of the boats 402a to 402f at the time when each image was captured. The calculated position information and the time information regarding the shooting time corresponding to the position information are transmitted to the first server device 20 and transmitted from the first server device 20 to the user terminal 10 . Note that the position information may be calculated in the first server device 20 .

In place of or in addition to the imaging devices 404a-404b, position sensors such as GPS sensors may be installed on the boats 402a-402f. The position information of the boats 402a to 402f obtained by the position sensors and the time information indicating the time when the position information was obtained are finally transmitted to the user terminal 10. FIG.

FIG. 5 is a schematic diagram showing an example of a virtual object displayed on the user terminal 10. As shown in FIG. In the example of FIG. 5, the virtual objects are a racetrack object 501, moving objects 502a to 502f (hereinafter collectively referred to as "moving objects 502"), two turn mark objects 503, a virtual display board 505, It is shown.

A racetrack object 501 is an object that is a virtual display of the boat racetrack 401 . The race track object 501 and the turn mark object 503 are preferably created based on race track data such as course information of the boat race track 401 , and preferably have shapes corresponding to the boat race track 401 .

The moving objects 502a to 502f are objects that are virtual representations of the boats 402a to 402f, respectively, and have boat-like shapes. The moving objects 502a-502f move in the racetrack object 501 based on the race time information, the positional information of the boats 402a-402f, and the time information corresponding to the positional information. That is, a race in the real world is displayed on the user terminal 10 as a virtual race using the racetrack object 501 and the moving objects 502a to 502f.

It should be noted that it is also possible to display the virtual race only by the race time information without the position information and time information of the boats 402a-402f. However, in this case, although the final order of finish is the same as in the real-world race, it is difficult to reproduce the progress of the race, such as the ranking during the race.

A virtual display board 505 is an object that displays text information. Virtual display board 505 is, for example, an object that does not have a corresponding existence in boat race track 401 . The text information displayed on the virtual display board 505 is not particularly limited, and may be ranking information, odds information, or the like, for example. Also, the text information displayed on the virtual display board 505 may be changeable based on the user's operation input.

FIG. 6 is a flowchart illustrating an example of display control processing. It should be noted that the order of each process constituting the flow chart described below is random as long as there is no contradiction or inconsistency in the contents of the process. Also, the processing executed by each device may be executed by another device as long as there is no contradiction.

The processing shown in FIG. 6 is implemented by the control unit 190 executing the application program 151 and the control unit 290 executing the program 251, respectively. First, in step S610, the control unit 190 activates the imaging unit 170, which is a camera. A real image around the user terminal 10 is captured by the imaging unit 170 .

In step S<b>620 , the control unit 190 detects a flat surface within the image captured by the imaging unit 170 . In step S630, the control unit 190 arranges the virtual object on the detected flat surface.

Here, the processing of steps S610, S620, and S630 will be specifically described using FIGS. 7 and 8. FIG. FIG. 7 is a schematic diagram showing an example of a real image captured by the imaging unit 170. As shown in FIG. In the example of FIG. 7, a keyboard 702 and a monitor device 703 are placed on a flat desk 701 .

When the imaging unit 170 is activated in step S610, a real image captured by the imaging unit 170 is displayed on the display 132. FIG. Next, in step S<b>620 , the control unit 190 detects a flat surface within the image captured by the imaging unit 170 , that is, within the image displayed on the display 132 .

In FIG. 7, region 704 is detected as a flat surface. There is a keyboard 702 within the area 704, but the size of the keyboard 702 is such that it can be hidden by the racetrack object 501, so the control unit 190 detects the area 704 as a flat surface.

In the state shown in FIG. 7, if the position captured by the imaging unit 170 is changed, the position of the region 704 can also be changed. The region 704 is displayed on the display 132 by adding a predetermined color, for example, so as to be distinguishable from other portions. When the user performs a tap operation or the like on the area 704, the control unit 190 arranges a virtual object such as the racetrack object 501 on the area 704 in step S630.

FIG. 8 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image. In FIG. 8, the dot patterned area including the monitor device 703 is the real image, and the other area is the area where the virtual object is displayed. For example, an advertisement image may be displayed in the area where no virtual object is displayed.

In FIG. 8, as virtual objects, there are a racetrack object 501, a plurality of moving objects 502, two turn mark objects 503, a large monitor object 506, building objects 507a to 507b, and other objects not labeled. A large number of objects (tree objects, clock objects, etc.) are displayed. These objects are created based on the first information 152A received from the first server device 20, for example.

In FIG. 8, the racetrack object 501 is placed on the area 704 such that the angle between the flat surface included in the area 704 and the bottom surface of the racetrack object 501 is 0 degrees. In this case, for example, an area in the depth direction such as the area X1 and moving objects 502 may overlap each other and become difficult to see. In addition, a blind spot where the moving object 502 cannot be seen may occur in a region on the depth direction side of the large monitor object 506 .

However, in the state shown in FIG. 8, the user can change the viewpoint of the superimposed image displayed on display 132 . For example, when the user performs an operation input such as a pinch-in operation or a pinch-out operation, the viewpoint position of the imaging unit 170 may move closer to or farther from the racetrack object 501 . Also, when the user moves in the depth direction of the display 132 while holding the user terminal 10 or moves in the front direction, the viewpoint position of the imaging unit 170 may move closer to or further away from the racetrack object 501 . Also, when the user performs an operation to specify a predetermined position on the display 132, the viewpoint position can move to the specified position. Such a viewpoint change can solve the visibility problem described above.

Further, by arranging the race field object 501 such that the angle θ formed between the flat surface S1 and the bottom surface S2 forming the race field object 501 is an acute angle, the above-described problem related to visibility can be alleviated.

Returning to the description of the flowchart in FIG. In step S<b>640 , the control unit 290 of the first server device 20 acquires contestant information from the second server device 40 . The control unit 190 acquires contestant information from the first server device 20 . The process of step S640 may be performed with a predetermined frequency or when a specific event occurs. That is, the contestant information can be updated each time the process of step S640 is performed. Specific events are not particularly limited, but may include, for example, changes in participant information (for example, changes in odds), the start or end of races, finalization of rankings, etc. There are cases where

In step S650, the control unit 190 associates each moving object 502 with the corresponding contestant information. Next, the control unit 190 displays a text object presenting at least part of the contestant information associated with the moving object 502 around the moving object 502 .

In step S670, the control unit 190 associates each moving object 502 with the corresponding contestant information. Next, the control unit 190 displays a text object presenting at least part of the contestant information associated with the moving object 502 around the moving object 502 .

Here, the processing of step S670 will be specifically described using FIG. FIG. 9 is a schematic diagram showing an example of a display method of contestant information. In FIG. 9, moving objects 502a to 502b are displayed on a racetrack object 501. In FIG. A text object 512a presenting contestant information corresponding to the moving object 502a is displayed above the moving object 502a.

When the moving object 502a moves, the text object 512a also moves to follow the moving object 502a. In one aspect, the relative positional relationship between moving object 502a and text object 512a does not change. The display position of the text object 512a is not particularly limited as long as it is around the moving object 502a. The moving object 502b and the text object 512b are similar to the moving object 502a and the text object 512a. In this specification, the term “surrounding the moving object” may include a range that overlaps with the moving object.

In the example of FIG. 9, the text objects 512a-512b indicate the frame numbers of the moving objects 502a-502b, the name of the racer to board, and odds information. When the contestant information is updated based on the process of step S640, the contestant information displayed in the text objects 512a-512b is also updated. It is preferable that the contestant information indicated by the text objects 512a and 512b can be changed according to the user's operation input.

Returning to the description of the flowchart in FIG. In step S670, when control unit 190 receives a selection operation on moving object 502, the process of step S680 is executed. Note that the selection operation may be performed on a text object.

In step S680, the control unit 190 displays in detail the contestant information corresponding to the moving object 502 selected in step S680. Next, when the control unit 190 receives an operation input for ending the detailed display, the detailed display of the contestant information is ended in step S690. After the detailed display ends, for example, the display returns to step S660. The control unit 190 terminates the series of display control processing in response to receiving an operation input to terminate the application program 151 or the like.

Here, the processing of step S680 will be specifically described with reference to FIGS. 10 to 12. FIG. FIG. 10 is a schematic diagram showing an example of a display method of detailed contestant information. FIG. 10 shows, for example, a screen displayed on the display 132 when the user performs an operation (for example, a tap operation) to select the moving object 502a in the state of FIG.

In FIG. 10, a detailed information object 520 is displayed around the moving object 502a. The detailed information object 520 includes an image display column 521 , a detailed information display column 522 and an end button 523 . The image display field 521 displays, for example, a face image of a racer riding the moving object 502a. In the detailed information display column 522, contestant information more detailed than the example in FIG. 9 is displayed as text information. The end button 523 is a virtual button for hiding the detailed information object 520 . Note that the detailed information object 520 may be hidden when the outside of the detailed information object 520 is tapped.

FIG. 11 is a schematic diagram showing another example of a method of displaying detailed contestant information. In the example of FIG. 11, a detailed information object 530 is displayed instead of the detailed information object 520 of FIG. The detailed information object 530 includes an image display column 531 , a first detailed information display column 532 , a second detailed information display column 533 and a switching button 534 . The image display field 531 displays, for example, a face image of a racer riding the moving object 502a. In the first detailed information display column 532, contestant information more detailed than the example in FIG. 9 is displayed as text information.

The second detailed information display column 533 is a column for graphically displaying the contestant information. The information displayed in the second detailed information display field 533 may be the contestant information obtained as text information and graphed by the control unit 190, or may be graphed from the beginning of acquisition in step S640. Contestant information may be used. The switch button 534 is a virtual button for changing the contestant information displayed in the second detailed information display column 533 .

FIG. 12 is a schematic diagram showing still another example of a method of displaying detailed contestant information. In the example of FIG. 12, a detailed information object 540 is displayed instead of the detailed information object 520 of FIG. The detailed information object 540 shown in FIG. 12 includes an image display field 541 , a first detailed information display field 542 , a second detailed information display field 543 and a third detailed information display field 544 .

The image display field 541 displays, for example, an image of a character created based on a racer riding the moving object 502a. Contestant information is displayed as text information in the first detailed information display column 542 . The second detailed information display column 543 displays the status information of the racer riding the moving object 502a. The status information is, for example, a virtual status calculated based on past race results and predetermined rules. The third detailed information display column 544 displays skill information of the racer riding the moving object 502a. Skill information is, for example, virtual skills derived based on past race results and predetermined rules. In FIG. 12, the third detailed information display field 544 displays the skills "popular" and "reversal". These skills are displayed as skills, for example, in the results of past races, that the racer is more likely to gain popularity than other racers, and that he has many come-from-behind wins.

Next, a method of displaying participant information during a virtual race will be described with reference to FIG. In FIG. 13, in addition to the example of FIG. 8, a virtual display board 505, a virtual screen 508, a purchase information display board 509, and a ranking display board 510 are displayed as virtual objects. It is preferable that these virtual objects can be switched to non-display, changed in display position, changed in display content, etc., by user's operation input.

For example, the virtual display board 505 can display text information such as the order of the moving objects 502a to 502f and the race time after the virtual race ends. Other text information such as odds information may be displayed on the virtual display board 505 before the start of the race or during the race.

A video of a boat race in the real world is displayed on the virtual screen 508 . What is displayed on virtual screen 508 is, for example, real-time video of a race. Before and after the race, the virtual screen 508 may display images showing the state of each boat before and after the race, images of player interviews, race replay images, exhibition race images, and the like. .

On the purchase information display board 509, the information of the boat ticket purchased by the user, which is acquired by the control unit 190 (selected information acquisition unit 196), is displayed. On the right side of the purchase information display board 509, purchase information, which is information on the boat ticket purchased by the user, is displayed, and on the left side, the refund amount for each boat ticket is displayed.

Also, on the purchase information display board 509, if the current ranking in the virtual race corresponds to the moving object 502 indicated by the purchase information (for example, if the boat ticket hits the finish line with the current ranking), The corresponding purchase information is displayed in a manner different from other purchase information. The current first place in FIG. 13 is the moving object 502b in two frames. Therefore, on the purchase information display board 509, a mark 509a is attached to the column indicating the two-frame single-win boat ticket. A mark 509a is also attached to the top of the moving object 502a in the two frames.

If the order changes during the race, and the first place is provisionally 5 frames and the second place is 4 frames, a mark 509a is attached to the purchase information displayed second and third from the top. Also, a mark 509a is added to the moving objects 502 in the 5th frame and the 4th frame. It should be noted that the display in a different mode may be by adding a predetermined mark in this way, by coloring the purchase column in a predetermined color, or by other methods.

The order display board 510 displays the order of the moving objects 502a to 502f. During the race, the ranking displayed on the ranking display board 510 may change based on the positional information of the boats 402a to 402f in the real world.

In FIG. 13, a text object 512b indicating contestant information is displayed above the moving object 502b. In the example of FIG. 13, the frame number and racer name are displayed in the text object 512b. The contestant information displayed in the text object 512 is preferably user selectable. Note that the user can also hide text objects for some of the moving objects 502 .

FIG. 14 is a schematic diagram showing another example of a method of displaying participant information during a virtual race. In the example of FIG. 14, each moving object 502 is given a color corresponding to the frame number. As shown in the lower right frame of FIG. 14, the moving object 502a in one frame is displayed in white, and the moving object 502a in two frames is displayed in black. The display color can be freely changed by a user's operation input.

In addition, the text object 512d shows popularity information 552a of the race in progress as a type of participant information. The same is true for text objects 512b and 512c. By presenting popularity information instead of odds information in this way, the user can grasp at a glance which moving object is considered to be strong. Note that the moving object 502a and the like are not given popularity information because they are ranked lower in order of popularity, but they may also be given popularity information.

The above-described embodiments are merely examples for facilitating understanding of the present invention, and are not intended to limit the interpretation of the present invention. It goes without saying that the present invention can be modified and improved without departing from its spirit, and that equivalents thereof are included in the present invention.

[Additional notes]
The contents of the present disclosure are listed below.

(Item 1)
A program executed in a first computer comprising a processor and an imaging unit,
The program causes the processor to:
receiving from a second computer first information about a given race in the real world;
generating, based on the first information, a virtual object for presenting second information about the predetermined race to a user of the first computer;
superimposing and displaying the virtual object on a real image of the surroundings of the first computer captured by the imaging unit;
The first information includes at least contestant information related to contestants and/or moving bodies in the predetermined race,
including at least a moving object corresponding to the contestant or the moving object as the virtual object;
In the displaying step, at least part of the contestant information is displayed in association with the moving object;
program.
As a result, it is possible to make it easier to distinguish moving objects corresponding to race participants and moving objects in the real world.

(Item 2)
In the displaying step, the contestant information is displayed in more detail in association with the moving object in accordance with the user's operation input.
The program of item 1.
As a result, a large amount of information can be provided to the user in response to the user's request, so that the user's satisfaction level can be improved.

(Item 3)
Contestant information displayed in the displaying step includes at least odds information of the contestant or the moving body;
A program according to item 1 or item 2.
This allows the user to grasp which moving object is considered to be strong. In addition, since odds information is usually one of the pieces of information that users are most interested in, user satisfaction can be improved by displaying the odds information together with the moving object.

(Item 4)
the receiving step is performed with a predetermined frequency or when a specified event occurs;
the contestant information may be updated by the receiving step being performed;
The program according to any one of items 1 to 3.
As a result, even if the contestant information changes with the passage of time, the changed contestant information can be delivered to the user.

(Item 5)
The program further causes the processor to:
causing execution of a step of acquiring one or more selection information indicating one or more of the contestants or the mobile objects selected by the user;
The first information includes location information of the contestant or the moving body during the execution of the predetermined race, and time information corresponding to the location information,
In the displaying step, the moving object is moved based on the position information and the time information, and a virtual race that virtually displays the predetermined race is displayed together with at least part of the selection information. including,
The program according to any one of items 1 to 4.
This makes it possible to display a race in the real world as a virtual race with high reproducibility using virtual objects. Further, since the contestant information is displayed in association with the moving object, it is easy to distinguish the moving object even during the virtual race. In addition, it is possible to watch a highly reproducible virtual race without actually going to the racetrack. In addition, since the place around the user becomes a virtual racetrack, it is possible to provide the user with unprecedented enjoyment.

(Item 6)
In the virtual race, displaying a moving object corresponding to the one or more contestants or the moving object indicated by the one or more selection information in a display mode different from that of other moving objects;
The program according to any one of items 1 to 5.
This makes it possible to improve the distinguishability of the moving object selected by the user.

(Item 7)
When the current ranking in the virtual race corresponds to one or more of the contestants or the moving objects indicated by the one or more selection information, the corresponding one or more selection information is different from other selection information. display in different ways,
The program according to any one of items 1 to 6.
As a result, the user can easily grasp that the user's selection will be correct if the race continues as it is. It is also possible to increase the degree of immersion in the virtual race.

(Item 8)
An information processing method executed in a first computer having a processor and an imaging unit,
The information processing method includes:
receiving from a second computer first information about a given race in the real world;
generating, based on the first information, a virtual object for presenting second information about the predetermined race to a user of the first computer;
a step of superimposing and displaying the virtual object on a real image of the surroundings of the first computer captured by the imaging unit;
including causing the
The first information includes at least contestant information related to contestants and/or moving bodies in the predetermined race,
including at least a moving object corresponding to the contestant or the moving object as the virtual object;
In the displaying step, at least part of the contestant information is displayed in association with the moving object;
Information processing methods.
As a result, it is possible to make it easier to distinguish moving objects corresponding to race participants and moving objects in the real world.

(Item 9)
An information processing device comprising a processor and an imaging unit,
The processor
receiving first information from a second computer regarding a given race in the real world;
generating a virtual object for presenting second information about the predetermined race to a user of the first computer based on the first information;
The virtual object is superimposed and displayed on a real image of the surroundings of the first computer captured by the imaging unit,
The first information includes at least contestant information related to contestants and/or moving bodies in the predetermined race,
including at least a moving object corresponding to the contestant or the moving object as the virtual object;
The displaying step includes displaying at least part of the contestant information in association with the moving object.
Information processing equipment.
As a result, it is possible to make it easier to distinguish moving objects corresponding to race participants and moving objects in the real world.

(Item 10)
A system realized by a first computer comprising a first processor and an imaging device, and a second computer comprising a second processor and communicatively connectable to the first computer,
the second processor,
obtaining first information about a given race in the real world;
transmitting the first information to the first computer;
The first processor
receiving the first information from the second computer;
generating a virtual object for presenting second information about the predetermined race to a user of the first computer based on the first information;
The virtual object is superimposed and displayed on a real image of the surroundings of the first computer captured by the imaging unit,
The first information includes at least contestant information related to contestants and/or moving bodies in the predetermined race,
including at least a moving object corresponding to the contestant or the moving object as the virtual object;
The superimposed display includes displaying at least part of the contestant information in association with the moving object.
system.
As a result, it is possible to make it easier to distinguish moving objects corresponding to race participants and moving objects in the real world.

(Item 11)
The first processor further
Acquiring one or more selection information indicating one or more contestants or mobile objects selected by the user;
The first information includes location information of the contestant or the moving body during the execution of the predetermined race, and time information corresponding to the location information,
In the displaying step, the moving object is moved based on the position information and the time information, and a virtual race that virtually displays the predetermined race is displayed together with at least part of the selection information. including
The position information is obtained based on a position sensor provided in the contestant or the moving body, or an image of the predetermined race captured by an imaging device during the execution of the predetermined race.
11. The system of item 10.
This makes it easier to obtain the position information of contestants and the like. As a result, it is possible to reproduce the order, offense and defense during the race in the real world in the virtual race, thereby improving user satisfaction.

1: System, 10: User Terminal, 20: First Server Device, 30: Network, 40: Second Server Device, 130: Touch Screen, 150: Storage Unit (of User Terminal), 190: Control (of User Terminal) Unit, 191: Operation input reception unit, 192: Transmission/reception unit, 193: Object generation unit, 194: Display control unit, 195: Detection unit, 196: Selection information acquisition unit, 250: Storage unit (of the first server device), 290: Control unit (of the first server device)

Claims (8)

A program running on a computer,
The program causes the computer to:
Receiving means for executing a receiving process for receiving first information relating to a predetermined race in the real world;
generating means for generating a virtual object for presenting second information about the predetermined race to a user of the computer based on the first information;
function as display means for displaying an image containing the virtual object;
The first information includes at least contestant information in the predetermined race,
including at least a moving object corresponding to a contestant or a moving object as the virtual object;
the display means displays at least part of the contestant information in association with the moving object;
The receiving process is executed when the contestant information including at least the odds information of the contestant or the moving object is changed,
The contestant information may be updated by executing the reception process.
program. The display means displays the contestant information in further detail in association with the moving object in accordance with the user's operation input.
A program according to claim 1. Contestant information displayed on the display means includes at least the odds information;
3. The program according to claim 1 or 2. The program causes the computer to:
Obtaining one or more selection information indicating one or more contestants or mobile objects selected by the user;
The first information includes location information of the contestant or the moving object in the predetermined race and time information corresponding to the location information,
The display means moves the moving object based on the position information and the time information, and displays a virtual race that virtually displays the predetermined race together with at least part of the selection information.
A program according to any one of claims 1 to 3 . In the virtual race, displaying a moving object corresponding to the one or more contestants or the moving object indicated by the one or more selection information in a display mode different from that of other moving objects;
5. A program according to claim 4 . When the current ranking in the virtual race corresponds to one or more of the contestants or the moving objects indicated by the one or more selection information, the corresponding one or more selection information is different from other selection information. display in different ways,
6. The program according to claim 4 or 5 . An information processing device comprising a processor,
The processor
receiving first information about a given race in the real world;
generating a virtual object for presenting second information about the predetermined race to a user of the information processing device based on the first information;
displaying an image containing the virtual object;
The first information includes at least contestant information in the predetermined race,
including at least a moving object corresponding to a contestant or a moving object as the virtual object;
displaying the image includes displaying at least part of the contestant information in association with the moving object;
The processor updates the contestant information by receiving the contestant information as the first information when the contestant information including at least the odds information of the contestant or the moving object is changed. to display the
Information processing equipment. A system realized by a first computer comprising a first processor and a second computer comprising a second processor and communicatively connectable with the first computer,
the second processor,
obtaining first information about a given race in the real world;
transmitting the first information to the first computer;
The first processor
receiving the first information from the second computer;
generating a virtual object for presenting second information about the predetermined race to a user of the first computer based on the first information;
displaying an image containing the virtual object;
The first information includes at least contestant information in the predetermined race,
including at least a moving object corresponding to a contestant or a moving object as the virtual object;
displaying the image includes displaying at least part of the contestant information in association with the moving object;
The first processor receives the contestant information as the first information when the contestant information including at least the odds information of the contestant or the moving object is changed, thereby performing the updated contestant information. display user information,
system.

Images