JP2022111015A - Program, information processing method, information processing device and system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve convenience of users when viewing a race via virtual objects displayed on a computer.

SOLUTION: A program to be executed in a first computer including a processor and an imaging section, causes the processor to execute the steps of: receiving first information relating to a prescribed race in an actual world from a second computer; generating based on the first information, virtual objects including a race track object 501 representing a race track of the prescribed race and moving objects 502 representing contestants or mobile objects of the prescribed race; and superimposingly displaying the virtual objects over a real image in the periphery of the first computer captured by the imaging section. The step of displaying the virtual objects includes displaying a user interface display area 1200 capable of receiving a user's first operation input, at a position different from the object display area on which the virtual objects are displayed, in the display section.

SELECTED DRAWING: Figure 12

COPYRIGHT: (C)2022,JPO&INPIT

Description

The present disclosure relates to programs, information processing methods, information processing apparatuses, and systems.

Patent Literatures 1 and 2 disclose techniques related to AR (Augmented Reality).

Japanese Patent Application Laid-Open No. 2020-58658 JP 2020-77187 A

In the real world, various races such as boat races and horse races are held. Some people actually go to the racetracks to watch these races, but in some cases it is not possible due to time or geographical restrictions to actually visit the racetracks. From the above situation, if it is possible to display the real world race as a virtual race on the display of various terminals using virtual objects linked to the real world race, it will be possible to race without actually going to the racetrack. can be watched in a simulated manner, which is useful.

By the way, a user may want to process other tasks such as voting or watching another race even while watching a virtual race of a predetermined race on a mobile terminal or the like.

An object of one aspect of the present disclosure is to provide a program, an information processing method, an information processing device, and a system that can improve user convenience when watching a race using virtual objects displayed on a computer. .

According to one embodiment shown in the present disclosure,
A program executed in a first computer comprising a processor, an imaging unit, and a display unit,
The program causes the processor to:
receiving from a second computer first information about a first predetermined race in the real world;
generating a virtual object including a racetrack object representing the racetrack of the first race and a moving object representing a contestant or moving object of the first race based on the first information;
causing the display unit to superimpose and display the virtual object on a real image of the surroundings of the first computer captured by the imaging unit;
The displaying step includes displaying a user interface display area capable of receiving a user's first operation input at a position different from an object display area in which the virtual object is displayed on the display unit.
A program is provided.

According to an embodiment shown in the present disclosure, it is possible to improve convenience for the user when watching the first race using the virtual object displayed on the first computer.

1 is a diagram showing a configuration example of a system according to an embodiment; FIG. 2 is a block diagram showing an example of functional configuration of a user terminal according to an embodiment; FIG. 3 is a block diagram showing an example of a functional configuration of a server according to one embodiment; FIG. 1 is a schematic diagram illustrating an example of a real-world race track according to an embodiment; FIG. FIG. 4 is a schematic diagram showing an example of a virtual object displayed on a user terminal according to an embodiment; FIG. 6 is a flow chart showing an example of display control processing according to an embodiment; FIG. 4 is a schematic diagram showing an example of a real image captured by an imaging unit according to an embodiment; FIG. 10 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image according to an embodiment; FIG. 10 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image according to an embodiment; 9 is a flowchart showing an example of display control processing in operation example 1 according to an embodiment; FIG. 10 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image according to an embodiment; FIG. 10 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image according to an embodiment; FIG. 10 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image according to an embodiment; FIG. 10 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image according to an embodiment; FIG. 10 is a flowchart showing an example of display control processing in operation example 2 according to an embodiment; FIG. FIG. 10 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image according to an embodiment; FIG. 10 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image according to an embodiment;

Hereinafter, embodiments of this technical idea will be described in detail with reference to the drawings. In the following description, the same elements are denoted by the same reference numerals, and overlapping descriptions are omitted as appropriate. In one or more of the embodiments presented in this disclosure, elements of each embodiment may be combined with each other and the combined result shall also form part of the embodiments presented in this disclosure.

(System configuration)
FIG. 1 is a diagram showing the configuration of system 1 according to the present embodiment. The system 1 can display, for example, a predetermined race held in the real world as a virtual race using virtual objects on the information processing device used by the user. In this specification, the "predetermined race" is not particularly limited as long as it is a race that is held in the real world. Examples include car races such as F1, drone races, dog races, marathons, and relay road races.

As shown in FIG. 1, the system 1 includes a user terminal 10A, a user terminal 10B, and a user terminal 10C (hereinafter referred to as user terminals 10A, 10B, 10C, etc.), which are information processing apparatuses (first computers) used by users. , a first server device (second computer) 20 , a second server device 40 , and a network 30 .

The user terminals 10A and 10B are connected to the network 30 by communicating with the radio base station 31 . The user terminal 10C connects to the network 30 by communicating with a wireless router 32 installed in a facility such as a house. The user terminal 10 is, for example, a mobile terminal having a touch screen, and may be a smart phone, a phablet, a tablet, or the like.

The user terminal 10 executes, for example, a program installed via a platform that distributes applications or the like, or a program including pre-installed website browsing software. The user terminal 10 communicates with the first server device 20 by executing the above program, and transmits/receives data related to a predetermined race, data related to the user, etc. to/from the first server device 20, thereby allowing the user It is possible to display a virtual race on the terminal 10. - 特許庁

The first server device 20 receives data related to a given race from the second server device 40 . The first server device 20 appropriately transmits data related to a predetermined race to the user terminal 10 . The first server device 20 stores and manages data related to a predetermined race and data related to each user.

The first server device 20 includes a communication IF (Interface) 22, an input/output IF 23, a memory 25, a storage 26, and a processor (second processor) 29 as a hardware configuration. connected to each other through

The communication IF 22 is compatible with various communication standards such as the LAN (Local Area Network) standard, and functions as an interface for transmitting and receiving data to and from the user terminal 10, the second server device 40, and the like.

The input/output IF 23 functions as an interface for receiving input of information to the first server device 20 and outputting information to the outside of the first server device 20 . The input/output IF 23 can include an input receiving section that receives connection of information input devices such as a mouse and keyboard, and an output section that receives connection of information output devices such as a display for displaying images and the like.

The memory 25 is a storage device for storing data used for processing. The memory 25 provides the processor 29 with a work area for temporary use when the processor 29 performs processing, for example. The memory 25 includes storage devices such as ROM (Read Only Memory) and RAM (Random Access Memory).

The storage 26 is a storage device for storing various programs and data for the processor 29 to read and execute. The information stored by the storage 26 includes data related to predetermined races, data related to each user, and the like. The storage 26 can be configured including a storage device such as an HDD (Hard Disk Drive) and flash memory. Note that the storage is not limited to being included in the server device, and a cloud service can also be used.

The processor 29 controls the operation of the first server device 20 by reading and executing programs and the like stored in the storage 26 . The processor 29 can be configured including, for example, a CPU (Central Processing Unit), MPU (Micro Processing Unit), GPU (Graphics Processing Unit), and the like.

The second server device 40 stores and manages data related to predetermined races. The second server device 40 is, for example, a server device managed by the organizer of a given race, or an organization that transmits information about a given race to the outside (publisher of a race journal, race video distributor, or radio distributor). etc.). The second server device 40 appropriately transmits data related to a predetermined race to the first server device 20 . In one aspect, the second server device 40 may transmit data related to a given race to the user terminal 10 . The hardware configuration of the second server device 40 may be the same as that of the first server device 20 as long as there is no contradiction. A plurality of second server devices 40 may be provided.

(user terminal)
FIG. 2 is a block diagram showing an example of the functional configuration of the user terminal 10. As shown in FIG. As shown in FIG. 2, the user terminal 10 includes an antenna 110, a wireless communication IF 120, a touch screen 130, an input/output IF 140, a storage unit 150, an audio processing unit 160, a microphone 161, a speaker 162, It includes an imaging unit 170 and a control unit (first processor) 190 .

The antenna 110 radiates the signal emitted by the user terminal 10 into space as radio waves. Antenna 110 also receives radio waves from space and provides a received signal to wireless communication IF 120 .

The wireless communication IF 120 performs modulation/demodulation processing and the like for transmitting and receiving signals via the antenna 110 and the like in order for the user terminal 10 to communicate with other communication devices. The wireless communication IF 120 is a communication module for wireless communication including a tuner, a high-frequency circuit, etc., performs modulation/demodulation and frequency conversion of wireless signals transmitted/received by the user terminal 10 , and provides received signals to the control unit 190 .

Touch screen 130 accepts input from a user and outputs information to display 132 for the user. Touch screen 130 includes a touch panel 131 and a display 132 for accepting user operation input. The touch panel 131 detects that a user's finger or the like approaches by using, for example, a capacitive touch panel. The display 132 is implemented by, for example, an LCD (Liquid Crystal Display), an organic EL (electroluminescence), or other display device.

The input/output IF 140 receives input of information to the user terminal 10 and functions as an interface for outputting information to the outside of the user terminal 10 .

The storage unit 150 is configured by a flash memory, an HDD, or the like, and stores programs used by the user terminal 10 and various data received by the user terminal 10 from the first server device 20 or the like.

The audio processing unit 160 modulates and demodulates an audio signal. Audio processing section 160 modulates the signal supplied from microphone 161 and supplies the modulated signal to control section 190 . Also, the audio processing unit 160 provides an audio signal to the speaker 162 . The audio processing unit 160 is implemented by, for example, a processor for audio processing. Microphone 161 functions as an audio input unit for receiving input of an audio signal and outputting it to control unit 190 . The speaker 162 functions as an audio output unit for outputting audio signals to the outside of the user terminal 10 .

The imaging unit 170 is a camera that captures a real image of the surroundings of the user terminal 10 . An image captured by the imaging unit 170 is subjected to image processing by the control unit 190 and output to the display 132 .

The control unit 190 controls the operation of the user terminal 10 by reading and executing programs stored in the storage unit 150 . The control unit 190 is implemented by, for example, an application processor.

A process of executing the application program 151 by the control unit 190 will be described in more detail. Storage unit 150 stores application program 151 , application information 152 , and user information 153 .

For example, the user terminal 10 downloads the application program 151 from the first server device 20 and stores it in the storage unit 150 . Also, the user terminal 10 communicates with the first server device 20 to transmit and receive various data such as application information 152 and user information 153 to and from the first server device 20 .

The application program 151 is a program for displaying virtual races on the user terminal 10 . The application information 152 includes various data referred to by the application program 151 . Application information 152 includes first information 152A and second information 152B.

The first information 152A is information regarding a predetermined race transmitted from the first server device 20 or the second server device 40 . Hereinafter, the predetermined race will be referred to as "first race". The first information 152A includes, for example, race time information indicating the race time of the first race contestants or moving bodies (hereinafter also referred to as “contestants, etc.”), position information of the contestants, etc. during the first race, and time information corresponding to the location information.

As used herein, the term “contestant” is a concept that includes not only humans but also animals such as horses and dogs. A "moving object" is an object that is the subject of movement in a race, such as an animal or a machine on which a contestant rides, or a machine that is remotely controlled by a contestant. In a marathon, a dog race, etc., the "participant" and the "moving object" are the same.

In addition to the above, the first information 152A includes, for example, the name of the first race, the date and time of the race, race field data, contestant data, moving body data, odds information, race forecast, race start chart, information just before the race, pit It may include reports, race results, race videos, race still images, past race information, and other information that can be published in information magazines and information sites regarding the first race.

The second information 152B is information related to a predetermined race transmitted from the first server device 20 or the second server device 40, and is related to a second race different from the first race targeted by the first information 152A. Information. The second race is, for example, a race that is held on a race track different from the first race on the same day that the first race is held. The first race and the second race may be the same type of race, or may be different types of races. For example, the first race and the second race may be boat races held at different boat races, where the first race is a boat race and the second race is a race other than a boat race (for example, It may be a horse race or a bicycle race). The second information 152B includes, for example, race time information indicating the race time of the contestants of the second race, position information of the contestants during the second race, and time information corresponding to the position information. .

In addition to the above, the second information 152B includes, for example, the name of the second race, the date and time of the race, race field data, contestant data, mobile data, odds information, race forecast, race start chart, information just before the race, pit It may include reports, race results, race videos, race still images, past race information, information that can be published in information magazines and information sites related to the second race, and the like.

User information 153 includes information about the user of user terminal 10 . The user information 153 includes, for example, information identifying the user, location information of the user terminal 10, user's race purchase history and hit rate (for example, in the case of a boat race, the history of purchased boat tickets and the number of purchased boat tickets). Hit rate) and the like may be included.

By reading and executing the application program 151, the control unit 190 controls the operation input reception unit 191, the transmission/reception unit 192, the object generation unit 193, the display control unit 194, the flat surface detection unit 195, the first information The functions of the acquisition unit 196, the second information acquisition unit 197, and the selection information acquisition unit 198 are exhibited.

The operation input receiving unit 191 receives user's operation input based on the output of the touch screen 130 . Specifically, the operation input reception unit 191 detects that a user's finger or the like touches or approaches the touch panel 131 as coordinates of a coordinate system including a horizontal axis and a vertical axis of the surface forming the touch screen 130 .

Operation input reception unit 191 determines a user's operation on touch screen 130 . The operation input reception unit 191 performs, for example, “approach operation”, “release operation”, “tap operation”, “double tap operation”, “long press operation (long touch operation)”, “drag operation (swipe operation)”, User operations such as "move operation", "flick operation", "pinch-in operation", and "pinch-out operation" are determined.

The operation input receiving unit 191 may receive, as an operation input, movement of the user terminal 10 detected by an acceleration sensor or the like mounted on the user terminal 10 .

The transmission/reception unit 192 transmits and receives various types of information to and from external communication devices such as the first server device 20 and the second server device 40 via the wireless communication IF 120 and the network 30 . The transmitter/receiver 192 receives the first information 152A from the first server device 20 or the second server device 40, for example. Further, the transmission/reception unit 192 transmits, for example, information corresponding to the operation input received by the operation input reception unit 191 and information stored in the user information 153 to the first server device 20 or the second server device 40. .

The object generator 193 generates a virtual object for presenting information about the first race to the user based on the first information 152A. The object generation unit 193 generates, as virtual objects, a racetrack object representing the racetrack of the first race and moving objects representing the contestants of the first race. The object generator 193 may generate a virtual display board for text-displaying information generated based on the first information 152A. In addition to the objects described above, the object generation unit 193 also generates virtual screens for image-displaying information generated based on the first information 152A, various building objects, landscape objects such as trees that form landscapes, and the like. may be generated.

The display control unit 194 superimposes the virtual object generated by the object generation unit 193 on the real image of the surroundings of the user terminal 10 captured by the imaging unit 170 (hereinafter also referred to as a “superimposed image”). displayed on the display 132. The display control unit 194 moves each moving object on the racefield object based on the race time information included in the first information 152A, and displays a virtual race that virtually reproduces the first race on the display 132. In addition to the race time information, the display control unit 194 preferably reproduces the virtual race based on the position information of the contestants included in the first information 152A and the time information corresponding to the position information. .

It is preferable that the display control unit 194 can change the viewpoint in the superimposed image according to the operation input received by the operation input reception unit 191 . A specific example of changing the viewpoint will be described later.

Further, it is preferable that the display control unit 194 can display various menu screens and GUI (Graphical User Interface) on the display 132 according to the operation input received by the operation input reception unit 191 . In this example, in particular, the display control unit 194 changes the display position of the virtual object displayed on the display 132 in response to the user's operation input for a switching button, which will be described later, received by the operation input reception unit 191, and changes the display position of the virtual object. A UI (User Interface) display area is provided at a position different from the area where the virtual objects on 132 are displayed, and various UI objects capable of receiving user operation inputs are displayed in the UI display area.

A flat surface detection unit 195 detects a flat surface in the real image captured by the imaging unit 170 . Detection of a flat surface is realized by conventionally known image recognition technology. For example, when the user performs an operation to select a flat surface detected by the flat surface detection unit 195, the display 132 displays a superimposed image in which a racetrack object is arranged on the flat surface.

Preferably, the flat surface is a horizontal surface. Also, the angle formed by the flat surface and the bottom surface forming the racetrack object may be 0 degrees, but is preferably an acute angle, and can be in the range of 15 degrees to 45 degrees, for example. The angle can also be adjusted by accepting a user's operation. In addition, even if there is a projection on a part of the flat surface in the real world, or even if there is an object on the flat surface, if the projection or the object is of a size that can be hidden by the racetrack object. , may be detected as a flat surface on which the racetrack object can be placed.

The first information acquisition unit 196 acquires first information 152A by receiving predetermined information (first information 252A described later) from the first server device 20 .

The second information acquisition unit 197 acquires second information 152B by receiving predetermined information (second information 252B described later) from the first server device 20 .

The selection information acquisition unit 198 acquires one or more pieces of selection information indicating one or more contestants selected by the user. The "selection information" is, for example, information indicating the contestants predicted by the user as the winners of the first race and the second race. If the first and second races are boat races or horse races, the "selection information" may be information indicating boat tickets or betting tickets purchased by the user.

The selection information acquisition unit 198 acquires selection information, for example, based on a user's operation input on a screen for selecting contestants. The selection information acquired by the selection information acquisition unit 198 is transmitted to the first server device 20 or the second server device 40, for example. For example, in response to transmission of the selection information to the second server device 40, processing for purchasing boat tickets and betting tickets for a predetermined race can be performed.

(First server device)
FIG. 3 is a block diagram showing the functional configuration of the first server device 20. As shown in FIG. A detailed configuration of the first server device 20 will be described with reference to FIG. The first server device 20 functions as a communication unit 220, a storage unit 250, and a control unit 290 by operating according to a program.

The communication unit 220 functions as an interface for the first server device 20 to communicate with external communication devices such as the user terminal 10 and the second server device 40 via the network 30 .

The storage unit 250 stores various programs and data for realizing the system 1 . In one aspect, storage unit 250 stores program 251 , race information 252 , and user information 253 .

The program 251 is a program for realizing the system 1 by the first server device 20 communicating with the user terminal 10 and the second server device 40 . The program 251 is executed by the control unit 290 to perform processing for transmitting and receiving data to and from the user terminal 10 and the second server device 40, processing according to the operation content performed by the user of the user terminal 10, race information 252 and user The first server device 20 is caused to perform processing such as updating the information 253 .

Race information 252 includes various data related to a given race. Race information 252 includes, for example, first information 252A and second information 252B. The first information 252A is information on which the first information 152A is based, and is information relating to the first race. First information 152A may be part of first information 252A. The first information 252A is information acquired from the second server device 40, for example. Similarly, the second information 252B is information on which the second information 152B is based, and is information about the second race. Second information 152B may be part of second information 252B. The second information 252B is information acquired from the second server device 40, for example.

User information 253 is information about the user of the user terminal 10 . User information 253 includes a user management table 253A. The user management table 253A stores, for example, user identification information, user terminal 10 position information, user's race purchase history, hit rate, and the like for each user.

The control unit 290 is realized by the processor 29, and by executing the program 251, the transmission/reception unit 291, the first information acquisition unit 292A, the second information acquisition unit 292B, the selection information acquisition unit 293, the data management unit 294, the timer unit 295 functions.

The transmission/reception unit 291 transmits and receives various types of information to and from external communication devices such as the user terminal 10 and the second server device 40 via the communication unit 220 and the network 30 . The transmitting/receiving unit 291 transmits at least part of the first information 252A and the second information 252B to the user terminal 10, for example. Also, the transmitting/receiving unit 291 receives the first information 252A and the second information 252B from the second server device 40, for example.

The first information acquisition unit 292A acquires the first information 252A from the second server device 40 via the transmission/reception unit 291 . The second information acquisition section 292B acquires the second information 252B from the second server device 40 via the transmission/reception section 291 . The selection information acquisition unit 293 acquires user selection information from the user terminal 10 or the second server device 40 via the transmission/reception unit 291 . The data management unit 294 updates various data stored in the storage unit 250 according to the processing results of the first information acquisition unit 292A, the second information acquisition unit 292B, the selection information acquisition unit 293, and the like. The timer 295 performs processing for measuring time. Various times displayed on the user terminal 10 (for example, the time until the start of the race, etc.) can be controlled based on the time measured by the timer 295 .

(Operation example)
Next, an operation example in the system 1 will be described with reference to FIGS. 4 to 14. FIG. In the following description, the case where the predetermined race, ie, the first race, is a boat race will be described as an example, but the following description can be applied even if the first race is another type of race. In the following description, data is transmitted and received between the user terminal 10 and the first server device 20, and between the first server device 20 and the second server device 40. The terminal 10 and the second server device 40 may be configured to directly transmit and receive data.

FIG. 4 is a schematic diagram showing an example of a boat race track in the real world. Two turn marks 403 are installed in the boat race course 401, and races are carried out by boats 402a to 402f on which boat racers ride. When the race ends, race time information indicating the race times of the boats 402a to 402f is transmitted from the second server device 40 to the first server device 20, and from the first server device 20 to the user terminal 10. FIG.

The boat race course 401 is provided with imaging devices (cameras) 404a to 404b. The imaging device 404a captures the boats 402a to 402f from above the boat race course 401 in its field of view. The imaging device 404b captures the boats 402a to 402f from the sides of the boat race course 401 in the field of view. The images of the boats 402 a - 402 f captured by the imaging devices 404 a - 404 b are transmitted to the second server device 40 . The second server device 40, for example, performs image analysis of each image, and calculates position information indicating the position of each of the boats 402a to 402f at the shooting time of each image. The calculated position information and the time information regarding the shooting time corresponding to the position information are transmitted to the first server device 20 and transmitted from the first server device 20 to the user terminal 10 . Note that the position information may be calculated in the first server device 20 .

Position sensors such as GPS sensors may be installed on the boats 402a to 402f instead of or in addition to the imaging devices 404a to 404b. The position information of the boats 402a to 402f obtained by the position sensors and the time information indicating the time when the position information was obtained are finally transmitted to the user terminal 10. FIG.

FIG. 5 is a schematic diagram showing an example of a virtual object displayed on the user terminal 10. As shown in FIG. In the example of FIG. 5, a racetrack object 501, moving objects 502a to 502f, two turn mark objects 503, and a virtual display board 505 are shown as virtual objects.

A racetrack object 501 is an object that is a virtual display of the boat racetrack 401 . The race track object 501 and the turn mark object 503 are preferably created based on race track data such as course information of the boat race track 401 , and preferably have shapes corresponding to the boat race track 401 .

The moving objects 502a to 502f are objects that are virtual representations of the boats 402a to 402f, respectively, and have boat-like shapes. The moving objects 502a to 502f move in the racetrack object 501 based on race time information, position information of the boats 402a to 402f, and time information corresponding to the position information. In other words, a race in the real world is displayed on the user terminal 10 as a virtual race using the racetrack object 501 and the moving objects 502a to 502f.

It is also possible to display the virtual race only by the race time information without the position information and time information of the boats 402a-402f. However, in this case, although the final order of finish is the same as in the race in the real world, it is difficult to reproduce the progress of the race, such as the ranking during the race.

A virtual display board 505 is an object that displays text information. Virtual display board 505 is, for example, an object that does not have a corresponding existence in boat race track 401 . The text information displayed on the virtual display board 505 is not particularly limited, and may be ranking information, odds information, or the like, for example. Also, the text information displayed on the virtual display board 505 may be changeable based on the user's operation input.

FIG. 6 is a flowchart illustrating an example of processing related to display control. It should be noted that the order of each process constituting the flow chart described below may be random as long as there is no contradiction or inconsistency in the contents of the process, and the processes may be executed in parallel. Also, the processing executed by each device in each flowchart may be executed by another device as long as there is no contradiction.

The processing shown in FIG. 6 is realized by the control unit 190 executing the application program 151 and the control unit 290 executing the program 251, respectively. First, in step S610, the control unit 190 activates the imaging unit 170, which is a camera. A real image around the user terminal 10 is captured by the imaging unit 170 .

In step S<b>620 , the control unit 190 detects a flat surface within the image captured by the imaging unit 170 . In step S630, the control unit 190 arranges the virtual object on the detected flat surface.

Here, the processing of steps S610, S620, and S630 will be specifically described with reference to FIGS. 7 to 9. FIG. FIG. 7 is a schematic diagram showing an example of a real image captured by the imaging unit 170. As shown in FIG. In the example of FIG. 7, a keyboard 702 and a monitor device 703 are placed on a flat desk 701 .

When the imaging unit 170 is activated in step S610, a real image captured by the imaging unit 170 is displayed on the display 132. FIG. Next, in step S<b>620 , the control unit 190 detects a flat surface within the image captured by the imaging unit 170 , that is, within the image displayed on the display 132 .

In FIG. 7, region 704 is detected as a flat surface. There is a keyboard 702 within the area 704, but the size of the keyboard 702 is such that it can be hidden by the racetrack object 501, so the control unit 190 detects the area 704 as a flat surface.

In the state shown in FIG. 7, if the position captured by the imaging unit 170 is changed, the position of the region 704 can also be changed. The area 704 is displayed on the display 132 by adding a predetermined color, for example, so as to be distinguishable from other parts. When the user performs a tap operation or the like on the area 704, the control unit 190 arranges a virtual object such as the racetrack object 501 on the area 704 in step S630.

FIG. 8 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image. In FIG. 8, the dot patterned area including the monitor device 703 is the real image, and the other area is the area where the virtual object is displayed. For example, an advertisement image may be displayed in the area where no virtual object is displayed.

In FIG. 8, as virtual objects, there are a racetrack object 501, a plurality of moving objects 502, two turn mark objects 503, a large monitor object 506, building objects 507a to 507b, and other objects not labeled. A large number of objects (tree objects, clock objects, etc.) are displayed. These objects are created based on the first information 152A received from the first server device 20, for example.

In FIG. 8, the racetrack object 501 is placed on the area 704 such that the angle between the flat surface included in the area 704 and the bottom surface of the racetrack object 501 is 0 degree. In this case, for example, the moving objects 502 may overlap each other and become difficult to see. In addition, a blind spot where the moving object 502 cannot be seen may occur in the area on the depth direction side of the large monitor object 506 .

However, in the state shown in FIG. 8, the user can change the viewpoint of the superimposed image displayed on display 132 . For example, when the user performs an operation input such as a pinch-in operation or a pinch-out operation, the viewpoint position of the imaging unit 170 may move closer to or farther from the racetrack object 501 . Also, when the user moves in the depth direction of the display 132 while holding the user terminal 10 or moves in the front direction, the viewpoint position of the imaging unit 170 may move closer to or farther from the racetrack object 501 . Also, when the user performs an operation to specify a predetermined position on the display 132, the viewpoint position can move to the specified position. Such a viewpoint change can solve the visibility problem described above.

Also, by arranging the race field object 501 so that the angle θ formed between the flat surface and the bottom surface of the race field object 501 is an acute angle, the above-described problems related to visibility can be alleviated.

FIG. 9 is a schematic diagram showing an example of a screen in which a virtual object is superimposed on a real image, and shows another aspect of the racetrack object 501 shown in FIG. Specifically, FIG. 9 is an example in which the first race is a horse race.

In FIG. 9 as well, the area with the dot pattern including the monitor device 703 is the real image, and the other area is the area where the virtual object is displayed. In FIG. 9, a racetrack object 511, a plurality of moving objects 512, a large monitor object 513, a pond object 514, and a plurality of tree objects 515 are displayed on the display 132 as virtual objects. These objects are also created based on the first information 152A received from the first server device 20, for example.

The racetrack object 511, the large monitor object 513, the pond object 514, and the plurality of tree objects 515 are preferably created based on racetrack data such as course information of a predetermined racetrack in the real world, for example. The plurality of moving objects 512 are, for example, virtual objects representing horses and jockeys running in a horse race.

Returning to the description of the flowchart in FIG. In step S640, the control unit 190 acquires position information of the boats 402a to 402f on the boat race track 401 in the real world. That is, when the boats 402a to 402f start a race in the real world, the control unit 190 acquires the position information and time information of the boats 402a to 402f from the first server device 20. FIG. The method of acquiring position information and time information is as described with reference to FIG.

In step S650, the control unit 190 performs control so that the position information acquired in step S640 and the moving object are linked. Specifically, using the time information and the position information, the movement of each of the boats 402a to 402f on the race course object 501 is controlled to be the same as that of the moving objects 502a to 502f on the boat race course 401. FIG.

The processing of steps S640 and S650 is repeated at least from the start to the end of the race in the real world, but may be repeated before the start and after the end of the race in the real world.

If the race displayed as the virtual race is a past race, the position information and the like of the boats 402a to 402f from the start to the end of the race may be collectively acquired before the start of the virtual race. Further, the virtual race may be displayed by acquiring only the race time information without acquiring the position information and the like. A race displayed as a virtual race may be an exhibition race.

After the race in the real world ends, the series of display control processing ends in response to receiving an operation input for ending the application program 151 or the like.

(Operation example 1 for executing the multitasking function)
Next, an operation example 1 for executing the multitasking function in the system 1 will be described with reference to FIGS. 10 to 14. FIG. FIG. 10 is a flowchart showing an example of display control processing in this operation example. FIG. 11 is a schematic diagram showing an example of a display screen in step S1010, which will be described later. It should be noted that the order of each process constituting the flowchart described in FIG. 10 is also random as long as there is no contradiction or inconsistency in the process content, and the processes may be executed in parallel. Also, the processing executed by each device in each flowchart may be executed by another device as long as there is no contradiction.

In step S<b>1010 , the control unit 190 arranges virtual objects such as the racetrack object 501 on the display 132 . That is, the control unit 190 displays the racetrack object 501 and the like on the display 132 . This process is similar to step S630 in FIG.

As shown in FIG. 11 , in this operation example 1, the control unit 190 displays the racetrack object 501 and the like, and also displays the switching button 1150 on the display 132 . For example, the control unit 190 displays a race field object 501, a moving object 502 and a turn mark object 503 attached to the race field object 501, and a large scale object 502 and 503 attached to the race field object 501 slightly below the central part of the display 132 with respect to the vertically oriented display 132, for example. An object display area 1100 is set as an area in which a virtual object such as the monitor object 506 is displayed. Also, a switch button 1150 is displayed below the object display area 1100 where the racetrack object 501 and the like are displayed. The background of the racetrack object 501 on the display 132 is the real image captured by the imaging unit 170. In this example, for the sake of simplification of illustration, only the monitor device 703 is shown in the real image. Illustrated.

In step S<b>1020 , control unit 190 determines whether or not a user's operation input for switching button 1150 displayed on display 132 has been received. If it is determined in step S1020 that the user's operation input to the switch button 1150 has been received (Yes in step S1020), in step S1030, the control unit 190 displays an object display in which a virtual object such as the racetrack object 501 is displayed. Change the display position of area 1100 . Then, in step S1040, control unit 190 displays a user interface display area capable of accepting user operation input at a position different from the display position of object display area 1100 on display 132. FIG.

The display processing in step S1040 will be specifically described below with reference to FIG. FIG. 12 is a schematic diagram showing an example of the display screen in step S1040.
When the switching button 1150 is tapped by the user, as shown in FIG. 12, the control unit 190 changes the display position of the object display area 1100 where the racetrack object 501 and the like are displayed to the initial position shown in FIG. Change position above. That is, the control unit 190 switches the screen display of the display 132 so that the object display area 1100 is displayed above the center of the display 132 . Furthermore, angle change buttons 1300 (1301 to 1303) are displayed above the object display area 1100 on the display 132 . Details of the angle change button 1300 will be described later.

Further, on the display 132, below the object display area 1100, a user interface display area (UI display area) 1200 capable of accepting user's operation input is displayed. In the UI display area 1200, for example, a race selection button 1201, a video display button 1202, and an option button 1203 are displayed.

A race selection button 1201 is a button for selecting to display information on a predetermined race in the UI display area 1200 . When the user taps the race selection button 1201, the UI display area 1200 displays a race selection screen (not shown) for the user to select a desired race whose information is to be displayed in the UI display area 1200. Is displayed. Through the race selection screen, for example, the user can select information display of a race (for example, a second race) different from the first race, which is the target of the racetrack object 501 displayed in the object display area 1100.

A moving image display button 1202 is a button for the user to select to display a desired race moving image (actual image). When the user taps the video display button 1202 , a video selection screen (not shown) for selecting a desired race video is displayed in the UI display area 1200 . For example, the user selects the video display of the first race, which is the object of the racetrack object 501 displayed in the object display area 1100, or the video display of the race other than the first race (second race, etc.) through the video selection screen. can do.

An option button 1203 is a button for executing processes other than race selection and race video display. When the user taps the option button 1203, various option processes are executed, such as changing the display positions of the object display area 1100 and the UI display area 1200 to positions desired by the user.

Returning to FIG. 10, in step S1050, control unit 190 determines whether or not a user's operation input to UI display area 1200 has been received. In this example, the control unit 190 allows the user to tap, for example, a race selection button 1201 among a plurality of buttons 1201 to 1203 displayed in the UI display area 1200 to select a desired race for which information is to be displayed in the UI display area 1200. is selected.

If it is determined in step S1050 that the user's selection operation on UI display area 1200 has been received (Yes in step S1050), control unit 190 transmits information corresponding to the user's selection operation in step S1060. 1 Make a request to the server device 20 . Hereinafter, in this example, the control unit 190 causes the UI display area 1200 to perform the user's selection operation for the second race different from the first race targeted by the racetrack object 501 displayed in the object display area 1100. will be described. In this case, control unit 190 transmits to first server device 20 a request signal for requesting transmission of second information 152B, which is information about the second race.

In step S1070, the control unit 290 of the first server device 20 acquires the second information 252B regarding the second race based on the request signal regarding the second information 152B transmitted from the control unit 190 of the user terminal 10. Specifically, the control unit 290 stores, as the second information 252B, the name of the second race, the date and time of the race, the race field data, the contestant data, the moving object data, the odds information, the race forecast, the race start chart, and the information immediately before the race. , pit report, race time information which is the result of the race, race moving images, race still images, past race information, and other information about the second race are obtained from the second server device 40 or other external devices.

In step S<b>1080 , control unit 290 transmits acquired second information 252</b>B to control unit 190 of user terminal 10 .

In step S<b>1090 , control unit 190 generates a predetermined UI object based on second information 252</b>B transmitted from first server device 20 and displays the UI object in UI display area 1200 .

The display processing in step S1090 will be specifically described below with reference to FIGS. 13 and 14. FIG. 13 and 14 are schematic diagrams showing an example of the display screen in step S1090.
In the example shown in FIG. 13 , various UI objects related to the second race are displayed within a UI display area 1200 on the display 132 . Specifically, in the UI display area 1200, a contestant data column 1251, a purchase amount column 1252, a voting button 1253, a race selection button 1254, and an option button 1255 are displayed.

The contestant data column 1251 displays the data of the contestants (six in this example) who participate in the second race. Specifically, the contestant data column 1251 displays the face photo, license (class), registration number, name, birthplace, weight, etc. of each contestant participating in the second race. The purchase amount column 1252 displays the amount that the user purchased the voting ticket for the second race. The voting button 1253 is a button for displaying a voting screen for users to vote for the second race. The voting screen will be described later with reference to FIG. A race selection button 1254 is a button similar to the race selection button 1201 in FIG. used for Option button 1255 is a button similar to option button 1203 in FIG.

For example, when the user taps the vote button 1253, the screen display of the display 132 switches to the example shown in FIG. In the example shown in FIG. 14, a voting screen 1400 is displayed in the UI display area 1200 . The voting screen 1400 is a screen for the user to purchase a voting ticket (boat ticket or betting ticket) for the second race. By tapping various buttons (button 1401, etc.) displayed in the voting screen 1400, the user can purchase a voting ticket for a desired contestant in the second race. Also in this case, in the object display area 1100 at the top of the display 132, the racetrack object 501 and the like are displayed as the virtual race of the first race.

Returning to FIG. 10, in step S1110, control unit 190 determines whether or not a user's selection operation for a UI object displayed in UI display area 1200 has been received. Specifically, for example, on the screen shown in FIG. 14, the control unit 190 determines whether or not the user has operated the button 1401 or the like displayed on the voting screen 1400 . When it is determined in step S1110 that the user's selection operation for the UI object has been received (Yes in step S1110), in step S1120, the control unit 190 executes predetermined task processing based on the selection operation. For example, the control unit 190 executes a process of purchasing a predetermined betting ticket for the second race according to the user's selection operation on the betting screen 1400 .

As described above, in this example, while the race field object 501 related to the first race is displayed on the display 132, the UI display area 1200 is displayed in an area different from the area where the race field object 501 is displayed on the display 132. , the UI display area 1200 can receive a user's operation input. That is, the user can simultaneously perform a plurality of tasks on the display 132, for example, watching the virtual race of the first race and purchasing a betting ticket for the second race.

Returning to FIG. 10 again, in step S1130, control unit 190 determines whether or not the user's operation for ending the display of the UI object displayed in UI display area 1200 has been received. If it is determined in step S1130 that an operation to end the display of the UI object (or UI display area 1200) has been received (Yes in step S1130), control unit 190 causes UI display area 1200 to be displayed in step S1140. Hide. Then, in step S1150, control unit 190 changes the display position of object display area 1100 displayed at the top of display 132 to the initial position. Specifically, the control unit 190 switches the screen display of the display 132 so that the object display area 1100 is displayed at the position shown in FIG. Control unit 190 then returns the process to step S1120.

(Modification)
Modifications of the present embodiment will be described below with reference to FIGS. 15 to 17 and the like.

As shown in FIGS. 12 to 14 , when the display position of object display area 1100 on display 132 is changed in step S 1030 , angle change button 1300 is displayed above object display area 1100 . In this example, as the angle change buttons 1300 , an “up” angle button 1301 , a “sideways” angle button 1302 , and an “other” angle button 1303 are displayed on the display 132 . By tapping these angle change buttons 1300 by the user, the display angle (viewpoint) of the racetrack object 501 displayed in the object display area 1100 can be changed.

15 is a schematic diagram illustrating an example of a display screen according to modification 1. FIG. FIG. 15 shows, for example, the display mode of the racetrack object 501 when the “up” angle button 1301 of the angle change buttons 1300 is tapped. When the "up" angle button 1301 is tapped, etc., as shown in FIG. 15, the viewpoint of the racetrack object 501 is changed from the viewpoint from diagonally above, which is the initial position, to the viewpoint from directly above. be. In other words, the viewpoint is changed to a state in which the racetrack object 501 is captured in a straight-down view.

Also, although illustration is omitted, for example, when the "horizontal" angle button 1302 is tapped, the viewpoint of the racetrack object 501 is changed to the viewpoint from the side (for example, the start point side). be able to. Furthermore, when the "other" angle button 1303 is tapped, the viewpoint of the racetrack object 501 can be changed to any other viewpoint. Other viewpoints include, for example, a viewpoint from the opposite side of the racetrack object 501 (clock tower object side) to the viewpoint shown in FIG. Viewpoints and the like may be included.

In the example of the flowchart shown in FIG. 10, even if the display position of the object display area 1100 is changed to the upper part of the display 132 in step S1030, the display angle of the racetrack object 501 is changed from the initial state shown in FIG. Although a configuration that does not require a connection has been described, the configuration is not limited to this example. For example, in step S1030, the display position of the object display area 1100 may be changed to the upper part of the display 132, and the display angle (viewpoint) of the racetrack object 501 displayed in the object display area 1100 may be changed. That is, the change of the display position and the change of the display angle of the racetrack object 501 may be performed at the same time. For example, at the same time as switching the screen so that the object display area 1100 is displayed on the upper part of the display 132, the racetrack object 501 can be displayed from directly above as shown in FIG. In this case, when the display of the UI display area 1200 ends and the display position of the racefield object 501 returns to the initial position, the display angle of the racefield object 501 may be returned to the initial value. The display angle of 501 may be displayed as it is from directly above, and the user may arbitrarily change the display angle.

FIG. 16 is a schematic diagram showing an example of a display screen according to modification 2. As shown in FIG.
16, the UI display area 1200 displays a purchase price column 1252, a vote button 1253, a race selection button 1254, and an option button 1255, and also includes a race display screen 1600. . That is, the example of FIG. 16 differs from the example of FIG. 13 in that a race display screen 1600 is displayed instead of the contestant data column 1251 . In the example of FIG. 16, the race display screen 1600 displays, for example, a race video of a bicycle race as the second race. The race display screen 1600 may display the virtual race of the second race (race field object of the second race) instead of the real race video. In this way, in the example of FIG. 16, on the display 132, a plurality of tasks of virtual race viewing of the first race, purchase of betting tickets for the second race, and race viewing of the second race can be executed simultaneously. can be done.

FIG. 17 is a schematic diagram showing an example of a display screen according to Modification 3. As shown in FIG.
In Modified Example 3 shown in FIG. 17, a race moving image 1700 is displayed on the display 132 above the object display area 1100 where the race field object 501 of the first race is displayed. The race video 1700 is, for example, the actual race video of the first race. The display positions of the object display area 1100 and the race video 1700 are not limited to the example in FIG. 17, and the display may be reversed. That is, the object display area 1100 in which the race field object 501 of the first race is displayed may be displayed at the top of the display 132 and the race moving image 1700 of the first race may be displayed below the race field object 501 . Thus, in the example of FIG. 17, on the display 132, it is possible to simultaneously execute a plurality of tasks of viewing the race video and virtual race of the first race and purchasing a betting ticket for the second race.

In each of the above examples, examples of display screens displayed on the display 132 when the user terminal 10 is vertically oriented (vertically placed) are described, but the present invention is not limited to this example. Even when the user terminal 10 is turned sideways (horizontally placed), the display position of the object display area where the racetrack object 501 is displayed is changed, and the UI display area is displayed at a position different from the object display area. It may be displayed so that multiple tasks can be performed simultaneously on the horizontal display 132 .

The above-described embodiments are merely examples for facilitating understanding of the present invention, and are not intended to limit the interpretation of the present invention. It goes without saying that the present invention can be modified and improved without departing from its spirit, and that equivalents thereof are included in the present invention.

[Additional notes]
The contents of the present disclosure are listed below.

(Item 1)
A program executed in a first computer comprising a processor, an imaging unit, and a display unit,
The program causes the processor to:
receiving from a second computer first information about a first predetermined race in the real world;
generating a virtual object including a racetrack object representing the racetrack of the first race and a moving object representing a contestant or moving object of the first race based on the first information;
causing the display unit to superimpose and display the virtual object on a real image of the surroundings of the first computer captured by the imaging unit;
The displaying step includes displaying a user interface display area capable of receiving a user's first operation input at a position different from an object display area in which the virtual object is displayed on the display unit.
program.
This makes it possible to accept a user's operation for executing another task while watching the virtual race displayed on the first computer. Therefore, while the user is watching the virtual race of the predetermined race or during the free time of watching the race, the user can perform tasks other than watching the virtual race, thereby improving the user's convenience. can.

(Item 2)
The displaying step includes displaying the user interface display area after changing the display position of the object display area in response to the user's second operation input on the display unit.
The program of item 1.
As a result, it is possible to smoothly switch the screen between the case where only the object display area is displayed on the display unit and the case where both the object display area and the user interface display area are displayed on the display unit.

(Item 3)
The displaying step includes changing the display angle of the virtual object according to the change in the display position.
A program according to item 2.
Accordingly, even when the object display area and the user interface display area are displayed on the display unit, the visibility of the virtual race can be improved, and the user's convenience can be further improved.

(Item 4)
the receiving step includes receiving from the second computer second information about a second race that is different from the first race in the real world;
the displaying step includes displaying the second information in the user interface display area;
A program according to any one of items 1 to 3.
As a result, other tasks such as voting for races other than the virtual race being watched can be executed, thereby further improving convenience for the user.

(Item 5)
The second information includes a user interface image for the user to select a contestant or moving object for the second race, a real image of the second race, a virtual racetrack object and a moving object of the second race. containing at least one of the objects
A program according to item 4.
As a result, even while watching the virtual race of the first race, the user can vote for the second race, which is different from the first race, or watch the video of the second race or the virtual race. can.

(Item 6)
the displaying step includes displaying a realistic image of the first race in the user interface display area;
A program according to any one of items 1 to 5.
Thereby, the user can view the virtual race of the first race as well as the real image (actual moving image) of the first race.

(Item 7)
An information processing method executed in a first computer comprising a processor, an imaging unit, and a display unit,
The information processing method includes:
receiving from a second computer first information about a first predetermined race in the real world;
generating a virtual object including a racetrack object representing a racetrack and a moving object representing a contestant or moving object of the first race based on the first information;
causing the display unit to superimpose and display the virtual object on a real image of the surroundings of the first computer captured by the imaging unit;
The displaying step includes displaying a user interface display area capable of receiving a user's first operation input at a position different from an object display area in which the virtual object is displayed on the display unit.
Information processing methods.
Thereby, the user's convenience can be improved while watching the virtual race displayed on the first computer.

(Item 8)
An information processing device comprising a processor, an imaging unit, and a display unit, wherein the processor
receiving first information about a given first race in the real world from a second computer, and based on said first information, a racetrack object representing a racetrack and a movement representing a contestant or moving object of said first race; create a virtual object containing the object and
wherein the display unit superimposes and displays the virtual object on a real image of the surroundings of the information processing device captured by the imaging unit;
The superimposed display includes displaying a user interface display area capable of receiving a user's first operation input at a position different from an object display area in which the virtual object is displayed on the display unit.
Information processing equipment.
As a result, it is possible to improve convenience for the user who is watching the virtual race displayed on the information processing device.

(Item 9)
A system that includes a first computer that includes a first processor, an imaging device, and a display device, and a second computer that includes a second processor and is communicatively connectable to the first computer,
The second processor
obtaining first information about a given first race in the real world and transmitting said first information to said first computer, said first processor comprising:
receiving the first information from a second computer;
generating a virtual object including a racetrack object representing a racetrack and a moving object representing a contestant or moving object of the first race based on the first information;
wherein the display device superimposes and displays the virtual object on a real image of the surroundings of the first computer captured by the imaging device;
The superimposed display includes displaying a user interface display area capable of accepting a user's first operation input at a position different from an object display area in which the virtual object is displayed on the display device.
system.
Thereby, the user's convenience can be improved while watching the virtual race displayed on the first computer.

1: system, 10: user terminal, 20: first server device, 30: network, 40: second server device, 130: touch screen, 150: storage unit (of user terminal), 152A, 252A: first information, 152B, 252B: second information, 190: control unit (of user terminal), 191: operation input reception unit, 192: transmission/reception unit, 193: object generation unit, 194: display control unit, 195: flat surface detection unit, 196 : first information acquisition unit 197: second information acquisition unit 198: selection information acquisition unit 250: storage unit (of first server device) 290: control unit (of first server device) 401: boat race field, 402a-402f: boat, 501: race field object, 502 (502a-502f): moving object, 1100: object display area, 1150: switching button, 1200: user interface display area (UI display area), 1201, 1254 1202: Video display button 1203, 1255: Option button 1251: Contestant data column 1252: Purchase amount column 1253: Vote button 1300: Angle change button 1400: Vote screen 1600: Race Display screen, 1700: Race video

Claims (9)

A program executed in a first computer comprising a processor, an imaging unit, and a display unit,
The program causes the processor to:
receiving from a second computer first information about a first predetermined race in the real world;
generating a virtual object including a racetrack object representing the racetrack of the first race and a moving object representing a contestant or moving object of the first race based on the first information;
causing the display unit to superimpose and display the virtual object on a real image of the surroundings of the first computer captured by the imaging unit;
The displaying step includes displaying a user interface display area capable of receiving a user's first operation input at a position different from an object display area in which the virtual object is displayed on the display unit.
program. The displaying step includes displaying the user interface display area after changing the display position of the object display area in response to the user's second operation input on the display unit.
A program according to claim 1. The displaying step includes changing the display angle of the virtual object according to the change in the display position.
3. A program according to claim 2. the receiving step includes receiving from the second computer second information about a second race that is different from the first race in the real world;
the displaying step includes displaying the second information in the user interface display area;
A program according to any one of claims 1 to 3. The second information includes a user interface image for the user to select a contestant or moving object for the second race, a real image of the second race, a virtual racetrack object and a moving object of the second race. containing at least one of the objects
5. A program according to claim 4. the displaying step includes displaying a realistic image of the first race in the user interface display area;
A program according to any one of claims 1 to 5. An information processing method executed in a first computer comprising a processor, an imaging unit, and a display unit,
The information processing method includes:
receiving from a second computer first information about a first predetermined race in the real world;
generating a virtual object including a racetrack object representing a racetrack and a moving object representing a contestant or moving object of the first race based on the first information;
causing the display unit to superimpose and display the virtual object on a real image of the surroundings of the first computer captured by the imaging unit;
The displaying step includes displaying a user interface display area capable of receiving a user's first operation input at a position different from an object display area in which the virtual object is displayed on the display unit.
Information processing methods. An information processing device comprising a processor, an imaging unit, and a display unit, wherein the processor
receiving first information about a given first race in the real world from a second computer, and based on said first information, a racetrack object representing a racetrack and a movement representing a contestant or moving object of said first race; create a virtual object containing the object and
wherein the display unit superimposes and displays the virtual object on a real image of the surroundings of the information processing device captured by the imaging unit;
The superimposed display includes displaying a user interface display area capable of receiving a user's first operation input at a position different from an object display area in which the virtual object is displayed on the display unit.
Information processing equipment. A system that includes a first computer that includes a first processor, an imaging device, and a display device, and a second computer that includes a second processor and is communicatively connectable to the first computer,
The second processor
obtaining first information about a given first race in the real world and transmitting said first information to said first computer, said first processor comprising:
receiving the first information from a second computer;
generating a virtual object including a racetrack object representing a racetrack and a moving object representing a contestant or moving object of the first race based on the first information;
wherein the display device superimposes and displays the virtual object on a real image of the surroundings of the first computer captured by the imaging device;
The superimposed display includes displaying a user interface display area capable of accepting a user's first operation input at a position different from an object display area in which the virtual object is displayed on the display device.
system.

Images