JP2022112830A - Program, information processing method, information processing device, and system - Google Patents

Abstract

To improve convenience and a satisfaction level of a user by improving visibility of a screen when viewing a plurality of races.SOLUTION: In a system in which a plurality of user terminals, a first server device, and a second server device are connected by a network, the user terminal including a processor, an imaging unit, and a display, is configured to: receive first information on a first race in a real world and second information on a second race from the first server device; generate a first display object of the first information and a second display object of second information; divide a display region into a plurality of regions including a first region and a second region by a user operation; superpose a virtual object on a reality image around a first computer, display the first display object in a first region, and display a second display object in a second region in a display; acquire selection information indicating one or more participants of a user or a mobile body; and change display modes of the first and second regions by selection.SELECTED DRAWING: Figure 2

Description

The present disclosure relates to programs, information processing methods, information processing apparatuses, and systems.

Patent Literatures 1 and 2 disclose techniques related to AR (Augmented Reality).

Japanese Patent Application Laid-Open No. 2020-58658 JP 2020-77187 A

In the real world, various races such as boat races and horse races are held. Some people actually go to the racetracks to watch these races, but in some cases it is not possible due to time or geographical restrictions to actually visit the racetracks. From the above situation, if it is possible to display the real world race as a virtual race on the display of various terminals using virtual objects linked to the real world race, it will be possible to race without actually going to the racetrack. can be watched in a simulated manner, which is useful.

By the way, there is room for improvement in the visibility of the race display screen when the user is watching a plurality of virtual races on a mobile terminal or the like.

An object of one aspect of the present disclosure is to provide a program, an information processing method, an information processing apparatus, and a system that can improve user convenience and satisfaction by improving visibility when viewing multiple races. do.

According to one embodiment shown in the present disclosure,
A program executed in a first computer comprising a processor, an imaging unit, and a display unit,
The program causes the processor to:
receiving from a second computer first information about a first predetermined race in the real world and second information about a second predetermined race different from the first race in the real world;
generating a first display object based on the first information;
generating a second display object based on the second information;
dividing the display area of the display unit into a plurality of areas including at least a first area and a second area different from the first area when receiving an operation input from a user;
In the display unit, the first display object is displayed in the first area by being superimposed on a real image of the surroundings of the first computer captured by the imaging unit, and the second display is displayed in the second area. displaying the object;
a step of obtaining selection information indicating one or more of the contestants or moving bodies selected by the user from among the contestants or moving bodies in at least one of the first race and the second race;
and changing a display mode of at least one of the first area and the second area based on the selection information.

According to an embodiment shown in the present disclosure, user convenience and satisfaction can be improved by improving the visibility when viewing multiple races.

1 is a diagram showing a configuration example of a system according to an embodiment; FIG. 2 is a block diagram showing an example of functional configuration of a user terminal according to an embodiment; FIG. 3 is a block diagram showing an example of a functional configuration of a server according to one embodiment; FIG. 1 is a schematic diagram illustrating an example of a real-world race track according to an embodiment; FIG. FIG. 4 is a schematic diagram showing an example of a virtual object displayed on a user terminal according to an embodiment; FIG. 6 is a flow chart showing an example of display control processing according to an embodiment; FIG. 4 is a schematic diagram showing an example of a real image captured by an imaging unit according to an embodiment; FIG. 10 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image according to an embodiment; FIG. 10 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image according to an embodiment; 9 is a flowchart showing an example of display control processing in an operation example according to an embodiment; 9 is a flowchart showing an example of display control processing in an operation example according to an embodiment; FIG. 4 is a schematic diagram showing an example of a display screen according to an embodiment; FIG. 4 is a schematic diagram showing an example of a display screen according to an embodiment; FIG. 4 is a schematic diagram showing an example of a display screen according to an embodiment; FIG. 4 is a schematic diagram showing an example of a display screen according to an embodiment; FIG. 4 is a schematic diagram showing an example of a display screen according to an embodiment; FIG. 4 is a schematic diagram showing an example of a screen displaying real images captured by an imaging unit according to an embodiment in a plurality of display areas; FIG. 10 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image according to an embodiment;

Hereinafter, embodiments of this technical idea will be described in detail with reference to the drawings. In the following description, the same elements are denoted by the same reference numerals, and overlapping descriptions are omitted as appropriate. In one or more of the embodiments presented in this disclosure, elements of each embodiment may be combined with each other and the combined result shall also form part of the embodiments presented in this disclosure.

(System configuration)
FIG. 1 is a diagram showing the configuration of system 1 according to the present embodiment. The system 1 can display, for example, a predetermined race held in the real world as a virtual race using virtual objects on the information processing device used by the user. In this specification, the "predetermined race" is not particularly limited as long as it is a race that is held in the real world. Examples include car races such as F1, drone races, dog races, marathons, and relay road races.

As shown in FIG. 1, the system 1 includes a user terminal 10A, a user terminal 10B, and a user terminal 10C (hereinafter referred to as user terminals 10A, 10B, 10C, etc.), which are information processing apparatuses (first computers) used by users. , a first server device (second computer) 20 , a second server device 40 , and a network 30 .

The user terminals 10A and 10B are connected to the network 30 by communicating with the radio base station 31 . The user terminal 10C connects to the network 30 by communicating with a wireless router 32 installed in a facility such as a house. The user terminal 10 is, for example, a mobile terminal having a touch screen, and may be a smart phone, a phablet, a tablet, or the like.

The user terminal 10 executes, for example, a program installed via a platform that distributes applications or the like, or a program including pre-installed website browsing software. The user terminal 10 communicates with the first server device 20 by executing the above program, and transmits/receives data related to a predetermined race, data related to the user, etc. to/from the first server device 20, thereby allowing the user It is possible to display a virtual race on the terminal 10. - 特許庁

The first server device 20 receives data related to a given race from the second server device 40 . The first server device 20 appropriately transmits data related to a predetermined race to the user terminal 10 . The first server device 20 stores and manages data related to a predetermined race and data related to each user.

The first server device 20 includes a communication IF (Interface) 22, an input/output IF 23, a memory 25, a storage 26, and a processor (second processor) 29 as a hardware configuration. connected to each other through

The communication IF 22 is compatible with various communication standards such as the LAN (Local Area Network) standard, and functions as an interface for transmitting and receiving data to and from the user terminal 10, the second server device 40, and the like.

The input/output IF 23 functions as an interface for receiving input of information to the first server device 20 and outputting information to the outside of the first server device 20 . The input/output IF 23 can include an input receiving section that receives connection of information input devices such as a mouse and keyboard, and an output section that receives connection of information output devices such as a display for displaying images and the like.

The memory 25 is a storage device for storing data used for processing. The memory 25 provides the processor 29 with a work area for temporary use when the processor 29 performs processing, for example. The memory 25 includes storage devices such as ROM (Read Only Memory) and RAM (Random Access Memory).

The storage 26 is a storage device for storing various programs and data for the processor 29 to read and execute. The information stored by the storage 26 includes data related to predetermined races, data related to each user, and the like. The storage 26 can be configured including a storage device such as an HDD (Hard Disk Drive) and flash memory. Note that the storage is not limited to being included in the server device, and a cloud service can also be used.

The processor 29 controls the operation of the first server device 20 by reading and executing programs and the like stored in the storage 26 . The processor 29 can be configured including, for example, a CPU (Central Processing Unit), MPU (Micro Processing Unit), GPU (Graphics Processing Unit), and the like.

The second server device 40 stores and manages data related to predetermined races. The second server device 40 is, for example, a server device managed by the organizer of a given race, or an organization that transmits information about a given race to the outside (publisher of a race journal, race video distributor, or radio distributor). etc.). The second server device 40 appropriately transmits data related to a predetermined race to the first server device 20 . In one aspect, the second server device 40 may transmit data related to a given race to the user terminal 10 . The hardware configuration of the second server device 40 may be the same as that of the first server device 20 as long as there is no contradiction. A plurality of second server devices 40 may be provided.

(user terminal)
FIG. 2 is a block diagram showing an example of the functional configuration of the user terminal 10. As shown in FIG. As shown in FIG. 2, the user terminal 10 includes an antenna 110, a wireless communication IF 120, a touch screen 130, an input/output IF 140, a storage unit 150, an audio processing unit 160, a microphone 161, a speaker 162, It includes an imaging unit 170 and a control unit (first processor) 190 .

The antenna 110 radiates the signal emitted by the user terminal 10 into space as radio waves. Antenna 110 also receives radio waves from space and provides a received signal to wireless communication IF 120 .

The wireless communication IF 120 performs modulation/demodulation processing and the like for transmitting and receiving signals via the antenna 110 and the like in order for the user terminal 10 to communicate with other communication devices. The wireless communication IF 120 is a communication module for wireless communication including a tuner, a high-frequency circuit, etc., performs modulation/demodulation and frequency conversion of wireless signals transmitted/received by the user terminal 10 , and provides received signals to the control unit 190 .

Touch screen 130 accepts input from a user and outputs information to display 132 for the user. Touch screen 130 includes a touch panel 131 and a display 132 for accepting user operation input. The touch panel 131 detects that a user's finger or the like approaches by using, for example, a capacitive touch panel. The display 132 is implemented by, for example, an LCD (Liquid Crystal Display), an organic EL (electroluminescence), or other display device.

The input/output IF 140 receives input of information to the user terminal 10 and functions as an interface for outputting information to the outside of the user terminal 10 .

The storage unit 150 is configured by a flash memory, an HDD, or the like, and stores programs used by the user terminal 10 and various data received by the user terminal 10 from the first server device 20 or the like.

The audio processing unit 160 modulates and demodulates an audio signal. Audio processing section 160 modulates the signal supplied from microphone 161 and supplies the modulated signal to control section 190 . Also, the audio processing unit 160 provides an audio signal to the speaker 162 . The audio processing unit 160 is implemented by, for example, a processor for audio processing. Microphone 161 functions as an audio input unit for receiving input of an audio signal and outputting it to control unit 190 . The speaker 162 functions as an audio output unit for outputting audio signals to the outside of the user terminal 10 .

The imaging unit 170 is a camera that captures a real image of the surroundings of the user terminal 10 . An image captured by the imaging unit 170 is subjected to image processing by the control unit 190 and output to the display 132 .

The control unit 190 controls the operation of the user terminal 10 by reading and executing programs stored in the storage unit 150 . The control unit 190 is implemented by, for example, an application processor.

A process of executing the application program 151 by the control unit 190 will be described in more detail. Storage unit 150 stores application program 151 , application information 152 , and user information 153 .

For example, the user terminal 10 downloads the application program 151 from the first server device 20 and stores it in the storage unit 150 . Also, the user terminal 10 communicates with the first server device 20 to transmit and receive various data such as application information 152 and user information 153 to and from the first server device 20 .

The application program 151 is a program for displaying virtual races on the user terminal 10 . The application information 152 includes various data referred to by the application program 151 . Application information 152 includes first information 152A and second information 252B.

The first information 152A is information regarding a predetermined race transmitted from the first server device 20 or the second server device 40 . Hereinafter, the predetermined race will be referred to as "first race". The first information 152A includes, for example, race time information indicating the race time of the first race contestants or moving bodies (hereinafter also referred to as “contestants, etc.”), position information of the contestants, etc. during the first race, and time information corresponding to the location information.

As used herein, the term “contestant” is a concept that includes not only humans but also animals such as horses and dogs. A "moving object" is an object that is the subject of movement in a race, such as an animal or a machine on which a contestant rides, or a machine that is remotely controlled by a contestant. In a marathon, a dog race, etc., the "participant" and the "moving object" are the same.

In addition to the above, the first information 152A includes, for example, the name of the first race, the date and time of the race, race field data, contestant data, mobile data, odds information, race prediction information, race start chart, information immediately before the race, It may include pit reports, race results, race videos, race still images, past race information, and other information that can be published in information magazines and information sites related to the first race.

The race prediction information included in the first information 152A includes predicted rankings of participants in a predetermined race. The race prediction information may include a plurality of ranking predictions for a given race and ranking predictions for a plurality of races. The race prediction information may also include a ranking prediction for each race held at a plurality of racetracks. Here, the plurality of racecourses may be racecourses where the same competition is held (for example, boat racecourses at different locations), or racecourses where different competitions are held (for example, boat races). course and racetrack).

The prediction information includes, for example, computer prediction information calculated by a computer device. The computer prediction information is, for example, the first server device 20, the second server device 40, or the user terminal 10 based on past data, which is information about other races held in the past, and race conditions in a predetermined race. This includes the ranking predictions calculated by Calculation of rank prediction may be performed, for example, by a machine learning model using a neural network.

Also, the prediction information can include, for example, human prediction information predicted by a person (for example, a reporter, a tipster, etc.). The people prediction information is prediction information input by a human, and is transmitted from the first server device 20 or the second server device 40 to the user terminal 10 . The human prediction information can include audio information generated from the voice uttered by the predicted human and/or moving image information of a moving image of the human.

The second information 152B is information related to a predetermined race transmitted from the first server device 20 or the second server device 40, and is related to a second race different from the first race targeted by the first information 152A. Information. The second race is, for example, a race that is held on a race track different from the first race on the same day that the first race is held. The first race and the second race may be the same type of race, or may be different types of races. For example, the first race and the second race may be boat races held at different boat races, where the first race is a boat race and the second race is a race other than a boat race (for example, It may be a horse race or bicycle race). The second information 152B includes, for example, race time information indicating the race time of the contestants of the second race, position information of the contestants during the second race, and time information corresponding to the position information. . The second race is not limited to one race, and may be multiple races different from the first race.

In addition to the above, the second information 152B includes, for example, the name of the second race, the date and time of the race, race field data, contestant data, mobile data, odds information, race forecast, race start chart, information just before the race, pit It may include reports, race results, race videos, race still images, past race information, information that can be published in information magazines and information sites related to the second race, and the like.

User information 153 includes information about the user of user terminal 10 . The user information 153 includes, for example, information identifying the user, location information of the user terminal 10, user's race purchase history and hit rate (for example, in the case of a boat race, the history of purchased boat tickets and the number of purchased boat tickets). Hit rate) and the like may be included.

By reading and executing the application program 151, the control unit 190 controls the operation input reception unit 191, the transmission/reception unit 192, the object generation unit 193, the display control unit 194, the flat surface detection unit 195, the first information The functions of the acquisition unit 196, the second information acquisition unit 197, and the selection information acquisition unit 198 are exhibited.

The operation input receiving unit 191 receives user's operation input based on the output of the touch screen 130 . Specifically, the operation input reception unit 191 detects that a user's finger or the like touches or approaches the touch panel 131 as coordinates of a coordinate system including a horizontal axis and a vertical axis of the surface forming the touch screen 130 .

Operation input reception unit 191 determines a user's operation on touch screen 130 . The operation input reception unit 191 performs, for example, “approach operation”, “release operation”, “tap operation”, “double tap operation”, “long press operation (long touch operation)”, “drag operation (swipe operation)”, User operations such as "move operation", "flick operation", "pinch-in operation", and "pinch-out operation" are determined.

The operation input receiving unit 191 may receive, as an operation input, movement of the user terminal 10 detected by an acceleration sensor or the like mounted on the user terminal 10 .

The transmission/reception unit 192 transmits and receives various types of information to and from external communication devices such as the first server device 20 and the second server device 40 via the wireless communication IF 120 and the network 30 . The transmitter/receiver 192 receives the first information 152A from the first server device 20 or the second server device 40, for example. Further, the transmission/reception unit 192 transmits, for example, information corresponding to the operation input received by the operation input reception unit 191 and information stored in the user information 153 to the first server device 20 or the second server device 40. .

The object generator 193 generates a virtual object for presenting information about the first race to the user based on the first information 152A. The object generation unit 193 generates, as virtual objects, a racetrack object representing the racetrack of the first race and moving objects representing the contestants of the first race. The object generator 193 may generate a virtual display board for text-displaying information generated based on the first information 152A. In addition to the objects described above, the object generation unit 193 also generates virtual screens for image-displaying information generated based on the first information 152A, various building objects, landscape objects such as trees that form landscapes, and the like. may be generated.

The display control unit 194 superimposes the virtual object generated by the object generation unit 193 on the real image of the surroundings of the user terminal 10 captured by the imaging unit 170 (hereinafter also referred to as a “superimposed image”). displayed on the display 132. The display control unit 194 moves each moving object on the racefield object based on the race time information included in the first information 152A, and displays a virtual race that virtually reproduces the first race on the display 132. In addition to the race time information, the display control unit 194 preferably reproduces the virtual race based on the position information of the contestants included in the first information 152A and the time information corresponding to the position information. .

It is preferable that the display control unit 194 can change the viewpoint in the superimposed image according to the operation input received by the operation input reception unit 191 . A specific example of changing the viewpoint will be described later.

Further, it is preferable that the display control unit 194 can display various menu screens and GUI (Graphical User Interface) on the display 132 according to the operation input received by the operation input reception unit 191 . In this example, in particular, the display control unit 194 changes the display position of the virtual object displayed on the display 132 in response to the user's operation input for a switching button, which will be described later, received by the operation input reception unit 191, and changes the display position of the virtual object. A UI (User Interface) display area is provided at a position different from the area where the virtual objects on 132 are displayed, and various UI objects capable of receiving user operation inputs are displayed in the UI display area.

A flat surface detection unit 195 detects a flat surface in the real image captured by the imaging unit 170 . Detection of a flat surface is realized by conventionally known image recognition technology. For example, when the user performs an operation to select a flat surface detected by the flat surface detection unit 195, the display 132 displays a superimposed image in which a racetrack object is arranged on the flat surface.

Preferably, the flat surface is a horizontal surface. Also, the angle formed by the flat surface and the bottom surface forming the racetrack object may be 0 degrees, but is preferably an acute angle, and can be in the range of 15 degrees to 45 degrees, for example. The angle can also be adjusted by accepting a user's operation. In addition, even if there is a projection on a part of the flat surface in the real world, or even if there is an object on the flat surface, if the projection or the object is of a size that can be hidden by the racetrack object. , may be detected as a flat surface on which the racetrack object can be placed.

The first information acquisition unit 196 acquires first information 152A by receiving predetermined information (first information 252A described later) from the first server device 20 .

The second information acquisition unit 197 acquires second information 152B by receiving predetermined information (second information 252B described later) from the first server device 20 .

The selection information acquisition unit 198 acquires one or more pieces of selection information indicating one or more contestants selected by the user. The "selection information" is, for example, information indicating the contestants predicted by the user as the winners of the first race and the second race. If the first and second races are boat races or horse races, the "selection information" may be information indicating boat tickets or betting tickets purchased by the user.

The selection information acquisition unit 198 acquires selection information, for example, based on a user's operation input on a screen for selecting contestants. The selection information acquired by the selection information acquisition unit 198 is transmitted to the first server device 20 or the second server device 40, for example. For example, in response to transmission of the selection information to the second server device 40, processing for purchasing boat tickets and betting tickets for a predetermined race can be performed.

(First server device)
FIG. 3 is a block diagram showing the functional configuration of the first server device 20. As shown in FIG. A detailed configuration of the first server device 20 will be described with reference to FIG. The first server device 20 functions as a communication unit 220, a storage unit 250, and a control unit 290 by operating according to a program.

The communication unit 220 functions as an interface for the first server device 20 to communicate with external communication devices such as the user terminal 10 and the second server device 40 via the network 30 .

The storage unit 250 stores various programs and data for realizing the system 1 . In one aspect, storage unit 250 stores program 251 , race information 252 , and user information 253 .

The program 251 is a program for realizing the system 1 by the first server device 20 communicating with the user terminal 10 and the second server device 40 . The program 251 is executed by the control unit 290 to perform processing for transmitting and receiving data to and from the user terminal 10 and the second server device 40, processing according to the operation content performed by the user of the user terminal 10, race information 252 and user The first server device 20 is caused to perform processing such as updating the information 253 .

Race information 252 includes various data related to a given race. Race information 252 includes, for example, first information 252A and second information 252B. The first information 252A is information on which the first information 152A is based, and is information relating to the first race. First information 152A may be part of first information 252A. The first information 252A is information acquired from the second server device 40, for example. Similarly, the second information 252B is information on which the second information 152B is based, and is information about the second race. Second information 152B may be part of second information 252B. The second information 252B is information acquired from the second server device 40, for example.

User information 253 is information about the user of the user terminal 10 . User information 253 includes a user management table 253A. The user management table 253A stores, for example, user identification information, user terminal 10 position information, user's race purchase history, hit rate, and the like for each user.

The control unit 290 is realized by the processor 29, and by executing the program 251, the transmission/reception unit 291, the first information acquisition unit 292A, the second information acquisition unit 292B, the selection information acquisition unit 293, the data management unit 294, the timer unit 295 functions.

The transmission/reception unit 291 transmits and receives various types of information to and from external communication devices such as the user terminal 10 and the second server device 40 via the communication unit 220 and the network 30 . The transmitting/receiving unit 291 transmits at least part of the first information 252A and the second information 252B to the user terminal 10, for example. Also, the transmitting/receiving unit 291 receives the first information 252A and the second information 252B from the second server device 40, for example.

The first information acquisition unit 292A acquires the first information 252A from the second server device 40 via the transmission/reception unit 291 . The second information acquisition section 292B acquires the second information 252B from the second server device 40 via the transmission/reception section 291 . The selection information acquisition unit 293 acquires user selection information from the user terminal 10 or the second server device 40 via the transmission/reception unit 291 . The data management unit 294 updates various data stored in the storage unit 250 according to the processing results of the first information acquisition unit 292A, the second information acquisition unit 292B, the selection information acquisition unit 293, and the like. The timer 295 performs processing for measuring time. Various times displayed on the user terminal 10 (for example, the time until the start of the race, etc.) can be controlled based on the time measured by the timer 295 .

(Operation example)
Next, an operation example of the system 1 will be described with reference to FIGS. 4 to 18. FIG. In the following description, the case where the predetermined race, ie, the first race, is a boat race will be described as an example, but the following description can be applied even if the first race is another type of race. In the following description, data is transmitted and received between the user terminal 10 and the first server device 20, and between the first server device 20 and the second server device 40. The terminal 10 and the second server device 40 may be configured to directly transmit and receive data.

FIG. 4 is a schematic diagram showing an example of a boat race track in the real world. Two turn marks 403 are installed in the boat race course 401, and races are carried out by boats 402a to 402f on which boat racers ride. When the race ends, race time information indicating the race times of the boats 402a to 402f is transmitted from the second server device 40 to the first server device 20, and from the first server device 20 to the user terminal 10. FIG.

The boat race course 401 is provided with imaging devices (cameras) 404a to 404b. The imaging device 404a captures the boats 402a to 402f from above the boat race course 401 in its field of view. The imaging device 404b captures the boats 402a to 402f from the sides of the boat race course 401 in the field of view. The images of the boats 402 a - 402 f captured by the imaging devices 404 a - 404 b are transmitted to the second server device 40 . The second server device 40, for example, performs image analysis of each image, and calculates position information indicating the position of each of the boats 402a to 402f at the shooting time of each image. The calculated position information and the time information regarding the shooting time corresponding to the position information are transmitted to the first server device 20 and transmitted from the first server device 20 to the user terminal 10 . Note that the position information may be calculated in the first server device 20 .

Position sensors such as GPS sensors may be installed on the boats 402a to 402f instead of or in addition to the imaging devices 404a to 404b. The position information of the boats 402a to 402f obtained by the position sensors and the time information indicating the time when the position information was obtained are finally transmitted to the user terminal 10. FIG.

FIG. 5 is a schematic diagram showing an example of a virtual object displayed on the user terminal 10. As shown in FIG. In the example of FIG. 5, a racetrack object 501, moving objects 502a to 502f, two turn mark objects 503, and a virtual display board 505 are shown as virtual objects.

A racetrack object 501 is an object that is a virtual display of the boat racetrack 401 . The race track object 501 and the turn mark object 503 are preferably created based on race track data such as course information of the boat race track 401 , and preferably have shapes corresponding to the boat race track 401 .

The moving objects 502a to 502f are objects that are virtual representations of the boats 402a to 402f, respectively, and have boat-like shapes. The moving objects 502a to 502f move in the racetrack object 501 based on race time information, position information of the boats 402a to 402f, and time information corresponding to the position information. In other words, a race in the real world is displayed on the user terminal 10 as a virtual race using the racetrack object 501 and the moving objects 502a to 502f.

It is also possible to display the virtual race only by the race time information without the position information and time information of the boats 402a-402f. However, in this case, although the final order of finish is the same as in the race in the real world, it is difficult to reproduce the progress of the race, such as the ranking during the race.

A virtual display board 505 is an object that displays text information. Virtual display board 505 is, for example, an object that does not have a corresponding existence in boat race track 401 . The text information displayed on the virtual display board 505 is not particularly limited, and may be ranking information, odds information, or the like, for example. Also, the text information displayed on the virtual display board 505 may be changeable based on the user's operation input.

FIG. 6 is a flowchart illustrating an example of processing related to display control. It should be noted that the order of each process constituting the flow chart described below may be random as long as there is no contradiction or inconsistency in the contents of the process, and the processes may be executed in parallel. Also, the processing executed by each device in each flowchart may be executed by another device as long as there is no contradiction.

The processing shown in FIG. 6 is implemented by the control unit 190 executing the application program 151 and the control unit 290 executing the program 251, respectively. First, in step S610, the control unit 190 activates the imaging unit 170, which is a camera. A real image around the user terminal 10 is captured by the imaging unit 170 .

In step S<b>620 , the control unit 190 detects a flat surface within the image captured by the imaging unit 170 . In step S630, the control unit 190 arranges the virtual object on the detected flat surface.

Here, the processing of steps S610, S620, and S630 will be specifically described with reference to FIGS. 7 to 9. FIG. FIG. 7 is a schematic diagram showing an example of a real image captured by the imaging unit 170. As shown in FIG. In the example of FIG. 7, a keyboard 702 and a monitor device 703 are placed on a flat desk 701 .

When the imaging unit 170 is activated in step S610, a real image captured by the imaging unit 170 is displayed on the display 132. FIG. Next, in step S<b>620 , the control unit 190 detects a flat surface within the image captured by the imaging unit 170 , that is, within the image displayed on the display 132 .

In FIG. 7, region 704 is detected as a flat surface. There is a keyboard 702 within the area 704, but the size of the keyboard 702 is such that it can be hidden by the racetrack object 501, so the control unit 190 detects the area 704 as a flat surface.

In the state shown in FIG. 7, if the position captured by the imaging unit 170 is changed, the position of the region 704 can also be changed. The area 704 is displayed on the display 132 by adding a predetermined color, for example, so as to be distinguishable from other parts. When the user performs a tap operation or the like on the area 704, the control unit 190 arranges a virtual object such as the racetrack object 501 on the area 704 in step S630.

FIG. 8 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image. In FIG. 8, the dot patterned area including the monitor device 703 is the real image, and the other area is the area where the virtual object is displayed. For example, an advertisement image may be displayed in the area where no virtual object is displayed.

In FIG. 8, as virtual objects, there are a racetrack object 501, a plurality of moving objects 502, two turn mark objects 503, a large monitor object 506, building objects 507a to 507b, and other objects not labeled. A large number of objects (tree objects, clock objects, etc.) are displayed. These objects are created based on the first information 152A received from the first server device 20, for example.

In FIG. 8, the racetrack object 501 is placed on the area 704 such that the angle between the flat surface included in the area 704 and the bottom surface of the racetrack object 501 is 0 degrees. In this case, for example, the moving objects 502 may overlap each other and become difficult to see. In addition, a blind spot where the moving object 502 cannot be seen may occur in the area on the depth direction side of the large monitor object 506 .

However, in the state shown in FIG. 8, the user can change the viewpoint of the superimposed image displayed on display 132 . For example, when the user performs an operation input such as a pinch-in operation or a pinch-out operation, the viewpoint position of the imaging unit 170 may move closer to or farther from the racetrack object 501 . Also, when the user moves in the depth direction of the display 132 while holding the user terminal 10 or moves in the front direction, the viewpoint position of the imaging unit 170 may move closer to or farther from the racetrack object 501 . Also, when the user performs an operation to specify a predetermined position on the display 132, the viewpoint position can move to the specified position. Such a viewpoint change can solve the visibility problem described above.

Also, by arranging the race field object 501 so that the angle θ formed between the flat surface and the bottom surface of the race field object 501 is an acute angle, the above-described problems related to visibility can be alleviated.

FIG. 9 is a schematic diagram showing an example of a screen in which a virtual object is superimposed on a real image, and shows another aspect of the racetrack object 501 shown in FIG. Specifically, FIG. 9 is an example in which the first race is a horse race.

In FIG. 9 as well, the area with the dot pattern including the monitor device 703 is the real image, and the other area is the area where the virtual object is displayed. In FIG. 9, a racetrack object 511, a plurality of moving objects 512, a large monitor object 513, a pond object 514, and a plurality of tree objects 515 are displayed on the display 132 as virtual objects. These objects are also created based on the first information 152A received from the first server device 20, for example.

The racetrack object 511, the large monitor object 513, the pond object 514, and the plurality of tree objects 515 are preferably created based on racetrack data such as course information of a predetermined racetrack in the real world, for example. The plurality of moving objects 512 are, for example, virtual objects representing horses and jockeys running in a horse race.

Returning to the description of the flowchart in FIG. In step S640, the control unit 190 acquires position information of the boats 402a to 402f on the boat race track 401 in the real world. That is, when the boats 402a to 402f start a race in the real world, the control unit 190 acquires the position information and time information of the boats 402a to 402f from the first server device 20. FIG. The method of acquiring position information and time information is as described with reference to FIG.

In step S650, the control unit 190 performs control so that the position information acquired in step S640 and the moving object are linked. Specifically, using the time information and the position information, the movement of each of the boats 402a to 402f on the race course object 501 is controlled to be the same as that of the moving objects 502a to 502f on the boat race course 401. FIG.

The processing of steps S640 and S650 is repeated at least from the start to the end of the race in the real world, but may be repeated before the start and after the end of the race in the real world.

If the race displayed as the virtual race is a past race, the position information and the like of the boats 402a to 402f from the start to the end of the race may be collectively acquired before the start of the virtual race. Further, the virtual race may be displayed by acquiring only the race time information without acquiring the position information and the like. A race displayed as a virtual race may be an exhibition race.

After the race in the real world ends, the series of display control processing ends in response to receiving an operation input for ending the application program 151 or the like.

(Operation example for executing the mode switching function)
Next, an operation example for executing the mode switching function in the system 1 will be described with reference to FIGS. 10 to 18. FIG. 10 and 11 are flowcharts showing an example of display control processing in this operation example. FIG. 12 is a schematic diagram showing an example of a display screen in step S1010, which will be described later. 10 and 11. The order of each process constituting the flowcharts described in FIGS. 10 and 11 is also random as long as there is no contradiction or inconsistency in the contents of the process, and the processes may be executed in parallel. Also, the processing executed by each device in each flowchart may be executed by another device as long as there is no contradiction.

In step S<b>1010 , the control unit 190 arranges virtual objects such as the racetrack object 501 on the display 132 . That is, the control unit 190 displays the racetrack object 501 and the like on the display 132 . This process is similar to step S630 in FIG.

As shown in FIG. 12, in this operation example, the control unit 190 superimposes a switch button 1200, a human prediction display column 1210, and a computer prediction display column on the racetrack object 501 displayed on the display 132. 1220 and a race name field 1230 are displayed on the display 132 . The background of the racetrack object 501 on the display 132 is the real image captured by the imaging unit 170. In this example, for the sake of simplification of illustration, only the monitor device 703 is shown in the real image. Illustrated. The racetrack object 501, the switch button 1200, the race prediction display field 1210, the computer prediction display field 1220, and the race name field 1230 are created based on the first information 152A received from the first server device 20, for example. be done.

A switch button 1200 is displayed, for example, in the lower right portion of the display 132 . When the user taps the switching button 1200, the screen display can be switched.

The people prediction display field 1210 is displayed in the upper left part of the display 132, for example. The crowd prediction display field 1210 displays, for example, one or more prediction rankings included in the crowd prediction information. In the speculation information, the race reporter is a speculator, and the speculation predicted by the race reporter is displayed in the speculation display field 1210 . Also, in the prediction display column 1210, an image icon 1211 of a tipster is displayed. In the example of FIG. 12, when the user performs an operation input (for example, tapping the image icon 1211) for displaying the tipster's voice and video, the voice is output from the speaker 162, and a predetermined area of the display 132 is displayed. videos can be displayed on In addition, past race images, images of exhibition races, and the like may be displayed.

A computer prediction display field 1220 is displayed, for example, in the upper central portion of the display 132 . The computer prediction display column 1220 displays, for example, one or more prediction rankings included in the computer prediction information calculated by the computer device.

The race name column 1230 displays the name of a predetermined real race (for example, the name of the boat racing course and the name of the round) targeted by the race course object 501 displayed on the display 132 .

Returning to FIG. 10 , in step S 1020 , control unit 190 determines whether or not a user's operation input for switching button 1200 displayed on display 132 has been received. If it is determined in step S1020 that the user's operation input to switch button 1200 has been received (Yes in step S1020), control unit 190 displays racetrack object 501 in the first display area on display 132 in step S1030. Switch the screen display to Then, in step S1040, control unit 190 causes a user interface display area (hereinafter referred to as a UI display area), which is an area different from the first display area on display 132, to receive a user's operation input. A user interface object (hereinafter referred to as a UI object) is displayed.

The display processing of steps S1030 and S1040 will be specifically described below with reference to FIG. FIG. 13 is a schematic diagram showing an example of the display screen in step S1040.
When the user taps switch button 1200, control unit 190 causes racetrack object 501 to be displayed in first display area 1300A, which is the left half area of display 132, as shown in FIG. do. That is, the control unit 190 changes the display area of the racetrack object 501 from the full area of the display 132 to the left half of the display 132 . Further, the control unit 190 displays the UI objects 1301 to 1303 in a UI display area 1300B, which is the right half area of the display 132. FIG. In the UI display area 1300B, for example, a voting page button 1301, a purchase race display button 1302, and other buttons 1303 are displayed as UI objects.

A voting page button 1301 is a button for displaying a voting screen for users to vote for a predetermined race. A purchased race display button 1302 is used to display race information for which the user has purchased a voting ticket in the UI display area 1300B. The other button 1303 is a button for executing processing other than voting and purchase race display. When the user taps the other button 1303, for example, various option processes are executed, such as changing the display positions of the first display area 1300A and the UI display area 1300B to positions desired by the user.

Returning to FIG. 10, in step S1050, control unit 190 determines whether or not a user's selection operation for any of various UI objects 1301 to 1303 displayed in UI display area 1300B has been received. If it is determined that the user's selection operation for any of the UI objects 1301 to 1303 has been accepted (Yes in step S1050), in step S1060, the control unit 190 responds to the UI objects 1301 to 1303 for which the selection operation has been accepted. The screen to be displayed is displayed in the UI display area 1300B. For example, when the user taps the voting page button 1301 , the control unit 190 displays a screen corresponding to the voting page button 1301 in the UI display area 1300B of the display 132 .

The display processing in step S1050 will be specifically described below with reference to FIG. FIG. 14 is a schematic diagram showing an example of the display screen in step S1050. In the example shown in FIG. 14, a predetermined race voting screen 1400 is displayed in the UI display area 1300B. The voting screen 1400 is a screen for the user to purchase a voting ticket (boat ticket or betting ticket) for a predetermined race. For example, the control unit 190 displays, in the UI display area 1300B, as the voting screen 1400 a screen for purchasing the betting ticket for the first race targeted by the racetrack object 501 displayed in the first display area 1300A. can do.

Further, the control unit 190 may display a screen for purchasing a betting ticket for a race different from the first race as the betting screen 1400 in the UI display area 1300B according to the user's operation input. When a voting screen for a race different from the first race is displayed, the voting screen is created based on the second information 152B received from the first server device 20, for example.

The user can purchase a voting ticket for a desired contestant by tapping various buttons (voting buttons 1401 and the like) displayed in the voting screen 1400 . Also in this case, in the first display area 1300A on the left half of the display 132, the racetrack object 501, which is the virtual race of the first race, is displayed.

Returning to FIG. 10, in step S1070, control unit 190 determines whether or not the user has operated voting button 1401 or the like displayed on voting screen 1400 on the screen shown in FIG. When it is determined in step S1070 that the user's selection operation on the voting button 1401 has been received (Yes in step S1070), in step S1080, the control unit 190 selects from the first server device 20 based on the selection operation. Get information. Specifically, the control unit 190 executes processing for purchasing a voting ticket for a predetermined contestant or the like in accordance with the user's selection operation on the voting screen 1400 . Note that after the selection information is acquired in this step (betting ticket purchase processing is executed), the control unit 190 automatically changes the UI display area according to the user's operation input or without the operation input. The display of 1300B may be returned to the state of FIG. In addition, the control unit 190 may display, in the UI display area 1300B, a voting screen for a race different from the predetermined race targeted by the voting screen 1400 shown in FIG. good.

In step S1090, the control unit 190 determines whether or not the user's selection operation for the purchase race display button 1302 among the UI objects shown in FIG. 13 has been received. If it is determined that the user's selection operation on purchase race display button 1302 has been received (Yes in step S1090), in step S1110 shown in FIG. ) is acquired from the first server device 20 . When there are a plurality of races for which the user has purchased voting tickets, the control unit 190 acquires race information on all the corresponding purchased races from the first server device 20 . The race information acquired in this step includes, for example, the name of the purchased race, the date and time of the race, race field data, contestant data, moving body data, odds information, race prediction information, race start chart, information just before the race, pit report , race results (race time information, location information and time information of contestants, etc.), race moving images, race still images, past race information, and the like. Further, when the race information acquired in this step relates to the first race, the control unit 190 acquires the race information from the first server device 20 as the first information 152A. Further, when the race information acquired in this step relates to a race different from the first race, the control unit 190 acquires the race information from the first server device 20 as the second information 152B.

In step S<b>1120 , the control unit 190 generates a racetrack object based on the race information of the purchase race acquired from the first server device 20 . Note that if the purchase race includes the first race targeted by the racetrack object 501 displayed in the first display area 1300A, the control unit 190 controls the purchase race other than the first race. Create a new field object.

In step S1130, control unit 190 determines the position and size of each display area on display 132 in which each racefield object is displayed, according to the number of racefield objects generated in step S1120. Then, in step S1140, control unit 190 displays each racetrack object in each display area.

The display processing in step S1140 will be specifically described below with reference to FIG. FIG. 15 is a schematic diagram showing an example of the display screen in step S1140. In this example, for example, a case where the number of purchased races is six will be described. When the number of purchased races is 6, as shown in FIG. 15, the display 132 is divided into 6 display areas 1500A to 1500F, and race field objects 501A to 501F are displayed in the respective display areas 1500A to 1500D. . Specifically, in the left half of the horizontally placed display 132, a display area 1500A, a display area 1500B, and a display area 1500C are set in order from the top, and racetrack objects 501A to 501C are displayed in each of them. It is In the right half of the display 132, a display area 1500D, a display area 1500E, and a display area 1500F are set in order from the top, and racetrack objects 501D to 501F are displayed in each of them. Each of the display areas 1500A-1500F preferably has substantially the same size.

Note that in this step, the display 132 is divided into six display areas 1500A to 1500F. becomes smaller than Therefore, it is preferable that each of the racetrack objects 501A-501F is displayed in each of the display areas 1500A-1500F in such a manner that a portion thereof is enlarged. For example, in this example, as shown in FIG. 15, the goal portions (one turn mark object 503 and a plurality of poles 508) of the racetrack objects 501A to 501F displayed in the display areas 1500A to 1500F are enlarged and displayed. It is In this way, when a plurality of race field objects are displayed on the display 132 at the same time, by displaying the race field objects in such a way that the user may be most interested (for example, near the goal) in an enlarged manner, User visibility can be secured.

In the example of FIG. 15, an example in which the number of purchased races is an even number is shown, but when the number of purchased races is an odd number, for example, when the number of purchased races is three, the left side of the display 132 One racetrack object may be displayed on one half and two racetrack objects may be displayed on the right half of the display 132 . In this way, not only the number of display areas in which racetrack objects are displayed, but also their positions and sizes can be appropriately changed according to the number of purchased races.

Returning to FIG. 11, in step S1150, the control unit 190 determines whether the contestants (hereinafter referred to as purchased contestants) whose voting tickets are purchased by the user among the racetrack objects 501A to 501F displayed on the display 132 are selected. It is determined whether or not there is a racetrack object whose probability of winning the race is equal to or greater than a predetermined threshold. The probability that a purchasing contestant wins the race (hereinafter referred to as the winning percentage) is determined, for example, by the start timing during the race, the approach course, the order and position at a specific point during the race, the development of the race, and the like. Also, environmental information such as the weather and temperature of the racetrack may be taken into consideration when determining the winning percentage. The "winning rate" here refers to the winning rate determined during the race based on the development of the race and environmental information after the race starts, but information on the purchasers before the race (odds, frame number, class, record, etc.) It may be a winning percentage before the race calculated from. The predetermined threshold value for the winning rate may be set in advance by the control unit 190, or may be appropriately changed according to the user's selection input or the like. Also, the predetermined threshold value may be changed as appropriate according to the type of race and the number of races purchased.

If it is determined that among the race field objects 501A to 501F, there is a race field object in which the winning rate of the purchasing contestant is equal to or greater than the predetermined threshold value (Yes in step S1150), in step S1160, the control unit 190 It is determined whether or not there are a plurality of racetrack objects equal to or greater than the predetermined threshold.

In step S1160, if it is not determined that there are a plurality of racetrack objects whose winning percentages of purchasing contestants are equal to or greater than the predetermined threshold value (No in step S1160), that is, racetracks whose winning percentages are equal to or greater than the predetermined threshold value. If it is determined that there is only one object, in step S1170 control unit 190 expands the display area of the racetrack object whose winning percentage is equal to or greater than the predetermined threshold.

The display processing in step S1170 will be specifically described below with reference to FIG. FIG. 16 is a schematic diagram showing an example of the display screen in step S1170. Among the plurality of race field objects 501A to 501F displayed on the display 132 shown in FIG. 15, for example, the race field object 501B is the only race field object for which the winning percentage of purchased contestants is equal to or higher than a predetermined threshold. , in the example shown in FIG. 16, the racetrack object 501B is enlarged and displayed. Specifically, the display area 1500B of the race field object 501B is enlarged so that the race field object 501B is displayed on the entire left half of the display 132. FIG. On the right half of the display 132, the racetrack objects 501D to 501F remain displayed in the display areas 1500D to 1500F, respectively, as in the example of FIG.

In FIG. 16, race field objects 501A and 501C among the race field objects 501A to 501C displayed in the left half of the display 132 in FIG. Although it is displayed, it is not limited to this example. For example, among the race field objects 501A to 501F, all the race field objects other than the enlarged race field object 501B may be displayed in the right half of the display 132. FIG. That is, the race field objects 501A, 501C to 501F other than the enlarged race field object 501B may be reduced from the state shown in FIG. good.

Returning to FIG. 11, when it is determined in step S1160 that there are a plurality of racetrack objects whose winning percentages of purchased contestants are equal to or greater than a predetermined threshold value (Yes in step S1160), in step S1180, the controller 190 expands the display area of the racecourse object in which the purchaser with the highest winning rate exists among the plurality of racecourse objects. Since the method for enlarging the display area of the racetrack object in this step is the same as that shown in FIG. 16, detailed description thereof will be omitted.

In the above example, even when there are a plurality of racefield objects equal to or greater than a predetermined threshold value, only one racefield object is enlarged and displayed, but the present invention is not limited to this example. For example, a plurality of racetrack objects each having a winning percentage equal to or greater than a predetermined threshold may be displayed in an enlarged manner. In this case, for example, it is possible to enlarge and display a racetrack object whose winning percentage is equal to or higher than a predetermined threshold over both the left and right halves of the display 132 in landscape orientation.

An example of a screen division method for displaying a plurality of racetrack objects on the display 132 will be described below with reference to FIGS. 17 and 18. FIG. 17 and 18 are schematic diagrams showing examples of display screens displayed on the display 132. FIG.
As described above, in step S1090, when the user's selection operation for the purchase race display button 1302 among the UI objects shown in FIG. The screen of the display 132 is divided according to the number of races that exist, that is, the number of purchase races. At this time, the control unit 190 adjusts the real image (the image of the desk 701, the keyboard 702, the monitor device 703, etc.) captured by the imaging unit 170 and displayed on the display 132 according to the number of purchase races. may be divided and displayed. That is, the control unit 190 may divide the display area of the real image into the same number of display areas as the number of purchase races. For example, when the number of purchase races of the user is four, as shown in FIG. 17, control unit 190 divides display 132 into four display areas 1700A-1700D, The same real image captured by the imaging unit 170 is displayed.

After that, as shown in FIG. 18, the control unit 190 displays the racetrack objects 501A to 501D corresponding to the purchase race superimposed on the real images displayed in the respective display areas 1700A to 1700D. In the example of FIG. 18, the illustration of the real image is omitted for the sake of simplification of the drawing, but the four races for which the user purchased the betting ticket are superimposed on the real image and displayed in each of the display areas 1700A to 1700D. can be

In the above-described embodiment, the race field object is displayed in order to highlight the race field object for which the winning percentage of the purchased participants is equal to or higher than a predetermined threshold value, that is, the race field object of the most advantageous race among the purchased races. , is displayed in a larger size than other racetrack objects displayed on the display 132, but the present invention is not limited to this example. It suffices that a racefield object whose winning rate is equal to or higher than a predetermined threshold is displayed in a display mode different from that of other racefield objects. It is possible to change the color of the background of the field object to a color different from that of the background, or to surround the display frame of the race field object whose winning rate is equal to or higher than a predetermined threshold value in a predetermined color.

Further, in the above embodiment, when the purchase race display button 1302 is tapped, etc., the race field objects 501A to 501F of the purchase race are displayed on the display 132, but this is not the only example. do not have. That is, the display object displayed on the display 132 is not limited to the racefield object of the purchase race, but may be an actual video of the purchase race, a user interface or the like that allows the user to further select the contestants of the purchase race. may For example, when the actual image of the purchase race is displayed on the display 132 (for example, the display areas 1500A to 1500F), the display area of the actual image of the race in which the winning rate of the purchase contestants is equal to or higher than a predetermined threshold value. may be displayed larger than the display area of the actual images of other races. Further, when a user interface is displayed on the display 132 to allow the user to further select the participants of the purchase race, for example, the user can further vote for the race with a high winning percentage before starting the race among the purchase races. The user interface for the race may be displayed larger or more conspicuous so that additional tickets can be purchased.

Further, in the above-described embodiment, an example of the display screen displayed on the display 132 in a state in which the user terminal 10 is placed horizontally (sideways) has been described, but the present invention is not limited to this example. Even when the user terminal 10 is placed vertically (portrait), a plurality of display areas in which racetrack objects are displayed on the display 132 are set according to the number of purchased races, etc., and the display 132 in the portrait state is set. The user may be able to visually recognize multiple racetrack objects simultaneously via the system.

The above-described embodiments are merely examples for facilitating understanding of the present invention, and are not intended to limit the interpretation of the present invention. It goes without saying that the present invention can be modified and improved without departing from its spirit, and that equivalents thereof are included in the present invention.

[Additional notes]
The contents of the present disclosure are listed below.

(Item 1)
A program executed in a first computer comprising a processor, an imaging unit, and a display unit,
The program causes the processor to:
receiving from a second computer first information about a first predetermined race in the real world and second information about a second predetermined race different from the first race in the real world;
generating a first display object based on the first information;
generating a second display object based on the second information;
dividing the display area of the display unit into a plurality of areas including at least a first area and a second area different from the first area when receiving an operation input from a user;
In the display unit, the first display object is displayed in the first area by being superimposed on a real image of the surroundings of the first computer captured by the imaging unit, and the second display is displayed in the second area. displaying the object;
a step of obtaining selection information indicating one or more of the contestants or moving bodies selected by the user from among the contestants or moving bodies in at least one of the first race and the second race;
and changing a display mode of at least one of the first area and the second area based on the selection information.
According to the above program, when information about a plurality of races is displayed on the display unit, by changing the display mode of each race information according to the information selected by the user, for example, one or more entries selected by the user can be displayed. The display of a plurality of race screens can be controlled based on the race content of the racers or moving bodies. Therefore, visibility is improved when viewing multiple races, which leads to improved user convenience and satisfaction.

(Item 2)
The selection information is one or more selected by the user from among a plurality of selection targets including the first contestant or the first moving body of the first race and the second contestant or the second moving body of the second race. contains information about the selection,
In the step of changing the display mode, when the one or more selection targets satisfy a predetermined condition, the display size of the region including the one or more selection targets among the first region and the second region is changed. 2. The program according to item 1, including making the display size larger than other areas.
According to the above configuration, it is possible to make the race information stand out by displaying the area of the predetermined race information larger according to the selection target. Accordingly, it is possible to clearly present to the user which race to pay attention to among the plurality of races displayed on the display unit.

(Item 3)
The predetermined condition includes at least one of: the winning rate of the one or more selection targets being equal to or greater than a predetermined threshold; or the current ranking of the one or more selection targets being equal to or greater than a predetermined threshold. , item 2.
According to the above configuration, it is possible to highlight a race in which the selected contestant or moving object is highly likely to win, or a race in which the contestant or moving object is in an advantageous position, thereby increasing user satisfaction. It can be improved further.

(Item 4)
The first display object is a first virtual display object including a first racetrack object representing a racetrack of the first race and a first moving object representing a first contestant or a first moving object of the first race. 4. The program according to any one of items 1 to 3, which is at least one of an object, a user interface for the user to select the first contestant or the first moving body, and an actual image of the first race. .
The first display object preferably includes those listed above.

(Item 5)
The second display object is a second virtual display object including a second racetrack object representing a racetrack of the second race and a second moving object representing a second contestant or a second moving object of the second race. 5. The program according to any one of items 1 to 4, which is at least one of an object, a user interface for the user to select the second contestant or the second moving object, and an actual image of the second race. .
The second display object preferably includes those listed above.

(Item 6)
The displaying step includes:
displaying the real image of the surroundings of the first computer in both the first area and the second area;
displaying the first display object superimposed on the real image displayed in the first area, and displaying the second display object superimposed on the real image displayed in the second area; ,
6. The program according to any one of items 1 to 5, comprising
According to the above configuration, after the display area of the real image around the first computer is divided, the first display object and the second display object are displayed by being superimposed on each of the divided real images. . This makes it possible to easily divide the display areas of the first display object and the second display object.

(Item 7)
An information processing method executed in a first computer comprising a processor, an imaging unit, and a display unit,
receiving from a second computer first information about a first predetermined race in the real world and second information about a second predetermined race different from the first race in the real world;
generating a first display object based on the first information;
generating a second display object based on the second information;
dividing the display area of the display unit into a plurality of areas including at least a first area and a second area different from the first area when receiving an operation input from a user;
In the display unit, the first display object is displayed in the first area by being superimposed on a real image of the surroundings of the first computer captured by the imaging unit, and the second display is displayed in the second area. displaying the object;
obtaining user selection information for at least one of the first race and the second race;
and changing a display mode of at least one of the first area and the second area based on the selection information.
According to the above method, when information about a plurality of races is displayed on the display unit, by changing the display mode of each race information according to the information selected by the user, for example, one or more entries selected by the user can be displayed. The display of a plurality of race screens can be controlled based on the race content of the racers or moving bodies. Therefore, visibility is improved when viewing multiple races, which leads to improved user convenience and satisfaction.

(Item 8)
An information processing device comprising a processor, an imaging unit, and a display unit,
The processor
receiving from a second computer first information about a first predetermined race in the real world and second information about a second predetermined race different from the first race in the real world;
generating a first display object based on the first information;
generating a second display object based on the second information;
dividing the display area of the display unit into a plurality of areas including at least a first area and a second area different from the first area when a user's operation input is received;
In the display unit, the first display object is displayed in the first area by being superimposed on a real image of the surroundings of the information processing device captured by the imaging unit, and the second display is displayed in the second area. display the object,
Acquiring user selection information for at least one of the first race and the second race;
changing the display mode of at least one of the first area and the second area based on the selection information;
Information processing equipment that executes things.
According to the above device, when information about a plurality of races is displayed on the display unit, by changing the display mode of each race information according to the information selected by the user, for example, one or more entries selected by the user can be displayed. The display of a plurality of race screens can be controlled based on the race content of the racers or moving bodies. Therefore, visibility is improved when viewing multiple races, which leads to improved user convenience and satisfaction.

(Item 9)
A system that includes a first computer that includes a first processor, an imaging device, and a display device, and a second computer that includes a second processor and is communicatively connectable to the first computer,
The second processor
obtaining first information about a predetermined first race in the real world and second information about a predetermined second race different from the first race;
transmitting the first information and the second information to the first computer;
The first processor
receiving the first information and the second information from the second computer;
generating a first display object based on the first information;
generating a second display object based on the second information;
dividing a display area of the display device into a plurality of areas including at least a first area and a second area different from the first area when a user's operation input is received;
In the display device, the first display object is displayed in the first area by superimposing it on a real image of the surroundings of the first computer captured by the imaging device, and the second display is displayed in the second area. display the object,
Acquiring user selection information for at least one of the first race and the second race;
A system that changes a display mode of at least one of the first area and the second area based on the selection information.
According to the above system, when information about a plurality of races is displayed on the display unit, by changing the display mode of each race information according to the information selected by the user, for example, one or more entries selected by the user can be displayed. The display of a plurality of race screens can be controlled based on the race content of the racers or moving bodies. Therefore, visibility is improved when viewing multiple races, which leads to improved user convenience and satisfaction.

1: system, 10: user terminal, 20: first server device, 30: network, 40: second server device, 130: touch screen, 150: storage unit (of user terminal), 152A, 252A: first information, 152B, 252B: second information, 190: control unit (of user terminal), 191: operation input reception unit, 192: transmission/reception unit, 193: object generation unit, 194: display control unit, 195: flat surface detection unit, 196 : first information acquisition unit 197: second information acquisition unit 198: selection information acquisition unit 250: storage unit (of first server device) 290: control unit (of first server device) 401: boat race Field, 402a to 402f: boat, 501 (501A to 501F): race field object, 502 (502a to 502f): moving object, 503: turn mark object, 1200: switching button, 1300A: first display area, 1300B: UI Display area 1301: Voting page button 1302: Purchase race display button 1303: Other buttons 1400: Voting screen 1500A to 1500F 1700A to 1700D: Display area

Claims (9)

A program executed in a first computer comprising a processor, an imaging unit, and a display unit,
The program causes the processor to:
receiving from a second computer first information about a first predetermined race in the real world and second information about a second predetermined race different from the first race in the real world;
generating a first display object based on the first information;
generating a second display object based on the second information;
dividing the display area of the display unit into a plurality of areas including at least a first area and a second area different from the first area when receiving an operation input from a user;
In the display unit, the first display object is displayed in the first area by being superimposed on a real image of the surroundings of the first computer captured by the imaging unit, and the second display is displayed in the second area. displaying the object;
a step of obtaining selection information indicating one or more of the contestants or moving bodies selected by the user from among the contestants or moving bodies in at least one of the first race and the second race;
and changing a display mode of at least one of the first area and the second area based on the selection information. The selection information is one or more selected by the user from among a plurality of selection targets including the first contestant or the first moving body of the first race and the second contestant or the second moving body of the second race. contains information about the selection,
In the step of changing the display mode, when the one or more selection targets satisfy a predetermined condition, the display size of the region including the one or more selection targets among the first region and the second region is changed. 2. The program according to claim 1, comprising making the display size larger than the display size of other areas. The predetermined condition includes at least one of: the winning rate of the one or more selection targets being equal to or greater than a predetermined threshold; or the current ranking of the one or more selection targets being equal to or greater than a predetermined threshold. 3. The program according to claim 2. The first display object is a first virtual display object including a first racetrack object representing a racetrack of the first race and a first moving object representing a first contestant or a first moving object of the first race. Any one of claims 1 to 3, which is at least one of an object, a user interface for the user to select the first contestant or the first moving body, and an actual image of the first race program as described. The second display object is a second virtual display object including a second racetrack object representing a racetrack of the second race and a second moving object representing a second contestant or a second moving object of the second race. 5. An object, a user interface for the user to select the second contestant or the second moving body, and an actual image of the second race, according to any one of claims 1 to 4 program as described. The displaying step includes:
displaying the real image of the surroundings of the first computer in both the first area and the second area;
displaying the first display object superimposed on the real image displayed in the first area, and displaying the second display object superimposed on the real image displayed in the second area; ,
6. The program according to any one of claims 1 to 5, comprising: An information processing method executed in a first computer comprising a processor, an imaging unit, and a display unit,
receiving from a second computer first information about a first predetermined race in the real world and second information about a second predetermined race different from the first race in the real world;
generating a first display object based on the first information;
generating a second display object based on the second information;
dividing the display area of the display unit into a plurality of areas including at least a first area and a second area different from the first area when receiving an operation input from a user;
In the display unit, the first display object is displayed in the first area by being superimposed on a real image of the surroundings of the first computer captured by the imaging unit, and the second display is displayed in the second area. displaying the object;
obtaining user selection information for at least one of the first race and the second race;
and changing a display mode of at least one of the first area and the second area based on the selection information. An information processing device comprising a processor, an imaging unit, and a display unit,
The processor
receiving from a second computer first information about a first predetermined race in the real world and second information about a second predetermined race different from the first race in the real world;
generating a first display object based on the first information;
generating a second display object based on the second information;
dividing the display area of the display unit into a plurality of areas including at least a first area and a second area different from the first area when a user's operation input is received;
In the display unit, the first display object is displayed in the first area by being superimposed on a real image of the surroundings of the information processing device captured by the imaging unit, and the second display is displayed in the second area. display the object,
Acquiring user selection information for at least one of the first race and the second race;
changing the display mode of at least one of the first area and the second area based on the selection information;
Information processing equipment that executes things. A system that includes a first computer that includes a first processor, an imaging device, and a display device, and a second computer that includes a second processor and is communicatively connectable to the first computer,
The second processor
obtaining first information about a predetermined first race in the real world and second information about a predetermined second race different from the first race;
transmitting the first information and the second information to the first computer;
The first processor
receiving the first information and the second information from the second computer;
generating a first display object based on the first information;
generating a second display object based on the second information;
dividing a display area of the display device into a plurality of areas including at least a first area and a second area different from the first area when a user's operation input is received;
In the display device, the first display object is displayed in the first area by superimposing it on a real image of the surroundings of the first computer captured by the imaging device, and the second display is displayed in the second area. display the object,
Acquiring user selection information for at least one of the first race and the second race;
A system that changes a display mode of at least one of the first area and the second area based on the selection information.

Images