JP7482821B2 - PROGRAM, INFORMATION PROCESSING METHOD, INFORMATION PROCESSING APPARATUS, AND SYSTEM - Google Patents

Description

This disclosure relates to a program, an information processing method, an information processing device, and a system.

Patent Documents 1 and 2 disclose technology related to AR (Augmented Reality).

JP 2020-58658 A JP 2020-77187 A

In the real world, various races such as boat races and horse races are held. Some people actually go to race tracks to watch these races, but sometimes it is impossible to actually go to a race track due to time or geographical constraints. In light of the above situation, if real-world races could be displayed on the displays of various devices as virtual races using virtual objects linked to the real-world races, it would be beneficial to be able to virtually watch the races without actually going to the race track.

However, there is room for improvement in the visibility of the race display screen when a user is watching multiple virtual races on a mobile device, etc.

One aspect of the present disclosure aims to provide a program, information processing method, information processing device, and system that can improve user convenience and satisfaction by improving visibility when watching multiple races.

According to one embodiment shown in the present disclosure,
A program executed on a first computer including a processor, an imaging unit, and a display unit,
The program causes the processor to:
receiving from a second computer first information relating to a first predetermined race in the real world and second information relating to a second predetermined race in the real world different from the first race;
generating a first display object based on the first information; and generating a second display object based on the second information;
When a user's operation input is received, dividing a display area of the display unit into a plurality of areas including at least a first area and a second area different from the first area;
displaying the first display object in the first area and the second display object in the second area on the display unit by superimposing the first display object on a real image of the surroundings of the first computer captured by the imaging unit;
acquiring selection information indicating one or more of the contestants or moving objects selected by the user from among the contestants or moving objects in at least one of the first race and the second race;
and changing a display mode of at least one of the first area and the second area based on the selection information.

According to one embodiment of the present disclosure, by improving visibility when viewing multiple races, it is possible to improve user convenience and satisfaction.

FIG. 1 illustrates an example of a system configuration according to an embodiment. FIG. 2 is a block diagram showing an example of a functional configuration of a user terminal according to an embodiment. FIG. 2 is a block diagram showing an example of a functional configuration of a server according to an embodiment. FIG. 1 is a schematic diagram illustrating an example of a real-world racetrack in accordance with one embodiment. FIG. 11 is a schematic diagram showing an example of a virtual object displayed on a user terminal according to an embodiment. 10 is a flowchart illustrating an example of a display control process according to an embodiment. 1 is a schematic diagram showing an example of a real image captured by an imaging section according to an embodiment; FIG. 13 is a schematic diagram showing an example of a screen on which a virtual object is displayed superimposed on a real image according to an embodiment. FIG. 13 is a schematic diagram showing an example of a screen on which a virtual object is displayed superimposed on a real image according to an embodiment. 10 is a flowchart showing an example of a display control process in an operation example according to an embodiment. 10 is a flowchart showing an example of a display control process in an operation example according to an embodiment. FIG. 2 is a schematic diagram showing an example of a display screen according to an embodiment. FIG. 2 is a schematic diagram showing an example of a display screen according to an embodiment. FIG. 2 is a schematic diagram showing an example of a display screen according to an embodiment. FIG. 2 is a schematic diagram showing an example of a display screen according to an embodiment. FIG. 2 is a schematic diagram showing an example of a display screen according to an embodiment. 1 is a schematic diagram showing an example of a screen on which a real image captured by an imaging section according to an embodiment is displayed in a plurality of display areas; FIG. FIG. 13 is a schematic diagram showing an example of a screen on which a virtual object is displayed superimposed on a real image according to an embodiment.

Below, an embodiment of this technical idea will be described in detail with reference to the drawings. In the following description, the same elements will be given the same reference numerals, and duplicated descriptions will be omitted as appropriate. In one or more embodiments shown in this disclosure, the elements included in each embodiment can be combined with each other, and the result of such combinations will also form part of the embodiment shown in this disclosure.

(System Configuration)
1 is a diagram showing the configuration of a system 1 according to the present embodiment. The system 1 is capable of displaying, for example, a predetermined race held in the real world as a virtual race using virtual objects on an information processing device used by a user. In this specification, the "predetermined race" is not particularly limited as long as it is a race held in the real world, and examples thereof include boat races (real races and exhibition races), horse racing, bicycle racing, auto racing, car racing such as F1, drone racing, dog racing, marathons, and relay races.

As shown in FIG. 1, the system 1 includes a plurality of user terminals 10, such as user terminal 10A, user terminal 10B, and user terminal 10C (hereinafter, user terminals such as user terminals 10A, 10B, and 10C are collectively referred to as "user terminals 10"), which are information processing devices (first computers) used by each user, a first server device (second computer) 20, a second server device 40, and a network 30.

User terminal 10A and user terminal 10B connect to network 30 by communicating with wireless base station 31. User terminal 10C connects to network 30 by communicating with wireless router 32 installed in a facility such as a house. User terminal 10 is, for example, a portable terminal equipped with a touch screen, and may be a smartphone, a phablet, a tablet, etc.

The user terminal 10 executes, for example, a program installed via a platform that distributes apps, etc., or a program including software for browsing websites that is pre-installed. By executing the above program, the user terminal 10 communicates with the first server device 20 and transmits and receives data related to a specific race, data related to the user, etc., to and from the first server device 20, thereby enabling a virtual race to be displayed on the user terminal 10.

The first server device 20 receives data related to the specified race from the second server device 40. The first server device 20 transmits the data related to the specified race to the user terminal 10 as appropriate. The first server device 20 stores and manages the data related to the specified race and data related to each user.

The first server device 20 has, as its hardware configuration, a communication IF (Interface) 22, an input/output IF 23, a memory 25, a storage 26, and a processor (second processor) 29, which are connected to each other via a communication bus.

The communication IF 22 supports various communication standards, such as the LAN (Local Area Network) standard, and functions as an interface for transmitting and receiving data between the user terminal 10, the second server device 40, etc.

The input/output IF 23 functions as an interface for accepting input of information to the first server device 20 and outputting information to the outside of the first server device 20. The input/output IF 23 may include an input accepting unit that accepts connection of an information input device such as a mouse or keyboard, and an output unit that accepts connection of an information output device such as a display for displaying images, etc.

Memory 25 is a storage device for storing data and the like used in processing. For example, memory 25 provides processor 29 with a working area for temporary use when processor 29 performs processing. Memory 25 is configured to include storage devices such as ROM (Read Only Memory) and RAM (Random Access Memory).

Storage 26 is a storage device for storing various programs and data to be read and executed by processor 29. Information stored in storage 26 includes data related to a specific race, data related to each user, and the like. Storage 26 may be configured to include a storage device such as an HDD (Hard Disk Drive) or flash memory. Note that storage is not limited to being included in a server device, and cloud services may also be used.

The processor 29 controls the operation of the first server device 20 by reading and executing programs and the like stored in the storage 26. The processor 29 can be configured to include, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), and the like.

The second server device 40 stores and manages data related to the specified race. The second server device 40 is, for example, a server device managed by the organizer of the specified race, or a server device managed by an organization that disseminates information about the specified race to the outside (such as a publisher of a race magazine, a video distributor or radio distributor of the race, etc.). The second server device 40 transmits data related to the specified race to the first server device 20 as appropriate. In some aspects, the second server device 40 may transmit data related to the specified race to the user terminal 10. The hardware configuration of the second server device 40 may be the same as that of the first server device 20 to the extent that no contradictions arise. There may be multiple second server devices 40.

(User terminal)
Fig. 2 is a block diagram showing an example of a functional configuration of the user terminal 10. As shown in Fig. 2, the user terminal 10 includes an antenna 110, a wireless communication IF 120, a touch screen 130, an input/output IF 140, a storage unit 150, an audio processing unit 160, a microphone 161, a speaker 162, an imaging unit 170, and a control unit (first processor) 190.

The antenna 110 radiates the signal emitted by the user terminal 10 into space as radio waves. The antenna 110 also receives radio waves from space and provides the received signal to the wireless communication IF 120.

The wireless communication IF 120 performs modulation and demodulation processing and the like for transmitting and receiving signals via the antenna 110 and the like so that the user terminal 10 can communicate with other communication devices. The wireless communication IF 120 is a communication module for wireless communication that includes a tuner, high-frequency circuit, and the like, and performs modulation and demodulation and frequency conversion of the wireless signals transmitted and received by the user terminal 10, and provides the received signals to the control unit 190.

Touch screen 130 accepts input from the user and outputs information to the user on display 132. Touch screen 130 includes a touch panel 131 for accepting user operation input, and display 132. Touch panel 131 detects the approach of a user's finger, for example, by using a capacitance type touch panel. Display 132 is realized by, for example, an LCD (Liquid Crystal Display), an organic EL (electroluminescence), or other display device.

The input/output IF 140 accepts information input to the user terminal 10 and functions as an interface for outputting information outside the user terminal 10.

The storage unit 150 is composed of a flash memory, a HDD, etc., and stores programs used by the user terminal 10 and various data that the user terminal 10 receives from the first server device 20, etc.

The audio processing unit 160 modulates and demodulates audio signals. The audio processing unit 160 modulates a signal provided from the microphone 161 and provides the modulated signal to the control unit 190. The audio processing unit 160 also provides the audio signal to the speaker 162. The audio processing unit 160 is realized, for example, by a processor for audio processing. The microphone 161 functions as an audio input unit that accepts input of an audio signal and outputs it to the control unit 190. The speaker 162 functions as an audio output unit that outputs the audio signal to the outside of the user terminal 10.

The imaging unit 170 is a camera that captures a real image of the surroundings of the user terminal 10. The image captured by the imaging unit 170 is processed by the control unit 190 and output to the display 132.

The control unit 190 controls the operation of the user terminal 10 by reading and executing programs stored in the storage unit 150. The control unit 190 is realized, for example, by an application processor.

The process in which the control unit 190 executes the application program 151 will now be described in more detail. The storage unit 150 stores the application program 151, application information 152, and user information 153.

The user terminal 10, for example, downloads an application program 151 from the first server device 20 and stores it in the storage unit 150. In addition, the user terminal 10 communicates with the first server device 20 to transmit and receive various data such as application information 152 and user information 153 to and from the first server device 20.

The application program 151 is a program for displaying a virtual race on the user terminal 10. The application information 152 includes various data referenced by the application program 151. The application information 152 includes first information 152A and second information 252B.

The first information 152A is information about a specific race transmitted from the first server device 20 or the second server device 40. Hereinafter, the specific race will be referred to as the "first race." The first information 152A includes, for example, race time information indicating the race times of the participants or moving objects (hereinafter also referred to as "participants, etc.") in the first race, location information of the participants, etc. during the first race, and time information corresponding to the location information.

In this specification, the term "contestant" refers not only to humans, but also to animals such as horses and dogs. Furthermore, a "mobile object" refers to the main vehicle of movement in a race, such as an animal or aircraft ridden by a contestant, or an aircraft remotely controlled by a contestant. In marathons, dog races, etc., the "contestant" and the "mobile object" are the same.

In addition to the above, the first information 152A may also include, for example, the name of the first race, the date and time of the race, racecourse data, participant data, mobile data, odds information, race prediction information, race entry list, pre-race information, pit reports, race results, race videos, still images of the race, past race information, and other information that may be published in information magazines or information sites about the first race.

The race prediction information included in the first information 152A includes predicted rankings of participants in a specified race. The race prediction information may include multiple predicted rankings in a specified race, or predicted rankings for multiple races. The race prediction information may also include predicted rankings for each race held at multiple racecourses. Here, multiple racecourses may be racecourses where the same competition is held (for example, boat racecourses in different locations), or may be racecourses where different competitions are held (for example, a boat racecourse and a horse racecourse).

The prediction information includes, for example, computer prediction information calculated by a computer device. The computer prediction information includes, for example, ranking predictions calculated by the first server device 20, the second server device 40, or the user terminal 10 based on past data, which is information about other races held in the past, and the race conditions for a specific race. The calculation of the ranking predictions may be performed, for example, by a machine learning model using a neural network.

Furthermore, the prediction information may include, for example, person prediction information predicted by a human (e.g., a reporter, a prognosticator, etc.). The person prediction information is prediction information input by a human, and is transmitted from the first server device 20 or the second server device 40 to the user terminal 10. The person prediction information may include audio information generated from the voice uttered by the human who made the prediction, and/or video information of a video capturing the human.

The second information 152B is information about a specific race transmitted from the first server device 20 or the second server device 40, and is information about a second race different from the first race that is the subject of the first information 152A. The second race is, for example, a race held at a different racecourse from the first race on the day the first race is held. The first race and the second race may be the same type of race, or different types of race. For example, the first race and the second race may be boat races held at different boat racecourses, or the first race may be a boat race and the second race may be a race other than a boat race (for example, a horse race or a bicycle race). The second information 152B includes, for example, race time information indicating the race time of the participants, etc. in the second race, position information of the participants, etc. during the second race, and time information corresponding to the position information. Note that the second race is not limited to one race, and may be multiple races different from the first race.

In addition to the above, the second information 152B may also include, for example, the name of the second race, the date and time of the race, racecourse data, participant data, mobile data, odds information, race predictions, race entry list, pre-race information, pit reports, race results, race videos, race still images, past race information, and other information that may be published in information magazines or information sites about the second race.

The user information 153 includes information about the user of the user terminal 10. The user information 153 may include, for example, information for identifying the user, location information of the user terminal 10, the user's race purchase history and winning rate (for example, in the case of a boat race, the history of boat tickets purchased and the winning rate of the purchased boat tickets), etc.

The control unit 190 loads and executes the application program 151 to perform the functions of an operation input reception unit 191, a transmission/reception unit 192, an object generation unit 193, a display control unit 194, a flat surface detection unit 195, a first information acquisition unit 196, a second information acquisition unit 197, and a selection information acquisition unit 198.

The operation input receiving unit 191 receives operation input from the user based on the output of the touch screen 130. Specifically, the operation input receiving unit 191 detects that the user's finger or the like has touched or approached the touch panel 131 as coordinates in a coordinate system consisting of the horizontal and vertical axes of the surface that constitutes the touch screen 130.

The operation input reception unit 191 determines user operations on the touch screen 130. The operation input reception unit 191 determines user operations such as, for example, an "approach operation," a "release operation," a "tap operation," a "double tap operation," a "long press operation (long touch operation)," a "drag operation (swipe operation)," a "move operation," a "flick operation," a "pinch-in operation," and a "pinch-out operation."

The operation input receiving unit 191 may receive, as operation input, the movement of the user terminal 10 detected by an acceleration sensor or the like mounted on the user terminal 10.

The transmission/reception unit 192 transmits and receives various information to and from external communication devices such as the first server device 20 and the second server device 40 via the wireless communication IF 120 and the network 30. The transmission/reception unit 192 receives, for example, the first information 152A from the first server device 20 or the second server device 40. The transmission/reception unit 192 also transmits, for example, information corresponding to the operation input received by the operation input receiving unit 191, information stored in the user information 153, etc. to the first server device 20 or the second server device 40.

The object generation unit 193 generates virtual objects for presenting information about the first race to the user based on the first information 152A. The object generation unit 193 generates, as virtual objects, a racecourse object representing the racecourse of the first race and moving objects representing the participants of the first race, etc. The object generation unit 193 may generate a virtual display board for displaying, in text form, the information generated based on the first information 152A. In addition to the above objects, the object generation unit 193 may generate a virtual screen for displaying images of the information generated based on the first information 152A, various building objects, landscape objects that make up the scenery, such as trees, etc.

The display control unit 194 displays on the display 132 an image (hereinafter also referred to as a "superimposed image") in which the virtual object generated by the object generation unit 193 is superimposed on a real image of the surroundings of the user terminal 10 captured by the imaging unit 170. The display control unit 194 moves each moving object on the racecourse object based on the race time information included in the first information 152A, and displays a virtual race that virtually reproduces the first race on the display 132. It is preferable that the display control unit 194 reproduces the virtual race based on position information of the participants, etc., included in the first information 152A, and time information corresponding to the position information, in addition to the race time information.

It is preferable that the display control unit 194 is capable of changing the viewpoint in the superimposed image in response to the operation input received by the operation input receiving unit 191. Specific examples of changing the viewpoint will be described later.

The display control unit 194 is preferably further capable of displaying various menu screens and GUIs (Graphical User Interfaces) on the display 132 in response to the operation input received by the operation input receiving unit 191. In this example, in particular, in response to the user's operation input on a switching button (described below) received by the operation input receiving unit 191, the display control unit 194 changes the display position of the virtual object displayed on the display 132, provides a UI (User Interface) display area in a position different from the area on the display 132 where the virtual object is displayed, and displays various UI objects capable of receiving the user's operation input in the UI display area.

The flat surface detection unit 195 detects flat surfaces in the real image captured by the imaging unit 170. The detection of flat surfaces is achieved by conventionally known image recognition technology. For example, when a user performs an operation to select a flat surface detected by the flat surface detection unit 195, a superimposed image in which a race track object is placed on the flat surface is displayed on the display 132.

The flat surface is preferably a horizontal surface. The angle between the flat surface and the bottom surface constituting the race track object may be 0 degrees, but is preferably an acute angle, and can be in the range of 15 degrees to 45 degrees, for example. The angle can also be adjusted in response to a user operation. Even if there is a protrusion on part of a flat surface in the real world, or if there is an object placed on the flat surface, the surface may be detected as a flat surface on which a race track object can be placed, as long as the protrusion or object is of a size that is hidden by the race track object.

The first information acquisition unit 196 acquires the first information 152A by receiving specific information (first information 252A described below) from the first server device 20.

The second information acquisition unit 197 acquires the second information 152B by receiving specific information (second information 252B described below) from the first server device 20.

The selection information acquisition unit 198 acquires one or more pieces of selection information indicating one or more contestants selected by the user. The "selection information" is, for example, information indicating the contestants predicted by the user as the winners of the first and second races. If the first and second races are boat races and horse races, the "selection information" may be information indicating the boat ticket or betting ticket purchased by the user.

The selection information acquisition unit 198 acquires selection information, for example, based on a user's operational input on a screen for selecting participants, etc. The selection information acquired by the selection information acquisition unit 198 is transmitted, for example, to the first server device 20 or the second server device 40. For example, in response to the selection information being transmitted to the second server device 40, a process for purchasing boat tickets or betting tickets for a specific race can be performed.

(First server device)
Fig. 3 is a block diagram showing the functional configuration of the first server device 20. The detailed configuration of the first server device 20 will be described with reference to Fig. 3. The first server device 20 performs the functions of a communication unit 220, a storage unit 250, and a control unit 290 by operating according to a program.

The communication unit 220 functions as an interface for the first server device 20 to communicate with external communication devices such as the user terminal 10 and the second server device 40 via the network 30.

The storage unit 250 stores various programs and data for implementing the system 1. In one aspect, the storage unit 250 stores a program 251, race information 252, and user information 253.

The program 251 is a program for the first server device 20 to communicate with the user terminal 10 and the second server device 40 to realize the system 1. When the program 251 is executed by the control unit 290, it causes the first server device 20 to perform processes such as sending and receiving data to and from the user terminal 10 and the second server device 40, processing according to the operation contents performed by the user of the user terminal 10, and processing for updating the race information 252 and the user information 253.

The race information 252 includes various data related to a specific race. The race information 252 includes, for example, first information 252A and second information 252B. The first information 252A is the source of the first information 152A and is information related to the first race. The first information 152A may be a part of the first information 252A. The first information 252A is, for example, information obtained from the second server device 40. Similarly, the second information 252B is the source of the second information 152B and is information related to the second race. The second information 152B may be a part of the second information 252B. The second information 252B is, for example, information obtained from the second server device 40.

User information 253 is information about the user of the user terminal 10. User information 253 includes a user management table 253A. User management table 253A stores, for each user, information identifying the user, location information of the user terminal 10, the user's race purchase history and hit rate, etc.

The control unit 290 is realized by the processor 29, and by executing the program 251, performs the functions of a transmission/reception unit 291, a first information acquisition unit 292A, a second information acquisition unit 292B, a selection information acquisition unit 293, a data management unit 294, and a timing unit 295.

The transmission/reception unit 291 transmits and receives various information to and from external communication devices such as the user terminal 10 and the second server device 40 via the communication unit 220 and the network 30. The transmission/reception unit 291 transmits, for example, at least a portion of the first information 252A and the second information 252B to the user terminal 10. The transmission/reception unit 291 also receives, for example, the first information 252A and the second information 252B from the second server device 40.

The first information acquisition unit 292A acquires the first information 252A from the second server device 40 via the transmission/reception unit 291. The second information acquisition unit 292B acquires the second information 252B from the second server device 40 via the transmission/reception unit 291. The selection information acquisition unit 293 acquires the user's selection information from the user terminal 10 or the second server device 40 via the transmission/reception unit 291. The data management unit 294 performs a process of updating various data stored in the storage unit 250 according to the processing results of the first information acquisition unit 292A, the second information acquisition unit 292B, the selection information acquisition unit 293, etc. The timing unit 295 performs a process of measuring time. Various times (e.g., the time until the start of the race, etc.) displayed on the user terminal 10 can be controlled based on the time measured by the timing unit 295.

(Example of operation)
Next, an example of the operation of the system 1 will be described with reference to Figures 4 to 18. The following description will be given by taking as an example a case where a predetermined race, i.e., the first race, is a boat race, but the following description can also be applied to cases where the first race is another type of race. The following description will be given assuming that data is transmitted and received between the user terminal 10 and the first server device 20, and between the first server device 20 and the second server device 40, but in some aspects, the user terminal 10 and the second server device 40 may be configured to directly transmit and receive data.

Figure 4 is a schematic diagram showing an example of a real-world boat racing venue. Two turn marks 403 are set up at the boat racing venue 401, and a race is held between boats 402a to 402f carrying each boat racer. When the race is over, race time information showing the race time of each of the boats 402a to 402f is transmitted from the second server device 40 to the first server device 20, and then transmitted from the first server device 20 to the user terminal 10.

The boat race venue 401 is provided with imaging devices (cameras) 404a to 404b. The imaging device 404a views the boats 402a to 402f from above the boat race venue 401. The imaging device 404b views the boats 402a to 402f from the side of the boat race venue 401. The images of the boats 402a to 402f captured by the imaging devices 404a to 404b are transmitted to the second server device 40. The second server device 40, for example, performs image analysis of each image and calculates position information indicating the position of each of the boats 402a to 402f at the time each image was captured. The calculated position information and time information relating to the capture time corresponding to the position information are transmitted to the first server device 20, and then transmitted from the first server device 20 to the user terminal 10. The calculation of the position information may be performed by the first server device 20.

Furthermore, instead of or in addition to the imaging devices 404a to 404b, a position sensor such as a GPS sensor may be installed on the boats 402a to 402f. The position information of the boats 402a to 402f acquired by the position sensor and time information indicating the time when the position information was acquired are ultimately transmitted to the user terminal 10.

Figure 5 is a schematic diagram showing an example of virtual objects displayed on the user terminal 10. In the example of Figure 5, the virtual objects shown are a racetrack object 501, moving objects 502a to 502f, two turn mark objects 503, and a virtual display board 505.

The racecourse object 501 is an object that virtually displays the boat racing course 401. The racecourse object 501 and the turn mark object 503 are preferably created based on racecourse data such as course information for the boat racing course 401, and preferably have a shape that corresponds to the boat racing course 401.

The moving objects 502a to 502f are virtual representations of the boats 402a to 402f, respectively, and are shaped to resemble boats. The moving objects 502a to 502f move around the racecourse object 501 based on race time information, position information of the boats 402a to 402f, and time information corresponding to the position information. In other words, a real-world race is displayed as a virtual race on the user terminal 10 by the racecourse object 501 and the moving objects 502a to 502f.

It is also possible to display a virtual race using only the race time information, even if there is no position information or time information for the boats 402a to 402f. In this case, however, although the final finishing order will be the same as in a real-world race, it is difficult to reproduce the progress of the race, such as the ranking during the race.

The virtual display board 505 is an object that displays text information. The virtual display board 505 is, for example, an object that does not have a corresponding object in the boat racing venue 401. There are no particular limitations on the text information displayed on the virtual display board 505, and it may be, for example, ranking information or odds information. In addition, the text information displayed on the virtual display board 505 may be changeable based on a user's operational input.

Figure 6 is a flowchart showing an example of processing related to display control. Note that the order of each process constituting the flowchart described below may be random and may be executed in parallel as long as no contradictions or inconsistencies occur in the processing content. Furthermore, the processing executed by each device in each flowchart may be executed by another device as long as no contradictions occur.

The process shown in FIG. 6 is realized by the control unit 190 executing the application program 151, and the control unit 290 executing the program 251. First, in step S610, the control unit 190 starts the imaging unit 170, which is a camera. The imaging unit 170 captures a real image of the surroundings of the user terminal 10.

In step S620, the control unit 190 detects a flat surface in the image captured by the imaging unit 170. In step S630, the control unit 190 places a virtual object on the detected flat surface.

Here, the processing of steps S610, S620, and S630 will be specifically described with reference to Figs. 7 to 9. Fig. 7 is a schematic diagram showing an example of a real image captured by the imaging unit 170. In the example of Fig. 7, a keyboard 702 and a monitor device 703 are placed on a flat desk 701.

When the imaging unit 170 is started in step S610, the real image captured by the imaging unit 170 is displayed on the display 132. Next, in step S620, the control unit 190 detects flat surfaces within the image captured by the imaging unit 170, i.e., within the image displayed on the display 132.

In FIG. 7, area 704 is detected as a flat surface. There is a keyboard 702 within area 704, but since the keyboard 702 is small enough to be hidden by the racetrack object 501, the control unit 190 detects area 704 as a flat surface.

In the state shown in FIG. 7, if the position captured by the imaging unit 170 is changed, the position of the area 704 can also be changed. The area 704 is displayed on the display 132, for example, with a predetermined color added to make it distinguishable from other parts. When the user performs a tap operation or the like on the area 704, in step S630, the control unit 190 places a virtual object such as the racetrack object 501 on the area 704.

Figure 8 is a schematic diagram showing an example of a screen on which a virtual object is displayed superimposed on a real image. In Figure 8, the area marked with a dot pattern including the monitor device 703 is the real image, and the other areas are areas in which virtual objects are displayed. In areas in which virtual objects are not displayed, for example, an advertising image may be displayed.

In FIG. 8, the following virtual objects are displayed: a racetrack object 501, multiple moving objects 502, two turn marker objects 503, a large monitor object 506, building objects 507a-507b, and numerous other objects not labeled (such as tree objects and clock objects). These objects are created, for example, based on the first information 152A received from the first server device 20.

In FIG. 8, the race track object 501 is placed on the area 704 so that the angle between the flat surface included in the area 704 and the bottom surface constituting the race track object 501 is 0 degrees. In this case, for example, the moving objects 502 may overlap with each other and become difficult to see. Also, blind spots where the moving objects 502 cannot be seen may occur in areas on the depth side of the large monitor object 506, etc.

However, in the state shown in FIG. 8, the user can change the viewpoint of the superimposed image displayed on the display 132. For example, if the user performs an operation input such as a pinch-in operation or a pinch-out operation, the viewpoint position of the imaging unit 170 may move closer to or farther away from the racecourse object 501. Also, if the user moves toward the depth or front of the display 132 while holding the user terminal 10, the viewpoint position of the imaging unit 170 may move closer to or farther away from the racecourse object 501. Also, if the user performs an operation to specify a specific position on the display 132, the viewpoint position may move to the specified position. Such a change in viewpoint may solve the above-mentioned visibility problem.

The above-mentioned visibility problems can also be mitigated by positioning the racetrack object 501 so that the angle θ between the flat surface and the bottom surface that constitutes the racetrack object 501 is an acute angle.

Figure 9 is a schematic diagram showing an example of a screen in which a virtual object is superimposed on a real image, and shows another aspect of the racetrack object 501 shown in Figure 8. Specifically, Figure 9 shows an example in which the first race is a horse race.

In FIG. 9 as well, the area marked with a dot pattern including the monitor device 703 is the real image, and the other areas are areas in which virtual objects are displayed. In FIG. 9, a racetrack object 511, multiple moving objects 512, a large monitor object 513, a pond object 514, and multiple tree objects 515 are displayed as virtual objects on the display 132. These objects are also created based on, for example, the first information 152A received from the first server device 20.

The racecourse object 511, the large monitor object 513, the pond object 514, and the multiple tree objects 515 are preferably created based on racecourse data such as course information of a specific racecourse in the real world. The multiple moving objects 512 are, for example, objects that virtually represent the horses and jockeys participating in the race.

Returning to the explanation of the flowchart in FIG. 6, in step S640, the control unit 190 acquires the position information of the boats 402a to 402f at the boat racing track 401 in the real world. That is, when a race between the boats 402a to 402f starts in the real world, the control unit 190 acquires the position information and time information of the boats 402a to 402f from the first server device 20. The method of acquiring the position information and time information is as described using FIG. 4.

In step S650, the control unit 190 controls the position information acquired in step S640 to be linked to the moving objects. Specifically, using time information and position information, the control unit 190 controls the movement of each of the boats 402a to 402f on the racecourse object 501 to be similar to the movement of the moving objects 502a to 502f on the boat racecourse 401.

The processing of steps S640 and S650 is repeated at least from the start to the end of the race in the real world, but may also be repeated before the start and after the end of the race in the real world.

Note that if the race to be displayed as a virtual race is a past race, position information and the like of the boats 402a to 402f from the start to the finish of the race may be acquired together before the start of the virtual race. Also, the virtual race may be displayed by acquiring only race time information without acquiring position information and the like. The race to be displayed as a virtual race may be an exhibition race.

After the race in the real world ends, the display control process ends in response to, for example, receiving an operation input to terminate the application program 151.

(Example of operation for executing mode switching function)
Next, an operation example for executing the mode switching function in the system 1 will be described with reference to Figs. 10 to 18. Figs. 10 and 11 are flowcharts showing an example of a display control process in this operation example. Fig. 12 is a schematic diagram showing an example of a display screen in step S1010 described later. The order of each process constituting the flowcharts described in Figs. 10 and 11 may be random and may be executed in parallel as long as no contradiction or inconsistency occurs in the process contents. Furthermore, the process executed by each device in each flowchart may be executed by another device as long as no contradiction occurs.

In step S1010, the control unit 190 places virtual objects such as the race track object 501 on the display 132. That is, the control unit 190 displays the race track object 501 on the display 132. This process is the same as step S630 in FIG. 6.

As shown in FIG. 12, in this operation example, the control unit 190 displays a switching button 1200, a runner prediction display field 1210, a computer prediction display field 1220, and a race name field 1230 on the display 132, superimposed on the race track object 501 displayed on the display 132. Note that a real image captured by the imaging unit 170 is displayed in the background of the race track object 501 on the display 132, but in this example, for simplicity of illustration, only the monitor device 703 of the real image is illustrated. The race track object 501, the switching button 1200, the runner prediction display field 1210, the computer prediction display field 1220, and the race name field 1230 are created based on, for example, the first information 152A received from the first server device 20.

The switching button 1200 is displayed, for example, in the lower right corner of the display 132. The user can switch the screen display by tapping the switching button 1200, etc.

The personal prediction display field 1210 is displayed, for example, in the upper left of the display 132. In the personal prediction display field 1210, for example, one or more predicted rankings included in the personal prediction information are displayed. In the personal prediction information, the race reporter is the tipster, and the bets predicted by the race reporter are displayed in the personal prediction display field 1210. In addition, the personal prediction display field 1210 displays an image icon 1211 of the tipster. In the example of FIG. 12, when the user performs an operation input (for example, tapping the image icon 1211, etc.) to display the audio and video of the tipster, audio is output from the speaker 162, and the video can be displayed in a specified area of the display 132. Note that video of past races, video of exhibition races, etc. may also be displayed.

The computer prediction display field 1220 is displayed, for example, in the upper center of the display 132. The computer prediction display field 1220 displays, for example, one or more predicted rankings included in the computer prediction information calculated by a computer device.

The race name column 1230 displays the name of a specific real-life race that is the subject of the racecourse object 501 displayed on the display 132 (e.g., the name of the boat racing course and the name of the round).

Returning to FIG. 10, in step S1020, the control unit 190 determines whether or not a user operation input to the switching button 1200 displayed on the display 132 has been received. If it is determined in step S1020 that a user operation input to the switching button 1200 has been received (Yes in step S1020), in step S1030, the control unit 190 switches the screen display so that the racetrack object 501 is displayed in the first display area on the display 132. Then, in step S1040, the control unit 190 displays a user interface object (hereinafter referred to as a UI object) that can receive a user operation input in a user interface display area (hereinafter referred to as a UI display area), which is an area on the display 132 different from the first display area.

The display processing in steps S1030 and S1040 will be specifically described below with reference to Fig. 13. Fig. 13 is a schematic diagram showing an example of a display screen in step S1040.
When the switching button 1200 is tapped or otherwise operated by the user, the control unit 190 displays the race track object 501 in a first display area 1300A which is the left half of the display 132, as shown in Fig. 13. That is, the control unit 190 changes the display area of the race track object 501 from the entire area of the display 132 to the left half of the display 132. The control unit 190 also displays the UI objects 1301 to 1303 in a UI display area 1300B which is the right half of the display 132. In the UI display area 1300B, for example, a voting page button 1301, a purchase race display button 1302, and a miscellaneous button 1303 are displayed as UI objects.

The voting page button 1301 is a button for displaying a voting screen that enables the user to vote for a specific race. The purchased race display button 1302 is used to display race information for which the user has purchased a betting ticket in the UI display area 1300B. The other button 1303 is a button for performing processes other than voting and displaying purchased races. When the user taps the other button 1303, various optional processes are performed, such as changing the display position of the first display area 1300A or the UI display area 1300B to a position desired by the user.

Returning to FIG. 10, in step S1050, the control unit 190 determines whether or not a user selection operation has been received for any of the various UI objects 1301-1303 displayed in the UI display area 1300B. If it is determined that a user selection operation has been received for any of the UI objects 1301-1303 (Yes in step S1050), in step S1060, the control unit 190 displays a screen corresponding to the UI object 1301-1303 for which the selection operation has been received in the UI display area 1300B. For example, if the user performs a tap operation or the like on the voting page button 1301, the control unit 190 displays a screen corresponding to the voting page button 1301 in the UI display area 1300B of the display 132.

The display process of step S1050 will be specifically described below with reference to FIG. 14. FIG. 14 is a schematic diagram showing an example of a display screen in step S1050. In the example shown in FIG. 14, a betting screen 1400 for a specified race is displayed in the UI display area 1300B. The betting screen 1400 is a screen on which a user can purchase betting tickets (boat tickets or betting tickets) for the specified race. The control unit 190 can display, for example, a screen on which a user can purchase betting tickets for the first race that is the subject of the racecourse object 501 displayed in the first display area 1300A as the betting screen 1400 in the UI display area 1300B.

The control unit 190 may also display a screen for purchasing betting tickets for a race other than the first race as a voting screen 1400 in the UI display area 1300B in response to a user's operational input. When a voting screen for a race other than the first race is displayed, the voting screen is generated based on, for example, the second information 152B received from the first server device 20.

The user can purchase a voting ticket for a desired contestant by tapping on various buttons (such as the voting button 1401) displayed on the voting screen 1400. Note that in this case as well, the racecourse object 501, which is the virtual race for the first race, is displayed in the first display area 1300A in the left half of the display 132.

Returning to FIG. 10, in step S1070, the control unit 190 determines whether or not the user has operated the voting button 1401 or the like displayed on the voting screen 1400 on the screen shown in FIG. 14. If it is determined in step S1070 that the user's selection operation on the voting button 1401 has been accepted (Yes in step S1070), in step S1080, the control unit 190 acquires selection information from the first server device 20 based on the selection operation. Specifically, the control unit 190 executes a purchase process for a voting ticket for a specified contestant or the like in response to the user's selection operation on the voting screen 1400. Note that after the selection information is acquired in this step (the purchase process for the voting ticket is executed), the control unit 190 may return the display of the UI display area 1300B to the state shown in FIG. 13 in response to a user's operation input or automatically without the operation input. In addition, the control unit 190 may display a voting screen for a race other than the predetermined race that is the subject of the voting screen 1400 shown in FIG. 14 in the UI display area 1300B in response to a user's operational input.

In step S1090, the control unit 190 determines whether or not a user selection operation on the Purchased Race Display button 1302 among the UI objects shown in FIG. 13 has been accepted. If it is determined that a user selection operation on the Purchased Race Display button 1302 has been accepted (Yes in step S1090), in step S1110 shown in FIG. 11, the control unit 190 acquires information on the race for which the user has purchased a betting ticket (purchased race) from the first server device 20. If the user has purchased a betting ticket for multiple races, the control unit 190 acquires race information on all of the relevant purchased races from the first server device 20. The race information acquired in this step includes, for example, the name of the purchased race, the date and time of the race, racecourse data, participant data, mobile data, odds information, race prediction information, race entry list, pre-race information, pit report, race results (race time information, position information and time information of participants, etc.), race video, race still images, past race information, etc. Furthermore, if the race information acquired in this step is related to the first race, the control unit 190 acquires the race information from the first server device 20 as first information 152A. Furthermore, if the race information acquired in this step is related to a race different from the first race, the control unit 190 acquires the race information from the first server device 20 as second information 152B.

In step S1120, the control unit 190 generates a race track object based on the race information of the purchased race obtained from the first server device 20. Note that if the purchased race includes the first race that is the target of the race track object 501 displayed in the first display area 1300A, the control unit 190 generates a new race track object for the purchased race other than the first race.

In step S1130, the control unit 190 determines the position and size of each display area on the display 132 in which each race track object is displayed, depending on the number of race track objects generated in step S1120. Then, in step S1140, the control unit 190 displays each race track object in each display area.

The display process of step S1140 will be specifically described below with reference to FIG. 15. FIG. 15 is a schematic diagram showing an example of a display screen in step S1140. In this example, for example, a case where the number of purchased races is six will be described. When the number of purchased races is six, as shown in FIG. 15, the display 132 is divided into six display areas 1500A to 1500F, and the racetrack objects 501A to 501F are displayed in each of the display areas 1500A to 1500D. Specifically, in the left half of the display 132 in the horizontally placed state, from top to bottom, the display area 1500A, the display area 1500B, and the display area 1500C are set, and the racetrack objects 501A to 501C are displayed in each of them. In addition, in the right half of the display 132, from top to bottom, the display area 1500D, the display area 1500E, and the display area 1500F are set, and the racetrack objects 501D to 501F are displayed in each of them. It is preferable that each display area 1500A-1500F be approximately the same size.

In this step, since the display 132 is divided into six display areas 1500A to 1500F, the size of each display area in which each racecourse object 501A to 501F is displayed is smaller than that shown in FIG. 8, FIG. 12, etc. Therefore, it is preferable that each racecourse object 501A to 501F is displayed in each display area 1500A to 1500F by enlarging a part of it. For example, in this example, as shown in FIG. 15, the goal part (one turn mark object 503 and multiple poles 508) of each racecourse object 501A to 501F displayed in each display area 1500A to 1500F is enlarged and displayed. In this way, when multiple racecourse objects are displayed simultaneously on the display 132, the visibility of the user can be ensured by enlarging and displaying the part of the racecourse object that is most likely to interest the user (for example, near the goal).

Note that the example in FIG. 15 shows a case where the number of purchased races is an even number, but if the number of purchased races is an odd number, for example, if the number of purchased races is three, one race track object can be displayed in the left half of the display 132, and two race track objects can be displayed in the right half of the display 132. In this way, not only the number of display areas in which the race track objects are displayed, but also their positions and sizes can be changed appropriately depending on the number of purchased races.

Returning to FIG. 11, in step S1150, the control unit 190 determines whether or not there is a racecourse object among the racecourse objects 501A to 501F displayed on the display 132 in which the probability that a contestant for whom a betting ticket has been purchased by the user (hereinafter referred to as a purchased contestant) will win the race is equal to or greater than a predetermined threshold value. The probability that a purchased contestant will win the race (hereinafter referred to as a winning percentage) is determined, for example, by the start timing and entry course during the race, the ranking and position at a specific point during the race, the race development, and the like. The winning percentage may also be determined by taking into account environmental information such as the weather and temperature at the racecourse. The "winning percentage" here refers to the winning percentage determined during the race based on the race development and environmental information after the race, but may also be the winning percentage before the race calculated from the information of the purchased contestant before the race (odds, bracket number, class, track record, etc.). The predetermined threshold value for the winning percentage may be preset by the control unit 190, or may be appropriately changed according to the user's selection input, etc. The predetermined threshold value may also be appropriately changed according to the type of race and the number of purchased races.

If it is determined that there is a racetrack object among the racetrack objects 501A-501F whose winning rate of the purchasing contestant etc. is equal to or greater than a predetermined threshold (Yes in step S1150), in step S1160, the control unit 190 determines whether there are multiple racetrack objects whose winning rate is equal to or greater than the predetermined threshold.

If it is not determined in step S1160 that there are multiple racetrack objects whose winning rate of purchasing contestants, etc. is equal to or greater than the predetermined threshold (No in step S1160), that is, if it is determined that there is only one racetrack object whose winning rate is equal to or greater than the predetermined threshold, in step S1170, the control unit 190 expands the display area of the racetrack object whose winning rate is equal to or greater than the predetermined threshold.

The display process of step S1170 will be described in detail below with reference to FIG. 16. FIG. 16 is a schematic diagram showing an example of a display screen in step S1170. If, for example, race track object 501B is the only race track object with a winning rate of the purchasing contestant or the like exceeding a predetermined threshold value among the multiple race track objects 501A-501F displayed on display 132 shown in FIG. 15, then in the example shown in FIG. 16, race track object 501B is enlarged and displayed. Specifically, display area 1500B of race track object 501B is enlarged so that race track object 501B is displayed over the entire left half of display 132. In the right half of display 132, race track objects 501D-501F remain displayed in display areas 1500D-1500F, respectively, as in the example of FIG. 15.

Note that in FIG. 16, as the race track object 501B is enlarged, the race track objects 501A and 501C of the race track objects 501A to 501C displayed in the left half of the display 132 in FIG. 15 are hidden, but this is not a limitation. For example, all of the race track objects 501A to 501F other than the enlarged race track object 501B may be displayed in the right half of the display 132. In other words, the race track objects 501A, 501C to 501F other than the enlarged race track object 501B may be reduced from the state in FIG. 15 and displayed in a different area of the display 132 from the race track object 501B.

Returning to FIG. 11, if it is determined in step S1160 that there are multiple racetrack objects with winning rates of purchased contestants etc. equal to or higher than a predetermined threshold value (Yes in step S1160), in step S1180, the control unit 190 enlarges the display area of the racetrack object with the purchased contestant etc. with the highest winning rate among the multiple racetrack objects. The method of enlarging the display area of the racetrack object in this step is the same as that shown in FIG. 16, so a detailed description will be omitted.

Note that in the above example, even if there are multiple racetrack objects with a winning rate above a predetermined threshold, a method is adopted in which only one racetrack object is enlarged and displayed, but this is not limited to the example. For example, multiple racetrack objects with a winning rate above a predetermined threshold may each be enlarged and displayed. In this case, for example, racetrack objects with a winning rate above a predetermined threshold may be enlarged and displayed over the entire left and right halves of the display 132 in a horizontally placed state.

17 and 18, an example of a screen division method for respectively displaying a plurality of racetrack objects on the display 132 will be described below. Figures 17 and 18 are schematic diagrams showing an example of a display screen displayed on the display 132.
As described above, in step S1090, when the user selects the Purchased Race Display button 1302 among the UI objects shown in FIG. 13, the control unit 190 divides the screen of the display 132 according to the number of races in which the purchased contestants, etc., for which the user has purchased a betting ticket exist, i.e., the number of purchased races. At this time, the control unit 190 may divide and display the real image (images of the desk 701, keyboard 702, monitor device 703, etc.) captured by the imaging unit 170 and displayed on the display 132 according to the number of purchased races. That is, the control unit 190 may divide the display area of the real image so that the number of display areas is the same as the number of purchased races. For example, when the user has purchased four races, as shown in FIG. 17, the control unit 190 divides the display 132 into four display areas 1700A to 1700D, and displays the same real image captured by the imaging unit 170 in each of the display areas 1700A to 1700D.

Then, the control unit 190 displays the racetrack objects 501A-501D corresponding to the purchased races, superimposed on the real-world images displayed in each of the display areas 1700A-1700D, as shown in Figure 18. In the example of Figure 18, the real-world images are omitted to simplify the drawing, but the four races for which the user has purchased betting tickets can be displayed in each of the display areas 1700A-1700D, superimposed on the real-world images.

In the above embodiment, in order to highlight a race track object for which the winning rate of the purchasing contestant is equal to or greater than a predetermined threshold, i.e., the race track object for the most favorable race among the purchased races, the race track object is enlarged more than the other race track objects displayed on the display 132, but this is not limited to the example. It is sufficient that the race track object for which the winning rate is equal to or greater than a predetermined threshold is displayed in a different display mode from the other race track objects. For example, the background of the race track object for which the winning rate is equal to or greater than a predetermined threshold may be changed to a color different from the background of the other race track objects, or the display frame of the race track object for which the winning rate is equal to or greater than a predetermined threshold may be surrounded by a predetermined color.

In the above embodiment, when the purchased race display button 1302 is tapped or otherwise operated, the racetrack objects 501A to 501F of the purchased race are displayed on the display 132, but this is not limited to this example. In other words, the display object displayed on the display 132 is not limited to the racetrack object of the purchased race, but may be real images of the purchased race, or a user interface for allowing the user to further select the participants of the purchased race. For example, when real images of the purchased race are displayed on the display 132 (for example, in the display areas 1500A to 1500F), the display area for the real images of the race in which the winning rate of the purchased participants is equal to or higher than a predetermined threshold value may be displayed larger than the display area for the real images of the other races. In addition, when a user interface for allowing the user to further select the participants of the purchased race is displayed on the display 132, the user interface for the race may be displayed larger or more prominently, for example, so that the user can purchase more betting tickets for the race with a high winning rate before the race among the purchased races.

In addition, in the above embodiment, an example of a display screen displayed on the display 132 when the user terminal 10 is placed horizontally (horizontally oriented) is described, but this example is not limited to this. Even when the user terminal 10 is placed vertically (portrait-oriented), multiple display areas in which racetrack objects are displayed may be set on the display 132 according to the number of purchased races, etc., so that the user can simultaneously view multiple racetrack objects via the display 132 in a vertical position.

The above embodiments are merely examples to facilitate understanding of the present invention, and are not intended to limit the present invention. The present invention can be modified and improved without departing from the spirit of the invention, and it goes without saying that the present invention includes equivalents.

[Additional Notes]
The contents of the present disclosure are listed as follows:

(Item 1)
A program executed on a first computer including a processor, an imaging unit, and a display unit,
The program causes the processor to:
receiving from a second computer first information relating to a first predetermined race in the real world and second information relating to a second predetermined race in the real world different from the first race;
generating a first display object based on the first information; and generating a second display object based on the second information;
When a user's operation input is received, dividing a display area of the display unit into a plurality of areas including at least a first area and a second area different from the first area;
displaying the first display object in the first area and the second display object in the second area on the display unit by superimposing the first display object on a real image of the surroundings of the first computer captured by the imaging unit;
acquiring selection information indicating one or more of the contestants or moving objects selected by the user from among the contestants or moving objects in at least one of the first race and the second race;
changing a display mode of at least one of the first area and the second area based on the selection information.
According to the above program, when information about multiple races is displayed on the display unit, the display mode of each piece of race information can be changed according to the user's selection information, so that the display of multiple race screens can be controlled based on the race content of one or more contestants or moving objects selected by the user, for example. This improves the visibility when viewing multiple races, which in turn leads to improved convenience and satisfaction for the user.

(Item 2)
the selection information includes information regarding one or more selection objects selected by the user from a plurality of selection objects including a first contestant or a first moving object in the first race and a second contestant or a second moving object in the second race;
2. The program according to item 1, wherein the step of changing the display mode includes making a display size of an area of the first area and the second area in which the one or more selection objects are included larger than a display size of another area when the one or more selection objects satisfy a predetermined condition.
According to the above configuration, the area of the predetermined race information is enlarged depending on the selection, so that the race information can be made to stand out, and thus it is possible to clearly show the user which race out of the multiple races displayed on the display unit the user should pay attention to.

(Item 3)
3. The program according to item 2, wherein the predetermined condition includes at least one of: a winning rate of the one or more selection targets being equal to or greater than a predetermined threshold; and a current ranking of the one or more selection targets being equal to or greater than a predetermined threshold.
According to the above configuration, races in which the contestant or moving body to be selected is likely to win, or races in which the contestant or moving body is in an advantageous position, can be highlighted, thereby further improving user satisfaction.

(Item 4)
The program described in any one of items 1 to 3, wherein the first display object is at least one of a first virtual object including a first racecourse object representing the racecourse of the first race and a first moving object representing a first contestant or a first moving object of the first race, a user interface for the user to select the first contestant or the first moving object, and an actual video image of the first race.
The first display object preferably includes those listed above.

(Item 5)
The program described in any one of items 1 to 4, wherein the second display object is at least one of a second virtual object including a second racecourse object representing the racecourse of the second race and a second moving object representing a second contestant or a second moving object of the second race, a user interface for the user to select the second contestant or the second moving object, and an actual image of the second race.
The second display object preferably includes those listed above.

(Item 6)
The displaying step includes:
displaying the real image of the surroundings of the first computer in both the first area and the second area;
displaying the first display object so as to be superimposed on the real image displayed in the first area, and displaying the second display object so as to be superimposed on the real image displayed in the second area;
6. The program according to any one of items 1 to 5, comprising:
According to the above configuration, the display area of the real image around the first computer is divided, and the first display object and the second display object are displayed by being superimposed on each divided real image. This makes it possible to simply divide the display area of the first display object and the second display object.

(Item 7)
An information processing method executed in a first computer including a processor, an imaging unit, and a display unit,
receiving from a second computer first information relating to a first predetermined race in the real world and second information relating to a second predetermined race in the real world different from the first race;
generating a first display object based on the first information; and generating a second display object based on the second information;
When a user's operation input is received, dividing a display area of the display unit into a plurality of areas including at least a first area and a second area different from the first area;
displaying the first display object in the first area and the second display object in the second area on the display unit by superimposing the first display object on a real image of the surroundings of the first computer captured by the imaging unit;
acquiring user selection information for at least one of the first race and the second race;
changing a display mode of at least one of the first area and the second area based on the selection information.
According to the above method, when information about multiple races is displayed on the display unit, the display mode of each piece of race information can be changed according to the user's selection information, so that the display of multiple race screens can be controlled based on the race content of one or more contestants or moving objects selected by the user, for example. This improves the visibility when viewing multiple races, which in turn leads to improved convenience and satisfaction for the user.

(Item 8)
An information processing device including a processor, an imaging unit, and a display unit, wherein the processor receives first information related to a predetermined first race in the real world and second information related to a predetermined second race different from the first race in the real world from a second computer;
generating a first display object based on the first information, and generating a second display object based on the second information;
When a user's operation input is received, a display area of the display unit is divided into a plurality of areas including at least a first area and a second area different from the first area;
in the display unit, the first display object is displayed in the first area, and the second display object is displayed in the second area, superimposed on a real image of a surrounding area of the information processing device captured by the imaging unit;
acquiring user selection information for at least one of the first race and the second race;
changing a display mode of at least one of the first region and the second region based on the selection information;
An information processing device that performs the above.
According to the above-mentioned device, when information about multiple races is displayed on the display unit, the display mode of each piece of race information can be changed according to the user's selection information, so that the display of multiple race screens can be controlled based on the race content of one or more contestants or moving objects selected by the user, for example. This improves the visibility when viewing multiple races, which in turn leads to improved convenience and satisfaction for the user.

(Item 9)
A system including a first computer including a first processor, an imaging device, and a display device, and a second computer including a second processor and communicatively connectable to the first computer,
The second processor
acquiring first information about a predetermined first race in the real world and second information about a predetermined second race different from the first race;
The first information and the second information are transmitted to the first computer, and the first processor
receiving the first information and the second information from the second computer, and generating a first display object based on the first information;
generating a second display object based on the second information;
When a user's operation input is received, a display area of the display device is divided into a plurality of areas including at least a first area and a second area different from the first area;
in the display device, the first display object is displayed in the first area, and the second display object is displayed in the second area, superimposed on a real image of the surroundings of the first computer captured by the imaging device;
acquiring user selection information for at least one of the first race and the second race;
The system changes a display mode of at least one of the first area and the second area based on the selection information.
According to the above system, when information about multiple races is displayed on the display unit, the display mode of each piece of race information can be changed according to the user's selection information, so that the display of multiple race screens can be controlled based on the race content of one or more contestants or moving objects selected by the user, for example. This improves the visibility when viewing multiple races, which in turn leads to improved convenience and satisfaction for the user.

1: System, 10: User terminal, 20: First server device, 30: Network, 40: Second server device, 130: Touch screen, 150: Memory unit (of user terminal), 152A, 252A: First information, 152B, 252B: Second information, 190: Control unit (of user terminal), 191: Operation input reception unit, 192: Transmission/reception unit, 193: Object generation unit, 194: Display control unit, 195: Flat surface detection unit, 196: First information acquisition unit, 197: Second information acquisition unit, 198: Selection information acquisition unit, 250: Memory (of first server device) Memory unit, 290: control unit (of the first server device), 401: boat race track, 402a-402f: boat, 501 (501A-501F): race track object, 502 (502a-502f): moving object, 503: turn mark object, 1200: switching button, 1300A: first display area, 1300B: UI display area, 1301: voting page button, 1302: purchase race display button, 1303: other buttons, 1400: voting screen, 1500A-1500F, 1700A-1700D: display area

Claims (8)

Computer,
a receiving means for receiving first information relating to a predetermined first race in the real world and second information relating to a predetermined second race different from the first race in the real world;
a first generating means for generating a first display object based on the first information;
second generating means for generating a second display object based on the second information;
a dividing means for dividing a display area of the computer into a plurality of areas including at least a first area and a second area different from the first area when a user's operation input is received;
a display means, in the computer, for displaying the first display object in the first area and displaying the second display object in the second area;
an acquisition means for acquiring selection information indicating one or more of the contestants or moving objects selected by the user from among the contestants or moving objects in at least one of the first race and the second race;
a program that functions as a display change means that changes a display size of at least one of the first area and the second area based on the selection information. the selection information includes information regarding one or more selection objects selected by the user from a plurality of selection objects including a first contestant or a first moving object in the first race and a second contestant or a second moving object in the second race;
The program according to claim 1 , wherein the display change means makes a display size of an area of the first area and the second area containing the one or more selection items larger than a display size of the other areas when the one or more selection items satisfy a predetermined condition. The program according to claim 2, wherein the predetermined condition includes at least one of the following: the win rate of the one or more selection targets is equal to or greater than a predetermined threshold value; and the current ranking of the one or more selection targets is equal to or greater than a predetermined threshold value. The program according to any one of claims 1 to 3, wherein the first display object is at least one of a first virtual object including a first racetrack object representing the racetrack of the first race and a first moving object representing a first contestant or a first moving object of the first race, a user interface for the user to select the first contestant or the first moving object, and an actual video image of the first race. The program according to any one of claims 1 to 4, wherein the second display object is at least one of a second virtual object including a second racecourse object representing the racecourse of the second race and a second moving object representing a second contestant or a second moving object of the second race, a user interface for the user to select the second contestant or the second moving object, and an actual video image of the second race. The display means includes:
Displaying a real image of the surroundings of the computer in both the first area and the second area;
The program according to claim 1 , further comprising: displaying the first display object by superimposing it on the real image displayed in the first area; and displaying the second display object by superimposing it on the real image displayed in the second area. An information processing device including a processor and a display unit,
The processor,
receiving first information relating to a first predetermined race in the real world and second information relating to a second predetermined race in the real world different from the first race;
generating a first display object based on the first information;
generating a second display object based on the second information;
When a user's operation input is received, a display area of the display unit is divided into a plurality of areas including at least a first area and a second area different from the first area;
The display unit displays the first display object in the first area and displays the second display object in the second area;
acquiring user selection information for at least one of the first race and the second race;
changing a display size of at least one of the first region and the second region based on the selection information;
An information processing device that performs the above. A system including a first computer having a first processor and a display device, and a second computer having a second processor and communicatively connectable to the first computer,
The second processor
acquiring first information about a predetermined first race in the real world and second information about a predetermined second race different from the first race;
transmitting the first information and the second information to the first computer;
The first processor,
receiving the first information and the second information from the second computer;
generating a first display object based on the first information;
generating a second display object based on the second information;
When a user's operation input is received, a display area of the display device is divided into a plurality of areas including at least a first area and a second area different from the first area;
In the display device, the first display object is displayed in the first area, and the second display object is displayed in the second area;
acquiring user selection information for at least one of the first race and the second race;
The system changes a display size of at least one of the first area and the second area based on the selection information.

Images