JP7212721B2 - Program, information processing method, information processing apparatus, and system - Google Patents

Description

The present disclosure relates to programs, information processing methods, information processing apparatuses, and systems.

Patent Documents 1 and 2 disclose techniques for playing back AR (Augmented Reality) content and VR (Virtual Reality) content on a terminal.

JP 2019-87180 A Japanese Patent Publication No. 2020-13236

By the way, in the real world, various races such as boat races and horse races are held, and race predictions about these races are provided by computers and predictions on newspapers and on the web. However, the race predictions provided there simply indicate the ranking predictions, prediction developments, etc. in text form, and there is room for improvement from the viewpoint of visual representation. It should be noted that Patent Documents 1 and 2 do not show the viewpoint of improving the visual expression when providing race predictions, nor do they disclose any means for solving the problem.

One aspect of the present disclosure aims to improve visual representation when providing race predictions to users.

According to one embodiment shown in the present disclosure,
A program executed in a first computer comprising a processor and an imaging unit,
The program causes the processor to:
receiving from a second computer first information about a given race in the real world;
a step of generating a virtual object including a racetrack object representing a racetrack and a moving object representing a contestant or moving object of the predetermined race based on the first information;
superimposing and displaying the virtual object on a real image of the surroundings of the first computer captured by the imaging unit;
The first information includes prediction information indicating a predicted order of the predetermined race,
The displaying step moves the moving object on the racetrack object based on the prediction information, and displays a predicted race in which the predetermined race is virtually displayed according to the predicted ranking. include,
A program is provided.

According to an embodiment shown in the present disclosure, it is possible to improve visual representation when providing race predictions to users.

1 is a diagram showing a configuration example of a system according to an embodiment; FIG. 2 is a block diagram showing an example of functional configuration of a user terminal according to an embodiment; FIG. 3 is a block diagram showing an example of a functional configuration of a server according to one embodiment; FIG. 6 is a flow chart showing an example of display control processing according to an embodiment; FIG. 4 is a schematic diagram showing an example of a real image captured by an imaging unit according to an embodiment; FIG. 10 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image according to an embodiment; FIG. 10 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image according to an embodiment; 9 is a flowchart showing an example of prediction display processing according to an embodiment; FIG. 4 is a schematic diagram showing an example of a display screen according to an embodiment; FIG. 4 is a schematic diagram showing an example of a lace pattern according to an embodiment; FIG. 4 is a schematic diagram showing an example of a display screen according to an embodiment;

Hereinafter, embodiments of this technical idea will be described in detail with reference to the drawings. In the following description, the same elements are denoted by the same reference numerals, and overlapping descriptions are omitted as appropriate. In one or more of the embodiments presented in this disclosure, elements of each embodiment may be combined with each other and the combined result shall also form part of the embodiments presented in this disclosure.

(System configuration)
FIG. 1 is a diagram showing the configuration of system 1 according to the present embodiment. The system 1 can display, for example, a prediction of a predetermined race to be held in the real world as a virtual race using virtual objects on the information processing device used by the user. In this specification, the "predetermined race" is not particularly limited as long as it is a race that is held in the real world. Examples include car races such as F1, drone races, dog races, marathons, and relay road races.

As shown in FIG. 1, the system 1 includes a user terminal 10A, a user terminal 10B, and a user terminal 10C (hereinafter referred to as user terminals 10A, 10B, 10C, etc.), which are information processing apparatuses (first computers) used by users. a plurality of user terminals 10 , a first server device (second computer) 20 , a second server device 40 , and a network 30 .

The user terminals 10A and 10B are connected to the network 30 by communicating with the radio base station 31 . The user terminal 10C connects to the network 30 by communicating with a wireless router 32 installed in a facility such as a house. The user terminal 10 is, for example, a mobile terminal with a touch screen, and may be a smart phone, a phablet, a tablet, or the like.

The user terminal 10 executes, for example, a program installed via a platform that distributes applications or the like, or a program including pre-installed website browsing software. The user terminal 10 communicates with the first server device 20 by executing the above program, and transmits/receives data related to a predetermined race, data related to the user, etc. to/from the first server device 20, thereby allowing the user It is possible to display a virtual race based on the race prediction (hereinafter also referred to as "prediction race") on the terminal 10. FIG.

The first server device 20 receives data related to a given race from the second server device 40 . The first server device 20 appropriately transmits data related to a predetermined race to the user terminal 10 . The first server device 20 stores and manages data related to a predetermined race and data related to each user.

The first server device 20 includes a communication IF (Interface) 22, an input/output IF 23, a memory 25, a storage 26, and a processor (second processor) 29 as a hardware configuration. connected to each other through

The communication IF 22 is compatible with various communication standards such as the LAN (Local Area Network) standard, and functions as an interface for transmitting and receiving data to and from the user terminal 10, the second server device 40, and the like.

The input/output IF 23 functions as an interface for receiving input of information to the first server device 20 and outputting information to the outside of the first server device 20 . The input/output IF 23 can include an input receiving section that receives connection of information input devices such as a mouse and keyboard, and an output section that receives connection of information output devices such as a display for displaying images and the like.

The memory 25 is a storage device for storing data used for processing. The memory 25 provides the processor 29 with a work area for temporary use when the processor 29 performs processing, for example. The memory 25 includes ROM (Read Only Memory), RAM (Random
Access Memory) and other storage devices.

The storage 26 is a storage device for storing various programs and data for the processor 29 to read and execute. The information stored by the storage 26 includes data related to predetermined races, data related to each user, and the like. The storage 26 can be configured including a storage device such as an HDD (Hard Disk Drive) and flash memory. Note that the storage is not limited to being included in the server device, and a cloud service can also be used.

The processor 29 controls the operation of the first server device 20 by reading and executing programs and the like stored in the storage 26 . The processor 29 is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics
Processing Unit) and the like.

The second server device 40 stores and manages data related to predetermined races. The second server device 40 is, for example, a server device managed by an organizer of a predetermined race, or a server device managed by an organization (publisher of a race magazine, etc.) that transmits information about a predetermined race to the outside. The second server device 40 appropriately transmits data related to a predetermined race to the first server device 20 . In one aspect, the second server device 40 may transmit data related to a given race to the user terminal 10 . The hardware configuration of the second server device 40 may be the same as that of the first server device 20 as long as there is no contradiction.

(user terminal)
FIG. 2 is a block diagram showing an example of the functional configuration of the user terminal 10. As shown in FIG. As shown in FIG. 2, the user terminal 10 includes an antenna 110, a wireless communication IF 120, a touch screen 130, an input/output IF 140, a storage unit 150, an audio processing unit 160, a microphone 161, a speaker 162, It includes an imaging unit 170 and a control unit (first processor) 190 .

The antenna 110 radiates the signal emitted by the user terminal 10 into space as radio waves. Antenna 110 also receives radio waves from space and provides a received signal to wireless communication IF 120 .

The wireless communication IF 120 performs modulation/demodulation processing and the like for transmitting and receiving signals via the antenna 110 and the like in order for the user terminal 10 to communicate with other communication devices. The wireless communication IF 120 is a communication module for wireless communication including a tuner, a high-frequency circuit, and the like.

Touch screen 130 accepts input from a user and outputs information to display 132 for the user. Touch screen 130 includes a touch panel 131 and a display 132 for accepting user operation input. The touch panel 131 detects that a user's finger or the like approaches by using, for example, a capacitive touch panel. The display 132 is implemented by, for example, an LCD (Liquid Crystal Display), an organic EL (electroluminescence), or other display device.

The input/output IF 140 receives input of information to the user terminal 10 and functions as an interface for outputting information to the outside of the user terminal 10 .

The storage unit 150 is configured by a flash memory, an HDD, or the like, and stores programs used by the user terminal 10 and various data received by the user terminal 10 from the first server device 20 or the like.

The audio processing unit 160 modulates and demodulates an audio signal. Audio processing section 160 modulates the signal supplied from microphone 161 and supplies the modulated signal to control section 190 . Also, the audio processing unit 160 provides an audio signal to the speaker 162 . The audio processing unit 160 is implemented by, for example, a processor for audio processing. Microphone 161 functions as an audio input unit for receiving input of an audio signal and outputting it to control unit 190 . The speaker 162 functions as an audio output unit for outputting audio signals to the outside of the user terminal 10 .

The imaging unit 170 is a camera that captures a real image of the surroundings of the user terminal 10 . An image captured by the imaging unit 170 is subjected to image processing by the control unit 190 and output to the display 132 .

The control unit 190 controls the operation of the user terminal 10 by reading and executing programs stored in the storage unit 150 . The control unit 190 is implemented by, for example, an application processor.

A process of executing the application program 151 by the control unit 190 will be described in more detail. Storage unit 150 stores application program 151 , application information 152 , and user information 153 .

For example, the user terminal 10 downloads the application program 151 from the first server device 20 and stores it in the storage unit 150 . Also, the user terminal 10 communicates with the first server device 20 to transmit and receive various data such as application information 152 and user information 153 to and from the first server device 20 .

The application program 151 is a program for displaying predicted races on the user terminal 10 . The application information 152 includes various data referred to by the application program 151 . Application information 152 includes first information 152A.

The first information 152A includes information about a predetermined race transmitted from the first server device 20 or the second server device 40. FIG. The first information 152A includes, for example, prediction information indicating the predicted ranking of participants in a predetermined race or moving bodies (hereinafter also referred to as “participants, etc.”).

The forecast information may include multiple ranking forecasts for one race. The forecast information may also include ranking forecasts for a plurality of races. The forecast information may also include a ranking forecast for each race held at a plurality of racetracks. Here, the plurality of racecourses may be racecourses where the same competition is held (for example, boat racecourses at different locations), or racecourses where different competitions are held (for example, boat races). course and racetrack).

The prediction information includes, for example, computer prediction information calculated by a computer device. The computer prediction information is, for example, the first server device 20, the second server device 40, or the user terminal 10 based on past data, which is information about other races held in the past, and race conditions in a predetermined race. This includes the ranking predictions calculated by Calculation of rank prediction may be performed, for example, by a machine learning model using a neural network.

Past data includes, for example, performance information of participants such as rankings and times of participants in past races (which may include information on display races, training, test runs, etc.), when the past race was held environmental information (e.g., weather, temperature, wind force, wind direction, wave height, track and track conditions, etc.), and other information (based on past events) that can be used as a reference for race predictions. sell.

The race conditions include the location of the race, course type, race distance, information on each participant in the race (e.g., frame order, handicap, weight, equipment, etc.), environment assumed when the race is held, It may contain information (regarding the race) that may be helpful for other race predictions.

Also, the prediction information can include, for example, human prediction information predicted by humans (for example, reporters, tipsters, etc.). The people prediction information is prediction information input by a human, and is transmitted from the first server device 20 or the second server device 40 to the user terminal 10 . The human prediction information can include audio information generated from the voice uttered by the predicted human and/or moving image information of a moving image of the human.

Also, the prediction information preferably includes, for example, accuracy information indicating the accuracy of the ranking prediction. Accuracy indicates the possibility of winning the ranking prediction. Accuracy, for example, may be indicated by a specific numerical value such as 0 to 100%, or a predetermined rank (for example, A rank, B rank, C rank, etc. in descending order of likelihood), etc. good too. The accuracy of computer-predicted information may be calculated by the computer that calculated it. The accuracy of human prediction information can be determined by the human who predicted it. When the prediction information includes a plurality of rank predictions, the prediction information may include accuracy information for each rank prediction.

The prediction information may include a development prediction that predicts the development of the race. The development prediction can include, for example, a ranking prediction in a predetermined section such as the beginning, middle, and end of the race. The ranking prediction may be a prediction of all the rankings from the first to the lowest, or may be a prediction up to a predetermined ranking (for example, a betting target ranking), or a certain contestant or the like. may be predicted to be within a predetermined rank (for example, within the top three).

In this specification, the term “contestant” is a concept that includes not only humans but also animals such as horses and dogs. A "moving object" is an object that moves in a given race, such as an animal or a machine that a contestant rides, or a machine that is remotely controlled by a contestant. In a marathon, a dog race, etc., the "participant" and the "moving object" are the same.

The first information 152A may include, for example, past data, information on race conditions, etc., in addition to the prediction information. Specifically, the first information 152A includes the name of a predetermined race, race conditions, the date and time of the race, race field data, contestant data, mobile object data, odds information, race start chart, pre-race information, pit report, Race results, race videos, race still images, other past race information, and information that can be published in information magazines and information sites related to other predetermined races may also be included.

User information 153 includes information about the user of user terminal 10 . The user information 153 includes, for example, information identifying the user, location information of the user terminal 10, user's race purchase history and hit rate (for example, in the case of a boat race, the history of purchased boat tickets and the number of purchased boat tickets). Hit rate) and the like may be included.

By reading and executing the application program 151, the control unit 190 operates an operation input reception unit 191, a transmission/reception unit 192, an object generation unit 193, a display control unit 194, a detection unit 195, a reproduction unit 196, Demonstrate each function of

The operation input receiving unit 191 receives user's operation input based on the output of the touch screen 130 . Specifically, the operation input receiving unit 191 detects that a user's finger or the like touches or approaches the touch panel 131 as coordinates of a coordinate system having a horizontal axis and a vertical axis on the surface forming the touch screen 130 .

Operation input reception unit 191 determines a user's operation on touch screen 130 . The operation input reception unit 191 performs, for example, “approach operation”, “release operation”, “tap operation”, “double tap operation”, “long press operation (long touch operation)”, “drag operation (swipe operation)”, User operations such as "move operation", "flick operation", "pinch-in operation", and "pinch-out operation" are determined.

The operation input receiving unit 191 may receive, as an operation input, movement of the user terminal 10 detected by an acceleration sensor or the like mounted on the user terminal 10 .

The transmission/reception unit 192 transmits and receives various types of information to and from external communication devices such as the first server device 20 and the second server device 40 via the wireless communication IF 120 and the network 30 . The transmitter/receiver 192 receives the first information 152A from the first server device 20 or the second server device 40, for example. Further, the transmission/reception unit 192 transmits, for example, information corresponding to the operation input received by the operation input reception unit 191, information stored in the user information 153, and the like to the first server device 20 or the second server device 40. .

The object generator 193 generates a virtual object for presenting the user with second information about a predetermined race, based on the first information. In this specification, "second information" is, for example, at least part of the first information 152A or information calculated from the first information 152A. In one aspect, the "second information" can be information that can be presented as text. In a certain aspect, the "second information" can be a text indicating a ranking prediction or its accuracy.

The object generation unit 193 generates, as virtual objects, a racetrack object representing a racetrack and moving objects representing contestants and the like. The object generation unit 193 may generate a virtual display board for text-displaying the second information. In addition to the objects described above, the object generation unit 193 generates a virtual screen for displaying the image of the second information, various building objects, landscape objects such as trees that constitute the landscape, objects that serve as avatars of the user, and the like. may be generated.

The display control unit 194 superimposes a virtual object generated by the object generation unit 193 on a real image of the surroundings of the user terminal 10 captured by the imaging unit 70 (hereinafter also referred to as a “superimposed image”). displayed on the display 132. The display control unit 194 moves the moving object on the racetrack object based on the prediction information included in the first information 152A, and displays the predicted race on the display 132. FIG.

A predicted race is a virtual display of a predetermined race in accordance with the predicted ranking. The display control unit 194 preferably displays a predicted race based on the predicted ranking and a preset race pattern. The lace pattern is detailed in a later paragraph. If the prediction information includes a development prediction, the display control unit 194 may control the display of the predicted race based on the ranking prediction and the development prediction. In addition, the display control unit 194 may end the display of the predicted race when the order of finish is determined up to the predetermined order in the predicted race.

When there are a plurality of predicted races, the display control unit 194 determines the predicted race to be displayed, for example, based on the degree of certainty of the predicted races or based on the operation input by the user.

It is preferable that the display control unit 194 can change the viewpoint in the superimposed image according to the operation input received by the operation input reception unit 191 . The display control unit 194 causes the display 132 to display various menu screens and a GUI (Graphical User Interface) or changes the display contents of the display 132 in accordance with the operation input received by the operation input reception unit 191 .

The display control unit 194 causes the display 132 to display the ranking predictions included in the prediction information, for example. In this case, it is preferable to display the probability together with the ranking prediction. Moreover, when displaying a plurality of predicted rankings for one race, it is preferable to display the plurality of predicted rankings in an order according to their respective degrees of accuracy. Moreover, when displaying a plurality of ranking predictions for a plurality of races, it is preferable to display the ranking predictions in an order determined based on the accuracy of each of the plurality of ranking predictions and/or the start time of each race.

The detection unit 195 detects flat surfaces in the real image captured by the imaging unit 170 . Detection of a flat surface is realized by conventionally known image recognition technology. For example, when the user performs an operation to select the flat surface detected by the detection unit 195, the display 132 displays a superimposed image in which the racetrack object is arranged on the flat surface.

Preferably, the flat surface is a horizontal surface. Also, the angle formed by the flat surface and the bottom surface forming the racetrack object may be 0 degrees, but is preferably an acute angle, and can be in the range of 15 degrees to 45 degrees, for example. The angle can also be adjusted by accepting a user's operation. In addition, even if there is a projection on a part of the flat surface in the real world, or even if there is an object on the flat surface, if the projection or the object is of a size that can be hidden by the racetrack object. , may be detected as a flat surface on which the racetrack object can be placed.

The reproducing unit 196 reproduces audio and/or moving images based on the audio information and/or the moving image information included in the human forecast information. The audio and/or moving images are, for example, an explanation or commentary on the race predictions by the person who made the predictions.

(First server device)
FIG. 3 is a block diagram showing the functional configuration of the first server device 20. As shown in FIG. A detailed configuration of the first server device 20 will be described with reference to FIG. The first server device 20 functions as a communication unit 220, a storage unit 250, and a control unit 290 by operating according to a program.

The communication unit 220 functions as an interface for the first server device 20 to communicate with external communication devices such as the user terminal 10 and the second server device 40 via the network 30 .

The storage unit 250 stores various programs and data for realizing the system 1 . In one aspect, storage unit 250 stores program 251 , race information 252 , and user information 253 .

The program 251 is a program for realizing the system 1 by the first server device 20 communicating with the user terminal 10 and the second server device 40 . The program 251 is executed by the control unit 290 to perform processing for transmitting and receiving data to and from the user terminal 10 and the second server device 40, processing according to the operation content performed by the user of the user terminal 10, race information 252 and user The first server device 20 is caused to perform processing such as updating the information 253 .

Race information 252 includes various data related to a given race. Race information 252 includes, for example, first information 252A. The first information 252A is information from which the first information 152A is based, and the first information 152A can be part of the first information 252A. The first information 252A is, for example, information acquired from the second server device 40 or information calculated by the first server device 20 based on the information. That is, the first information 252A can include prediction information, information about other races that were held in the past, information about race conditions in a predetermined race, and the like.

User information 253 is information about the user of the user terminal 10 . User information 253 includes a user management table 253A. The user management table 253A stores, for each user, information for identifying the user, location information of the user terminal 10, user's race purchase history, hit rate, and the like.

The control unit 290 is implemented by the processor 29 , and functions as a transmission/reception unit 291 , a first information acquisition unit 292 , a data management unit 293 and a clock unit 294 by executing the program 251 .

The transmission/reception unit 291 transmits and receives various types of information to and from external communication devices such as the user terminal 10 and the second server device 40 via the communication unit 220 and the network 30 . The transmitting/receiving unit 291 transmits at least part of the first information 252A to the user terminal 10, for example. Also, the transmission/reception unit 291 receives the first information 252A from the second server device 40, for example.

The first information acquisition unit 292 acquires the first information 252A from the second server device 40 via the transmission/reception unit 291 . The first information acquisition unit 292 can calculate computer prediction information based on information acquired from the second server device 40 . The data management unit 293 performs processing for updating various data stored in the storage unit 250 according to the processing results of the first information acquisition unit 292 and the like. The clock unit 294 performs processing for measuring time. Various times displayed on the user terminal 10 (for example, the time until the start of the race, etc.) can be controlled based on the time measured by the timer 294 .

(Operation example)
Next, an operation example in the system 1 will be described with reference to FIGS. 4 to 11. FIG. Although the case where the predetermined race is a boat race will be mainly described below as an example, the following description can be applied even if the predetermined race is another race. In the following description, data is transmitted and received between the user terminal 10 and the first server device 20, and between the first server device 20 and the second server device 40. The terminal 10 and the second server device 40 may be configured to directly transmit and receive data.

FIG. 4 is a flowchart illustrating an example of display control processing. It should be noted that the order of each process constituting the flowchart (including FIG. 8) described below may be random as long as there is no contradiction or inconsistency in the contents of the process, and the processes may be executed in parallel. Also, the processing executed by each device may be executed by another device as long as there is no contradiction.

The processes shown in FIGS. 4 and 8 are realized by the control unit 190 executing the application program 151 and the control unit 290 executing the program 251, respectively. First, in step S610, the control unit 190 activates the imaging unit 170, which is a camera. A real image around the user terminal 10 is captured by the imaging unit 170 .

In step S<b>620 , the control unit 190 detects a flat surface within the image captured by the imaging unit 170 . In step S630, the control unit 190 arranges the virtual object on the detected flat surface.

Here, the processing of steps S610, S620, and S630 will be specifically described using FIGS. 5 to 7. FIG. FIG. 5 is a schematic diagram showing an example of a real image captured by the imaging unit 170. As shown in FIG. In the example of FIG. 5, a keyboard 702 and a monitor device 703 are placed on a flat desk 701 .

When the imaging unit 170 is activated in step S610, a real image captured by the imaging unit 170 is displayed on the display 132. FIG. Next, in step S<b>620 , the control unit 190 detects a flat surface within the image captured by the imaging unit 170 , that is, within the image displayed on the display 132 .

In FIG. 5, region 704 is detected as a flat surface. There is a keyboard 702 within the area 704, but the size of the keyboard 702 is such that it can be hidden by the racetrack object 501, so the control unit 190 detects the area 704 as a flat surface.

In the state shown in FIG. 5, the position of the region 704 can also be changed by changing the position captured by the imaging unit 170 . The area 704 is displayed on the display 132 by adding a predetermined color, for example, so as to be distinguishable from other parts. When the user performs a tap operation or the like on the area 704, the control unit 190 arranges a virtual object such as the racetrack object 501 on the area 704 in step S630.

FIG. 6 is a schematic diagram showing an example of a screen displaying a virtual object superimposed on a real image. In FIG. 6, the dot-patterned area including the monitor device 703 is the real image, and the other area is the area where the virtual object is displayed. For example, an advertisement image may be displayed in the area where no virtual object is displayed.

In FIG. 6, as virtual objects, there are a racetrack object 501, a plurality of moving objects 502, two turn mark objects 503, a large monitor object 506, building objects 507a to 507b, and other objects not labeled. A large number of objects (tree objects, clock objects, etc.) are displayed. These objects are created based on the first information 152A received from the first server device 20, for example.

In FIG. 6, the racetrack object 501 is placed on the area 704 such that the angle between the flat surface included in the area 704 and the bottom surface of the racetrack object 501 is 0 degrees. In this case, for example, an area in the depth direction such as the area X1 and the moving objects 502 may overlap each other and become difficult to see. In addition, a blind spot where the moving object 502 cannot be seen may occur in a region on the depth direction side of the large monitor object 506 .

However, in the state shown in FIG. 6, the user can change the viewpoint of the superimposed image displayed on display 132 . For example, when the user performs an operation input such as a pinch-in operation or a pinch-out operation, the viewpoint position of the imaging unit 170 may move closer to or farther from the racetrack object 501 . Also, when the user moves in the depth direction of the display 132 while holding the user terminal 10 or moves in the front direction, the viewpoint position of the imaging unit 170 may move closer to or farther from the racetrack object 501 . Also, when the user performs an operation to specify a predetermined position on the display 132, the viewpoint position can move to the specified position. Such a viewpoint change can solve the visibility problem described above.

FIG. 7 is a schematic diagram showing an example of a screen in which a virtual object is superimposed on a real image, showing another mode of the racetrack object 501 shown in FIG. Specifically, FIG. 7 is an example in which the predetermined race is a horse race.

In FIG. 7 as well, the area with the dot pattern including the monitor device 703 is the real image, and the other area is the area where the virtual object is displayed. In FIG. 7, a racetrack object 511, a plurality of moving objects 512, a large monitor object 513, a pond object 514, and a plurality of tree objects 515 are displayed on the display 132 as virtual objects. These objects are also created based on the first information 152A received from the first server device 20, for example.

The racetrack object 511, the large monitor object 513, the pond object 514, and the plurality of tree objects 515 are preferably created based on racetrack data such as course information of a predetermined racetrack in the real world, for example. A plurality of moving objects 512 are, for example, virtual objects representing horses and jockeys running in a horse race.

Returning to the description of the flowchart in FIG. In step S<b>640 , the control unit 190 executes the prediction display process, and ends the series of display control processes in response to receiving an operation input to end the application program 151 .

Here, the prediction display processing in step S640 will be described in detail with reference to FIG. FIG. 8 is a flowchart illustrating an example of prediction display processing. First, in step S<b>641 , the control unit 190 acquires past data, information on race conditions, or computer prediction information from the first server device 20 . The computer prediction information here includes a ranking prediction calculated by the first server device 20 based on at least past data and race conditions.

Next, if the information acquired in step S641 does not contain the necessary computer prediction information, the control unit 190 generates computer prediction information in step S642. The generation of computer prediction information in step S642 may be based on at least historical data and race conditions.

Next, in step S643, control unit 190 displays computer prediction information on display 132. FIG. At step S643, at least one prediction ranking included in the computer prediction information is displayed in a predetermined area of the display 132. FIG. Further, in step S643, information such as the accuracy of the predicted order and odds may be displayed.

Next, if there is a request to display a predicted race in step S644 (Yes in step S644), control unit 190 displays the predicted race on display 132 in step S645. Specifically, the control unit 190 virtually displays the predicted race by moving each moving object 502 on the race field object 501 in accordance with the predicted ranking. If there is no predicted race display request in step S644 (No in step S644), the process of step S645 is not executed.

The request to display the predicted race in step S644 may be made, for example, in response to an operation input by the user for displaying the predicted race, or in response to acquisition of prediction information, or the like.

Also, if a plurality of predicted rankings are displayed in step S643, the predicted race displayed in step S645 may be determined according to the user's selection, or may be determined according to a predetermined rule (for example, in descending order of probability). may be determined based on Moreover, when the display of one predicted race ends, the display of the next predicted race may be automatically started based on a predetermined rule.

The processing of steps S641 to S645 described above is prediction display processing related to computer prediction information. Steps S646 to S649 described below are prediction display processing related to people prediction information. Each process of S641 to step S645 and each process of S646 to step S649 can be executed in parallel.

First, in step S<b>646 , the control unit 190 acquires the input data of the tipster and the like from the first server device 20 . That is, in step S646, control unit 190 acquires people prediction information. In this embodiment, the person prediction information includes voice information of the person who made the prediction and moving image information of the person in addition to the order prediction.

Next, in step S<b>647 , the control unit 190 displays the people prediction information on the display 132 . At step S<b>647 , at least one prediction order included in the people prediction information is displayed in a predetermined area of the display 132 .

Next, if there is a request to reproduce audio and video in step S648 (Yes in step S648), control unit 190 reproduces audio and video in step S649. Specifically, in step S<b>649 , a moving image is displayed in a predetermined area of display 132 and sound is output from speaker 162 . In step S648, only audio may be played.

Next, each process of steps S643 to S645 and steps S647 to S649 will be described in more detail with reference to FIGS. 9 to 11. FIG. FIG. 9 is a schematic diagram showing an example of a display screen according to this embodiment.

In FIG. 9, the display 132 has a virtual screen 508, a computer prediction column 801, a human prediction column 801, a human prediction column 801, and a racetrack object 501, a moving object 502 (including 502a, 502b, etc.) and other virtual objects already described. A column 802 and a race information column 803 are displayed.

In the computer prediction column 801, a plurality of prediction rankings included in the computer prediction information and their accuracy are displayed in order of recommendation. In the example of FIG. 9, the predicted ranking is the one that predicts the rankings of 1st to 3rd (so-called 3-game winning streak), but is not limited to this. The expected order may correspond to a type such as a win-win system, a win-win system, a winning streak-single system, or a winning streak-double system. The computer prediction column 801 may include prediction rankings of different types, or may indicate prediction rankings corresponding to only one type determined according to a user's operation or the like.

In the example of FIG. 9, the accuracy is indicated by ABC ranks in descending order, but the accuracy is not limited to this. The accuracy may be indicated by a specific numerical value such as "X%", for example. Also, in the example of FIG. 9, the recommendation order is the order of accuracy, but is not limited to this. The recommended order may be an order from the highest odds, an order from the highest expected value that can be calculated based on the probability and the odds, or may be based on other criteria. Also, the display order of the predicted ranks may be determined based on a criterion selected by the user from criteria such as accuracy, odds, and expected value.

In the example of FIG. 9 , the predicted race is displayed on the racecourse object 501 when the user performs an operation input for displaying the predicted race. For example, when a user presses a virtual button (not shown) for viewing predicted races, the predicted races may be displayed in order of recommendation. Also, for example, when an operation is performed to select one of the predicted rankings shown in the computer prediction field 801, a predicted race can be displayed based on the selected predicted ranking.

A predicted race is displayed by moving each moving object 502 on the racetrack object 501 . Prediction races are developed in line with ranking predictions. In the example of FIG. 9, when the predicted ranking with the first recommended order is selected, the final ranking of the predicted race will be the contestants with 1 slot for 1st place, 3 slots for 2nd place, and 4 slots for 3rd place.

If the prediction information includes an expected development, the development of the predicted race may be based on the predicted development. On the other hand, the race development in the predicted race may be based on a preset race pattern.

FIG. 10 is a schematic diagram showing an example of a lace pattern. FIG. 10 shows a bird's-eye view of a scene in which each moving object 502 passes near a virtual line S indicating a lap or a goal line G indicating a goal in a race. In this example, the moving object 502a is ranked first, the moving object 502b is ranked second, and the moving object 502c is ranked third. Note that the arrows in FIG. 10 indicate the traveling direction of each moving object 502 . That is, each moving object 502 advances from left to right on the paper surface.

FIG. 10(a) shows the development of the first lap of the race. In (a) of FIG. 10 , each moving object 502 is in close combat with no clear superiority. (b) of FIG. 10 shows the development of the race on the second lap. In (b) of FIG. 10, the moving object 502a is at the top, but the other moving objects 502c to 502f are in close combat with no clear superiority.

(c) of FIG. 10 shows the development of the race from the beginning to the middle of the third lap. In (c) of FIG. 10, the moving object 502a keeps the lead, the moving objects 502b and 502c are competing for second place, and the moving objects 502d to 502f are far behind the moving objects 502b and 502c.

(d) of FIG. 10 shows the development of the race at the end of the third lap. (d) of FIG. 10 shows a state in which the moving object 502a crosses the goal line G first, the moving object 502b crosses the goal line G in second place, and the moving object 502c reaches the goal line G in third place. showing. The moving objects 502b and 502c, for example, move close to the goal line G while fighting closely, and the superiority or inferiority is determined near the goal line G, for example.

Further, in FIG. 10(d), when the third place is confirmed in the predicted race, the area 901 on the left side of the goal line G including the moving objects 502d to 502f that have not yet crossed the finish line is grayed out, and the rankings of the fourth and subsequent places are grayed out. is not displayed. The area to be grayed out is not particularly limited, and may be the entire area of the racetrack object 501 . Instead of graying out, the predicted race may be displayed until all the moving objects 502 pass the goal line.

The race pattern is not limited to the example in FIG. 10, and may be appropriately set by the administrator of the first server device 20 or the like. There may be a plurality of race patterns, and the race pattern to be used for the predicted race may be determined according to race conditions and the like. Also, the race pattern may be set according to the type of race. For example, in a race such as a boat race in which the higher the position, the more advantageous it is, it is preferable to use a race pattern as shown in FIG. In addition, when there is information (for example, leg quality and line) that can assume the position of each contestant during the race, such as horse racing and bicycle racing, the race pattern may be determined based on the information. .

Returning to the description of FIG. One or more prediction rankings included in the crowd prediction information are displayed in the crowd prediction column 802 . In the example of FIG. 9 , the race reporter is the tipper, and the spectator prediction field 802 shows the bids predicted by the race reporter.

In addition, in the person prediction field 802, an image icon 802a of a tipster is shown. In the example of FIG. 9, when the user performs an operation input (for example, tapping the image icon 802a) for displaying the tipster's voice and video, the sound is output from the speaker 162, and the video is displayed on the virtual screen 508. can be displayed. Note that what is displayed on the virtual screen 508 is not limited to this, and as shown in FIG. 9, images of past races, exhibition races, and the like can be displayed.

Further, when a predetermined operation such as tapping a predicted ranking is performed in the race prediction field 802, a predicted race based on the predicted ranking may be displayed. Further, when a predetermined operation such as the image icon 802a is performed, the ranking predictions displayed in the popular prediction field 802 may be changed to those of other tipsters.

A race information column 803 shows information on the race shown on the display 132 . In the example of FIG. 9, the race information column 803 indicates "No. 1 Boat Race Course 3R". This indicates that the racecourse object 501, each moving object 502, the computer prediction field 801, the people prediction field 802, etc. displayed on the display 132 correspond to the third race of the first boat race track. .

FIG. 11 is a schematic diagram showing an example of a display screen, and is another example of a method of displaying computer-predicted information. For example, in response to a predetermined operation input in the state shown in FIG. 9, the state transitions to the state shown in FIG. Although the computer prediction column 801 and the human prediction column 802 are not displayed in the example of FIG. 11, they may remain displayed.

A computer prediction field 1001 shown in FIG. 11 is displayed based on computer prediction information for two or more races. The computer prediction column 1001 includes computer prediction columns 1001a-1001d. In the computer prediction column 1001a, the accuracy of the ranking prediction included in the computer prediction information for the fourth race of the first boat race track is 90%, and the odds if the ranking prediction is correct are 1.3 times. It is shown. The computer prediction field 1001a shows the grade of the race, environment information (weather information), and deadline for purchase of betting tickets. The computer prediction field 1001a may further display a rank prediction corresponding to the indicated probability.

In the computer prediction column 1001b, the accuracy of the ranking prediction included in the computer prediction information for the fourth race at the third boat race track is 80%, and the odds if the ranking prediction is correct are 1.8 times. It is shown. In addition, the same kind of information as the computer prediction column 1001a is shown.

Similarly, the computer prediction field 1001c indicates that the accuracy of the ranking prediction included in the computer prediction information for the fifth race at the first racecourse is 70%. Further, the computer prediction column 1001d indicates that the accuracy of the ranking prediction included in the computer prediction information for the 11th race at the second boat race track is 70%. The month mark in the computer prediction column 1001d indicates that the race is held at night.

As described above, the computer prediction field 1001 shows part of the computer prediction information for multiple races with different venues and different types of races. The order of display in the computer prediction column 1001 is determined based on, for example, the accuracy of each of the predicted rankings and/or the start time of each race. The order of display in the computer prediction field 1001 may be determined based on criteria selected by the user from criteria such as accuracy, start time, odds, and expected value.

Further, when the user performs an operation input to select any one of the computer prediction fields 1001a to 1001d, the race track may be virtually moved to the selected information field. That is, processing may be performed to display the race field object 501 and the moving object 502 corresponding to the race field and the race corresponding to the selected information field. Along with this processing, a computer prediction column 801 and a crowd prediction column 802 corresponding to the race may be displayed.

The above-described embodiments are merely examples for facilitating understanding of the present invention, and are not intended to limit the interpretation of the present invention. It goes without saying that the present invention can be modified and improved without departing from its spirit, and that equivalents thereof are included in the present invention.

[Additional notes]
The contents of the present disclosure are listed below.

(Item 1)
A program executed in a first computer comprising a processor and an imaging unit,
The program causes the processor to:
receiving from a second computer first information about a given race in the real world;
a step of generating a virtual object including a racetrack object representing a racetrack and a moving object representing a contestant or moving object of the predetermined race based on the first information;
superimposing and displaying the virtual object on a real image of the surroundings of the first computer captured by the imaging unit;
The first information includes prediction information indicating a predicted order of the predetermined race,
The displaying step moves the moving object on the racetrack object based on the prediction information, and displays a predicted race in which the predetermined race is virtually displayed according to the predicted ranking. include,
program.
As a result, it is possible to improve the visual expression when providing race predictions to the user.

(Item 2)
In the displaying step, the predicted race is displayed based on the predicted ranking and a preset race pattern.
The program of item 1.
As a result, it is possible to make the predicted race less likely to cause a sense of incongruity, and to make the predicted race more lively with a natural race development. In addition, since it is not necessary to generate individual race developments for each race based on development predictions, etc., the first computer and the processing load on the first computer can be reduced.

(Item 3)
The ranking prediction is a prediction up to a predetermined ranking,
In the displaying step, the display of the predicted race is terminated when the order of finish is determined up to the predetermined rank in the predicted race.
A program according to item 1 or item 2.
As a result, even if the predicted races are predicted up to a predetermined rank, the displayed predicted races are less likely to cause a sense of incongruity. Specifically, it is less likely that a moving object with a high possibility of finishing at the bottom will finish as runner-up in a predetermined ranking.

(Item 4)
The prediction information includes accuracy information indicating the accuracy of the ranking prediction,
the displaying step further includes displaying the likelihood along with the rank prediction;
The program according to any one of items 1 to 3.
This makes it easier for the user to decide whether or not to purchase the voting ticket as indicated by the ranking prediction, and as a result, the user's satisfaction can be improved.

(Item 5)
The prediction information includes a plurality of ranking predictions regarding the predetermined race,
The step of displaying includes displaying the plurality of rank predictions in an order according to the respective probabilities of the plurality of rank predictions.
A program according to item 4.
As a result, the user can confirm in descending order of accuracy, and as a result, user satisfaction can be improved.

(Item 6)
The prediction information further includes a plurality of ranking predictions regarding one or more other races different from the predetermined race,
The displaying step includes displaying the plurality of ranking predictions in an order determined based on the accuracy of each of the plurality of ranking predictions and/or the start time of each race,
A program according to item 4 or item 5.
This enables the user to check the predicted rankings for a plurality of races at once, thereby improving the user's satisfaction.

(Item 7)
In the displaying step, the predicted race to be displayed is determined based on the degree of certainty, or the predicted race to be displayed is determined based on an operation input by the user of the first computer;
A program according to any one of items 4 to 6.
As a result, the user can see the predicted race that he/she wants to see, or can watch the predicted races in descending order of accuracy. As a result, user satisfaction can be improved.

(Item 8)
The forecast information includes information about other races held in the past and information indicating the ranking forecast calculated by the second computer or other computer based on the race conditions in the predetermined race.
The program according to any one of items 1 to 7.
This improves the accuracy of the prediction information, so it is possible to provide users with high-quality prediction races.

(Item 9)
The prediction information includes information indicating a human-predicted ranking prediction obtained by the second computer device,
The prediction information further includes audio information generated from the voice uttered by the person and/or moving image information of a moving image of the person,
The program further causes the processor to:
executing a step of playing back the audio and/or the video in response to an operation input by the user of the first computer;
The program according to any one of items 1 to 8.
As a result, it is possible to provide the user with prediction information different from the computer prediction, and as a result, it is possible to improve the user's satisfaction.

(Item 10)
An information processing method executed in a first computer having a processor and an imaging unit,
The information processing method includes:
receiving from a second computer first information about a given race in the real world;
a step of generating a virtual object including a racetrack object representing a racetrack and a moving object representing a contestant or moving object of the predetermined race based on the first information;
superimposing and displaying the virtual object on a real image of the surroundings of the first computer captured by the imaging unit;
The first information includes prediction information indicating a predicted order of the predetermined race,
The displaying step moves the moving object on the racetrack object based on the prediction information, and displays a predicted race in which the predetermined race is virtually displayed according to the predicted ranking. include,
Information processing methods.
As a result, it is possible to improve the visual expression when providing race predictions to the user.

(Item 11)
An information processing device comprising a processor and an imaging unit,
The processor
receiving first information from a second computer regarding a given race in the real world;
generating a virtual object including a racetrack object representing a racetrack and a moving object representing a contestant or moving object of the predetermined race based on the first information;
The virtual object is superimposed and displayed on a real image of the surroundings of the information processing device captured by the imaging unit,
The first information includes prediction information indicating a predicted order of the predetermined race,
The superimposed display includes moving the moving object on the racetrack object based on the prediction information, and displaying a prediction race in which the predetermined race is virtually displayed according to the ranking prediction. including to
Information processing equipment.
As a result, it is possible to improve the visual expression when providing race predictions to the user.

(Item 12)
A system that includes a first computer that includes a first processor and an imaging device, and a second computer that includes a second processor and is communicatively connectable to the first computer,
The second processor
obtaining first information about a given race in the real world;
transmitting the first information to the first computer;
The first processor
receiving the first information from a second computer;
generating a virtual object including a racetrack object representing a racetrack and a moving object representing a contestant or moving object of the predetermined race based on the first information;
The virtual object is superimposed and displayed on a real image of the surroundings of the first computer captured by the imaging device,
The first information includes prediction information indicating a predicted order of the predetermined race,
The superimposed display includes moving the moving object on the racetrack object based on the prediction information, and displaying a prediction race in which the predetermined race is virtually displayed according to the ranking prediction. including to
system.
As a result, it is possible to improve the visual expression when providing race predictions to the user.

1: System, 10: User Terminal, 20: First Server Device, 30: Network, 40: Second Server Device, 130: Touch Screen, 150: Storage Unit (of User Terminal), 190: Control (of User Terminal) Unit 250: Storage unit (of the first server device) 290: Control unit (of the first server device)

Claims (11)

A program running on a computer ,
The program causes the computer to :
receiving means for receiving first information about a given race in the real world;
generation means for generating a virtual object including a racetrack object representing a racetrack and a moving object representing a participant or moving object of the predetermined race based on the first information;
function as display means for displaying an image containing the virtual object;
The first information includes prediction information indicating a predicted order of the predetermined race,
The display means moves the moving object on the racetrack object based on the prediction information, and displays a predicted race in which the predetermined race is virtually displayed according to the predicted ranking .
program. The display means displays the predicted race based on the predicted ranking and a preset race pattern.
A program according to claim 1. The ranking prediction is a prediction up to a predetermined ranking,
The display means terminates the display of the predicted race when the order of finish is determined up to the predetermined rank in the predicted race.
3. The program according to claim 1 or 2. The prediction information includes accuracy information indicating the accuracy of the ranking prediction,
The display means further displays the probability together with the ranking prediction.
A program according to any one of claims 1 to 3. The prediction information includes a plurality of ranking predictions regarding the predetermined race,
The display means displays the plurality of ranking predictions in an order according to the accuracy of each of the plurality of ranking predictions .
5. A program according to claim 4. The prediction information further includes a plurality of ranking predictions regarding one or more other races different from the predetermined race,
The display means displays the plurality of ranking predictions in an order determined based on the accuracy of each of the plurality of ranking predictions and/or the start time of each race .
6. The program according to claim 4 or 5. The display means determines the predicted race to be displayed based on the degree of certainty, or determines the predicted race to be displayed based on an operation input by the user of the computer ;
A program according to any one of claims 4 to 6. The forecast information includes information about other races held in the past and information indicating the ranking forecast calculated by a computer other than the computer based on the race conditions in the predetermined race.
A program according to any one of claims 1 to 7. The prediction information includes information indicating a human-predicted ranking prediction obtained by a computer other than the computer,
The prediction information further includes audio information generated from the voice uttered by the person and/or moving image information of a moving image of the person,
The program further causes the computer to :
functioning as playback means for playing back the audio and/or the moving image in response to an operation input by the user of the first computer;
A program according to any one of claims 1 to 8. An information processing device comprising a processor,
The processor
receiving first information about a given race in the real world;
generating a virtual object including a racetrack object representing a racetrack and a moving object representing a contestant or moving object of the predetermined race based on the first information;
displaying an image containing the virtual object;
The first information includes prediction information indicating a predicted order of the predetermined race,
Displaying the image moves the moving object on the racetrack object based on the prediction information, and displays a prediction race in which the predetermined race is virtually displayed according to the ranking prediction. including
Information processing equipment. A system comprising a first computer comprising a first processor and a second computer comprising a second processor and communicatively connectable with the first computer,
The second processor
obtaining first information about a given race in the real world;
transmitting the first information to the first computer;
The first processor
receiving the first information from a second computer;
generating a virtual object including a racetrack object representing a racetrack and a moving object representing a contestant or moving object of the predetermined race based on the first information;
displaying an image containing the virtual object;
The first information includes prediction information indicating a predicted order of the predetermined race,
Displaying the image moves the moving object on the racetrack object based on the prediction information, and displays a prediction race in which the predetermined race is virtually displayed according to the ranking prediction. including
system.

Images