JP2022080645A - Program, information processing method, information processing device and system - Google Patents

Abstract

To improve visual expression when providing users with a racing prediction.SOLUTION: A program to be executed in a first computer causes a processor to execute the steps of: receiving first information relating to a prescribed race in an actual world from a second computer; generating virtual objects including a racetrack object representing a racetrack and moving objects representing contestants or moving objects of a prescribed race based on the first information; and displaying the virtual objects superimposed on the actual images captured by an imaging section. The first information includes prediction information representing prediction of ranking of the prescribed race. The steps to be displayed include: moving the moving objects on the racetrack object based on the prediction information; and displaying a prediction race virtually displaying the prescribed race so as to meet the ranking prediction.SELECTED DRAWING: Figure 8

Description

The present disclosure relates to programs, information processing methods, information processing devices, and systems.

Patent Documents 1 and 2 disclose a technique for reproducing AR (Augmented Reality) content and VR (Virtual Reality) content on a terminal.

Japanese Unexamined Patent Publication No. 2019-87180 Japanese Patent Publication No. 2020-13236

By the way, in the real world, various races such as boat races and horse races are carried out, and race predictions related to these races are provided by computers and tipsters on newspapers and the web. However, the race forecasts provided there merely indicate the ranking forecasts and forecast developments in text, and there was room for improvement from the viewpoint of visual expression. It should be noted that Patent Documents 1 and 2 do not show the viewpoint of improving the visual expression when providing the race prediction, and do not disclose any means for solving the problem.

One aspect of the present disclosure is intended to improve visual representation in providing a race prediction to a user.

According to one embodiment presented in the present disclosure.
A program executed in a first computer equipped with a processor and an image pickup unit.
The program is attached to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object including a race field object representing a race field and a moving object representing a contestant or a moving body of the predetermined race based on the first information.
The step of superimposing the virtual object on the real image around the first computer captured by the imaging unit and displaying the virtual object is executed.
The first information includes forecast information indicating the ranking forecast of the predetermined race.
The display step is to move the moving object on the race field object based on the prediction information, and display a predicted race in which the predetermined race is virtually displayed so as to be in line with the ranking prediction. include,
The program is offered.

According to one embodiment presented in the present disclosure, it is possible to improve the visual expression in providing the race prediction to the user.

It is a figure which shows the configuration example of the system which follows a certain embodiment. It is a block diagram which shows an example of the functional configuration of the user terminal according to a certain embodiment. It is a block diagram which shows an example of the functional configuration of the server according to a certain embodiment. It is a flowchart which shows an example of the display control processing according to a certain embodiment. It is a schematic diagram which shows an example of the real image which was taken by the image pickup part according to a certain embodiment. It is a schematic diagram which shows an example of the screen which superposed virtual object on the real image which follows a certain embodiment. It is a schematic diagram which shows an example of the screen which superposed virtual object on the real image which follows a certain embodiment. It is a flowchart which shows an example of the prediction display processing according to a certain embodiment. It is a schematic diagram which shows an example of the display screen according to a certain embodiment. It is a schematic diagram which shows an example of the race pattern according to a certain embodiment. It is a schematic diagram which shows an example of the display screen according to a certain embodiment.

Hereinafter, embodiments of this technical idea will be described in detail with reference to the drawings. In the following description, the same elements are designated by the same reference numerals, and duplicate description will be omitted as appropriate. In one or more embodiments shown in the present disclosure, the elements included in each embodiment may be combined with each other, and the combined result shall also form part of the embodiments shown in the present disclosure.

(System configuration)
FIG. 1 is a diagram showing a configuration of a system 1 according to the present embodiment. The system 1 can display, for example, a prediction of a predetermined race to be performed in the real world as a virtual race using a virtual object on an information processing device used by a user. In the present specification, the "predetermined race" is not particularly limited as long as it is a race carried out in the real world, and for example, a boat race (actual race or exhibition race), horse racing, bicycle racing, auto racing, etc. Car races such as F1, drone races, dog races, marathons, ekiden, etc. can be mentioned.

As shown in FIG. 1, the system 1 is a user such as a user terminal 10A, a user terminal 10B, and a user terminal 10C (hereinafter, user terminals 10A, 10B, 10C) which are information processing devices (first computers) used by each user. It includes a plurality of user terminals 10 such as (generally referred to as "user terminal 10"), a first server device (second computer) 20, a second server device 40, and a network 30.

The user terminal 10A and the user terminal 10B are connected to the network 30 by communicating with the radio base station 31. The user terminal 10C connects to the network 30 by communicating with a wireless router 32 installed in a facility such as a house. The user terminal 10 is, for example, a portable terminal provided with a touch screen, and may be a smartphone, a phablet, a tablet, or the like.

The user terminal 10 executes, for example, a program installed via a platform for distributing an application or the like, or a program including pre-installed website browsing software. The user terminal 10 communicates with the first server device 20 by executing the above program, and transmits / receives data related to a predetermined race, data related to the user, and the like to / from the first server device 20. It is possible to display a virtual race based on a race prediction (hereinafter, also referred to as a “prediction race”) on the terminal 10.

The first server device 20 receives data related to a predetermined race from the second server device 40. The first server device 20 appropriately transmits data related to a predetermined race to the user terminal 10. The first server device 20 stores and manages data related to a predetermined race and data related to each user.

The first server device 20 includes a communication IF (Interface) 22, an input / output IF 23, a memory 25, a storage 26, and a processor (second processor) 29 as a hardware configuration, and these provide a communication bus. They are connected to each other via.

The communication IF 22 supports various communication standards such as a LAN (Local Area Network) standard, and functions as an interface for transmitting and receiving data to and from a user terminal 10 and a second server device 40.

The input / output IF 23 functions as an interface for accepting input of information to the first server device 20 and outputting information to the outside of the first server device 20. The input / output IF 23 may include an input receiving unit that accepts the connection of an information input device such as a mouse and a keyboard, and an output unit that accepts the connection of an information output device such as a display for displaying an image or the like.

The memory 25 is a storage device for storing data or the like used for processing. The memory 25 provides the processor 29 with a work area for temporary use, for example, when the processor 29 performs processing. The memory 25 includes a storage device such as a ROM (Read Only Memory) and a RAM (Random Access Memory).

The storage 26 is a storage device for storing various programs and data for the processor 29 to read and execute. The information stored in the storage 26 includes data related to a predetermined race, data related to each user, and the like. The storage 26 may be configured to include a storage device such as an HDD (Hard Disk Drive) and a flash memory. The storage is not limited to the form included in the server device, and cloud services can also be used.

The processor 29 controls the operation of the first server device 20 by reading and executing a program or the like stored in the storage 26. The processor 29 may be configured to include, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), and the like.

The second server device 40 stores and manages data related to a predetermined race. The second server device 40 is, for example, a server device managed by a predetermined race organizer or a server device managed by an organization (such as a publisher of a race magazine) that transmits information about a predetermined race to the outside. The second server device 40 appropriately transmits data related to a predetermined race to the first server device 20. In certain aspects, the second server device 40 may transmit data related to a predetermined race to the user terminal 10. The hardware configuration of the second server device 40 may be the same as that of the first server device 20 as long as there is no contradiction.

(User terminal)
FIG. 2 is a block diagram showing an example of the functional configuration of the user terminal 10. As shown in FIG. 2, the user terminal 10 includes an antenna 110, a wireless communication IF 120, a touch screen 130, an input / output IF 140, a storage unit 150, a voice processing unit 160, a microphone 161 and a speaker 162. It includes an image pickup unit 170 and a control unit (first processor) 190.

The antenna 110 radiates a signal emitted by the user terminal 10 into space as a radio wave. Further, the antenna 110 receives radio waves from the space and gives a received signal to the wireless communication IF 120.

Since the user terminal 10 communicates with other communication devices, the wireless communication IF 120 performs modulation / demodulation processing for transmitting / receiving signals via the antenna 110 or the like. The wireless communication IF 120 is a communication module for wireless communication including a tuner, a high frequency circuit, etc., performs modulation / demodulation and frequency conversion of the wireless signal transmitted / received by the user terminal 10, and supplies the received signal to the control unit 190.

The touch screen 130 receives input from the user and outputs information to the user on the display 132. The touch screen 130 includes a touch panel 131 for receiving user operation input and a display 132. The touch panel 131 detects that a user's finger or the like has approached by using, for example, a capacitance type touch panel. The display 132 is realized by, for example, an LCD (Liquid Crystal Display), an organic EL (electroluminescence), or other display device.

The input / output IF 140 functions as an interface for accepting input of information to the user terminal 10 and outputting information to the outside of the user terminal 10.

The storage unit 150 is composed of a flash memory, an HDD, or the like, and stores a program used by the user terminal 10 and various data received by the user terminal 10 from the first server device 20 or the like.

The voice processing unit 160 performs modulation / demodulation of the voice signal. The voice processing unit 160 modulates the signal given from the microphone 161 and gives the modulated signal to the control unit 190. Further, the voice processing unit 160 gives a voice signal to the speaker 162. The voice processing unit 160 is realized by, for example, a processor for voice processing. The microphone 161 functions as an audio input unit for receiving an input of an audio signal and outputting it to the control unit 190. The speaker 162 functions as an audio output unit for outputting an audio signal to the outside of the user terminal 10.

The image pickup unit 170 is a camera that captures a real image around the user terminal 10. The image captured by the image pickup unit 170 is image-processed by the control unit 190 and output to the display 132.

The control unit 190 controls the operation of the user terminal 10 by reading and executing a program stored in the storage unit 150. The control unit 190 is realized by, for example, an application processor.

The process of executing the application program 151 by the control unit 190 will be described in more detail. The storage unit 150 stores the application program 151, the application information 152, and the user information 153.

For example, the user terminal 10 downloads the application program 151 from the first server device 20 and stores it in the storage unit 150. Further, the user terminal 10 communicates with the first server device 20 to send and receive various data such as application information 152 and user information 153 to and from the first server device 20.

The application program 151 is a program for displaying the predicted race on the user terminal 10. The application information 152 includes various data referred to by the application program 151. The application information 152 includes the first information 152A.

The first information 152A includes information regarding a predetermined race transmitted from the first server device 20 and the second server device 40. The first information 152A includes, for example, forecast information indicating the ranking forecast of a contestant or a moving body (hereinafter, also referred to as “participant or the like”) of a predetermined race.

The forecast information may include a plurality of ranking forecasts for one race. In addition, the forecast information may include ranking forecasts for a plurality of races. In addition, the forecast information may include ranking forecasts for each race held at a plurality of race fields. Here, the plurality of race fields may be race fields where the same competition is carried out (for example, boat race fields in different places), or race fields where different competitions are carried out (for example, boat race fields). It may be a field and a racetrack).

The forecast information includes, for example, computer forecast information calculated by a computer device. The computer forecast information is, for example, the first server device 20, the second server device 40, or the user terminal 10 based on past data which is information about other races held in the past and race conditions in a predetermined race. Includes the ranking forecast calculated by. The calculation of the ranking prediction may be performed by, for example, a machine learning model using a neural network.

The past data includes, for example, information on the results of the participants such as the ranking and time of the participants in the past race (which may include information on the exhibition race, training, test run, etc.), and when the past race is carried out. Includes environmental information (eg, weather, temperature, wind power, wind direction, wave height, information on riding ground and road conditions, etc.) and other information that can be used as a reference for race predictions (based on past events). sell.

The race conditions include information such as the location of the race, course form, race distance, information on each contestant in the race (for example, frame order, handicap, weight, equipment, etc.), the environment assumed at the time of the race, It may contain information that can be used as a reference for other race forecasts (those related to that race).

Further, the forecast information may include, for example, person forecast information predicted by a human being (for example, a reporter, a predictor, etc.). The human forecast information is forecast information input by a human and is transmitted from the first server device 20 or the second server device 40 to the user terminal 10. The human prediction information may include voice information generated from the voice emitted by the person who made the prediction, and / or moving image information of a moving image of the person.

Further, it is preferable that the prediction information includes, for example, accuracy information indicating the accuracy of the ranking prediction. Accuracy indicates the possibility that the ranking prediction will be correct. The accuracy may be indicated by a specific numerical value such as 0 to 100%, or may be indicated by a predetermined rank (for example, A rank, B rank, C rank, etc. in descending order of possibility). May be good. The accuracy of the computer forecast information can be calculated by the computer that calculated it. The accuracy of human prediction information can be determined by the person who predicted it. If the forecast information includes a plurality of rank forecasts, the forecast information may include accuracy information for each rank forecast.

The forecast information may include a deployment forecast that anticipates the development of the race. The development forecast may include, for example, a ranking forecast in a predetermined section such as the early stage, the middle stage, and the final stage of the race. The ranking prediction may be a prediction of all rankings from the first place to the lowest rank, a prediction of up to a predetermined rank (for example, up to the rank to be bet), a certain contestant, etc. May be expected to be within a predetermined rank (for example, within the third rank).

In addition, in this specification, "participant" is a concept including not only human beings but also animals such as horses and dogs. Further, the "moving body" is a main body of movement in a predetermined race, and is an animal or an aircraft on which a participant rides, an aircraft remotely controlled by a contestant, or the like. In marathons, dog races, etc., "participants" and "moving bodies" are the same.

The first information 152A may include, for example, past data, information on race conditions, and the like, in addition to the forecast information. Specifically, the first information 152A includes a predetermined race name, race conditions, date and time, race field data, contestant data, moving object data, odds information, race start table, information immediately before the race, pit report, etc. It may include race results, race videos, race stills, other past race information, and other information that may be published in information magazines or information sites about a given race.

The user information 153 includes information about the user of the user terminal 10. The user information 153 includes, for example, information for identifying a user, location information of a user terminal 10, a race purchase history and a hit rate of a user (for example, a history of a boat ticket purchased in the case of a boat race, and a boat ticket purchased. Hit rate) and the like may be included.

By reading and executing the application program 151, the control unit 190 includes an operation input reception unit 191, a transmission / reception unit 192, an object generation unit 193, a display control unit 194, a detection unit 195, and a playback unit 196. Demonstrate each function of.

The operation input receiving unit 191 accepts the user's operation input based on the output of the touch screen 130. Specifically, the operation input receiving unit 191 detects that the user's finger or the like touches or approaches the touch panel 131 as the coordinates of the coordinate system consisting of the horizontal axis and the vertical axis of the surface constituting the touch screen 130.

The operation input receiving unit 191 determines the user's operation on the touch screen 130. The operation input reception unit 191 is, for example, "approach operation", "release operation", "tap operation", "double tap operation", "long press operation (long touch operation)", "drag operation (swipe operation)", Determine the user's operation such as "move operation", "flick operation", "pinch-in operation", and "pinch-out operation".

The operation input receiving unit 191 may accept the movement of the user terminal 10 detected by the acceleration sensor or the like mounted on the user terminal 10 as an operation input.

The transmission / reception unit 192 transmits and receives various information to and from external communication devices such as the first server device 20 and the second server device 40 via the wireless communication IF 120 and the network 30. The transmission / reception unit 192 receives, for example, the first information 152A from the first server device 20 or the second server device 40. Further, the transmission / reception unit 192 transmits, for example, information corresponding to the operation input received by the operation input reception unit 191 and information stored in the user information 153 to the first server device 20 or the second server device 40. ..

The object generation unit 193 generates a virtual object for presenting the second information about a predetermined race to the user based on the first information. In the present specification, the "second information" is, for example, at least a part of the first information 152A or information calculated from the first information 152A. In a certain aspect, the "second information" can be information that can be presented as text. In a certain aspect, the "second information" can be a text indicating a ranking prediction or its accuracy.

The object generation unit 193 generates, as virtual objects, a race field object representing a race field and a moving object representing a contestant or the like. The object generation unit 193 may generate a virtual display board for displaying the second information as text. In addition to the above objects, the object generation unit 193 also creates a virtual screen for displaying the second information as an image, various building objects, landscape objects such as trees, objects that serve as user avatars, and the like. May be generated.

The display control unit 194 superimposes an image (hereinafter, also referred to as “superimposed image”) on which a virtual object generated by the object generation unit 193 is superimposed on a real image around the user terminal 10 imaged by the image pickup unit 70. It is displayed on the display 132. The display control unit 194 moves the moving object on the race field object based on the prediction information included in the first information 152A, and displays the predicted race on the display 132.

The predicted race is a virtual display of a predetermined race so as to be in line with the ranking prediction. It is preferable that the display control unit 194 displays the predicted race based on the ranking prediction and the preset race pattern. The race pattern will be described in detail in a later paragraph. When the forecast information includes the deployment forecast, the display control unit 194 may control the display of the predicted race based on the ranking forecast and the deployment forecast. Further, the display control unit 194 may end the display of the predicted race in response to the determination of the finish order up to the predetermined order in the predicted race.

When there are a plurality of ranking predictions, the display control unit 194 determines the prediction race to be displayed, for example, based on the high accuracy of the ranking prediction or based on the operation input by the user.

It is preferable that the display control unit 194 can change the viewpoint in the superimposed image according to the operation input received by the operation input reception unit 191. The display control unit 194 displays various menu screens and GUIs (Graphical User Interfaces) on the display 132, and changes the display contents of the display 132, in response to the operation input received by the operation input reception unit 191.

The display control unit 194 displays, for example, the rank prediction included in the prediction information on the display 132. In this case, it is preferable to display the accuracy together with the ranking prediction. Further, when displaying a plurality of ranking predictions for one race, it is preferable to display the plurality of ranking predictions in an order according to the accuracy of each. Further, when displaying a plurality of ranking predictions for a plurality of races, it is preferable to display them in an order determined based on the accuracy of each of the plurality of ranking predictions and / or the start time of each race.

The detection unit 195 detects a flat surface in the real image captured by the image pickup unit 170. The detection of a flat surface is realized by a conventionally known image recognition technique. For example, when the user performs an operation of selecting a flat surface detected by the detection unit 195, a superimposed image in which the race field object is arranged on the flat surface is displayed on the display 132.

The flat surface is preferably a horizontal surface. Further, the angle formed by the flat surface and the bottom surface constituting the race field object may be 0 degrees, but is preferably an acute angle, and can be, for example, in the range of 15 degrees to 45 degrees. The above angle may be adjusted by accepting a user's operation. Also, even if there is a convex part on a part of the flat surface in the real world, or if there is an object on the flat surface, if the convex part or the object is of a size that can be hidden by the race track object. , The place where the race field object can be placed may be detected as a flat surface.

The reproduction unit 196 reproduces the audio and / or the moving image based on the audio information and / or the moving image information included in the human forecast information. The audio and / or moving image is, for example, an explanation or explanation of a race prediction by a person who made a prediction.

(1st server device)
FIG. 3 is a block diagram showing a functional configuration of the first server device 20. A detailed configuration of the first server device 20 will be described with reference to FIG. The first server device 20 exerts functions as a communication unit 220, a storage unit 250, and a control unit 290 by operating according to a program.

The communication unit 220 functions as an interface for the first server device 20 to communicate with an external communication device such as the user terminal 10 or the second server device 40 via the network 30.

The storage unit 250 stores various programs and data for realizing the system 1. In a certain aspect, the storage unit 250 stores the program 251 and the race information 252 and the user information 253.

The program 251 is a program for the first server device 20 to communicate with the user terminal 10 and the second server device 40 to realize the system 1. The program 251 is executed by the control unit 290 to send and receive data to and from the user terminal 10 and the second server device 40, a process according to the operation content performed by the user of the user terminal 10, race information 252, and the user. The first server device 20 is made to perform a process of updating the information 253 and the like.

Race information 252 contains various data related to a given race. The race information 252 includes, for example, the first information 252A. The first information 252A is the source information of the first information 152A, and the first information 152A can be a part of the first information 252A. The first information 252A is, for example, information acquired from the second server device 40, or information calculated by the first server device 20 based on the information. That is, the first information 252A may include forecast information, information on other races conducted in the past, information on race conditions in a predetermined race, and the like.

The user information 253 is information about the user of the user terminal 10. The user information 253 includes a user management table 253A. The user management table 253A stores, for example, information for identifying the user, position information of the user terminal 10, a race purchase history of the user, a hit rate, and the like for each user.

The control unit 290 is realized by the processor 29, and by executing the program 251, functions as a transmission / reception unit 291, a first information acquisition unit 292, a data management unit 293, and a timing unit 294.

The transmission / reception unit 291 transmits and receives various information to and from an external communication device such as a user terminal 10 and a second server device 40 via the communication unit 220 and the network 30. The transmission / reception unit 291 transmits, for example, at least a part of the first information 252A to the user terminal 10. Further, the transmission / reception unit 291 receives, for example, the first information 252A from the second server device 40.

The first information acquisition unit 292 acquires the first information 252A from the second server device 40 via the transmission / reception unit 291. The first information acquisition unit 292 can calculate computer prediction information based on the information acquired from the second server device 40. The data management unit 293 performs a process of updating various data stored in the storage unit 250 according to the processing result of the first information acquisition unit 292 and the like. The timekeeping unit 294 performs a process of measuring the time. Various times displayed on the user terminal 10 (for example, the time until the start of the race) can be controlled based on the time measured by the time measuring unit 294.

(Operation example)
Next, an operation example in the system 1 will be described with reference to FIGS. 4 to 11. In the following, the case where the predetermined race is a boat race will be mainly described as an example, but the following description can be applied even if the predetermined race is another race. Further, in the following description, it is assumed that data is transmitted / received between the user terminal 10 and the first server device 20 and between the first server device 20 and the second server device 40, but in a certain aspect, the user The terminal 10 and the second server device 40 may be configured to directly transmit and receive data.

FIG. 4 is a flowchart showing an example of the display control process. The order of the processes constituting the flowchart (including FIG. 8) described below is in no particular order as long as the processing contents do not have any contradiction or inconsistency, and may be executed in parallel. Further, the processing executed by each device may be executed by another device within a range that does not cause a contradiction.

The processes shown in FIGS. 4 and 8 are realized by the control unit 190 executing the application program 151 and the control unit 290 executing the program 251. First, in step S610, the control unit 190 activates the image pickup unit 170, which is a camera. The image pickup unit 170 captures a real image around the user terminal 10.

In step S620, the control unit 190 detects a flat surface in the image captured by the image pickup unit 170. In step S630, the control unit 190 arranges the virtual object on the detected flat surface.

Here, the processes of steps S610, S620, and S630 will be specifically described with reference to FIGS. 5 to 7. FIG. 5 is a schematic diagram showing an example of a real image captured by the imaging unit 170. In the example of FIG. 5, a keyboard 702 and a monitoring device 703 are placed on a flat desk 701.

When the image pickup unit 170 is activated in step S610, the real image captured by the image pickup unit 170 is displayed on the display 132. Next, in step S620, the control unit 190 detects a flat surface in the image captured by the image pickup unit 170, that is, in the image displayed on the display 132.

In FIG. 5, the region 704 is detected as a flat surface. There is a keyboard 702 in the area 704, but since the keyboard 702 is small enough to be hidden by the race field object 501, the control unit 190 detects the area 704 as a flat surface.

If the position imaged by the imaging unit 170 is changed in the state shown in FIG. 5, the position of the region 704 can also be changed. The area 704 is displayed on the display 132 so as to be distinguishable from other parts, for example, by adding a predetermined color. When the user executes a tap operation or the like on the area 704, in step S630, the control unit 190 arranges a virtual object such as a race field object 501 on the area 704.

FIG. 6 is a schematic diagram showing an example of a screen in which a virtual object is superimposed on a real image and displayed. In FIG. 6, the area with the dot pattern including the monitor device 703 is the real image, and the other area is the area where the virtual object is displayed. For example, an advertisement image may be displayed in an area where the virtual object is not displayed.

In FIG. 6, the race field object 501, the plurality of moving objects 502, the two turnmark objects 503, the large monitor object 506, the building objects 507a to 507b, and other reference numerals are not attached as virtual objects. A large number of objects (tree objects, clock objects, etc.) and are displayed. These objects are created, for example, based on the first information 152A received from the first server device 20.

In FIG. 6, the race field object 501 is arranged on the area 704 so that the angle formed by the flat surface included in the area 704 and the bottom surface constituting the race field object 501 is 0 degree. In this case, for example, an area in the depth direction such as the area X1 or moving objects 502 may overlap each other and become difficult to see. Further, in the area on the depth direction side of the large monitor object 506 or the like, a blind spot may occur in which the moving object 502 cannot be seen.

However, in the state shown in FIG. 6, the user can change the viewpoint of the superimposed image displayed on the display 132. For example, when the user inputs an operation such as a pinch-in operation or a pinch-out operation, the viewpoint position of the image pickup unit 170 may move toward or away from the race field object 501. Further, even when the user moves in the depth direction of the display 132 while holding the user terminal 10 or moves in the front direction, the viewpoint position of the image pickup unit 170 may move toward or away from the race field object 501. Further, when the user performs an operation such as designating a predetermined position on the display 132, the viewpoint position can be moved to the designated position. By such a viewpoint change, the above-mentioned visibility problem can be solved.

FIG. 7 is a schematic diagram showing an example of a screen in which a virtual object is superimposed on a real image, and shows another aspect of the race field object 501 shown in FIG. Specifically, FIG. 7 is an example in which a predetermined race is horse racing.

Also in FIG. 7, the area with the dot pattern including the monitor device 703 is the real image, and the other area is the area where the virtual object is displayed. In FIG. 7, as virtual objects, a race field object 511, a plurality of moving objects 512, a large monitor object 513, a pond object 514, and a plurality of tree objects 515 are displayed on the display 132. These objects are also created, for example, based on the first information 152A received from the first server device 20.

The racetrack object 511, the large monitor object 513, the pond object 514, and the plurality of tree objects 515 are preferably created based on racetrack data such as, for example, course information of a predetermined racetrack in the real world. The plurality of moving objects 512 are, for example, objects that virtually display horses and jockeys running in horse racing.

Returning to the description of the flowchart of FIG. In step S640, the control unit 190 executes the prediction display process and ends a series of display control processes in response to receiving an operation input for terminating the application program 151.

Here, the prediction display process of step S640 will be described in detail with reference to FIG. FIG. 8 is a flowchart showing an example of the prediction display process. First, in step S641, the control unit 190 acquires past data, information on race conditions, or computer prediction information from the first server device 20. The computer forecast information referred to here includes a ranking forecast calculated by the first server device 20 based on at least past data and race conditions.

Next, if the information acquired in step S641 does not include the necessary computer prediction information, the control unit 190 generates computer prediction information in step S642. The generation of computer forecast information in step S642 can be done at least based on historical data and race conditions.

Next, in step S643, the control unit 190 displays the computer prediction information on the display 132. In step S643, at least one prediction order included in the computer prediction information is displayed in a predetermined area of the display 132. Further, in step S643, information such as the accuracy of the expected ranking and the odds may be further displayed.

Next, when there is a request to display the predicted race in step S644 (Yes in step S644), in step S645, the control unit 190 displays the predicted race on the display 132. Specifically, the control unit 190 virtually displays the predicted race by moving each moving object 502 on the race field object 501 so as to be in line with the ranking prediction. If there is no display request for the predicted race in step S644 (No in step S644), the process of step S645 is not executed.

The display request for the predicted race in step S644 may be made, for example, in response to the user inputting an operation for displaying the predicted race, or in response to the acquisition of the predicted information.

Further, when a plurality of predicted ranks are displayed in step S643, the predicted race displayed in step S645 may be determined according to the user's choice, or may be determined according to a predetermined rule (for example, in descending order of accuracy). It may be decided based on. Further, when the display of one predicted race is completed, the display of the next predicted race may be automatically started based on a predetermined rule.

The processes of steps S641 to S645 described above are forecast display processes related to computer forecast information. S646 to S649 described below are forecast display processes related to human forecast information. Each process of S641 to S645 and each process of S646 to S649 can be executed in parallel.

First, in step S646, the control unit 190 acquires input data and the like of a tipster from the first server device 20. That is, in step S646, the control unit 190 acquires the human forecast information. In the present embodiment, the human prediction information includes, in addition to the ranking prediction, the voice information of the person who made the prediction and the moving image information of the person.

Next, in step S647, the control unit 190 displays the human prediction information on the display 132. In step S647, at least one prediction order included in the person prediction information is displayed in a predetermined area of the display 132.

Next, when there is a request for reproduction of audio and moving image in step S648 (Yes in step S648), the control unit 190 reproduces audio and moving image in step S649. Specifically, in step S649, the moving image is displayed in a predetermined area of the display 132, and the sound is output from the speaker 162. In step S648, only the sound may be reproduced.

Next, each process of steps S643 to S645 and steps S647 to S649 will be described in more detail with reference to FIGS. 9 to 11. FIG. 9 is a schematic diagram showing an example of a display screen according to the present embodiment.

In FIG. 9, the display 132 has a virtual screen 508, a computer prediction column 801 and a person prediction, in addition to the virtual objects already described such as the race field object 501 and the moving object 502 (including 502a, 502b, etc.). A column 802 and a race information column 803 are displayed.

In the computer prediction column 801, a plurality of prediction ranks included in the computer prediction information and their accuracy are displayed in the recommended order. In the example of FIG. 9, the predicted ranking is a prediction of the ranking from the 1st place to the 3rd place (so-called trifecta single type), but is not limited to this. The expected order may correspond to a type such as a so-called win-win type, double-win type, consecutive-win single-type, or consecutive-win double-type. The computer prediction column 801 may include different types of prediction rankings, or may indicate prediction rankings corresponding to only one type determined according to a user's operation or the like.

In the example of FIG. 9, the accuracy is shown by the rank of ABC in descending order, but the accuracy is not limited to this. The accuracy may be indicated by a specific numerical value such as "X%". Further, in the example of FIG. 9, the recommended order is, but is not limited to, the order of high accuracy. The recommended order may be in descending order of odds, in descending order of expected value that can be calculated based on accuracy and odds, or based on other criteria. Further, the display order of the expected order may be determined based on the criteria selected by the user from the criteria such as accuracy, odds, and expected value.

In the example of FIG. 9, when the operation input for displaying the predicted race is made by the user, the predicted race is displayed on the race field object 501. For example, when the user presses a virtual button (not shown) for displaying the predicted races, the predicted races may be displayed in the recommended order. Further, for example, when an operation of selecting one of the predicted ranks shown in the computer prediction column 801 is performed, the predicted race may be displayed based on the selected predicted rank.

The display of the predicted race is made by moving each moving object 502 on the racefield object 501. Predictive races will be developed in line with the ranking forecast. In the example of FIG. 9, when the predicted ranking with the recommended order of 1 is selected, the final ranking of the predicted race is the contestants with 1st place in 1st place, 2nd place in 3rd place, 3rd place in 4th place, and the like.

If the forecast information includes a deployment forecast, the race deployment in the forecast race may be based on the deployment forecast. On the other hand, the race development in the predicted race may be based on a preset race pattern.

FIG. 10 is a schematic diagram showing an example of a race pattern. FIG. 10 is a bird's-eye view of a scene in which each moving object 502 passes near a virtual line S indicating a lap or a goal line G indicating a goal in a race. This is an example in which the first place in the expected order is the moving object 502a, the second place is the moving object 502b, and the third place is the moving object 502c. The arrows in FIG. 10 indicate the traveling direction of each moving object 502. That is, each moving object 502 travels from the left to the right of the paper.

FIG. 10A shows the race development on the first lap. In FIG. 10A, each moving object 502 is in a close battle without any clear superiority or inferiority. FIG. 10B shows the race development on the second lap. In FIG. 10B, the moving object 502a is at the head, but the other moving objects 502c to 502f are in a close battle without any clear superiority or inferiority.

FIG. 10 (c) shows the race development from the early stage to the middle stage of the third lap. In FIG. 10 (c), the moving objects 502a keep the head, the moving objects 502b and 502c are in a close battle for the second place, and the moving objects 502d to 502f are far behind the moving objects 502b and 502c.

FIG. 10D shows the race development at the end of the third lap. FIG. 10D shows a state in which the moving object 502a passes through the goal line G at the head, the moving object 502b passes through the goal line G in the second place, and the moving object 502c reaches the goal line G in the third place. Shows. For example, the moving objects 502b and 502c move to the vicinity of the goal line G while maintaining a close battle, and the superiority or inferiority is determined near the goal line G.

Further, in FIG. 10D, when the 3rd place is confirmed in the predicted race, the area 901 on the left side of the goal line G including the moving objects 502d to 502f which have not yet reached the goal is grayed out, and the ranking after the 4th place is achieved. Is not displayed. The area to be grayed out is not particularly limited and may be the entire area of the race field object 501. The predicted race may be displayed until all the moving objects 502 pass the goal line without graying out.

The race pattern is not limited to the example of FIG. 10, and may be appropriately set by the administrator or the like of the first server device 20. There may be a plurality of race patterns, and the race pattern used for the predicted race may be determined according to the race conditions and the like. Further, the race pattern may be set according to the type of race. For example, in a race such as a boat race, which is more advantageous toward the beginning, it is preferable to use a race pattern as shown in FIG. In addition, if there is information (for example, leg quality or line) that can be assumed for each contestant to be positioned during the race, such as horse racing or bicycle racing, the race pattern may be determined based on the information. ..

Returning to the description of FIG. In the person prediction column 802, one or more prediction ranks included in the person prediction information are displayed. In the example of FIG. 9, the race reporter is a tipster, and the buying eye predicted by the race reporter is shown in the person prediction column 802.

Further, in the person prediction column 802, an image icon 802a of a tipster is shown. In the example of FIG. 9, when an operation input for displaying a tipster's voice and video (for example, tapping the image icon 802a) is performed by the user, the voice is output from the speaker 162 and the video is displayed on the virtual screen 508. Can be displayed. It should be noted that what is displayed on the virtual screen 508 is not limited to this, and as shown in FIG. 9, images of past races, images of exhibition races, and the like can be displayed.

Further, when a predetermined operation such as tapping the ranking prediction in the person prediction column 802 is performed, the predicted race based on the ranking prediction may be displayed. Further, when a predetermined operation such as the image icon 802a is performed, the ranking prediction or the like displayed in the person prediction column 802 may be changed to that of another predictor.

The race information column 803 shows race information shown on the display 132. In the example of FIG. 9, "1st racecourse 3R" is shown in the race information column 803. This indicates that the race field object 501, each moving object 502, the computer prediction column 801 and the person prediction column 802 displayed on the display 132 correspond to the third race of the first racecourse. ..

FIG. 11 is a schematic diagram showing an example of a display screen, and is another example of a method of displaying computer prediction information. For example, in response to a predetermined operation input in the state shown in FIG. 9, the state transitions to the state shown in FIG. In the example of FIG. 11, the computer prediction column 801 and the person prediction column 802 are hidden, but they may be left displayed.

The computer prediction column 1001 shown in FIG. 11 is displayed based on the computer prediction information for two or more races. The computer prediction column 1001 includes computer prediction columns 1001a to 1001d. In the computer prediction column 1001a, the accuracy of the ranking prediction included in the computer prediction information in the 4th race of the 1st racecourse is 90%, and the odds when the ranking prediction is correct are 1.3 times. It is shown. Further, in the computer prediction column 1001a, the grade of the race, environmental information (weather information), and the deadline for purchasing voting tickets are shown. In the computer prediction column 1001a, a ranking prediction corresponding to the indicated accuracy may be further displayed.

In the computer prediction column 1001b, the accuracy of the ranking prediction included in the computer prediction information in the 4th race of the 3rd racecourse is 80%, and the odds when the ranking prediction is correct are 1.8 times. It is shown. In addition, the same kind of information as the computer prediction column 1001a is shown.

Similarly, in the computer prediction column 1001c, it is shown that the accuracy of the ranking prediction included in the computer prediction information in the fifth race of the first racetrack is 70%. Further, in the computer prediction column 1001d, it is shown that the accuracy of the ranking prediction included in the computer prediction information in the 11th race of the 2nd racecourse is 70%. The month mark in the computer prediction column 1001d indicates that the race is held at night.

As described above, the computer prediction column 1001 shows a part of computer prediction information for a plurality of races having different venues and race types. The display order in the computer prediction column 1001 is determined, for example, based on the accuracy of each ranking prediction and / or the start time of each race. Further, the display order in the computer prediction column 1001 may be determined based on the criteria selected by the user from the criteria such as accuracy, start time, odds, and expected value.

Further, when the user inputs an operation to select any of the computer prediction fields 1001a to 1001d, the user may virtually move to the race track corresponding to the selected information field. That is, the process of displaying the race field object 501 and the moving object 502 corresponding to the race field and the race corresponding to the selected information field may be performed. Further, along with this process, the computer prediction column 801 and the person prediction column 802 corresponding to the race may be displayed.

The above embodiments are merely examples for facilitating the understanding of the present invention, and are not intended to limit the interpretation of the present invention. It goes without saying that the present invention can be modified and improved without departing from the spirit thereof, and the present invention includes its equivalents.

[Additional notes]
The contents of this disclosure are listed below.

(Item 1)
A program executed in a first computer equipped with a processor and an image pickup unit.
The program is attached to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object including a race field object representing a race field and a moving object representing a contestant or a moving body of the predetermined race based on the first information.
The step of superimposing the virtual object on the real image around the first computer captured by the imaging unit and displaying the virtual object is executed.
The first information includes forecast information indicating the ranking forecast of the predetermined race.
The display step is to move the moving object on the race field object based on the prediction information, and display a predicted race in which the predetermined race is virtually displayed so as to be in line with the ranking prediction. include,
program.
This can improve the visual representation when providing the race prediction to the user.

(Item 2)
In the display step, the predicted race is displayed based on the ranking prediction and the preset race pattern.
The program described in item 1.
As a result, the displayed predicted race will not feel uncomfortable, and it will be possible to liven up the predicted race with a natural race development. Further, since it is not necessary to generate an individual race development for each race based on the development prediction and the like, the processing load on the first computer and the first computer can be reduced.

(Item 3)
The above-mentioned ranking forecast is a forecast up to a predetermined rank, and is
In the step to be displayed, the display of the predicted race is terminated according to the fact that the finish order is determined up to the predetermined order in the predicted race.
The program according to item 1 or item 2.
As a result, even if the ranking prediction predicts up to a predetermined ranking, the displayed predicted race is less likely to cause a sense of discomfort. Specifically, it is less likely that a moving object, which is likely to be at the bottom, will reach the next goal in a predetermined order.

(Item 4)
The forecast information includes accuracy information indicating the accuracy of the ranking forecast.
The display step further comprises displaying the accuracy along with the ranking prediction.
The program according to any one of items 1 to 3.
This makes it easier for the user to determine whether or not to purchase the voting ticket as shown in the ranking forecast, and as a result, the user's satisfaction level can be improved.

(Item 5)
The forecast information includes a plurality of ranking forecasts for the predetermined race.
The display step comprises displaying the plurality of ranking predictions in an order corresponding to the accuracy of each of the plurality of ranking predictions.
The program described in item 4.
As a result, the user can confirm in descending order of accuracy, and as a result, the satisfaction level of the user can be improved.

(Item 6)
The forecast information further includes a plurality of ranking forecasts for one or more other races different from the predetermined race.
The display step comprises displaying the plurality of ranking predictions in an order determined based on the accuracy of each of the plurality of ranking predictions and / or the start time of each race.
The program according to item 4 or item 5.
As a result, the user can confirm the ranking predictions for a plurality of races at once, and as a result, the satisfaction of the user can be improved.

(Item 7)
In the display step, the predicted race to be displayed is determined based on the high accuracy, or the predicted race to be displayed is determined based on the operation input by the user of the first computer.
The program according to any one of items 4 to 6.
As a result, the user can see the predicted races he / she wants to see, or can see the predicted races in descending order of accuracy, and as a result, the user's satisfaction can be improved.

(Item 8)
The forecast information includes information about other races held in the past and a ranking forecast calculated by the second computer or another computer based on the race conditions in the predetermined race.
The program according to any one of items 1 to 7.
This improves the accuracy of the prediction information and makes it possible to provide the user with a high quality prediction race.

(Item 9)
The forecast information includes a human-predicted ranking forecast acquired by the second computer device.
The expected information further includes voice information generated from the voice emitted by the human and / or moving image information of a moving image of the human.
The program is applied to the processor and further to the processor.
In response to the operation input of the user of the first computer, the step of playing the voice and / or the moving image is executed.
The program according to any one of items 1 to 8.
As a result, it is possible to provide the user with forecast information different from the computer forecast, and as a result, the user's satisfaction can be improved.

(Item 10)
An information processing method executed in a first computer equipped with a processor and an image pickup unit.
The information processing method is applied to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object including a race field object representing a race field and a moving object representing a contestant or a moving body of the predetermined race based on the first information.
The step of superimposing and displaying the virtual object on the real image around the first computer captured by the imaging unit is included.
The first information includes forecast information indicating the ranking forecast of the predetermined race.
The display step is to move the moving object on the race field object based on the prediction information, and display a predicted race in which the predetermined race is virtually displayed so as to be in line with the ranking prediction. include,
Information processing method.
This can improve the visual representation when providing the race prediction to the user.

(Item 11)
An information processing device equipped with a processor and an image pickup unit.
The processor
Receive the first information about a given race in the real world from the second computer,
Based on the first information, a virtual object including a race field object representing a race field and a moving object representing a contestant or a moving body of the predetermined race is generated.
The virtual object is superimposed and displayed on a real image around the information processing apparatus captured by the image pickup unit.
The first information includes forecast information indicating the ranking forecast of the predetermined race.
The superimposed display displays a predicted race in which the moving object is moved on the race field object based on the predicted information and the predetermined race is virtually displayed so as to be in line with the ranking prediction. Including doing,
Information processing equipment.
This can improve the visual representation when providing the race prediction to the user.

(Item 12)
There is a system including a first computer provided with a first processor and an image pickup apparatus, and a second computer provided with a second processor and capable of communicating with the first computer.
The second processor is
Get the first information about a given race in the real world,
The first information is transmitted to the first computer, and the first information is transmitted to the first computer.
The first processor is
The first information is received from the second computer,
Based on the first information, a virtual object including a race field object representing a race field and a moving object representing a contestant or a moving body of the predetermined race is generated.
The virtual object is superimposed and displayed on a real image around the first computer captured by the image pickup device.
The first information includes forecast information indicating the ranking forecast of the predetermined race.
The superimposed display displays a predicted race in which the moving object is moved on the race field object based on the predicted information and the predetermined race is virtually displayed so as to be in line with the ranking prediction. Including doing,
system.
This can improve the visual representation when providing the race prediction to the user.

1: System, 10: User terminal, 20: First server device, 30: Network, 40: Second server device, 130: Touch screen, 150: Storage unit (of user terminal), 190: Control (of user terminal) Unit, 250: Storage unit (of the first server device), 290: Control unit (of the first server device)

Claims (12)

A program executed in a first computer equipped with a processor and an image pickup unit.
The program is attached to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object including a race field object representing a race field and a moving object representing a contestant or a moving body of the predetermined race based on the first information.
The step of superimposing the virtual object on the real image around the first computer captured by the imaging unit and displaying the virtual object is executed.
The first information includes forecast information indicating the ranking forecast of the predetermined race.
The display step is to move the moving object on the race field object based on the prediction information, and display a predicted race in which the predetermined race is virtually displayed so as to be in line with the ranking prediction. include,
program. In the display step, the predicted race is displayed based on the ranking prediction and the preset race pattern.
The program according to claim 1. The above-mentioned ranking forecast is a forecast up to a predetermined rank, and is
In the step to be displayed, the display of the predicted race is terminated according to the fact that the finish order is determined up to the predetermined order in the predicted race.
The program according to claim 1 or 2. The forecast information includes accuracy information indicating the accuracy of the ranking forecast.
The display step further comprises displaying the accuracy along with the ranking prediction.
The program according to any one of claims 1 to 3. The forecast information includes a plurality of ranking forecasts for the predetermined race.
The display step comprises displaying the plurality of ranking predictions in an order corresponding to the accuracy of each of the plurality of ranking predictions.
The program according to claim 4. The forecast information further includes a plurality of ranking forecasts for one or more other races different from the predetermined race.
The display step comprises displaying the plurality of ranking predictions in an order determined based on the accuracy of each of the plurality of ranking predictions and / or the start time of each race.
The program according to claim 4 or 5. In the display step, the predicted race to be displayed is determined based on the high accuracy, or the predicted race to be displayed is determined based on the operation input by the user of the first computer.
The program according to any one of claims 4 to 6. The forecast information includes information about other races held in the past and a ranking forecast calculated by the second computer or another computer based on the race conditions in the predetermined race.
The program according to any one of claims 1 to 7. The forecast information includes a human-predicted ranking forecast acquired by the second computer device.
The expected information further includes voice information generated from the voice emitted by the human and / or moving image information of a moving image of the human.
The program is applied to the processor and further to the processor.
In response to the operation input of the user of the first computer, the step of playing the voice and / or the moving image is executed.
The program according to any one of claims 1 to 8. An information processing method executed in a first computer equipped with a processor and an image pickup unit.
The information processing method is applied to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object including a race field object representing a race field and a moving object representing a contestant or a moving body of the predetermined race based on the first information.
The step of superimposing and displaying the virtual object on the real image around the first computer captured by the imaging unit is included.
The first information includes forecast information indicating the ranking forecast of the predetermined race.
The display step is to move the moving object on the race field object based on the prediction information, and display a predicted race in which the predetermined race is virtually displayed so as to be in line with the ranking prediction. include,
Information processing method. An information processing device equipped with a processor and an image pickup unit.
The processor
Receive the first information about a given race in the real world from the second computer,
Based on the first information, a virtual object including a race field object representing a race field and a moving object representing a contestant or a moving body of the predetermined race is generated.
The virtual object is superimposed and displayed on a real image around the information processing apparatus captured by the image pickup unit.
The first information includes forecast information indicating the ranking forecast of the predetermined race.
The superimposed display displays a predicted race in which the moving object is moved on the race field object based on the predicted information and the predetermined race is virtually displayed so as to be in line with the ranking prediction. Including doing,
Information processing equipment. There is a system including a first computer provided with a first processor and an image pickup apparatus, and a second computer provided with a second processor and capable of communicating with the first computer.
The second processor is
Get the first information about a given race in the real world,
The first information is transmitted to the first computer, and the first information is transmitted to the first computer.
The first processor is
The first information is received from the second computer,
Based on the first information, a virtual object including a race field object representing a race field and a moving object representing a contestant or a moving body of the predetermined race is generated.
The virtual object is superimposed and displayed on a real image around the first computer captured by the image pickup device.
The first information includes forecast information indicating the ranking forecast of the predetermined race.
The superimposed display displays a predicted race in which the moving object is moved on the race field object based on the predicted information and the predetermined race is virtually displayed so as to be in line with the ranking prediction. Including doing,
system.

Images