JP6934547B1 - Programs, information processing methods, information processing devices, and systems - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make it easy to distinguish each moving object for a moving object corresponding to a race participant or a moving object in the real world. A program executed on a first computer provides a processor with a step of receiving first information about a real-world race from a second computer and a virtual object for presenting a second information about the race to a user. , A step of generating based on the first information and a step of superimposing and displaying a virtual object on the real image captured by the imaging unit are executed. In the step of including at least the contestants of the race and / or the contestants regarding the moving object as the first information, and at least the moving objects 502a and 502b corresponding to the contestants or the moving objects as virtual objects, in the step of displaying. At least a part of the contestant information is displayed in association with the moving objects 502a and 502b. [Selection diagram] FIG. 9

Description

The present disclosure relates to programs, information processing methods, information processing devices, and systems.

Patent Documents 1 and 2 disclose a technique relating to AR (Augmented Reality).

Japanese Unexamined Patent Publication No. 2020-58658 Japanese Unexamined Patent Publication No. 2020-77187

By the way, in the real world, various races such as boat races and horse races are carried out, but there is a problem that it is difficult for beginners to know where the contestants they support are in the race track.

The techniques disclosed in Patent Documents 1 and 2 superimpose and display a virtual object unrelated to the real world on an image in the real world, and do not present any means for solving the above problem.

One aspect of the present disclosure is to make it easier to identify each moving object for a moving object corresponding to a race participant or a moving object in the real world.

According to one embodiment presented in the present disclosure.
A program that is executed in a first computer equipped with a processor and an imaging unit.
The program is delivered to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object for presenting the second information about the predetermined race to the user of the first computer based on the first information, and
The step of superimposing the virtual object on the real image around the first computer captured by the imaging unit and displaying the virtual object is executed.
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
In the display step, at least a part of the contestant information is displayed in association with the moving object.
The program is provided.

According to one embodiment shown in the present disclosure, it is possible to easily identify each moving object for a moving object corresponding to a race participant or a moving object in the real world.

It is a figure which shows the configuration example of the system which follows a certain embodiment. It is a block diagram which shows an example of the functional structure of the user terminal according to a certain embodiment. It is a block diagram which shows an example of the functional configuration of the server according to a certain embodiment. It is a schematic diagram which shows an example of the race track of the real world according to a certain embodiment. It is a schematic diagram which shows an example of the virtual object displayed on the user terminal according to a certain embodiment. It is a flowchart which shows an example of the display control processing according to a certain embodiment. It is a schematic diagram which shows an example of the real image which was imaged by the imaging unit according to a certain embodiment. It is a schematic diagram which shows an example of the screen which superposed the virtual object on the real image according to a certain embodiment and displayed. It is a schematic diagram which shows an example of the display method of the contestant information according to a certain embodiment. It is a schematic diagram which shows an example of the display method of the detailed contestant information according to a certain embodiment. It is a schematic diagram which shows another example of the display method of the detailed contestant information according to a certain embodiment. It is a schematic diagram which shows another example of the display method of the detailed contestant information according to a certain embodiment. It is a schematic diagram which shows an example of the display method of the contestant information in the virtual race according to a certain embodiment. It is a schematic diagram which shows another example of the display method of the contestant information in the virtual race according to a certain embodiment.

Hereinafter, embodiments of this technical idea will be described in detail with reference to the drawings. In the following description, the same elements are designated by the same reference numerals, and duplicate description will be omitted as appropriate. In one or more embodiments set forth in the present disclosure, the elements included in each embodiment may be combined with each other, and the combined deliverables shall also form part of the embodiments set forth in the present disclosure.

(System configuration)
FIG. 1 is a diagram showing a configuration of a system 1 according to the present embodiment. The system 1 can display, for example, a predetermined race to be performed in the real world as a virtual race using a virtual object on an information processing device used by a user. In the present specification, the "predetermined race" is not particularly limited as long as it is a race carried out in the real world, and for example, a boat race (actual race or exhibition race), a horse race, a bicycle race, an auto race, etc. Car races such as F1, drone races, dog races, marathons, ekiden, etc. can be mentioned.

As shown in FIG. 1, the system 1 is a user such as a user terminal 10A, a user terminal 10B, and a user terminal 10C (hereinafter, user terminals 10A, 10B, 10C) which are information processing devices (first computers) used by each user. A plurality of user terminals 10 such as "terminals are also collectively referred to as" user terminals 10 "), a first server device (second computer) 20, a second server device 40, and a network 30 are included.

The user terminal 10A and the user terminal 10B are connected to the network 30 by communicating with the wireless base station 31. The user terminal 10C connects to the network 30 by communicating with the wireless router 32 installed in a facility such as a house. The user terminal 10 is, for example, a portable terminal provided with a touch screen, and may be a smartphone, a phablet, a tablet, or the like.

The user terminal 10 executes, for example, a program installed via a platform for distributing an application or the like, or a program including pre-installed website browsing software. The user terminal 10 communicates with the first server device 20 by executing the above program, and transmits / receives data related to a predetermined race, data related to the user, and the like to / from the first server device 20. It is possible to display a virtual race on the terminal 10.

The first server device 20 receives data related to a predetermined race from the second server device 40. The first server device 20 appropriately transmits data related to a predetermined race to the user terminal 10. The first server device 20 stores and manages data related to a predetermined race and data related to each user.

The first server device 20 includes a communication IF (Interface) 22, an input / output IF 23, a memory 25, a storage 26, and a processor (second processor) 29 as a hardware configuration, and these provide a communication bus. They are connected to each other via.

The communication IF 22 supports various communication standards such as a LAN (Local Area Network) standard, and functions as an interface for transmitting and receiving data to and from the user terminal 10 and the second server device 40.

The input / output IF 23 functions as an interface for accepting input of information to the first server device 20 and outputting information to the outside of the first server device 20. The input / output IF 23 may include an input receiving unit that accepts the connection of an information input device such as a mouse and a keyboard, and an output unit that accepts the connection of an information output device such as a display for displaying an image or the like.

The memory 25 is a storage device for storing data or the like used for processing. The memory 25 provides the processor 29 with a work area for temporary use, for example, when the processor 29 performs processing. The memory 25 includes a storage device such as a ROM (Read Only Memory) and a RAM (Random Access Memory).

The storage 26 is a storage device for storing various programs and data for the processor 29 to read and execute. The information stored in the storage 26 includes data related to a predetermined race, data related to each user, and the like. The storage 26 may be configured to include a storage device such as an HDD (Hard Disk Drive) or a flash memory. The storage is not limited to the form included in the server device, and a cloud service can also be used.

The processor 29 controls the operation of the first server device 20 by reading and executing a program or the like stored in the storage 26. The processor 29 may be configured to include, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), and the like.

The second server device 40 stores and manages data related to a predetermined race. The second server device 40 is, for example, a server device managed by a predetermined race organizer or a server device managed by an organization (such as a publisher of a race magazine) that transmits information on a predetermined race to the outside. The second server device 40 appropriately transmits data related to a predetermined race to the first server device 20. In certain aspects, the second server device 40 may transmit data related to a predetermined race to the user terminal 10. The hardware configuration of the second server device 40 may be the same as that of the first server device 20 as long as there is no contradiction.

(User terminal)
FIG. 2 is a block diagram showing an example of the functional configuration of the user terminal 10. As shown in FIG. 2, the user terminal 10 includes an antenna 110, a wireless communication IF 120, a touch screen 130, an input / output IF 140, a storage unit 150, a voice processing unit 160, a microphone 161 and a speaker 162. The image pickup unit 170 and the control unit (first processor) 190 are included.

The antenna 110 radiates a signal emitted by the user terminal 10 into space as a radio wave. Further, the antenna 110 receives radio waves from the space and gives a received signal to the wireless communication IF 120.

Since the user terminal 10 communicates with other communication devices, the wireless communication IF 120 performs modulation / demodulation processing for transmitting / receiving signals via the antenna 110 or the like. The wireless communication IF 120 is a communication module for wireless communication including a tuner, a high frequency circuit, etc., performs modulation / demodulation and frequency conversion of the wireless signal transmitted / received by the user terminal 10, and supplies the received signal to the control unit 190.

The touch screen 130 receives input from the user and outputs information to the user on the display 132. The touch screen 130 includes a touch panel 131 for receiving user operation input and a display 132. The touch panel 131 detects that a user's finger or the like has approached, for example, by using a capacitance type touch panel. The display 132 is realized by, for example, an LCD (Liquid Crystal Display), an organic EL (electroluminescence), or other display device.

The input / output IF 140 functions as an interface for accepting input of information to the user terminal 10 and outputting information to the outside of the user terminal 10.

The storage unit 150 is composed of a flash memory, an HDD, and the like, and stores a program used by the user terminal 10 and various data and the like received by the user terminal 10 from the first server device 20 and the like.

The audio processing unit 160 performs modulation / demodulation of the audio signal. The voice processing unit 160 modulates the signal given from the microphone 161 and gives the modulated signal to the control unit 190. Further, the voice processing unit 160 gives a voice signal to the speaker 162. The voice processing unit 160 is realized by, for example, a processor for voice processing. The microphone 161 functions as an audio input unit for receiving an input of an audio signal and outputting it to the control unit 190. The speaker 162 functions as an audio output unit for outputting an audio signal to the outside of the user terminal 10.

The imaging unit 170 is a camera that captures a real image of the surroundings of the user terminal 10. The image captured by the imaging unit 170 is image-processed by the control unit 190 and output to the display 132.

The control unit 190 controls the operation of the user terminal 10 by reading and executing the program stored in the storage unit 150. The control unit 190 is realized by, for example, an application processor.

The process in which the control unit 190 executes the application program 151 will be described in more detail. The storage unit 150 stores the application program 151, the application information 152, and the user information 153.

For example, the user terminal 10 downloads the application program 151 from the first server device 20 and stores it in the storage unit 150. Further, the user terminal 10 transmits and receives various data such as application information 152 and user information 153 to and from the first server device 20 by communicating with the first server device 20.

The application program 151 is a program for displaying a virtual race on the user terminal 10. The application information 152 includes various data referred to by the application program 151. The application information 152 includes the first information 152A.

The first information 152A is information regarding a predetermined race transmitted from the first server device 20 and the second server device 40. The first information 152A includes, for example, at least contestant information regarding a contestant in a predetermined race and / or a moving body (hereinafter, also referred to as “participant or the like”). The contestant information includes, for example, the names and names of the contestants, the popularity ranking and odds information of the contestants in a predetermined race, and the past race results of the contestants.

As used herein, the term "participant" is a concept that includes not only humans but also animals such as horses and dogs. Further, the "moving body" is a main body of movement in a predetermined race, and is an animal or an airframe on which a participant rides, an aircraft remotely controlled by a contestant, or the like. In marathons, dog races, etc., "participants" and "moving bodies" are the same.

In addition to the above, the first information 152A includes, for example, race time information indicating the race time of the contestants, position information of the contestants during the execution of a predetermined race, and time information corresponding to the position information. Can be included.

The first information 152A includes, for example, a predetermined race name, date and time, race field data, contestant data other than the above, moving object data, odds information, race forecast, race start table, race immediately before information, pit. It may include reports, race results, race videos, race stills, past race information, and other information that may be published in information magazines or information sites about a given race.

The user information 153 includes information about the user of the user terminal 10. The user information 153 includes, for example, information for identifying the user, position information of the user terminal 10, race purchase history and hit rate of the user (for example, in the case of boat race, the history of the purchased boat ticket and the purchased boat ticket. Hit rate) and the like may be included.

By reading and executing the application program 151, the control unit 190 reads and executes the operation input reception unit 191 and the transmission / reception unit 192, the object generation unit 193, the display control unit 194, the detection unit 195, and the selection information acquisition unit 196. And, each function is demonstrated.

The operation input receiving unit 191 receives the user's operation input based on the output of the touch screen 130. Specifically, the operation input receiving unit 191 detects that the user's finger or the like touches or approaches the touch panel 131 as the coordinates of the coordinate system including the horizontal axis and the vertical axis of the surface constituting the touch screen 130.

The operation input reception unit 191 determines the user's operation on the touch screen 130. The operation input reception unit 191 is, for example, "approach operation", "release operation", "tap operation", "double tap operation", "long press operation (long touch operation)", "drag operation (swipe operation)", Determine user operations such as "move operation", "flick operation", "pinch-in operation", and "pinch-out operation".

The operation input receiving unit 191 may accept the movement of the user terminal 10 detected by the acceleration sensor or the like mounted on the user terminal 10 as the operation input.

The transmission / reception unit 192 transmits and receives various information with external communication devices such as the first server device 20 and the second server device 40 via the wireless communication IF 120 and the network 30. The transmission / reception unit 192 receives the first information 152A from, for example, the first server device 20 or the second server device 40. Further, the transmission / reception unit 192 transmits, for example, information corresponding to the operation input received by the operation input reception unit 191 and information stored in the user information 153 to the first server device 20 or the second server device 40. ..

The object generation unit 193 generates a virtual object for presenting the second information regarding a predetermined race to the user based on the first information. In the present specification, the "second information" is, for example, at least a part of the first information 152A or information calculated from the first information 152A. In some aspects, the "second information" can be information that can be presented as text. In a certain aspect, the "second information" may be ranking information indicating the ranking of the contestants or the like during a predetermined race or the ranking of the contestants or the like as a result of the race.

The object generation unit 193 can generate a race track object representing a race track and a moving object representing a contestant or the like as virtual objects. In addition, the object generation unit 193 generates a text object that presents contestant information as a virtual object.

The object generation unit 193 may generate a virtual display board for displaying the second information as text. In addition to the above objects, the object generation unit 193 includes a virtual screen for displaying the second information as an image, various building objects, landscape objects that compose the landscape such as trees, and objects that serve as user avatars. It may be generated.

The display control unit 194 superimposes an image (hereinafter, also referred to as “superimposed image”) on which a virtual object generated by the object generation unit 193 is superimposed on a real image around the user terminal 10 imaged by the image pickup unit 70. It is displayed on the display 132. The display control unit 194 displays a text object that presents contestant information in association with a moving object.

Further, the display control unit 194 moves a moving object on the race track object based on the race time information included in the first information 152A, and displays a virtual race on the display 132 that virtually reproduces a predetermined race. Display it. It is preferable that the display control unit 194 reproduces the virtual race based on the position information of the contestants and the like included in the first information 152A and the time information corresponding to the position information in addition to the race time information. ..

It is preferable that the display control unit 194 can change the viewpoint in the superimposed image according to the operation input received by the operation input reception unit 191. The display control unit 194 displays various menu screens and GUIs (Graphical User Interfaces) on the display 132, and changes the display contents of the display 132, in response to the operation input received by the operation input reception unit 191.

The detection unit 195 detects a flat surface in the real image captured by the image pickup unit 170. The detection of a flat surface is realized by a conventionally known image recognition technique. For example, when the user performs an operation of selecting the flat surface detected by the detection unit 195, the superimposed image in which the race track object is arranged on the flat surface is displayed on the display 132.

The flat surface is preferably a horizontal surface. Further, the angle formed by the flat surface and the bottom surface forming the race track object may be 0 degrees, but is preferably an acute angle, and can be, for example, in the range of 15 degrees to 45 degrees. The angle may be adjusted by accepting a user's operation. Also, even if there is a convex part on a part of the flat surface in the real world, or if there is an object on the flat surface, if the convex part or the object is of a size that can be hidden by the race track object. , The racetrack object may be detected as a flat surface where it can be placed.

The selection information acquisition unit 196 acquires one or more selection information indicating one or more contestants selected by the user. The "selection information" is, for example, information indicating a contestant or the like predicted by the user as a winner or the like of a predetermined race. When the predetermined race is a boat race or a horse race, the "selection information" may be information indicating a boat ticket or a betting ticket purchased by the user.

The selection information acquisition unit 196 acquires selection information based on, for example, a user's operation input on the screen for selecting a contestant or the like. The selection information acquired by the selection information acquisition unit 196 is transmitted to, for example, the first server device 20 or the second server device 40. When the predetermined race is a boat race or a horse race, the purchase process of the boat ticket or the betting ticket can be performed according to the selection information being transmitted to the second server device 40.

(1st server device)
FIG. 3 is a block diagram showing a functional configuration of the first server device 20. A detailed configuration of the first server device 20 will be described with reference to FIG. The first server device 20 exerts functions as a communication unit 220, a storage unit 250, and a control unit 290 by operating according to a program.

The communication unit 220 functions as an interface for the first server device 20 to communicate with an external communication device such as the user terminal 10 or the second server device 40 via the network 30.

The storage unit 250 stores various programs and data for realizing the system 1. In a certain aspect, the storage unit 250 stores the program 251 and the race information 252 and the user information 253.

The program 251 is a program for the first server device 20 to communicate with the user terminal 10 and the second server device 40 to realize the system 1. The program 251 is executed by the control unit 290 to send and receive data to and from the user terminal 10 and the second server device 40, a process according to the operation content performed by the user of the user terminal 10, race information 252, and the user. The first server device 20 is made to perform a process of updating the information 253 and the like.

Race information 252 includes various data related to a given race. The race information 252 includes, for example, the first information 252A. The first information 252A is the source information of the first information 152A, and the first information 152A can be a part of the first information 252A. The first information 252A is, for example, information acquired from the second server device 40.

The user information 253 is information about the user of the user terminal 10. The user information 253 includes a user management table 253A. The user management table 253A stores, for example, information for identifying the user, position information of the user terminal 10, a race purchase history of the user, a hit rate, and the like for each user.

The control unit 290 is realized by the processor 29, and by executing the program 251, functions as a transmission / reception unit 291, a first information acquisition unit 292, a selection information acquisition unit 293, a data management unit 294, and a timekeeping unit 295. ..

The transmission / reception unit 291 transmits and receives various information to and from an external communication device such as a user terminal 10 and a second server device 40 via the communication unit 220 and the network 30. The transmission / reception unit 291 transmits, for example, at least a part of the first information 252A to the user terminal 10. Further, the transmission / reception unit 291 receives, for example, the first information 252A from the second server device 40.

The first information acquisition unit 292 acquires the first information 252A from the second server device 40 via the transmission / reception unit 291. The selection information acquisition unit 293 acquires the user's selection information from the user terminal 10 or the second server device 40 via the transmission / reception unit 291. The data management unit 294 performs a process of updating various data stored in the storage unit 250 according to the processing results of the first information acquisition unit 292, the selection information acquisition unit 293, and the like. The timekeeping unit 295 performs a process of measuring the time. Various times displayed on the user terminal 10 (for example, the time until the start of the race) can be controlled based on the time measured by the time measuring unit 295.

(Operation example)
Next, an operation example in the system 1 will be described with reference to FIGS. 4 to 14. In the following, the case where the predetermined race is a boat race will be described as an example, but the following description can be applied even if the predetermined race is another race. Further, in the following description, it is assumed that data is transmitted / received between the user terminal 10 and the first server device 20 and between the first server device 20 and the second server device 40, but in a certain aspect, the user The terminal 10 and the second server device 40 may be configured to directly send and receive data.

FIG. 4 is a schematic diagram showing an example of a boat race field in the real world. Two turn marks 403 are installed in the boat race field 401, and races are carried out by boats 402a to 402f on which each boat racer rides. When the race is completed, the race time information indicating the race times of the boats 402a to 402f is transmitted from the second server device 40 to the first server device 20, and is transmitted from the first server device 20 to the user terminal 10.

The boat race field 401 is provided with imaging devices (cameras) 404a to 404b. The image pickup apparatus 404a puts the boats 402a to 402f in the field of view from above the boat race field 401. The image pickup apparatus 404b puts the boats 402a to 402f in the field of view from the side of the boat race field 401. The images of the boats 402a to 402f captured by the image pickup devices 404a to 404b are transmitted to the second server device 40. In the second server device 40, for example, image analysis of each image is performed, and position information indicating the position of each of the boats 402a to 402f at the shooting time of each image is calculated. The calculated position information and the time information related to the shooting time corresponding to the position information are transmitted to the first server device 20, and are transmitted from the first server device 20 to the user terminal 10. The location information may be calculated by the first server device 20.

Further, a position sensor such as a GPS sensor may be installed on the boats 402a to 402f instead of or in addition to the image pickup devices 404a to 404b. The position information of the boats 402a to 402f acquired by the position sensor and the time information indicating the time when the position information was acquired are finally transmitted to the user terminal 10.

FIG. 5 is a schematic diagram showing an example of a virtual object displayed on the user terminal 10. In the example of FIG. 5, as virtual objects, a race track object 501, moving objects 502a to 502f (hereinafter collectively referred to as “moving object 502”), two turnmark objects 503, and a virtual display board 505 are used. It is shown.

The race field object 501 is an object that virtually displays the boat race field 401. The race field object 501 and the turn mark object 503 are preferably created based on race field data such as course information of the boat race field 401, and preferably have a shape corresponding to the boat race field 401.

The moving objects 502a to 502f are objects that virtually display the boats 402a to 402f, respectively, and have a shape imitating a boat. The moving objects 502a to 502f move the race field object 501 based on the race time information, the position information of the boats 402a to 402f, and the time information corresponding to the position information. That is, the race track objects 501 and the moving objects 502a to 502f display the real-world race as a virtual race on the user terminal 10.

Even if there is no position information and time information of the boats 402a to 402f, it is possible to display the virtual race only by the race time information. However, in this case, the final order of arrival will be the same as in the real world race, but it is difficult to reproduce the race progress such as the ranking during the race.

The virtual display board 505 is an object that displays text information. The virtual display board 505 is, for example, a corresponding nonexistent object in the boat race field 401. The text information displayed on the virtual display board 505 is not particularly limited, and may be, for example, ranking information, odds information, or the like. Further, the text information displayed on the virtual display board 505 may be changeable based on the operation input of the user.

FIG. 6 is a flowchart showing an example of the display control process. The order of each process constituting the flowchart described below is random as long as there is no contradiction or inconsistency in the process contents. Further, the processing executed by each device may be executed by another device as long as there is no contradiction.

The process shown in FIG. 6 is realized by the control unit 190 executing the application program 151 and the control unit 290 executing the program 251. First, in step S610, the control unit 190 activates the imaging unit 170, which is a camera. The image pickup unit 170 captures a real image of the surroundings of the user terminal 10.

In step S620, the control unit 190 detects a flat surface in the image captured by the imaging unit 170. In step S630, the control unit 190 arranges the virtual object on the detected flat surface.

Here, the processes of steps S610, S620, and S630 will be specifically described with reference to FIGS. 7 and 8. FIG. 7 is a schematic view showing an example of a real image captured by the imaging unit 170. In the example of FIG. 7, a keyboard 702 and a monitoring device 703 are placed on a flat desk 701.

When the imaging unit 170 is activated in step S610, the actual image captured by the imaging unit 170 is displayed on the display 132. Next, in step S620, the control unit 190 detects a flat surface in the image captured by the imaging unit 170, that is, in the image displayed on the display 132.

In FIG. 7, the region 704 is detected as a flat surface. There is a keyboard 702 in the area 704, but since the keyboard 702 is small enough to be hidden by the racetrack object 501, the control unit 190 detects the area 704 as a flat surface.

If the position imaged by the imaging unit 170 is changed in the state shown in FIG. 7, the position of the region 704 can also be changed. The area 704 is displayed on the display 132 so as to be distinguishable from other parts, for example, by adding a predetermined color. When the user executes a tap operation or the like on the area 704, in step S630, the control unit 190 arranges a virtual object such as a racetrack object 501 on the area 704.

FIG. 8 is a schematic diagram showing an example of a screen in which a virtual object is superimposed on a real image and displayed. In FIG. 8, the area with the dot pattern including the monitoring device 703 is the real image, and the other area is the area where the virtual object is displayed. For example, an advertisement image may be displayed in the area where the virtual object is not displayed.

In FIG. 8, the race field object 501, the plurality of moving objects 502, the two turnmark objects 503, the large monitor object 506, the building objects 507a to 507b, and other symbols are not attached as virtual objects. A large number of objects (tree objects, clock objects, etc.) and are displayed. These objects are created, for example, based on the first information 152A received from the first server device 20.

In FIG. 8, the race field object 501 is arranged on the area 704 so that the angle formed by the flat surface included in the area 704 and the bottom surface forming the race field object 501 is 0 degrees. In this case, for example, an area in the depth direction such as the area X1 or moving objects 502 may overlap each other and become difficult to see. Further, in a region on the depth direction side of the large monitor object 506 or the like, a blind spot may occur in which the moving object 502 cannot be seen.

However, in the state shown in FIG. 8, the user can change the viewpoint of the superimposed image displayed on the display 132. For example, when the user inputs an operation such as a pinch-in operation or a pinch-out operation, the viewpoint position of the imaging unit 170 may move closer to or further from the racetrack object 501. Further, when the user moves in the depth direction of the display 132 or moves in the front direction while holding the user terminal 10, the viewpoint position of the imaging unit 170 may move closer to or further away from the race track object 501. Further, when the user performs an operation for designating a predetermined position on the display 132, the viewpoint position can be moved to the designated position. By such a viewpoint change, the above-mentioned problem of visibility can be solved.

Further, by arranging the race field object 501 so that the angle θ formed by the flat surface S1 and the bottom surface S2 forming the race field object 501 is an acute angle, the above-mentioned problem regarding visibility can be alleviated.

Returning to the description of the flowchart of FIG. In step S640, the control unit 290 of the first server device 20 acquires the contestant information from the second server device 40. The control unit 190 acquires the contestant information from the first server device 20. The process of step S640 may be executed at a predetermined frequency or when a specific event occurs. That is, the contestant information can be updated every time the process of step S640 is executed. The specific event is not particularly limited, but for example, when the contestant information is changed (for example, when the odds fluctuate), the start or end of the race, the ranking is confirmed, etc. There are cases.

In step S650, the control unit 190 associates each moving object 502 with the corresponding contestant information. Next, the control unit 190 displays a text object that presents at least a part of the contestant information associated with the moving object 502 around the moving object 502.

In step S670, the control unit 190 associates each moving object 502 with the corresponding contestant information. Next, the control unit 190 displays a text object that presents at least a part of the contestant information associated with the moving object 502 around the moving object 502.

Here, the process of step S670 will be specifically described with reference to FIG. FIG. 9 is a schematic diagram showing an example of a method of displaying contestant information. In FIG. 9, moving objects 502a to 502b are displayed on the racetrack object 501. A text object 512a that presents contestant information corresponding to the moving object 502a is displayed above the moving object 502a.

When the moving object 502a moves, the text object 512a also moves so as to follow the moving object 502a. In a certain aspect, the relative positional relationship between the moving object 502a and the text object 512a does not change. The display position of the text object 512a is not particularly limited as long as it is around the moving object 502a. The moving object 502b and the text object 512b are the same as the moving object 502a and the text object 512a. In addition, in this specification, "around a moving object" may include a range overlapping with a moving object.

In the example of FIG. 9, the text objects 512a to 512b show the frame numbers of the moving objects 502a to 502b, the name of the racer to board, and the odds information. When the contestant information is updated based on the process of step S640, the contestant information displayed in the text objects 512a to 512b is also updated. It is preferable that the contestant information shown in the text objects 512a to 512b can be changed according to the operation input of the user.

Returning to the description of the flowchart of FIG. When the control unit 190 receives the selection operation for the moving object 502 in step S670, the process of step S680 is executed. The selection operation may be performed on a text object.

In step S680, the control unit 190 displays in detail the contestant information corresponding to the moving object 502 for which the selection operation was performed in step S680. Next, when the control unit 190 receives the operation input for ending the detailed display, the detailed display of the contestant information is finished in step S690. After the detail display is completed, the display returns to, for example, step S660. The control unit 190 ends a series of display control processes in response to receiving an operation input for terminating the application program 151.

Here, the process of step S680 will be specifically described with reference to FIGS. 10 to 12. FIG. 10 is a schematic diagram showing an example of a detailed display method of contestant information. FIG. 10 is a screen displayed on the display 132 when, for example, the user performs an operation (for example, a tap operation) to select the moving object 502a in the state of FIG. 9.

In FIG. 10, the detailed information object 520 is displayed around the moving object 502a. The detailed information object 520 includes an image display field 521, a detailed information display field 522, and an end button 523. In the image display field 521, for example, a face image of a racer boarding the moving object 502a is displayed. In the detailed information display column 522, more detailed participant information than the example of FIG. 9 is displayed as text information. The end button 523 is a virtual button for hiding the detailed information object 520. The detailed information object 520 may be hidden by tapping the outside of the detailed information object 520.

FIG. 11 is a schematic diagram showing another example of a detailed display method of contestant information. In the example of FIG. 11, the detailed information object 530 is displayed instead of the detailed information object 520 of FIG. The detailed information object 530 includes an image display field 531, a first detailed information display field 532, a second detailed information display field 533, and a switching button 534. In the image display field 531 for example, a face image of a racer boarding the moving object 502a is displayed. In the first detailed information display column 532, more detailed participant information than the example of FIG. 9 is displayed as text information.

The second detailed information display column 533 is a column for displaying the contestant information in a graph. The information displayed in the second detailed information display field 533 may be a graph of the contestant information obtained as text information by the control unit 190, or has been graphed from the beginning acquired in step S640. It may be contestant information. The switching button 534 is a virtual button for changing the contestant information displayed in the second detailed information display field 533.

FIG. 12 is a schematic diagram showing still another example of a detailed display method of contestant information. In the example of FIG. 12, the detailed information object 540 is displayed instead of the detailed information object 520 of FIG. The detailed information object 540 shown in FIG. 12 includes an image display field 541, a first detailed information display field 542, a second detailed information display field 543, and a third detailed information display field 544.

In the image display field 541, for example, an image of a character created based on a racer boarding a moving object 502a is displayed. Participant information is displayed as text information in the first detailed information display column 542. In the second detailed information display field 543, the status information of the racer boarding the moving object 502a is displayed. The status information is, for example, a virtual status calculated based on past race results and predetermined rules. In the third detailed information display field 544, skill information of the racer boarding the moving object 502a is displayed. Skill information is, for example, a virtual skill derived based on past race results and predetermined rules. In FIG. 12, the skills “popular” and “reversal” are displayed in the third detailed information display column 544. These skills, for example, show in the past race results that they are more popular than other racers and that they have many reverse wins.

Next, a method of displaying the contestant information during the virtual race will be described with reference to FIG. In FIG. 13, in addition to the example of FIG. 8, a virtual display board 505, a virtual screen 508, a purchase information display board 509, and a ranking display board 510 are displayed as virtual objects. It is preferable that these virtual objects can be switched to non-display, the display position can be changed, the display contents can be changed, and the like by the operation input of the user.

On the virtual display board 505, for example, after the end of the virtual race, text information such as the ranks of the moving objects 502a to 502f and the race time can be displayed. Before the start of the race or during the race, other text information such as odds information may be displayed on the virtual display board 505.

An image of a boat race in the real world is displayed on the virtual screen 508. What is displayed on the virtual screen 508 is, for example, a real-time image of the race. Before or after the start or end of the race, the virtual screen 508 may display images of each boat before and after the race, player interview images, race replay images, exhibition race images, and the like. ..

The purchase information display board 509 displays information on the boat ticket purchased by the user acquired by the control unit 190 (selection information acquisition unit 196). On the right side of the purchase information display board 509, purchase information, which is information on the boat ticket purchased by the user, is displayed, and on the left side, the refund amount when each boat ticket hits is displayed.

Further, on the purchase information display board 509, when the current rank in the virtual race and the moving object 502 indicated by the purchase information correspond to each other (for example, when the goal is achieved with the current rank, the boat ticket is correct). Display the corresponding purchase information in a manner different from other purchase information. The current first place in FIG. 13 is the two-frame moving object 502b. Therefore, on the purchase information display board 509, a mark 509a is attached to a column indicating a two-frame win-type boat ticket. A mark 509a is also attached to the upper part of the moving object 502a of the two frames.

If the rankings are changed during the race and the 1st place is provisionally 5 slots and the 2nd place is 4 slots, the mark 509a will be added to the purchase information displayed second and third from the top. Further, a mark 509a is attached on the moving objects 502 of the 5th frame and the 4th frame. In addition, the display in a different mode may have a predetermined mark as described above, the purchase column may be colored with a predetermined color, or may be displayed by another method.

The rank of the moving objects 502a to 502f is displayed on the rank display board 510. During the race, the ranking displayed on the ranking display board 510 may fluctuate based on the position information of the boats 402a to 402f in the real world.

In FIG. 13, a text object 512b indicating participant information is displayed above the moving object 502b. In the example of FIG. 13, the frame number and the racer name are displayed on the text object 512b. It is preferable that the contestant information to be displayed on the text object 512 can be selected by the user. The user can also hide the text object for some moving objects 502.

FIG. 14 is a schematic diagram showing another example of a method of displaying contestant information during a virtual race. In the example of FIG. 14, each of the moving objects 502 is colored according to the frame number. As shown in the lower right frame of FIG. 14, the moving object 502a in one frame is displayed in white, and the moving object 502a in two frames is displayed in black. The display color can be freely changed by the user's operation input.

Further, the text object 512d shows popular information 552a of the race being carried out as a kind of contestant information. The same applies to the text objects 512b and 512c. By presenting popularity information rather than odds information in this way, the user can grasp at a glance which moving object is considered to be strong. The moving object 502a and the like are not attached with popularity information because they are in the lower order of popularity, but they may also be attached with popularity information.

The above embodiments are merely examples for facilitating the understanding of the present invention, and are not intended to limit the interpretation of the present invention. It goes without saying that the present invention can be modified and improved without departing from the spirit thereof, and the present invention includes an equivalent thereof.

[Additional notes]
The contents of this disclosure are listed below.

(Item 1)
A program that is executed in a first computer equipped with a processor and an imaging unit.
The program is delivered to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object for presenting the second information about the predetermined race to the user of the first computer based on the first information, and
The step of superimposing the virtual object on the real image around the first computer captured by the imaging unit and displaying the virtual object is executed.
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
In the display step, at least a part of the contestant information is displayed in association with the moving object.
program.
This makes it easier to identify each moving object for a moving object corresponding to a race participant or a moving object in the real world.

(Item 2)
In the display step, the contestant information is displayed in more detail in association with the moving object in response to the operation input of the user.
The program described in item 1.
As a result, a large amount of information can be provided to the user in response to the request of the user, so that the satisfaction level of the user can be improved.

(Item 3)
The contestant information displayed in the step to be displayed includes at least the odds information of the contestant or the moving body.
The program according to item 1 or item 2.
This allows the user to know which moving object is believed to be strong. Further, since the odds information is usually one of the information that the user is highly interested in, the satisfaction of the user can be improved by displaying the odds information together with the moving object.

(Item 4)
The receiving step is executed at a predetermined frequency or when a specific event occurs, and is executed.
The contestant information can be updated by performing the receiving step.
The program according to any one of items 1 to 3.
As a result, even if the contestant information changes with the passage of time, the changed contestant information can be delivered to the user.

(Item 5)
The program is added to the processor.
The step of acquiring one or more selection information indicating the one or more contestants or the moving body selected by the user is executed.
The first information includes the position information of the contestant or the moving body during the execution of the predetermined race, and the time information corresponding to the position information.
The display step is to move the moving object based on the position information and the time information, and display a virtual race that virtually displays the predetermined race together with at least a part of the selection information. including,
The program according to any one of items 1 to 4.
This makes it possible to display a race in the real world as a virtual race with high reproducibility using a virtual object. Further, since the contestant information is displayed in association with the moving object, it is easy to identify the moving object even during the virtual race. In addition, you can watch a highly reproducible virtual race without actually going to the race track. In addition, since the place around the user becomes a virtual race track, it is possible to provide the user with unprecedented enjoyment.

(Item 6)
In the virtual race, one or more moving objects corresponding to the contestants or the moving objects indicated by the one or more selection information are displayed in a display mode different from other moving objects.
The program according to any one of items 1 to 5.
As a result, the discriminability of the moving object selected by the user can be improved.

(Item 7)
When the current ranking in the virtual race corresponds to one or more contestants or the moving body indicated by the one or more selection information, the corresponding one or more selection information is referred to as another selection information. Display in different ways,
The program according to any one of items 1 to 6.
This makes it easy for the user to know that the user's choice will be correct if the race goes on as it is. It also makes it possible to increase the degree of immersion in virtual racing.

(Item 8)
An information processing method executed in a first computer equipped with a processor and an imaging unit.
The information processing method is applied to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object for presenting the second information about the predetermined race to the user of the first computer based on the first information, and
A step of superimposing the virtual object on a real image around the first computer captured by the imaging unit and displaying the virtual object.
Including running
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
In the display step, at least a part of the contestant information is displayed in association with the moving object.
Information processing method.
This makes it easier to identify each moving object for a moving object corresponding to a race participant or a moving object in the real world.

(Item 9)
An information processing device equipped with a processor and an imaging unit.
The processor
Receive the first information about a given race in the real world from the second computer,
A virtual object for presenting the second information regarding the predetermined race to the user of the first computer is generated based on the first information.
The virtual object is superimposed and displayed on the real image around the first computer captured by the imaging unit.
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
The display step includes displaying at least a part of the contestant information in association with the moving object.
Information processing device.
This makes it easier to identify each moving object for a moving object corresponding to a race participant or a moving object in the real world.

(Item 10)
A system realized by a first computer provided with a first processor and an imaging device, and a second computer provided with a second processor and capable of communicating with the first computer.
The second processor is
Get the first information about a given race in the real world,
The first information is transmitted to the first computer,
The first processor is
The first information is received from the second computer,
A virtual object for presenting the second information regarding the predetermined race to the user of the first computer is generated based on the first information.
The virtual object is superimposed and displayed on the real image around the first computer captured by the imaging unit.
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
The superimposed display includes displaying at least a part of the contestant information in association with the moving object.
system.
This makes it easier to identify each moving object for a moving object corresponding to a race participant or a moving object in the real world.

(Item 11)
The first processor further
Acquire one or more selection information indicating the one or more contestants or the moving body selected by the user, and obtain the selection information.
The first information includes the position information of the contestant or the moving body during the execution of the predetermined race, and the time information corresponding to the position information.
The display step is to move the moving object based on the position information and the time information, and display a virtual race that virtually displays the predetermined race together with at least a part of the selection information. Including
The position information is acquired based on a position sensor provided on the contestant or the moving body, or an image of the predetermined race captured by an imaging device during the execution of the predetermined race.
Item 10. The system according to item 10.
This makes it easy to obtain location information of participants and the like. As a result, the ranking and offense and defense during the race in the real world can be reproduced on the virtual race, so that the user's satisfaction can be improved.

1: System, 10: User terminal, 20: First server device, 30: Network, 40: Second server device, 130: Touch screen, 150: Storage unit (of user terminal), 190: Control (of user terminal) Unit, 191: Operation input reception unit, 192: Transmission / reception unit, 193: Object generation unit, 194: Display control unit, 195: Detection unit, 196: Selection information acquisition unit, 250: Storage unit (of the first server device), 290: Control unit (of the first server device)

Claims (11)

A program that is executed in a first computer equipped with a processor and an imaging unit.
The program is delivered to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object for presenting the second information about the predetermined race to the user of the first computer based on the first information, and
The step of superimposing the virtual object on the real image around the first computer captured by the imaging unit and displaying the virtual object is executed.
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
In the display step, at least a part of the contestant information is displayed in association with the moving object.
program. In the display step, the contestant information is displayed in more detail in association with the moving object in response to the operation input of the user.
The program according to claim 1. The contestant information displayed in the step to be displayed includes at least the odds information of the contestant or the moving body.
The program according to claim 1 or 2. The receiving step is executed at a predetermined frequency or when a specific event occurs, and is executed.
The contestant information can be updated by performing the receiving step.
The program according to any one of claims 1 to 3. The program is added to the processor.
The step of acquiring one or more selection information indicating the one or more contestants or the moving body selected by the user is executed.
The first information includes the position information of the contestant or the moving body during the execution of the predetermined race, and the time information corresponding to the position information.
The display step is to move the moving object based on the position information and the time information, and display a virtual race that virtually displays the predetermined race together with at least a part of the selection information. including,
The program according to any one of claims 1 to 4. In the virtual race, one or more moving objects corresponding to the contestants or the moving objects indicated by the one or more selection information are displayed in a display mode different from other moving objects.
The program according to 請Motomeko 5. When the current ranking in the virtual race corresponds to one or more contestants or the moving body indicated by the one or more selection information, the corresponding one or more selection information is referred to as another selection information. Display in different ways,
The program according to claim 5 or 6. An information processing method executed in a first computer equipped with a processor and an imaging unit.
The information processing method is applied to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object for presenting the second information about the predetermined race to the user of the first computer based on the first information, and
A step of superimposing the virtual object on a real image around the first computer captured by the imaging unit and displaying the virtual object.
Including running
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
In the display step, at least a part of the contestant information is displayed in association with the moving object.
Information processing method. An information processing device equipped with a processor and an imaging unit.
The processor
Receive the first information about a given race in the real world from the second computer,
A virtual object for presenting the second information regarding the predetermined race to the user of the information processing apparatus is generated based on the first information.
The virtual object is superimposed and displayed on a real image around the information processing device captured by the imaging unit.
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
The display step includes displaying at least a part of the contestant information in association with the moving object.
Information processing device. A system realized by a first computer provided with a first processor and an imaging device, and a second computer provided with a second processor and capable of communicating with the first computer.
The second processor is
Get the first information about a given race in the real world,
The first information is transmitted to the first computer,
The first processor is
The first information is received from the second computer,
A virtual object for presenting the second information regarding the predetermined race to the user of the first computer is generated based on the first information.
The virtual object is superimposed and displayed on the real image around the first computer captured by the imaging unit.
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
The superimposed display includes displaying at least a part of the contestant information in association with the moving object.
system. The first processor further
Acquire one or more selection information indicating the one or more contestants or the moving body selected by the user, and obtain the selection information.
The first information includes the position information of the contestant or the moving body during the execution of the predetermined race, and the time information corresponding to the position information.
The display step is to move the moving object based on the position information and the time information, and display a virtual race that virtually displays the predetermined race together with at least a part of the selection information. Including
The position information is acquired based on a position sensor provided on the contestant or the moving body, or an image of the predetermined race captured by an imaging device during the execution of the predetermined race.
The system according to claim 10.

Images