JP2022017187A - Program, information processing method, information processing device, and system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To facilitate discriminating moving objects from each other, the moving objects corresponding to real-world race participants and mobile bodies.

SOLUTION: A program to be run in a first computer causes a processor to execute: a step for receiving first information about a real-world race from a second computer; a step for generating, on the basis of the first information, a virtual object for presenting second information about the race to a user; and a step for displaying the virtual object superimposed on a real image captured by an image capturing unit. The first information includes at least participant information about race participants and/or mobile bodies. The virtual object includes at least moving objects 502a, 502b corresponding to the participants or the mobile bodies. At least some of the participant information is displayed in association with the moving objects 502a, 502b in the display step.

SELECTED DRAWING: Figure 9

COPYRIGHT: (C)2022,JPO&INPIT

Description

The present disclosure relates to programs, information processing methods, information processing devices, and systems.

Patent Documents 1 and 2 disclose techniques related to AR (Augmented Reality).

Japanese Unexamined Patent Publication No. 2020-58658 Japanese Unexamined Patent Publication No. 2020-77187

By the way, in the real world, various races such as boat races and horse races are carried out, but there is a problem that it is difficult for beginners to watch the game to know where the contestants they support are in the race track.

The techniques disclosed in Patent Documents 1 and 2 superimpose and display a virtual object unrelated to the real world on an image in the real world, and do not present any means for solving the above problem.

One aspect of the present disclosure is to make it easier to identify each moving object for a moving object corresponding to a race participant or a moving object in the real world.

According to one embodiment presented in the present disclosure.
A program executed in a first computer equipped with a processor and an image pickup unit.
The program is attached to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object for presenting the second information about the predetermined race to the user of the first computer based on the first information, and
The step of superimposing the virtual object on the real image around the first computer captured by the image pickup unit and displaying the virtual object is executed.
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
In the display step, at least a part of the contestant information is displayed in association with the moving object.
The program is offered.

According to one embodiment shown in the present disclosure, it is possible to easily identify each moving object for a moving object corresponding to a race participant or a moving object in the real world.

It is a figure which shows the configuration example of the system which follows a certain embodiment. It is a block diagram which shows an example of the functional configuration of the user terminal according to a certain embodiment. It is a block diagram which shows an example of the functional configuration of the server according to a certain embodiment. It is a schematic diagram which shows an example of the race field of the real world according to a certain embodiment. It is a schematic diagram which shows an example of the virtual object displayed on the user terminal according to a certain embodiment. It is a flowchart which shows an example of the display control processing according to a certain embodiment. It is a schematic diagram which shows an example of the real image which was taken by the image pickup part according to a certain embodiment. It is a schematic diagram which shows an example of the screen which superposed virtual object on the real image which follows a certain embodiment. It is a schematic diagram which shows an example of the display method of the contestant information according to a certain embodiment. It is a schematic diagram which shows an example of the display method of the detailed contestant information according to a certain embodiment. It is a schematic diagram which shows another example of the display method of the detailed contestant information according to a certain embodiment. It is a schematic diagram which shows another example of the display method of the detailed contestant information according to a certain embodiment. It is a schematic diagram which shows an example of the display method of the contestant information in the virtual race according to a certain embodiment. It is a schematic diagram which shows another example of the display method of the contestant information in the virtual race according to a certain embodiment.

Hereinafter, embodiments of this technical idea will be described in detail with reference to the drawings. In the following description, the same elements are designated by the same reference numerals, and duplicate description will be omitted as appropriate. In one or more embodiments shown in the present disclosure, the elements included in each embodiment may be combined with each other, and the combined result shall also form part of the embodiments shown in the present disclosure.

(System configuration)
FIG. 1 is a diagram showing a configuration of a system 1 according to the present embodiment. The system 1 can display, for example, a predetermined race performed in the real world as a virtual race using a virtual object on an information processing device used by a user. In the present specification, the "predetermined race" is not particularly limited as long as it is a race carried out in the real world, and for example, a boat race (actual race or exhibition race), horse racing, bicycle racing, auto racing, etc. Car races such as F1, drone races, dog races, marathons, ekiden, etc. can be mentioned.

As shown in FIG. 1, the system 1 is a user such as a user terminal 10A, a user terminal 10B, and a user terminal 10C (hereinafter, user terminals 10A, 10B, 10C) which are information processing devices (first computers) used by each user. It includes a plurality of user terminals 10 such as (generally referred to as "user terminal 10"), a first server device (second computer) 20, a second server device 40, and a network 30.

The user terminal 10A and the user terminal 10B are connected to the network 30 by communicating with the radio base station 31. The user terminal 10C connects to the network 30 by communicating with a wireless router 32 installed in a facility such as a house. The user terminal 10 is, for example, a portable terminal provided with a touch screen, and may be a smartphone, a phablet, a tablet, or the like.

The user terminal 10 executes, for example, a program installed via a platform for distributing an application or the like, or a program including pre-installed website browsing software. The user terminal 10 communicates with the first server device 20 by executing the above program, and transmits / receives data related to a predetermined race, data related to the user, and the like to / from the first server device 20. It is possible to display a virtual race on the terminal 10.

The first server device 20 receives data related to a predetermined race from the second server device 40. The first server device 20 appropriately transmits data related to a predetermined race to the user terminal 10. The first server device 20 stores and manages data related to a predetermined race and data related to each user.

The first server device 20 includes a communication IF (Interface) 22, an input / output IF 23, a memory 25, a storage 26, and a processor (second processor) 29 as a hardware configuration, and these provide a communication bus. They are connected to each other via.

The communication IF 22 supports various communication standards such as a LAN (Local Area Network) standard, and functions as an interface for transmitting and receiving data to and from a user terminal 10 and a second server device 40.

The input / output IF 23 functions as an interface for accepting input of information to the first server device 20 and outputting information to the outside of the first server device 20. The input / output IF 23 may include an input receiving unit that accepts the connection of an information input device such as a mouse and a keyboard, and an output unit that accepts the connection of an information output device such as a display for displaying an image or the like.

The memory 25 is a storage device for storing data or the like used for processing. The memory 25, for example, provides the processor 29 with a work area for temporary use when the processor 29 performs processing. The memory 25 includes a ROM (Read Only Memory) and a RAM (Random).
It is configured to include a storage device such as Access Memory).

The storage 26 is a storage device for storing various programs and data for the processor 29 to read and execute. The information stored in the storage 26 includes data related to a predetermined race, data related to each user, and the like. The storage 26 may be configured to include a storage device such as an HDD (Hard Disk Drive) or a flash memory. The storage is not limited to the form included in the server device, and a cloud service can also be used.

The processor 29 controls the operation of the first server device 20 by reading and executing a program or the like stored in the storage 26. The processor 29 is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and a GPU (Graphics).
Processing Unit) etc. may be included.

The second server device 40 stores and manages data related to a predetermined race. The second server device 40 is, for example, a server device managed by a predetermined race organizer or a server device managed by an organization (such as a publisher of a race magazine) that transmits information about a predetermined race to the outside. The second server device 40 appropriately transmits data related to a predetermined race to the first server device 20. In certain aspects, the second server device 40 may transmit data related to a predetermined race to the user terminal 10. The hardware configuration of the second server device 40 may be the same as that of the first server device 20 as long as there is no contradiction.

(User terminal)
FIG. 2 is a block diagram showing an example of the functional configuration of the user terminal 10. As shown in FIG. 2, the user terminal 10 includes an antenna 110, a wireless communication IF 120, a touch screen 130, an input / output IF 140, a storage unit 150, a voice processing unit 160, a microphone 161 and a speaker 162. It includes an image pickup unit 170 and a control unit (first processor) 190.

The antenna 110 radiates a signal emitted by the user terminal 10 into space as a radio wave. Further, the antenna 110 receives radio waves from the space and gives a received signal to the wireless communication IF 120.

Since the user terminal 10 communicates with other communication devices, the wireless communication IF 120 performs modulation / demodulation processing for transmitting / receiving signals via the antenna 110 or the like. The wireless communication IF 120 is a communication module for wireless communication including a tuner, a high frequency circuit, etc., performs modulation / demodulation and frequency conversion of the wireless signal transmitted / received by the user terminal 10, and supplies the received signal to the control unit 190.

The touch screen 130 receives input from the user and outputs information to the user on the display 132. The touch screen 130 includes a touch panel 131 for receiving user operation input and a display 132. The touch panel 131 detects that a user's finger or the like has approached by using, for example, a capacitance type touch panel. The display 132 is realized by, for example, an LCD (Liquid Crystal Display), an organic EL (electroluminescence), or other display device.

The input / output IF 140 functions as an interface for accepting input of information to the user terminal 10 and outputting information to the outside of the user terminal 10.

The storage unit 150 is composed of a flash memory, an HDD, or the like, and stores a program used by the user terminal 10 and various data received by the user terminal 10 from the first server device 20 or the like.

The voice processing unit 160 performs modulation / demodulation of the voice signal. The voice processing unit 160 modulates the signal given from the microphone 161 and gives the modulated signal to the control unit 190. Further, the voice processing unit 160 gives a voice signal to the speaker 162. The voice processing unit 160 is realized by, for example, a processor for voice processing. The microphone 161 functions as an audio input unit for receiving an input of an audio signal and outputting it to the control unit 190. The speaker 162 functions as an audio output unit for outputting an audio signal to the outside of the user terminal 10.

The image pickup unit 170 is a camera that captures a real image around the user terminal 10. The image captured by the image pickup unit 170 is image-processed by the control unit 190 and output to the display 132.

The control unit 190 controls the operation of the user terminal 10 by reading and executing a program stored in the storage unit 150. The control unit 190 is realized by, for example, an application processor.

The process of executing the application program 151 by the control unit 190 will be described in more detail. The storage unit 150 stores the application program 151, the application information 152, and the user information 153.

For example, the user terminal 10 downloads the application program 151 from the first server device 20 and stores it in the storage unit 150. Further, the user terminal 10 communicates with the first server device 20 to send and receive various data such as application information 152 and user information 153 to and from the first server device 20.

The application program 151 is a program for displaying a virtual race on the user terminal 10. The application information 152 includes various data referred to by the application program 151. The application information 152 includes the first information 152A.

The first information 152A is information regarding a predetermined race transmitted from the first server device 20 and the second server device 40. The first information 152A includes, for example, at least contestant information regarding a contestant in a predetermined race and / or a moving body (hereinafter, also referred to as “participant or the like”). The contestant information includes, for example, the names and names of the contestants, the popularity ranking and odds information of the contestants in a predetermined race, and the past race results of the contestants and the like.

As used herein, the term "contestant" is a concept that includes not only humans but also animals such as horses and dogs. Further, the "moving body" is a main body of movement in a predetermined race, and is an animal or an aircraft on which a participant rides, an aircraft remotely controlled by a contestant, or the like. In marathons, dog races, etc., "participants" and "mobiles" are the same.

In addition to the above, the first information 152A includes, for example, race time information indicating the race time of the contestants, position information of the contestants during the execution of a predetermined race, and time information corresponding to the position information. Can be included.

The first information 152A includes, for example, a predetermined race name, date and time, race field data, contestant data other than the above, moving object data, odds information, race forecast, race start table, race immediately before information, pit. It may include reports, race results, race videos, race stills, past race information, and other information that may be published in information magazines or information sites about a given race.

The user information 153 includes information about the user of the user terminal 10. The user information 153 includes, for example, information for identifying the user, position information of the user terminal 10, a race purchase history and a hit rate of the user (for example, a history of a boat ticket purchased in the case of a boat race, and a boat ticket purchased. Hit rate) and the like may be included.

By reading and executing the application program 151, the control unit 190 reads and executes the operation input reception unit 191, the transmission / reception unit 192, the object generation unit 193, the display control unit 194, the detection unit 195, and the selection information acquisition unit 196. And, each function is demonstrated.

The operation input receiving unit 191 accepts the user's operation input based on the output of the touch screen 130. Specifically, the operation input receiving unit 191 detects that the user's finger or the like touches or approaches the touch panel 131 as the coordinates of the coordinate system consisting of the horizontal axis and the vertical axis of the surface constituting the touch screen 130.

The operation input receiving unit 191 determines the user's operation on the touch screen 130. The operation input reception unit 191 is, for example, "approach operation", "release operation", "tap operation", "double tap operation", "long press operation (long touch operation)", "drag operation (swipe operation)", Determine the user's operation such as "move operation", "flick operation", "pinch-in operation", and "pinch-out operation".

The operation input receiving unit 191 may accept the movement of the user terminal 10 detected by the acceleration sensor or the like mounted on the user terminal 10 as an operation input.

The transmission / reception unit 192 transmits and receives various information to and from external communication devices such as the first server device 20 and the second server device 40 via the wireless communication IF 120 and the network 30. The transmission / reception unit 192 receives, for example, the first information 152A from the first server device 20 or the second server device 40. Further, the transmission / reception unit 192 transmits, for example, information corresponding to the operation input received by the operation input reception unit 191 and information stored in the user information 153 to the first server device 20 or the second server device 40. ..

The object generation unit 193 generates a virtual object for presenting the second information regarding a predetermined race to the user based on the first information. In the present specification, the "second information" is, for example, at least a part of the first information 152A or information calculated from the first information 152A. In a certain aspect, the "second information" can be information that can be presented as text. In a certain aspect, the "second information" may be ranking information indicating the ranking of the contestants or the like during a predetermined race or the ranking of the contestants or the like as a result of the race.

The object generation unit 193 can generate a race field object representing a race field and a moving object representing a contestant or the like as virtual objects. Further, the object generation unit 193 generates a text object that presents contestant information as a virtual object.

The object generation unit 193 may generate a virtual display board for displaying the second information as text. In addition to the above objects, the object generation unit 193 also creates a virtual screen for displaying the second information as an image, various building objects, landscape objects such as trees, objects that serve as user avatars, and the like. May be generated.

The display control unit 194 superimposes an image (hereinafter, also referred to as “superimposed image”) on which a virtual object generated by the object generation unit 193 is superimposed on a real image around the user terminal 10 imaged by the image pickup unit 70. It is displayed on the display 132. The display control unit 194 displays a text object that presents contestant information in association with a moving object.

Further, the display control unit 194 moves a moving object on the race track object based on the race time information included in the first information 152A, and displays a virtual race on the display 132 that virtually reproduces a predetermined race. Display. It is preferable that the display control unit 194 reproduces the virtual race based on the position information of the contestants and the like included in the first information 152A and the time information corresponding to the position information in addition to the race time information. ..

It is preferable that the display control unit 194 can change the viewpoint in the superimposed image according to the operation input received by the operation input reception unit 191. The display control unit 194 displays various menu screens and GUIs (Graphical User Interfaces) on the display 132, and changes the display contents of the display 132, in response to the operation input received by the operation input reception unit 191.

The detection unit 195 detects a flat surface in the real image captured by the image pickup unit 170. The detection of a flat surface is realized by a conventionally known image recognition technique. For example, when the user performs an operation of selecting a flat surface detected by the detection unit 195, a superimposed image in which the race field object is arranged on the flat surface is displayed on the display 132.

The flat surface is preferably a horizontal surface. Further, the angle formed by the flat surface and the bottom surface constituting the race field object may be 0 degrees, but is preferably an acute angle, and can be, for example, in the range of 15 degrees to 45 degrees. The above angle may be adjusted by accepting a user's operation. Also, even if there is a convex part on a part of the flat surface in the real world, or if there is an object on the flat surface, if the convex part or the object is of a size that can be hidden by the race track object. , The place where the race field object can be placed may be detected as a flat surface.

The selection information acquisition unit 196 acquires one or more selection information indicating one or more contestants selected by the user. The "selection information" is, for example, information indicating a contestant or the like predicted by the user as a winner or the like of a predetermined race. When the predetermined race is a boat race or a horse race, the "selection information" may be information indicating a boat ticket or a betting ticket purchased by the user.

The selection information acquisition unit 196 acquires selection information based on, for example, a user's operation input on the screen for selecting a contestant or the like. The selection information acquired by the selection information acquisition unit 196 is transmitted to, for example, the first server device 20 or the second server device 40. When the predetermined race is a boat race or a horse race, the purchase process of the boat ticket or the betting ticket may be performed according to the selection information being transmitted to the second server device 40.

(1st server device)
FIG. 3 is a block diagram showing a functional configuration of the first server device 20. A detailed configuration of the first server device 20 will be described with reference to FIG. The first server device 20 exerts functions as a communication unit 220, a storage unit 250, and a control unit 290 by operating according to a program.

The communication unit 220 functions as an interface for the first server device 20 to communicate with an external communication device such as the user terminal 10 or the second server device 40 via the network 30.

The storage unit 250 stores various programs and data for realizing the system 1. In a certain aspect, the storage unit 250 stores the program 251 and the race information 252 and the user information 253.

The program 251 is a program for the first server device 20 to communicate with the user terminal 10 and the second server device 40 to realize the system 1. The program 251 is executed by the control unit 290 to send and receive data to and from the user terminal 10 and the second server device 40, a process according to the operation content performed by the user of the user terminal 10, race information 252, and the user. The first server device 20 is made to perform a process of updating the information 253 and the like.

Race information 252 contains various data related to a given race. The race information 252 includes, for example, the first information 252A. The first information 252A is the source information of the first information 152A, and the first information 152A can be a part of the first information 252A. The first information 252A is, for example, information acquired from the second server device 40.

The user information 253 is information about the user of the user terminal 10. The user information 253 includes a user management table 253A. The user management table 253A stores, for example, information for identifying the user, position information of the user terminal 10, a race purchase history of the user, a hit rate, and the like for each user.

The control unit 290 is realized by the processor 29, and by executing the program 251, functions as a transmission / reception unit 291, a first information acquisition unit 292, a selection information acquisition unit 293, a data management unit 294, and a timekeeping unit 295. ..

The transmission / reception unit 291 transmits and receives various information to and from an external communication device such as a user terminal 10 and a second server device 40 via the communication unit 220 and the network 30. The transmission / reception unit 291 transmits, for example, at least a part of the first information 252A to the user terminal 10. Further, the transmission / reception unit 291 receives, for example, the first information 252A from the second server device 40.

The first information acquisition unit 292 acquires the first information 252A from the second server device 40 via the transmission / reception unit 291. The selection information acquisition unit 293 acquires the user's selection information from the user terminal 10 or the second server device 40 via the transmission / reception unit 291. The data management unit 294 performs a process of updating various data stored in the storage unit 250 according to the processing results of the first information acquisition unit 292, the selection information acquisition unit 293, and the like. The timekeeping unit 295 performs a process of measuring time. Various times displayed on the user terminal 10 (for example, the time until the start of the race) can be controlled based on the time measured by the time measuring unit 295.

(Operation example)
Next, an operation example in the system 1 will be described with reference to FIGS. 4 to 14. In the following, a case where a predetermined race is a boat race will be described as an example, but the following description can be applied even if the predetermined race is another race. Further, in the following description, it is assumed that data is transmitted / received between the user terminal 10 and the first server device 20 and between the first server device 20 and the second server device 40, but in a certain aspect, the user The terminal 10 and the second server device 40 may be configured to directly transmit and receive data.

FIG. 4 is a schematic diagram showing an example of a boat race field in the real world. Two turn marks 403 are installed in the boat race field 401, and races are carried out by boats 402a to 402f on which each boat racer rides. When the race is completed, the race time information indicating the race times of the boats 402a to 402f is transmitted from the second server device 40 to the first server device 20, and is transmitted from the first server device 20 to the user terminal 10.

The boat race field 401 is provided with image pickup devices (cameras) 404a to 404b. The image pickup apparatus 404a captures the boats 402a to 402f in the field of view from above the boat race field 401. The image pickup apparatus 404b keeps the boats 402a to 402f in the field of view from the side of the boat race field 401. The images of the boats 402a to 402f captured by the image pickup devices 404a to 404b are transmitted to the second server device 40. In the second server device 40, for example, image analysis of each image is performed, and position information indicating the position of each of the boats 402a to 402f in the shooting time of each image is calculated. The calculated position information and the time information related to the shooting time corresponding to the position information are transmitted to the first server device 20, and are transmitted from the first server device 20 to the user terminal 10. The location information may be calculated by the first server device 20.

Further, a position sensor such as a GPS sensor may be installed on the boats 402a to 402f instead of or in addition to the image pickup devices 404a to 404b. The position information of the boats 402a to 402f acquired by the position sensor and the time information indicating the time when the position information was acquired are finally transmitted to the user terminal 10.

FIG. 5 is a schematic diagram showing an example of a virtual object displayed on the user terminal 10. In the example of FIG. 5, as virtual objects, a race field object 501, moving objects 502a to 502f (hereinafter collectively referred to as “moving object 502”), two turnmark objects 503, and a virtual display board 505 are used. It is shown.

The race field object 501 is an object that virtually displays the boat race field 401. The race field object 501 and the turn mark object 503 are preferably created based on race field data such as course information of the boat race field 401, and preferably have a shape corresponding to the boat race field 401.

The moving objects 502a to 502f are objects that virtually display the boats 402a to 402f, respectively, and have a shape imitating a boat. The moving objects 502a to 502f move the race field object 501 based on the race time information, the position information of the boats 402a to 402f, and the time information corresponding to the position information. That is, the race field object 501 and the moving objects 502a to 502f display the race in the real world as a virtual race on the user terminal 10.

Even if there is no position information and time information of the boats 402a to 402f, it is possible to display the virtual race only by the race time information. However, in this case, the final order of arrival will be the same as in the real world race, but it is difficult to reproduce the race progress such as the ranking during the race.

The virtual display board 505 is an object that displays text information. The virtual display board 505 is, for example, a corresponding nonexistent object in the boat race field 401. The text information displayed on the virtual display board 505 is not particularly limited, and may be, for example, ranking information, odds information, or the like. Further, the text information displayed on the virtual display board 505 may be changeable based on the operation input of the user.

FIG. 6 is a flowchart showing an example of the display control process. It should be noted that the order of each process constituting the flowchart described below is random as long as there is no contradiction or inconsistency in the process contents. Further, the processing executed by each device may be executed by another device within a range that does not cause a contradiction.

The process shown in FIG. 6 is realized by the control unit 190 executing the application program 151 and the control unit 290 executing the program 251. First, in step S610, the control unit 190 activates the image pickup unit 170, which is a camera. The image pickup unit 170 captures a real image around the user terminal 10.

In step S620, the control unit 190 detects a flat surface in the image captured by the image pickup unit 170. In step S630, the control unit 190 arranges the virtual object on the detected flat surface.

Here, the processes of steps S610, S620, and S630 will be specifically described with reference to FIGS. 7 and 8. FIG. 7 is a schematic diagram showing an example of a real image captured by the imaging unit 170. In the example of FIG. 7, a keyboard 702 and a monitoring device 703 are placed on a flat desk 701.

When the image pickup unit 170 is activated in step S610, the real image captured by the image pickup unit 170 is displayed on the display 132. Next, in step S620, the control unit 190 detects a flat surface in the image captured by the image pickup unit 170, that is, in the image displayed on the display 132.

In FIG. 7, the region 704 is detected as a flat surface. There is a keyboard 702 in the area 704, but since the keyboard 702 is small enough to be hidden by the race field object 501, the control unit 190 detects the area 704 as a flat surface.

If the position imaged by the image pickup unit 170 is changed in the state shown in FIG. 7, the position of the region 704 can also be changed. The area 704 is displayed on the display 132 so as to be distinguishable from other parts, for example, by adding a predetermined color. When the user executes a tap operation or the like on the area 704, in step S630, the control unit 190 arranges a virtual object such as a race field object 501 on the area 704.

FIG. 8 is a schematic diagram showing an example of a screen in which a virtual object is superimposed on a real image and displayed. In FIG. 8, the area with the dot pattern including the monitor device 703 is the real image, and the other area is the area where the virtual object is displayed. For example, an advertisement image may be displayed in an area where the virtual object is not displayed.

In FIG. 8, as virtual objects, a race field object 501, a plurality of moving objects 502, two turnmark objects 503, a large monitor object 506, building objects 507a to 507b, and other reference numerals are not attached. A large number of objects (tree objects, clock objects, etc.) and are displayed. These objects are created, for example, based on the first information 152A received from the first server device 20.

In FIG. 8, the race field object 501 is arranged on the area 704 so that the angle formed by the flat surface included in the area 704 and the bottom surface constituting the race field object 501 is 0 degree. In this case, for example, an area in the depth direction such as the area X1 or moving objects 502 may overlap each other and become difficult to see. Further, in the area on the depth direction side of the large monitor object 506 or the like, a blind spot may occur in which the moving object 502 cannot be seen.

However, in the state shown in FIG. 8, the user can change the viewpoint of the superimposed image displayed on the display 132. For example, when the user inputs an operation such as a pinch-in operation or a pinch-out operation, the viewpoint position of the image pickup unit 170 may move toward or away from the race field object 501. Further, even when the user moves in the depth direction of the display 132 while holding the user terminal 10 or moves in the front direction, the viewpoint position of the image pickup unit 170 may move toward or away from the race field object 501. Further, when the user performs an operation such as designating a predetermined position on the display 132, the viewpoint position can be moved to the designated position. By such a viewpoint change, the above-mentioned visibility problem can be solved.

Further, by arranging the race field object 501 so that the angle θ formed by the flat surface S1 and the bottom surface S2 constituting the race field object 501 is an acute angle, the above-mentioned problem regarding visibility can be alleviated.

Returning to the description of the flowchart of FIG. In step S640, the control unit 290 of the first server device 20 acquires the contestant information from the second server device 40. The control unit 190 acquires the contestant information from the first server device 20. The process of step S640 may be executed at a predetermined frequency or when a specific event occurs. That is, the contestant information can be updated every time the process of step S640 is executed. The specific event is not particularly limited, but for example, when the contestant information is changed (for example, when the odds change), the start or end of the race, the ranking is confirmed, etc. There are cases.

In step S650, the control unit 190 associates each moving object 502 with the corresponding contestant information. Next, the control unit 190 displays a text object around the moving object 502 that presents at least a part of the contestant information associated with the moving object 502.

In step S670, the control unit 190 associates each moving object 502 with the corresponding contestant information. Next, the control unit 190 displays a text object around the moving object 502 that presents at least a part of the contestant information associated with the moving object 502.

Here, the process of step S670 will be specifically described with reference to FIG. FIG. 9 is a schematic diagram showing an example of a method of displaying contestant information. In FIG. 9, moving objects 502a to 502b are displayed on the race field object 501. At the upper part of the moving object 502a, a text object 512a that presents the contestant information corresponding to the moving object 502a is displayed.

When the moving object 502a moves, the text object 512a also moves so as to follow the moving object 502a. In a certain aspect, the relative positional relationship between the moving object 502a and the text object 512a does not change. The display position of the text object 512a is not particularly limited as long as it is around the moving object 502a. The moving object 502b and the text object 512b are the same as the moving object 502a and the text object 512a. In addition, in this specification, "around a moving object" may include a range overlapping with a moving object.

In the example of FIG. 9, the text objects 512a to 512b show the frame numbers of the moving objects 502a to 502b, the racer name to be boarded, and the odds information. When the contestant information is updated based on the process of step S640, the contestant information displayed on the text objects 512a to 512b is also updated. It is preferable that the contestant information shown in the text objects 512a to 512b can be changed according to the operation input of the user.

Returning to the description of the flowchart of FIG. When the control unit 190 accepts the selection operation for the moving object 502 in step S670, the process of step S680 is executed. The selection operation may be performed on a text object.

In step S680, the control unit 190 displays in detail the contestant information corresponding to the moving object 502 for which the selection operation was performed in step S680. Next, when the control unit 190 receives the operation input for ending the detailed display, the detailed display of the contestant information is ended in step S690. After the detail display is completed, the display returns to, for example, in step S660. The control unit 190 ends a series of display control processes in response to receiving an operation input for terminating the application program 151.

Here, the process of step S680 will be specifically described with reference to FIGS. 10 to 12. FIG. 10 is a schematic diagram showing an example of a detailed display method of contestant information. FIG. 10 is a screen displayed on the display 132 when, for example, the user performs an operation (for example, a tap operation) to select the moving object 502a in the state of FIG. 9.

In FIG. 10, the detailed information object 520 is displayed around the moving object 502a. The detailed information object 520 includes an image display field 521, a detailed information display field 522, and an end button 523. In the image display field 521, for example, a face image of a racer boarding a moving object 502a is displayed. In the detailed information display column 522, more detailed contestant information than the example of FIG. 9 is displayed as text information. The end button 523 is a virtual button for hiding the detailed information object 520. The detailed information object 520 may be hidden by tapping the outside of the detailed information object 520.

FIG. 11 is a schematic diagram showing another example of a detailed display method of contestant information. In the example of FIG. 11, the detailed information object 530 is displayed instead of the detailed information object 520 of FIG. The detailed information object 530 includes an image display field 531, a first detailed information display field 532, a second detailed information display field 533, and a switching button 534. In the image display field 531 for example, a face image of a racer boarding a moving object 502a is displayed. In the first detailed information display column 532, more detailed contestant information than the example of FIG. 9 is displayed as text information.

The second detailed information display column 533 is a column for displaying the contestant information in a graph. The information displayed in the second detailed information display column 533 may be a graph of the contestant information obtained as text information by the control unit 190, or has been graphed from the beginning acquired in step S640. It may be contestant information. The switching button 534 is a virtual button for changing the contestant information displayed in the second detailed information display field 533.

FIG. 12 is a schematic diagram showing still another example of a detailed method of displaying contestant information. In the example of FIG. 12, the detailed information object 540 is displayed instead of the detailed information object 520 of FIG. The detailed information object 540 shown in FIG. 12 includes an image display field 541, a first detailed information display field 542, a second detailed information display field 543, and a third detailed information display field 544.

In the image display field 541, for example, an image of a character created based on a racer boarding a moving object 502a is displayed. Participant information is displayed as text information in the first detailed information display column 542. In the second detailed information display field 543, the status information of the racer boarding the moving object 502a is displayed. The status information is, for example, a virtual status calculated based on past race results and predetermined rules. In the third detailed information display field 544, skill information of the racer boarding the moving object 502a is displayed. Skill information is, for example, a virtual skill derived based on past race results and predetermined rules. In FIG. 12, the skills “popular” and “reversal” are displayed in the third detailed information display column 544. These skills, for example, show in the past race results that they are more popular than other racers and that they have many reverse wins.

Next, a method of displaying the contestant information during the virtual race will be described with reference to FIG. In FIG. 13, in addition to the example of FIG. 8, a virtual display board 505, a virtual screen 508, a purchase information display board 509, and a ranking display board 510 are displayed as virtual objects. It is preferable that these virtual objects can be switched to non-display, the display position can be changed, the display contents can be changed, and the like by the user's operation input.

On the virtual display board 505, for example, after the end of the virtual race, text information such as the order of the moving objects 502a to 502f and the race time may be displayed. Before the start of the race or during the race, other text information such as odds information may be displayed on the virtual display board 505.

The image of the boat race in the real world is displayed on the virtual screen 508. What is displayed on the virtual screen 508 is, for example, a real-time image of the race. Before and after the start and end of the race, the virtual screen 508 may display images of each boat before and after the race, player interview images, race replay images, exhibition race images, and the like. ..

The purchase information display board 509 displays information on the boat ticket purchased by the user acquired by the control unit 190 (selection information acquisition unit 196). On the right side of the purchase information display board 509, purchase information, which is information on the boat ticket purchased by the user, is displayed, and on the left side, the refund amount when each boat ticket is hit is displayed.

Further, on the purchase information display board 509, when the current rank in the virtual race and the moving object 502 indicated by the purchase information correspond to each other (for example, when the goal is reached with the current rank, the boat ticket is correct). Display the corresponding purchase information in a manner different from other purchase information. The current first place in FIG. 13 is the two-frame moving object 502b. Therefore, on the purchase information display board 509, the mark 509a is attached to the column indicating the two-frame win-win type boat ticket. A mark 509a is also attached to the upper part of the moving object 502a of the two frames.

If the rankings are changed during the race and the 1st place is tentatively 5 slots and the 2nd place is 4 slots, the mark 509a will be added to the purchase information displayed second and third from the top. Further, a mark 509a is attached on the moving objects 502 of the 5th frame and the 4th frame. In addition, the display in different modes may be marked with a predetermined mark, the purchase column may be colored with a predetermined color, or may be displayed by another method.

The order of the moving objects 502a to 502f is displayed on the order display board 510. During the race, the ranking displayed on the ranking display board 510 may fluctuate based on the position information of the boats 402a to 402f in the real world.

In FIG. 13, a text object 512b showing contestant information is displayed above the moving object 502b. In the example of FIG. 13, the frame number and the racer name are displayed on the text object 512b. It is preferable that the contestant information to be displayed on the text object 512 can be selected by the user. The user can also hide the text object for some moving objects 502.

FIG. 14 is a schematic diagram showing another example of a method of displaying contestant information during a virtual race. In the example of FIG. 14, each of the moving objects 502 is colored according to the frame number. As shown in the lower right frame of FIG. 14, the moving object 502a in one frame is displayed in white, and the moving object 502a in two frames is displayed in black. The display color can be freely changed by the user's operation input.

Further, the text object 512d shows popular information 552a of the race being carried out as a kind of contestant information. The same applies to the text objects 512b and 512c. By presenting popularity information rather than odds information in this way, the user can grasp at a glance which moving object is considered to be strong. The moving object 502a and the like are not attached with popularity information because they are in the lower order of popularity, but they may also be attached with popularity information.

The above embodiments are merely examples for facilitating the understanding of the present invention, and are not intended to limit the interpretation of the present invention. It goes without saying that the present invention can be modified and improved without departing from the spirit thereof, and the present invention includes its equivalents.

[Additional notes]
The contents of this disclosure are listed below.

(Item 1)
A program executed in a first computer equipped with a processor and an image pickup unit.
The program is attached to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object for presenting the second information about the predetermined race to the user of the first computer based on the first information, and
The step of superimposing the virtual object on the real image around the first computer captured by the image pickup unit and displaying the virtual object is executed.
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
In the display step, at least a part of the contestant information is displayed in association with the moving object.
program.
This makes it easier to identify each moving object for a moving object that corresponds to a race participant or a moving object in the real world.

(Item 2)
In the display step, the contestant information is displayed in more detail in association with the moving object in response to the operation input of the user.
The program described in item 1.
As a result, a large amount of information can be provided to the user in response to the request of the user, so that the satisfaction level of the user can be improved.

(Item 3)
The contestant information displayed in the step to be displayed includes at least the odds information of the contestant or the moving body.
The program according to item 1 or item 2.
This allows the user to know which moving object is believed to be strong. Further, since the odds information is usually one of the information that the user is highly interested in, the satisfaction of the user can be improved by displaying the odds information together with the moving object.

(Item 4)
The receiving step is executed at a predetermined frequency or when a specific event occurs, and is executed.
The contestant information may be updated by performing the receiving step.
The program according to any one of items 1 to 3.
As a result, even if the contestant information changes with the passage of time, the changed contestant information can be delivered to the user.

(Item 5)
The program is applied to the processor and further to the processor.
It is intended to execute a step of acquiring one or more selection information indicating one or more contestants or the moving object selected by the user.
The first information includes the position information of the contestant or the moving body during the execution of the predetermined race, and the time information corresponding to the position information.
The display step is to move the moving object based on the position information and the time information, and display a virtual race that virtually displays the predetermined race together with at least a part of the selection information. including,
The program according to any one of items 1 to 4.
This makes it possible to display a race in the real world as a virtual race with high reproducibility using a virtual object. Further, since the contestant information is displayed in association with the moving object, it is easy to identify the moving object even during the virtual race. In addition, you can watch a virtual race with high reproducibility without actually going to the race track. In addition, since the place around the user becomes a virtual race track, it is possible to provide the user with unprecedented enjoyment.

(Item 6)
In the virtual race, the moving object corresponding to the contestant or the moving object indicated by the selection information of the one or more is displayed in a display mode different from that of the other moving objects.
The program according to any one of items 1 to 5.
This makes it possible to improve the discriminability of the moving object selected by the user.

(Item 7)
When the current ranking in the virtual race corresponds to the one or more contestants or the moving body indicated by the one or more selection information, the corresponding one or more selection information is referred to as another selection information. Display in different ways,
The program according to any one of items 1 to 6.
This makes it easy for the user to know that the user's choice will be correct if the race goes on as it is. It also makes it possible to increase the degree of immersion in virtual races.

(Item 8)
An information processing method executed in a first computer equipped with a processor and an image pickup unit.
The information processing method is applied to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object for presenting the second information about the predetermined race to the user of the first computer based on the first information, and
A step of superimposing the virtual object on a real image around the first computer captured by the image pickup unit and displaying the virtual object.
Including running
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
In the display step, at least a part of the contestant information is displayed in association with the moving object.
Information processing method.
This makes it easier to identify each moving object for a moving object that corresponds to a race participant or a moving object in the real world.

(Item 9)
An information processing device equipped with a processor and an image pickup unit.
The processor
Receive the first information about a given race in the real world from the second computer,
A virtual object for presenting the second information regarding the predetermined race to the user of the first computer is generated based on the first information.
The virtual object is superimposed and displayed on a real image around the first computer captured by the image pickup unit.
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
The display step comprises displaying at least a portion of the contestant information in association with the moving object.
Information processing equipment.
This makes it easier to identify each moving object for a moving object that corresponds to a race participant or a moving object in the real world.

(Item 10)
A system realized by a first computer provided with a first processor and an image pickup apparatus, and a second computer provided with a second processor and capable of communicating with the first computer.
The second processor is
Get the first information about a given race in the real world,
The first information is transmitted to the first computer,
The first processor is
The first information is received from the second computer,
A virtual object for presenting the second information regarding the predetermined race to the user of the first computer is generated based on the first information.
The virtual object is superimposed and displayed on a real image around the first computer captured by the image pickup unit.
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
The superimposed display includes displaying at least a part of the contestant information in association with the moving object.
system.
This makes it easier to identify each moving object for a moving object that corresponds to a race participant or a moving object in the real world.

(Item 11)
The first processor further
Acquiring one or more selection information indicating the one or more contestants or the moving object selected by the user,
The first information includes the position information of the contestant or the moving body during the execution of the predetermined race, and the time information corresponding to the position information.
The display step is to move the moving object based on the position information and the time information, and display a virtual race that virtually displays the predetermined race together with at least a part of the selection information. Including
The position information is acquired based on a position sensor provided on the contestant or the moving body, or an image of the predetermined race captured by an image pickup device during the execution of the predetermined race.
The system according to item 10.
This makes it easy to obtain the position information of the contestants and the like. As a result, the ranking and offense and defense during the race in the real world can be reproduced on the virtual race, so that the user's satisfaction can be improved.

1: System, 10: User terminal, 20: First server device, 30: Network, 40: Second server device, 130: Touch screen, 150: Storage unit (of user terminal), 190: Control (of user terminal) Unit, 191: Operation input reception unit, 192: Transmission / reception unit, 193: Object generation unit, 194: Display control unit, 195: Detection unit, 196: Selection information acquisition unit, 250: Storage unit (of the first server device), 290: Control unit (of the first server device)

Claims (11)

A program executed in a first computer equipped with a processor and an image pickup unit.
The program is attached to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object for presenting the second information about the predetermined race to the user of the first computer based on the first information, and
The step of superimposing the virtual object on the real image around the first computer captured by the image pickup unit and displaying the virtual object is executed.
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
In the display step, at least a part of the contestant information is displayed in association with the moving object.
program. In the display step, the contestant information is displayed in more detail in association with the moving object in response to the operation input of the user.
The program according to claim 1. The contestant information displayed in the step to be displayed includes at least the odds information of the contestant or the moving body.
The program according to claim 1 or 2. The receiving step is executed at a predetermined frequency or when a specific event occurs, and is executed.
The contestant information may be updated by performing the receiving step.
The program according to any one of claims 1 to 3. The program is applied to the processor and further to the processor.
It is intended to execute a step of acquiring one or more selection information indicating one or more contestants or the moving object selected by the user.
The first information includes the position information of the contestant or the moving body during the execution of the predetermined race, and the time information corresponding to the position information.
The display step is to move the moving object based on the position information and the time information, and display a virtual race that virtually displays the predetermined race together with at least a part of the selection information. including,
The program according to any one of claims 1 to 4. In the virtual race, the moving object corresponding to the contestant or the moving object indicated by the selection information of the one or more is displayed in a display mode different from that of the other moving objects.
The program according to any one of claims 1 to 5. When the current ranking in the virtual race corresponds to the one or more contestants or the moving body indicated by the one or more selection information, the corresponding one or more selection information is referred to as another selection information. Display in different ways,
The program according to any one of claims 1 to 6. An information processing method executed in a first computer equipped with a processor and an image pickup unit.
The information processing method is applied to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object for presenting the second information about the predetermined race to the user of the first computer based on the first information, and
A step of superimposing the virtual object on a real image around the first computer captured by the image pickup unit and displaying the virtual object.
Including running
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
In the display step, at least a part of the contestant information is displayed in association with the moving object.
Information processing method. An information processing device equipped with a processor and an image pickup unit.
The processor
Receive the first information about a given race in the real world from the second computer,
A virtual object for presenting the second information regarding the predetermined race to the user of the first computer is generated based on the first information.
The virtual object is superimposed and displayed on a real image around the first computer captured by the image pickup unit.
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
The display step comprises displaying at least a portion of the contestant information in association with the moving object.
Information processing equipment. A system realized by a first computer provided with a first processor and an image pickup apparatus, and a second computer provided with a second processor and capable of communicating with the first computer.
The second processor is
Get the first information about a given race in the real world,
The first information is transmitted to the first computer,
The first processor is
The first information is received from the second computer,
A virtual object for presenting the second information regarding the predetermined race to the user of the first computer is generated based on the first information.
The virtual object is superimposed and displayed on a real image around the first computer captured by the image pickup unit.
The first information includes at least the contestant information regarding the contestants and / or the moving body in the predetermined race.
The virtual object includes at least a moving object corresponding to the contestant or the moving object.
The superimposed display includes displaying at least a part of the contestant information in association with the moving object.
system. The first processor further
Acquiring one or more selection information indicating the one or more contestants or the moving object selected by the user,
The first information includes the position information of the contestant or the moving body during the execution of the predetermined race, and the time information corresponding to the position information.
The display step is to move the moving object based on the position information and the time information, and display a virtual race that virtually displays the predetermined race together with at least a part of the selection information. Including
The position information is acquired based on a position sensor provided on the contestant or the moving body, or an image of the predetermined race captured by an image pickup device during the execution of the predetermined race.
The system according to claim 10.

Images