JP6903806B1 - Programs, information processing methods, information processing devices, and systems - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a user with an experience which cannot be obtained by watching a race in the real world when displaying the race in the real world as a virtual race by using a virtual object linked to the race in the real world, and to express the emotion of the user. Excitement. A program provides a processor with a step of receiving first information about a race in the real world, a step of generating a virtual object including a racefield object and a moving object based on the first information, and a real image. A step of superimposing and displaying virtual objects and a step of detecting the occurrence of an event in a race are executed. The first information includes the position information of the contestant or the moving body during the race, and the time information corresponding to the position information. In the display step, the race is virtually displayed based on the first information, and when the occurrence of the event is detected in the detection step, the effect display corresponding to the event is performed. [Selection diagram] Fig. 6

Description

The present disclosure relates to programs, information processing methods, information processing devices, and systems.

Patent Document 1 discloses a technique for efficiently transmitting location-specific information among a plurality of users by using augmented reality in a social networking service.

Japanese Unexamined Patent Publication No. 2020-77187

By the way, in the real world, various races such as boat races and horse races are carried out. When watching a game at these race tracks, you will see the race that is actually happening as it is, and there will be no production that excites emotions such as harassment and excitement.

Further, the technique disclosed in Patent Document 1 shares information associated with the place among users who visit the place, and is applicable when watching a race at a different place. It's not a thing.

One aspect of the present disclosure provides the user with an experience that cannot be obtained by watching a real-world race when displaying a real-world race as a virtual race using a virtual object linked to the real-world race. The purpose is to excite the user's emotions.

According to one embodiment presented in the present disclosure.
A program that is executed in a first computer equipped with a processor and an imaging unit.
The program is delivered to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object including a race track object representing a race track and a moving object representing a contestant or a moving body of the predetermined race based on the first information.
A step of superimposing the virtual object on a real image around the first computer captured by the imaging unit and displaying the virtual object.
A step of detecting the occurrence of a predetermined event in the predetermined race, and a step of detecting the occurrence of the predetermined event are executed.
The first information includes the position information of the contestant or the moving body during the execution of the predetermined race, and the time information corresponding to the position information.
In the display step, the moving object is moved on the racetrack object based on the first information, and the predetermined race is virtually displayed.
In response to the detection of the occurrence of the predetermined event in the detection step, the effect display corresponding to the occurrence of the predetermined event is performed in the display step.
The program is provided.

According to one embodiment shown in the present disclosure, when displaying a real world race as a virtual race using a virtual object linked to the real world race, a user can experience an experience that cannot be obtained by watching a real world race. It can be provided to the user to excite the user's emotions.

It is a figure which shows the configuration example of the system which follows a certain embodiment. It is a block diagram which shows an example of the functional structure of the user terminal according to a certain embodiment. It is a block diagram which shows an example of the functional configuration of the server according to a certain embodiment. It is a schematic diagram which shows an example of the race track of the real world according to a certain embodiment. It is a schematic diagram which shows an example of the virtual object displayed on the user terminal according to a certain embodiment. It is a flowchart which shows an example of the display control processing according to a certain embodiment. It is a schematic diagram which shows an example of the real image which was taken by the imaging unit according to a certain embodiment. It is a schematic diagram which shows an example of the screen which superposed the virtual object on the real image according to a certain embodiment and displayed. It is a schematic diagram which shows an example of the screen which superposed the virtual object on the real image according to a certain embodiment and displayed. It is a flowchart which shows an example of the race production processing according to a certain embodiment. It is a schematic diagram which shows an example of the display screen according to a certain embodiment. It is a schematic diagram which shows an example of the effect pattern according to a certain embodiment. It is a schematic diagram which shows an example of the effect pattern according to a certain embodiment. It is a schematic diagram which shows an example of the display screen according to a certain embodiment. It is a schematic diagram which shows an example of the display screen according to a certain embodiment. It is a flowchart which shows an example of the race production processing according to a certain embodiment. It is a schematic diagram which shows an example of the display screen according to a certain embodiment.

Hereinafter, embodiments of this technical idea will be described in detail with reference to the drawings. In the following description, the same elements are designated by the same reference numerals, and duplicate description will be omitted as appropriate. In one or more embodiments set forth in the present disclosure, the elements included in each embodiment may be combined with each other, and the combined deliverables shall also form part of the embodiments set forth in the present disclosure.

(System configuration)
FIG. 1 is a diagram showing a configuration of a system 1 according to the present embodiment. The system 1 can display, for example, a predetermined race to be performed in the real world as a virtual race using a virtual object on an information processing device used by a user. In the present specification, the "predetermined race" is not particularly limited as long as it is a race to be carried out in the real world, and for example, a boat race (actual race or exhibition race), horse racing, bicycle racing, auto racing, etc. Car races such as F1, drone races, dog races, marathons, ekiden, etc. can be mentioned.

As shown in FIG. 1, the system 1 is a user such as a user terminal 10A, a user terminal 10B, and a user terminal 10C (hereinafter, user terminals 10A, 10B, 10C) which are information processing devices (first computers) used by each user. A plurality of user terminals 10 such as "terminals are also collectively referred to as" user terminals 10 "), a first server device (second computer) 20, a second server device 40, and a network 30 are included.

The user terminal 10A and the user terminal 10B are connected to the network 30 by communicating with the wireless base station 31. The user terminal 10C connects to the network 30 by communicating with the wireless router 32 installed in a facility such as a house. The user terminal 10 is, for example, a portable terminal provided with a touch screen, and may be a smartphone, a phablet, a tablet, or the like.

The user terminal 10 executes, for example, a program installed via a platform for distributing an application or the like, or a program including pre-installed website browsing software. The user terminal 10 communicates with the first server device 20 by executing the above program, and transmits / receives data related to a predetermined race, data related to the user, and the like to / from the first server device 20. It is possible to display a virtual race on the terminal 10.

The first server device 20 receives data related to a predetermined race from the second server device 40. The first server device 20 appropriately transmits data related to a predetermined race to the user terminal 10. The first server device 20 stores and manages data related to a predetermined race and data related to each user.

The first server device 20 includes a communication IF (Interface) 22, an input / output IF 23, a memory 25, a storage 26, and a processor (second processor) 29 as a hardware configuration, and these provide a communication bus. They are connected to each other via.

The communication IF 22 supports various communication standards such as a LAN (Local Area Network) standard, and functions as an interface for transmitting and receiving data to and from the user terminal 10 and the second server device 40.

The input / output IF 23 functions as an interface for accepting input of information to the first server device 20 and outputting information to the outside of the first server device 20. The input / output IF 23 may include an input receiving unit that accepts the connection of an information input device such as a mouse and a keyboard, and an output unit that accepts the connection of an information output device such as a display for displaying an image or the like.

The memory 25 is a storage device for storing data or the like used for processing. The memory 25 provides the processor 29 with a work area for temporary use, for example, when the processor 29 performs processing. The memory 25 includes a ROM (Read Only Memory) and a RAM (Random).
It is configured to include a storage device such as Access Memory).

The storage 26 is a storage device for storing various programs and data for the processor 29 to read and execute. The information stored in the storage 26 includes data related to a predetermined race, data related to each user, and the like. The storage 26 may be configured to include a storage device such as an HDD (Hard Disk Drive) or a flash memory. The storage is not limited to the form included in the server device, and cloud services can also be used.

The processor 29 controls the operation of the first server device 20 by reading and executing a program or the like stored in the storage 26. The processor 29 includes, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and a GPU (Graphics).
Processing Unit) and the like can be included.

The second server device 40 stores and manages data related to a predetermined race. The second server device 40 is, for example, a server device managed by a predetermined race organizer or a server device managed by an organization (such as a publisher of a race magazine) that transmits information on a predetermined race to the outside. The second server device 40 appropriately transmits data related to a predetermined race to the first server device 20. In certain aspects, the second server device 40 may transmit data related to a predetermined race to the user terminal 10. The hardware configuration of the second server device 40 may be the same as that of the first server device 20 as long as there is no contradiction.

(User terminal)
FIG. 2 is a block diagram showing an example of the functional configuration of the user terminal 10. As shown in FIG. 2, the user terminal 10 includes an antenna 110, a wireless communication IF 120, a touch screen 130, an input / output IF 140, a storage unit 150, a voice processing unit 160, a microphone 161 and a speaker 162. The image pickup unit 170 and the control unit (first processor) 190 are included.

The antenna 110 radiates a signal emitted by the user terminal 10 into space as a radio wave. Further, the antenna 110 receives radio waves from the space and gives a received signal to the wireless communication IF 120.

Since the user terminal 10 communicates with other communication devices, the wireless communication IF 120 performs modulation / demodulation processing for transmitting / receiving signals via the antenna 110 or the like. The wireless communication IF 120 is a communication module for wireless communication including a tuner, a high frequency circuit, etc., performs modulation / demodulation and frequency conversion of a wireless signal transmitted / received by the user terminal 10, and supplies a received signal to the control unit 190.

The touch screen 130 receives input from the user and outputs information to the user on the display 132. The touch screen 130 includes a touch panel 131 for receiving user operation input and a display 132. The touch panel 131 detects that a user's finger or the like approaches by using, for example, a capacitance type touch panel. The display 132 is realized by, for example, an LCD (Liquid Crystal Display), an organic EL (electroluminescence), or other display device.

The input / output IF 140 functions as an interface for accepting input of information to the user terminal 10 and outputting information to the outside of the user terminal 10.

The storage unit 150 is composed of a flash memory, an HDD, and the like, and stores a program used by the user terminal 10 and various data and the like received by the user terminal 10 from the first server device 20 and the like.

The voice processing unit 160 performs modulation / demodulation of the voice signal. The voice processing unit 160 modulates the signal given from the microphone 161 and gives the modulated signal to the control unit 190. Further, the voice processing unit 160 gives a voice signal to the speaker 162. The voice processing unit 160 is realized by, for example, a processor for voice processing. The microphone 161 functions as an audio input unit for receiving an input of an audio signal and outputting it to the control unit 190. The speaker 162 functions as an audio output unit for outputting an audio signal to the outside of the user terminal 10.

The imaging unit 170 is a camera that captures a real image of the surroundings of the user terminal 10. The image captured by the imaging unit 170 is image-processed by the control unit 190 and output to the display 132.

The control unit 190 controls the operation of the user terminal 10 by reading and executing the program stored in the storage unit 150. The control unit 190 is realized by, for example, an application processor.

The process in which the control unit 190 executes the application program 151 will be described in more detail. The storage unit 150 stores the application program 151, the application information 152, and the user information 153.

For example, the user terminal 10 downloads the application program 151 from the first server device 20 and stores it in the storage unit 150. Further, the user terminal 10 transmits and receives various data such as application information 152 and user information 153 to and from the first server device 20 by communicating with the first server device 20.

The application program 151 is a program for displaying a virtual race on the user terminal 10. The application information 152 includes various data referred to by the application program 151. The application information 152 includes the first information 152A and the event information 152B.

The first information 152A is information regarding a predetermined race transmitted from the first server device 20 and the second server device 40. The first information 152A includes, for example, race time information indicating the race time of a participant or a moving body (hereinafter, also referred to as “participant or the like”) of a predetermined race, position information of the participant or the like during the execution of the predetermined race, and the like. The time information corresponding to the location information and the time information are included.

As used herein, the term "contestant" is a concept that includes not only humans but also animals such as horses and dogs. Further, the "moving body" is a main body of movement in a predetermined race, and is an animal or an aircraft on which a contestant rides, an aircraft remotely controlled by a contestant, or the like. In marathons, dog races, etc., "participants" and "moving bodies" are the same.

In addition to the above, the first information 152A includes, for example, a predetermined race name, date and time, race field data, contestant data, moving object data, odds information, race prediction, race start table, and information immediately before the race. It may include pit reports, race results, race videos, race stills, past race information, and other information that may be published in information magazines or information sites about a given race.

The event information 152B is information about an event that can occur or has occurred in a predetermined race, and includes, for example, information about an effect display and an effect sound corresponding to the event. The event information includes, for example, template event information corresponding to a template event that always occurs in a predetermined race, and random event information corresponding to a random event that randomly occurs in a predetermined race.

The template event is not particularly limited, but for example, one or more of the entry of the contestants into the race track, the start of the predetermined race, the achievement of the goal of the first contestant, etc., and the determination of the ranking of the predetermined race. It may be. The random event is not particularly limited, but for example, the rankings of the contestants, etc. are changed, and the difference in the positions of two or more contestants, etc. at a predetermined timing is equal to or less than a predetermined threshold value (two or more contestants, etc.). ), Rule violation occurs, the fixed odds of the predetermined race are equal to or higher than the predetermined magnification, and the voting ticket of the predetermined race stored as the user's purchase information in the first computer is correct. It may be one or more of them.

Random events also include, for example, unforeseen events that are not normally expected in a given race. Unexpected events include, for example, spectators rushing into the race track and sudden natural disasters such as a large earthquake.

The event information 152B may include information stored in the storage unit 150 before the start of the predetermined race and information received from the first server device 20 after the event occurs in the predetermined race. For example, at least a part of the random event information such as the information of the unexpected event is the information received from the first server device 20 after the event occurs in the predetermined race.

Further, the event information 152B includes, for example, information about a two-dimensional image or a three-dimensional image corresponding to a predetermined event. Specifically, the event information 152B may include information about a text image for notifying the content of the event, a predetermined character image, an effect image to be added to a virtual object described later, and the like.

The user information 153 includes information about the user of the user terminal 10. The user information 153 includes, for example, information for identifying the user, position information of the user terminal 10, race purchase history and hit rate of the user (for example, in the case of boat race, the history of the purchased boat ticket and the purchased boat ticket. Hit rate) and the like may be included.

By reading and executing the application program 151, the control unit 190 reads and executes the operation input reception unit 191 and the transmission / reception unit 192, the object generation unit 193, the display control unit 194, the flat surface detection unit 195, and the event detection unit. Each function of 196 and the effect sound control unit 197 is exhibited.

The operation input receiving unit 191 receives the user's operation input based on the output of the touch screen 130. Specifically, the operation input receiving unit 191 detects that the user's finger or the like touches or approaches the touch panel 131 as the coordinates of the coordinate system including the horizontal axis and the vertical axis of the surface constituting the touch screen 130.

The operation input reception unit 191 determines the user's operation on the touch screen 130. The operation input reception unit 191 is, for example, "approach operation", "release operation", "tap operation", "double tap operation", "long press operation (long touch operation)", "drag operation (swipe operation)", Determine the user's operation such as "move operation", "flick operation", "pinch-in operation", and "pinch-out operation".

The operation input receiving unit 191 may accept the movement of the user terminal 10 detected by the acceleration sensor or the like mounted on the user terminal 10 as the operation input.

The transmission / reception unit 192 transmits and receives various information with external communication devices such as the first server device 20 and the second server device 40 via the wireless communication IF 120 and the network 30. The transmission / reception unit 192 receives, for example, the first information 152A and the event information 152B from the first server device 20 or the second server device 40. Further, the transmission / reception unit 192 transmits, for example, information corresponding to the operation input received by the operation input reception unit 191 and information stored in the user information 153 to the first server device 20 or the second server device 40. ..

The object generation unit 193 generates a virtual object for presenting the second information regarding a predetermined race to the user based on the first information. In the present specification, the "second information" is, for example, at least a part of the first information 152A or information calculated from the first information 152A. In some aspects, the "second information" can be information that can be presented as text. In a certain aspect, the "second information" may be ranking information indicating the ranking of the contestants or the like during a predetermined race or the ranking of the contestants or the like as a result of the race.

The object generation unit 193 generates, as virtual objects, a race track object representing a race track and a moving object representing a contestant or the like. The object generation unit 193 may generate a virtual display board for displaying the second information as text. In addition to the above objects, the object generation unit 193 includes a virtual screen for displaying the second information as an image, various building objects, landscape objects that compose the landscape such as trees, and objects that serve as user avatars. It may be generated.

The display control unit 194 superimposes an image (hereinafter, also referred to as “superimposed image”) on which a virtual object generated by the object generation unit 193 is superimposed on a real image around the user terminal 10 imaged by the image pickup unit 70. It is displayed on the display 132. The display control unit 194 moves the moving object on the race track object based on the race time information included in the first information 152A, and displays a virtual race that virtually reproduces a predetermined race on the display 132. It is preferable that the display control unit 194 reproduces the virtual race based on the position information of the contestants and the like included in the first information 152A and the time information corresponding to the position information in addition to the race time information. ..

It is preferable that the display control unit 194 can change the viewpoint in the superimposed image according to the operation input received by the operation input reception unit 191. The display control unit 194 displays various menu screens and GUIs (Graphical User Interfaces) on the display 132, and changes the display contents of the display 132, in response to the operation input received by the operation input reception unit 191.

Further, the display control unit 194 displays an effect corresponding to the event in response to the event detection unit 196 detecting the occurrence of the event. The content of the effect display is not particularly limited, but for example, a display of a two-dimensional image or a three-dimensional image corresponding to a predetermined event, a display of a predetermined character image, and operation of these images according to the progress of the race. , And one or more of the effect displays on at least one of the racetrack object and the moving object. The display control unit 194 may simultaneously execute two or more effect displays corresponding to different events.

The flat surface detection unit 195 detects a flat surface in the real image captured by the image pickup unit 170. The detection of a flat surface is realized by a conventionally known image recognition technique. For example, when the user performs an operation of selecting the flat surface detected by the flat surface detection unit 195, the superimposed image in which the race track object is arranged on the flat surface is displayed on the display 132.

The flat surface is preferably a horizontal surface. Further, the angle formed by the flat surface and the bottom surface forming the race track object may be 0 degrees, but is preferably an acute angle, and can be, for example, in the range of 15 degrees to 45 degrees. The angle may be adjusted by accepting a user's operation. Also, even if there is a convex part on a part of the flat surface in the real world, or if there is an object on the flat surface, if the convex part or the object is of a size that can be hidden by the race track object. , The racetrack object may be detected as a flat surface where it can be placed.

The event detection unit 196 detects the occurrence of a predetermined event in a predetermined race. The event detection unit 196, for example, receives event information transmitted from the first server device 20 when a predetermined event occurs in a predetermined race in the real world, and the transmission / reception unit 192 receives the event information of the predetermined event. Detect the occurrence.

Further, the event detection unit 196 may detect the occurrence of a predetermined event based on, for example, the first information 152A and the user information 153. Specifically, the event detection unit 196 can determine from the position of the contestants, etc. during the race, such as the change of ranking of the contestants, etc., based on the position information of the contestants, etc. and the time information corresponding to the position information. Events can be detected. The event detection unit 196 can detect an event such as a hit of a voting ticket purchased by the user based on, for example, information on the race result and information on the race purchase history of the user.

The effect sound control unit 197 outputs the effect sound corresponding to the generated event as a voice together with the effect display by the display control unit 194. The effect sound control unit 197 controls, for example, to output sound from the speaker 162 based on the effect sound information included in the event information 152B.

(1st server device)
FIG. 3 is a block diagram showing a functional configuration of the first server device 20. A detailed configuration of the first server device 20 will be described with reference to FIG. The first server device 20 exerts functions as a communication unit 220, a storage unit 250, and a control unit 290 by operating according to a program.

The communication unit 220 functions as an interface for the first server device 20 to communicate with an external communication device such as the user terminal 10 or the second server device 40 via the network 30.

The storage unit 250 stores various programs and data for realizing the system 1. In a certain aspect, the storage unit 250 stores the program 251 and the race information 252 and the user information 253.

The program 251 is a program for the first server device 20 to communicate with the user terminal 10 and the second server device 40 to realize the system 1. The program 251 is executed by the control unit 290 to send and receive data to and from the user terminal 10 and the second server device 40, a process according to the operation content performed by the user of the user terminal 10, race information 252, and the user. The first server device 20 is made to perform a process of updating the information 253 and the like.

Race information 252 includes various data related to a given race. The race information 252 includes, for example, the first information 252A and the event information 252B. The first information 252A is the source information of the first information 152A, and the first information 152A can be a part of the first information 252A. The first information 252A is, for example, information acquired from the second server device 40.

The event information 252B is the source information of the event information 152B, and the event information 152B can be a part of the event information 252B. That is, the event information 252B may include information on the effect display and the effect sound corresponding to each event. Further, the event information 252B may include template event information and random event information.

The user information 253 is information about the user of the user terminal 10. The user information 253 includes a user management table 253A. The user management table 253A stores, for example, information for identifying the user, position information of the user terminal 10, a race purchase history of the user, a hit rate, and the like for each user.

The control unit 290 is realized by the processor 29, and by executing the program 251, the transmission / reception unit 291 and the first information acquisition unit 292, the event occurrence detection unit 293, the event information registration unit 294, the data management unit 295, and the timekeeping unit 296. Demonstrate each function as.

The transmission / reception unit 291 transmits and receives various information to and from an external communication device such as a user terminal 10 and a second server device 40 via the communication unit 220 and the network 30. The transmission / reception unit 291 transmits, for example, at least a part of the first information 252A and the event information 252B to the user terminal 10. Further, the transmission / reception unit 291 receives, for example, the first information 252A from the second server device 40.

The first information acquisition unit 292 acquires the first information 252A from the second server device 40 via the transmission / reception unit 291.

The event occurrence detection unit 293 detects that an event has occurred in a predetermined race in the real world. The event occurrence detection unit 293 may detect the occurrence of an event by, for example, analyzing an image obtained by capturing an image of a predetermined race. Further, the event occurrence detection unit 293 detects the occurrence of an event based on, for example, the transmission / reception unit 291 receiving information notifying the occurrence of the event (for example, the occurrence of a rule violation) from the second server device 40. You may.

Further, the event occurrence detection unit 293 may detect the occurrence of an event based on, for example, an operation input by an administrator or the like of the first server device 20 that is performed when an event occurs. Further, the event occurrence detection unit 293 may detect the occurrence of an event based on, for example, the administrator of the first server device 20 registering the information about the unexpected event in the event information 252B after the occurrence of the unexpected event. ..

When the event occurrence detection unit 293 detects the occurrence of an event, for example, the event information corresponding to the generated event is transmitted to the user terminal 10 with reference to the event information 252B. The event information transmitted at this time may include information related to the effect display and the effect sound, or may be only information that can identify the event that has occurred (for example, the event ID).

The event information registration unit 294 accepts event registration. The event information registration unit 294 accepts, for example, the definition of each event and the registration of the effect display and the effect sound corresponding to each event based on the operation input by the administrator of the first server device 20 or the like. The event information registration unit 294 can accept registration of event information, for example, before the start of a predetermined race in the real world or during the progress of the predetermined race.

The definition of an event may be related to a predetermined timing in the race (for example, the start of the race, the second lap, the entry into the final corner, etc.), the positional relationship of the contestants, etc., or the predetermined timing and positional relationship. It may be related to. Further, the definition of the event may include the relevance to the user, and may be, for example, the positional relationship and the ranking of the contestants who are the target of the voting ticket purchased by the user.

As a specific example of the definition of an event, the start of a race is defined as a race start event, the determination of the ranking of participants, etc. is defined as a ranking determination event, and a predetermined timing (for example, the end of the race). The definition of a close battle event is that the difference between the positions of two or more contestants is equal to or less than a predetermined threshold value, but the event is not limited to this. The definition of the event can be appropriately set by the administrator of the first server device 20 or the like according to the type of race or the like.

The data management unit 295 performs a process of updating various data stored in the storage unit 250 according to the processing results of the first information acquisition unit 292, the event information registration unit 294, and the like. The timekeeping unit 296 performs a process of measuring the time. Various times displayed on the user terminal 10 (for example, the time until the start of the race) can be controlled based on the time measured by the time measuring unit 296.

(Operation example)
Next, an operation example in the system 1 will be described with reference to FIGS. 4 to 17. In the following, the case where the predetermined race is a boat race will be mainly described as an example, but the following description can be applied even if the predetermined race is another race. Further, in the following description, it is assumed that data is transmitted / received between the user terminal 10 and the first server device 20 and between the first server device 20 and the second server device 40, but in a certain aspect, the user The terminal 10 and the second server device 40 may be configured to directly send and receive data.

FIG. 4 is a schematic diagram showing an example of a boat race field in the real world. Two turn marks 403 are installed in the boat race field 401, and races are carried out by boats 402a to 402f on which each boat racer rides. When the race is completed, the race time information indicating the race times of the boats 402a to 402f is transmitted from the second server device 40 to the first server device 20, and is transmitted from the first server device 20 to the user terminal 10.

The boat race field 401 is provided with imaging devices (cameras) 404a to 404b. The image pickup apparatus 404a brings the boats 402a to 402f into view from above the boat race field 401. The image pickup apparatus 404b brings the boats 402a to 402f into view from the side of the boat race field 401. The images of the boats 402a to 402f captured by the image pickup devices 404a to 404b are transmitted to the second server device 40. In the second server device 40, for example, image analysis of each image is performed, and position information indicating the position of each of the boats 402a to 402f at the shooting time of each image is calculated. The calculated position information and the time information related to the shooting time corresponding to the position information are transmitted to the first server device 20, and are transmitted from the first server device 20 to the user terminal 10. The location information may be calculated by the first server device 20.

Further, a position sensor such as a GPS sensor may be installed on the boats 402a to 402f instead of or in addition to the image pickup devices 404a to 404b. The position information of the boats 402a to 402f acquired by the position sensor and the time information indicating the time when the position information was acquired are finally transmitted to the user terminal 10.

FIG. 5 is a schematic diagram showing an example of a virtual object displayed on the user terminal 10. In the example of FIG. 5, as virtual objects, a race track object 501, moving objects 502a to 502f (hereinafter collectively referred to as “moving object 502”), two turnmark objects 503, and a virtual display board 505 are used. It is shown.

The race field object 501 is an object that virtually displays the boat race field 401. The race track object 501 and the turn mark object 503 are preferably created based on race track data such as course information of the boat race track 401, and preferably have a shape corresponding to the boat race track 401.

The moving objects 502a to 502f are objects that virtually display the boats 402a to 402f, respectively, and have a shape imitating a boat. The moving objects 502a to 502f move the race track object 501 based on the race time information, the position information of the boats 402a to 402f, and the time information corresponding to the position information. That is, the race track objects 501 and the moving objects 502a to 502f display the real world race as a virtual race on the user terminal 10.

Even if there is no position information and time information of the boats 402a to 402f, it is possible to display the virtual race only by the race time information. However, in this case, the final order of arrival will be the same as in the real world race, but it is difficult to reproduce the race progress such as the ranking during the race.

The virtual display board 505 is an object that displays text information. The virtual display board 505 is, for example, a corresponding nonexistent object in the boat race field 401. The text information displayed on the virtual display board 505 is not particularly limited, and may be, for example, ranking information, odds information, or the like. Further, the text information displayed on the virtual display board 505 may be changeable based on the operation input of the user.

FIG. 6 is a flowchart showing an example of the display control process. The order of the processes constituting each of the flowcharts (including FIGS. 10 and 16) described below is in no particular order as long as the processing contents are not inconsistent or inconsistent, and may be executed in parallel. Further, the processing executed by each device may be executed by another device as long as there is no contradiction.

The processing shown in each flowchart is realized by the control unit 190 executing the application program 151 and the control unit 290 executing the program 251. First, in step S610, the control unit 190 activates the image pickup unit 170, which is a camera. The image pickup unit 170 captures a real image of the surroundings of the user terminal 10.

In step S620, the control unit 190 detects a flat surface in the image captured by the imaging unit 170. In step S630, the control unit 190 arranges the virtual object on the detected flat surface.

Here, the processes of steps S610, S620, and S630 will be specifically described with reference to FIGS. 7 to 9. FIG. 7 is a schematic view showing an example of a real image captured by the imaging unit 170. In the example of FIG. 7, a keyboard 702 and a monitoring device 703 are placed on a flat desk 701.

When the imaging unit 170 is activated in step S610, the actual image captured by the imaging unit 170 is displayed on the display 132. Next, in step S620, the control unit 190 detects a flat surface in the image captured by the imaging unit 170, that is, in the image displayed on the display 132.

In FIG. 7, the region 704 is detected as a flat surface. Although there is a keyboard 702 in the area 704, the control unit 190 detects the area 704 as a flat surface because the size of the keyboard 702 is hidden by the race track object 501.

If the position imaged by the imaging unit 170 is changed in the state shown in FIG. 7, the position of the region 704 can also be changed. The area 704 is displayed on the display 132 so as to be distinguishable from other parts, for example, by adding a predetermined color. When the user executes a tap operation or the like on the area 704, in step S630, the control unit 190 arranges a virtual object such as the race track object 501 on the area 704.

FIG. 8 is a schematic diagram showing an example of a screen in which a virtual object is superimposed on a real image and displayed. In FIG. 8, the area with the dot pattern including the monitoring device 703 is the real image, and the other area is the area where the virtual object is displayed. For example, an advertisement image may be displayed in the area where the virtual object is not displayed.

In FIG. 8, the racefield object 501, the plurality of moving objects 502, the two turnmark objects 503, the large monitor object 506, the building objects 507a to 507b, and other symbols are not attached as virtual objects. A large number of objects (tree objects, clock objects, etc.) and are displayed. These objects are created, for example, based on the first information 152A received from the first server device 20.

In FIG. 8, the race track object 501 is arranged on the region 704 so that the angle formed by the flat surface included in the region 704 and the bottom surface forming the race track object 501 is 0 degrees. In this case, for example, an area in the depth direction such as the area X1 or moving objects 502 may overlap each other and become difficult to see. Further, in a region on the depth direction side of the large monitor object 506 or the like, a blind spot may occur in which the moving object 502 cannot be seen.

However, in the state shown in FIG. 8, the user can change the viewpoint of the superimposed image displayed on the display 132. For example, when the user inputs an operation such as a pinch-in operation or a pinch-out operation, the viewpoint position of the imaging unit 170 may move closer to or further from the racetrack object 501. Further, when the user moves in the depth direction of the display 132 or moves in the front direction while holding the user terminal 10, the viewpoint position of the imaging unit 170 may move closer to or further away from the race track object 501. Further, when the user performs an operation such as designating a predetermined position on the display 132, the viewpoint position can be moved to the designated position. By such a viewpoint change, the above-mentioned problem of visibility can be solved.

Further, by arranging the race track object 501 so that the angle θ formed by the flat surface and the bottom surface forming the race track object 501 is an acute angle, the above-mentioned problem regarding visibility can be alleviated.

FIG. 9 is a schematic view showing an example of a screen in which a virtual object is superimposed on a real image, and shows another aspect of the racetrack object 501 shown in FIG. Specifically, FIG. 9 shows an example in which a predetermined race is horse racing.

Also in FIG. 9, the area with the dot pattern including the monitoring device 703 is the real image, and the other area is the area where the virtual object is displayed. In FIG. 9, as virtual objects, a race track object 511, a plurality of moving objects 512, a large monitor object 513, a pond object 514, and a plurality of tree objects 515 are displayed on the display 132. These objects are also created based on, for example, the first information 152A received from the first server device 20.

The racetrack object 511, the large monitor object 513, the pond object 514, and the plurality of tree objects 515 are preferably created based on racetrack data such as, for example, course information of a predetermined racetrack in the real world. The plurality of moving objects 512 are, for example, objects that virtually display horses and jockeys running in horse racing.

Returning to the description of the flowchart of FIG. In step S640, the control unit 190 acquires the position information of the boats 402a to 402f in the boat race field 401 in the real world. That is, when the race by the boats 402a to 402f is started in the real world, the control unit 190 acquires the position information and the time information of the boats 402a to 402f from the first server device 20. The method of acquiring the position information and the time information is as described with reference to FIG.

In step S650, the control unit 190 controls the position information acquired in step S640 and the moving object to be linked with each other. Specifically, using the time information and the position information, the movements of the boats 402a to 402f on the race field object 501 are controlled to be the same as the movement objects 502a to 502f on the boat race field 401.

In step S660, the control unit 190 executes the race effect processing. The details of the race effect processing will be described in detail with reference to FIGS. 10 and 16.

The processes of steps S640, S650, and S660 are repeated at least from the start to the end of the race in the real world, but may be repeated before and after the start and end of the race in the real world.

If the race to be displayed as a virtual race is a past race, the position information of the boats 402a to 402f from the start to the end of the race may be collectively acquired before the start of the virtual race. Further, the virtual race may be displayed by acquiring only the race time information without acquiring the position information and the like. The race displayed as a virtual race may be an exhibition race.

FIG. 10 is a flowchart showing an example of the race effect processing in step S660 described above. FIG. 10 is a flowchart when, for example, information about an event that has occurred is registered in the event information 152B and / or the event information 252B before the event occurs.

First, in step S661, the control unit 290 registers an event. In step S661, for example, the definition of each event is registered in the event information 252B based on the operation input by the administrator of the first server device 20 or the like.

Next, in step S662, the control unit 290 registers an effect pattern such as an effect display and an effect sound corresponding to each event. In step S662, for example, the effect pattern is registered in the event information 252B based on the operation input by the administrator of the first server device 20 or the like.

Note that steps S661 and S662 are processes executed, for example, before a predetermined race is started in the real world, that is, at least before the process of step S640. Further, at least a part of the contents registered in step S661 and step S662 may be transmitted to the user terminal 10 and stored as event information 152B at least before the processing of step S640.

In step S663, the control unit 190 detects the occurrence of a predetermined event in a predetermined race. When a predetermined event occurs in a predetermined race in the real world, for example, the control unit 290 analyzes the image of the race and based on the information received from the second server device 40 and the information stored in the event information 252B. , The occurrence of the event is detected, and the event information indicating that the occurrence of the event has been detected is transmitted to the user terminal 10. In step S663, the control unit 190 detects the occurrence of an event, for example, based on receiving the event information during the race.

Further, in step S663, the control unit 190 generates a predetermined event based on, for example, the first information 152A and the user information 153, without transmitting the event information from the first server device 20 during the race. It may be detected. For example, the control unit 190 may detect the occurrence of a predetermined event based on the position information of the contestants and the like and the time information corresponding to the position information.

Next, in step S664, the control unit 190 outputs an effect display and an effect sound corresponding to the generated event, and ends. In step S663, when the event information is received from the first server device 20, and the event information includes information related to the effect display or the like, in step S664, for example, based on the information related to the effect display or the like. The effect display and the like are executed.

On the other hand, when the event information received from the first server device 20 is only information that identifies an event such as an event ID, in step S664, for example, information on the effect display and the effect sound corresponding to the acquired event ID or the like is displayed as an event. It is acquired from the information 152B, and the effect display and the like are executed based on the information.

Hereinafter, the process of step S664 will be specifically described with reference to FIGS. 11 to 15. FIG. 11 is a schematic view showing an example of the display screen in step S664. In the example of FIG. 11, the display 132 displays the effect display column 1001 in addition to various virtual objects such as the race track object 501.

The effect display field 1001 may be displayed at all times during the race, may be displayed when an event occurs, and may be hidden when the event ends. The effect display field 1001 may be a two-dimensional image or a three-dimensional image.

In the effect display column 1001, an effect display is made according to the type of event detected in step S663. In FIG. 11, each moving object 502 is waiting in the area X1 which is the starting point, and the race is about to start. In step S663, for example, the occurrence of a pre-race event is detected based on this situation.

In this case, the effect display 1011 corresponding to the pre-race start event is displayed in the effect display column 1001. In the example of FIG. 11, a text image showing the name of the race to be started is displayed as the effect display 1011. Further, in accordance with the display, a production sound such as a fanfare is output from the speaker 162.

12 and 13 are schematic views showing another example of the effect pattern in step S664. Specifically, FIG. 12 shows an example of an effect pattern when an event occurs in which a voting ticket purchased by a user hits the mark.

In the example of FIG. 12, an animation image is displayed as the effect display 1012 in the effect display column 1001. The animation image is a video showing how the Kusudama is broken and the confetti is scattered. Along with the display of the animation image, for example, a directing sound such as an applause sound is output from the speaker 162.

Specifically, FIG. 13 shows an example of an effect pattern when a close battle event occurs by two contestants. In the example of FIG. 13, in the effect display column 1001, an image in which two contestants 1013a and 1013b who are performing close battles face each other is displayed as the effect display 1013. Along with the display of the image, for example, a production sound such as a sound effect that excites the confrontation is output from the speaker 162.

At least one of the contestants 1013a and 1013b is preferably subject to the voting ticket purchased by the user. That is, it is preferable that the definition of a close battle event is that the contestant who is the target of the voting ticket purchased by the user plays the close battle. In addition, from the viewpoint of further increasing the excitement of the user, the close battle event is the order in which the contestants who are the target of the voting ticket purchased by the user are involved in the voting ticket (for example, the voting ticket is a triple single type or a triple double type). It is more preferable to generate it when competing for 1st to 3rd place).

FIG. 14 is a schematic view showing another example of the display screen in step S664. In the example of FIG. 14, the display 132 displays the effect object 1301 in addition to various virtual objects such as the race track object 501. The effect object 1301 may be displayed when an event occurs and may be hidden when the event ends. The effect object 1301 may be a two-dimensional object or a three-dimensional object.

The effect object 1301 is an object generated according to the type of event detected in step S663. FIG. 14 shows a situation in which the leading moving object 502b has entered the last straight line of the race. In step S663, for example, the occurrence of the final linear event is detected based on this situation.

That is, the effect object 1301 in the example of FIG. 14 corresponds to the final linear event. The effect object 1301 contains the text "last spurt" to inform the user that the race has entered the last straight line. Further, a predetermined effect sound is output from the speaker 162 in accordance with the display of the effect object 1301.

Further, an effect image such as an aura is displayed around the moving object 502a. This effect display is added to the contestants who are the target of the voting ticket purchased by the user, for example, when the final straight line event occurs.

The addition of the effect display is not limited to the above example, and may be always added to the contestants who are the target of the voting ticket purchased by the user, or the occurrence of other events other than the final linear event. It may be added according to the detection (for example, when it detects that the acceleration has increased, the speed is faster than other contestants, etc.), or it is not covered by the voting ticket purchased by the user. It may be added to a certain contestant.

Further, the effect display may be added to other virtual objects such as the racetrack object 501 instead of the moving object 502. For example, an effect image showing the trajectory of the predetermined moving object 502 may be added to the race track object 501.

FIG. 15 is a schematic view showing another example of the display screen in step S664. In the example of FIG. 15, on the display 132, in addition to various virtual objects such as the race track object 501, the effect objects 1401a and 1401b are displayed.

The situation of FIG. 15 is a situation in which the moving objects 502a'and 502b are playing a close battle. In step S663, for example, the occurrence of a close battle event is detected based on this situation.

The effect object 1401a is a three-dimensional object of the character corresponding to one moving object 502a'playing a close battle, and the effect object 1401b is a three-dimensional object of the character corresponding to the other moving object 502b playing a close battle. It is an object. The effect objects 1401a and 1401b may be two-dimensional images of the character.

The correspondence between the moving object 502 and the three-dimensional object may be set in advance by the administrator of the first server device 20, or may be set by the user of the user terminal 10. For example, the object corresponding to each moving object 502 may be configured so that the user can select from a plurality of three-dimensional objects set as selection candidates. Further, the types of three-dimensional objects as selection candidates may be increased according to the user's billing and the like.

The effect objects 1401a and 1401b operate according to the progress of the race, for example. Specifically, the effect objects 1401a and 1401b may behave as if they fight each other according to the progress of the race, and finally, the one who wins the close battle may win the battle.

Further, in the example of FIG. 15, the moving object 502a'corresponds to the moving object 502a imitating a boat, that is, moves according to the position information of the boat 402a, but is an object imitating a boat. Instead, it has been replaced with a character image that imitates a bear. Such replacement of the moving object 502 is also a kind of effect display. Further, in the case of such a replacement, an effect display such that the moving object 502a'is swimming on the race track object 501 may be displayed.

In the example of FIG. 15, the user has purchased a voting ticket for the moving object 502a. Then, in response to the display of the effect objects 1401a and 1401b, the moving object 502a is replaced with the moving object 502a'indicating the character image corresponding to the effect object 1401a. The moving object 502b may also be replaced with, for example, a character image imitating an oni.

The replacement of the moving object 502 is not limited to the above example, and the moving object 502 may be replaced with another three-dimensional object, for example. Further, the replacement of the moving object 502 may be performed at all times regardless of the occurrence of the event.

Further, the moving object 502 may be hidden instead of being replaced with another object or the like. For example, when the occurrence of an event in which a contestant or the like is disqualified during a race is detected, the moving object 502 corresponding to the disqualified contestant or the like may be hidden.

Next, another example of the race effect processing will be described with reference to FIG. FIG. 16 is a flowchart when, for example, information about an event that has occurred is not registered in the event information 152B and / or the event information 252B before the occurrence of the event, that is, when an unexpected event occurs.

When an unexpected situation occurs during the race (Yes in step S665), in step S666, the control unit 290 directs the unexpected event and the unexpected event based on the operation input by the administrator of the first server device 20 or the like. The pattern is newly registered in the event information 252B. In addition, the control unit 290 transmits information about the unexpected event and the effect pattern of the unexpected event to the user terminal 10.

Registration of unforeseen events and transmission of information regarding unforeseen events and the like may be performed in stages. For example, only the occurrence of an unexpected event may be registered and transmitted first, and the specific content of the unexpected event may be registered later. In this case, first, only the effect display indicating the occurrence of the unexpected event is made on the user terminal 10, and as soon as the specific content of the unexpected event is registered and transmitted, the effect display showing the specific content of the unexpected event is made.

Next, in step S667, the control unit 190 detects the occurrence of the unexpected event based on the reception of the unexpected event and the information regarding the effect pattern of the unexpected event. Next, in step S668, the control unit 190 outputs an effect display and an effect sound corresponding to the unexpected event that has occurred, and ends.

If no unexpected situation has occurred during the race (No in step S665), the processes of steps S666 to S668 are not executed and end. The control unit 290 detects the occurrence of an unexpected situation based on, for example, the information transmitted from the second server device 40 or the operation input by the administrator of the first server device 20 or the like.

FIG. 17 is a schematic view showing an example of the display screen in step S668. In the example of FIG. 17, on the display 132, in addition to various virtual objects such as the race track object 501, the effect object 1601 and the text field 1602 are displayed.

The effect object 1601 is an object indicating that an unexpected event has occurred. The text field 1602 is a field indicating the content of the unexpected event. In the example of FIG. 17, "warning" is displayed in the text field 1602, and the specific content of the unexpected event is not shown. The text field 1602 is changed to indicate, for example, the specific content of the unexpected event, the influence on the race, etc. after the user terminal 10 receives the information indicating the specific content of the unexpected event and the effect pattern thereof. To.

The above embodiments are merely examples for facilitating the understanding of the present invention, and are not intended to limit the interpretation of the present invention. It goes without saying that the present invention can be modified and improved without departing from the spirit thereof, and the present invention includes an equivalent thereof.

[Additional notes]
The contents of this disclosure are listed below.

(Item 1)
A program that is executed in a first computer equipped with a processor and an imaging unit.
The program is delivered to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object including a race track object representing a race track and a moving object representing a contestant or a moving body of the predetermined race based on the first information.
A step of superimposing the virtual object on a real image around the first computer captured by the imaging unit and displaying the virtual object.
A step of detecting the occurrence of a predetermined event in the predetermined race, and a step of detecting the occurrence of the predetermined event are executed.
The first information includes the position information of the contestant or the moving body during the execution of the predetermined race, and the time information corresponding to the position information.
In the display step, the moving object is moved on the racetrack object based on the first information, and the predetermined race is virtually displayed.
In response to the detection of the occurrence of the predetermined event in the detection step, the effect display corresponding to the occurrence of the predetermined event is performed in the display step.
program.
As a result, when displaying a real-world race as a virtual race using a virtual object linked to a real-world race, the user is provided with an experience that cannot be obtained by watching a real-world race, and the user's emotions are expressed. You can get excited.

(Item 2)
The program is added to the processor.
Along with the effect display, a step of outputting an effect sound corresponding to the predetermined event that has occurred is executed.
The program described in item 1.
As a result, it is possible to provide the user with an experience that cannot be obtained by watching a race in the real world in terms of hearing as well as sight, and as a result, the user's emotions can be further excited.

(Item 3)
The detection step detects the occurrence of the predetermined event based on the event information transmitted from the second computer when the predetermined event occurs in the predetermined race in the real world.
The program according to item 1 or item 2.
As a result, the occurrence of an event can be detected easily and with high accuracy. In addition, the processing load on the first computer can be reduced.

(Item 4)
The event information transmitted from the second computer includes template event information corresponding to a template event that always occurs in the predetermined race, and random event information corresponding to a random event that randomly occurs in the predetermined race. , Included,
The random event information includes information registered in the second computer after the occurrence of the random event.
The program described in item 3.
As a result, it becomes possible to immediately display the effect in response to the occurrence of an event. In addition, even when an unexpected situation that is not normally expected occurs, it is possible to display an appropriate display on the first computer.

(Item 5)
In the template event, the contestant or the moving body enters the race track, the start of the predetermined race, the goal of the first contestant or the moving body is reached, and the ranking of the predetermined race is determined. One or more of them are included,
In the random event, the order of the contestant or the moving body is changed, and the difference between the positions of the two or more contestants or the two or more moving bodies at a predetermined timing becomes equal to or less than a predetermined threshold value, which is a rule violation. , The fixed odds of the predetermined race are equal to or higher than the predetermined magnification, and one or more of the voting tickets of the predetermined race stored as the purchase information of the user in the first computer are correct. included,
The program according to item 4.
As a result, it is possible to display the effect in a situation in which the user's emotions are easily excited, and as a result, the user's emotions are easily excited.

(Item 6)
The effect display includes a display of a two-dimensional image or a three-dimensional image corresponding to the predetermined event that has occurred.
The program according to any one of items 1 to 5.
As a result, the range of the effect display can be widened, and as a result, it becomes easy to excite the user's emotions.

(Item 7)
The effect display includes displaying a predetermined character image.
The program according to any one of items 1 to 6.
As a result, the range of the effect display can be widened, and as a result, it becomes easy to excite the user's emotions. In addition, it is possible to enhance the taste of watching virtual races.

(Item 8)
The predetermined character image is associated with any of the contestants or the moving body.
The effect display includes operating the character image according to the race progress of the associated contestant or the moving body.
The program according to item 7.
As a result, the range of the effect display can be widened, and as a result, the user's emotions can be further excited. In addition, it is possible to further enhance the taste of watching virtual races.

(Item 9)
The effect display includes displaying an effect on at least one of the race track object and the moving object.
The program according to any one of items 1 to 8.
As a result, the range of the effect display can be widened, and as a result, the user's emotions can be easily excited.

(Item 10)
An information processing method executed in a first computer equipped with a processor and an imaging unit.
The information processing method is applied to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object including a race track object representing a race track and a moving object representing a contestant or a moving body of the predetermined race based on the first information.
A step of superimposing the virtual object on a real image around the first computer captured by the imaging unit and displaying the virtual object.
Including the step of detecting the occurrence of a predetermined event in the predetermined race and the execution of the step.
The first information includes the position information of the contestant or the moving body during the execution of the predetermined race, and the time information corresponding to the position information.
In the display step, the moving object is moved on the racetrack object based on the first information, and the predetermined race is virtually displayed.
In response to the detection of the occurrence of the predetermined event in the detection step, the effect display corresponding to the occurrence of the predetermined event is performed in the display step.
Information processing method.
As a result, when displaying a real-world race as a virtual race using a virtual object linked to a real-world race, the user is provided with an experience that cannot be obtained by watching a real-world race, and the user's emotions are expressed. You can get excited.

(Item 11)
An information processing device equipped with a processor and an imaging unit.
The processor
Receive the first information about a given race in the real world from the second computer,
Based on the first information, a virtual object including a race track object representing a race track and a moving object representing a participant or a moving body of the predetermined race is generated.
The virtual object is superimposed and displayed on the real image around the information processing apparatus captured by the imaging unit.
It detects the occurrence of a predetermined event in the predetermined race, and detects the occurrence of a predetermined event.
The first information includes the position information of the contestant or the moving body during the execution of the predetermined race, and the time information corresponding to the position information.
The superimposed display includes moving the moving object on the racetrack object based on the first information and virtually displaying the predetermined race.
The superimposed display includes displaying an effect corresponding to the occurrence of the predetermined event in response to the detection of the occurrence of the predetermined event.
Information processing device.
As a result, when displaying a real-world race as a virtual race using a virtual object linked to a real-world race, the user is provided with an experience that cannot be obtained by watching a real-world race, and the user's emotions are expressed. You can get excited.

(Item 12)
There is a system including a first computer provided with a first processor and an imaging device, and a second computer provided with a second processor and capable of communicating with the first computer.
The second processor
Get the first information about a given race in the real world,
The first information is transmitted to the first computer, and the first information is transmitted to the first computer.
The first processor is
The first information is received from the second computer,
Based on the first information, a virtual object including a race track object representing a race track and a moving object representing a participant or a moving body of the predetermined race is generated.
The virtual object is superimposed and displayed on the real image around the first computer captured by the imaging device.
It detects the occurrence of a predetermined event in the predetermined race, and detects the occurrence of a predetermined event.
The first information includes position information of the contestant or the moving body during the execution of the predetermined race, and time information corresponding to the position information.
The superimposed display includes moving the moving object on the racetrack object based on the first information and virtually displaying the predetermined race.
The superimposed display includes displaying an effect corresponding to the occurrence of the predetermined event in response to the detection of the occurrence of the predetermined event.
system.
As a result, when displaying a real-world race as a virtual race using a virtual object linked to a real-world race, the user is provided with an experience that cannot be obtained by watching a real-world race, and the user's emotions are expressed. You can get excited.

(Item 13)
The second processor further
The occurrence of the predetermined event in the predetermined race in the real world is detected by analyzing the image obtained by capturing the image of the predetermined race.
When the occurrence of the predetermined event is detected, the event information corresponding to the generated predetermined event is transmitted to the first computer, and the event information is transmitted to the first computer.
The first processor is
Detects the occurrence of the predetermined event based on the received event information.
The system according to item 12.
As a result, the occurrence of an event can be detected easily and with high accuracy. In addition, the processing load on the first computer can be reduced.

1: System, 10: User terminal, 20: First server device, 30: Network, 40: Second server device, 130: Touch screen, 150: Storage unit (of user terminal), 190: Control (of user terminal) Unit, 250: Storage unit (of the first server device), 290: Control unit (of the first server device)

Claims (13)

A program that is executed in a first computer equipped with a processor and an imaging unit.
The program is delivered to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object including a race track object representing a race track and a moving object representing a contestant or a moving body of the predetermined race based on the first information.
A step of superimposing the virtual object on a real image around the first computer captured by the imaging unit and displaying the virtual object.
A step of detecting the occurrence of a predetermined event in the predetermined race, and a step of detecting the occurrence of the predetermined event are executed.
The first information includes the position information of the contestant or the moving body during the execution of the predetermined race, and the time information corresponding to the position information.
In the display step, the moving object is moved on the racetrack object based on the first information, and the predetermined race is virtually displayed.
In response to the detection of the occurrence of the predetermined event in the detection step, the effect display corresponding to the occurrence of the predetermined event is performed in the display step.
program. The program is added to the processor.
Along with the effect display, a step of outputting an effect sound corresponding to the predetermined event that has occurred is executed.
The program according to claim 1. The detection step detects the occurrence of the predetermined event based on the event information transmitted from the second computer when the predetermined event occurs in the predetermined race in the real world.
The program according to claim 1 or 2. The event information transmitted from the second computer includes template event information corresponding to a template event that always occurs in the predetermined race, and random event information corresponding to a random event that randomly occurs in the predetermined race. , Included,
The random event information includes information registered in the second computer after the occurrence of the random event.
The program according to claim 3. In the template event, the contestant or the moving body enters the race track, the start of the predetermined race, the goal of the first contestant or the moving body is reached, and the ranking of the predetermined race is determined. One or more of them are included,
In the random event, the order of the contestant or the moving body is changed, and the difference between the positions of the two or more contestants or the two or more moving bodies at a predetermined timing becomes equal to or less than a predetermined threshold value, which is a rule violation. , The fixed odds of the predetermined race are equal to or higher than the predetermined magnification, and one or more of the voting tickets of the predetermined race stored as the purchase information of the user in the first computer are correct. included,
The program according to claim 4. The effect display includes a display of a two-dimensional image or a three-dimensional image corresponding to the predetermined event that has occurred.
The program according to any one of claims 1 to 5. The effect display includes displaying a predetermined character image.
The program according to any one of claims 1 to 6. The predetermined character image is associated with any of the contestants or the moving body.
The effect display includes operating the character image according to the race progress of the associated contestant or the moving body.
The program according to claim 7. The effect display includes displaying an effect on at least one of the race track object and the moving object.
The program according to any one of claims 1 to 8. An information processing method executed in a first computer equipped with a processor and an imaging unit.
The information processing method is applied to the processor.
The step of receiving the first information about a given race in the real world from the second computer,
A step of generating a virtual object including a race track object representing a race track and a moving object representing a contestant or a moving body of the predetermined race based on the first information.
A step of superimposing the virtual object on a real image around the first computer captured by the imaging unit and displaying the virtual object.
Including the step of detecting the occurrence of a predetermined event in the predetermined race and the execution of the step.
The first information includes the position information of the contestant or the moving body during the execution of the predetermined race, and the time information corresponding to the position information.
In the display step, the moving object is moved on the racetrack object based on the first information, and the predetermined race is virtually displayed.
In response to the detection of the occurrence of the predetermined event in the detection step, the effect display corresponding to the occurrence of the predetermined event is performed in the display step.
Information processing method. An information processing device equipped with a processor and an imaging unit.
The processor
Receive the first information about a given race in the real world from the second computer,
Based on the first information, a virtual object including a race track object representing a race track and a moving object representing a participant or a moving body of the predetermined race is generated.
The virtual object is superimposed and displayed on the real image around the information processing apparatus captured by the imaging unit.
It detects the occurrence of a predetermined event in the predetermined race, and detects the occurrence of a predetermined event.
The first information includes the position information of the contestant or the moving body during the execution of the predetermined race, and the time information corresponding to the position information.
The superimposed display includes moving the moving object on the racetrack object based on the first information and virtually displaying the predetermined race.
The superimposed display includes displaying an effect corresponding to the occurrence of the predetermined event in response to the detection of the occurrence of the predetermined event.
Information processing device. There is a system including a first computer provided with a first processor and an imaging device, and a second computer provided with a second processor and capable of communicating with the first computer.
The second processor
Get the first information about a given race in the real world,
The first information is transmitted to the first computer, and the first information is transmitted to the first computer.
The first processor is
The first information is received from the second computer,
Based on the first information, a virtual object including a race track object representing a race track and a moving object representing a participant or a moving body of the predetermined race is generated.
The virtual object is superimposed and displayed on the real image around the first computer captured by the imaging device.
It detects the occurrence of a predetermined event in the predetermined race, and detects the occurrence of a predetermined event.
The first information includes position information of the contestant or the moving body during the execution of the predetermined race, and time information corresponding to the position information.
The superimposed display includes moving the moving object on the racetrack object based on the first information and virtually displaying the predetermined race.
The superimposed display includes displaying an effect corresponding to the occurrence of the predetermined event in response to the detection of the occurrence of the predetermined event.
system. The second processor further
The occurrence of the predetermined event in the predetermined race in the real world is detected by analyzing the image obtained by capturing the image of the predetermined race.
When the occurrence of the predetermined event is detected, the event information corresponding to the generated predetermined event is transmitted to the first computer, and the event information is transmitted to the first computer.
The first processor is
Detects the occurrence of the predetermined event based on the received event information.
The system according to claim 12.

Images