JP2019162257A - Remote operation system and program - Google Patents

Abstract

To achieve high operability of a remote operation based on a pointing operation in a game for challenging acquisition of a prize by remotely operating a prize acquisition device.SOLUTION: A prize acquisition device is provided with an AR marker that serves as a marker for recognizing an image of a coordinate system in a play space in a capturing range of a video camera for imaging a play space. A user terminal 1500 displays an image captured by the video camera as a live monitor image 38, sets a correspondence between the coordinate system of the play space and a display coordinate system of the live monitor image 38 on the basis of the AR marker in the captured image, and displays a grid line virtual image 60 or the like as a guide for the operation on the live monitor image 38. A remote operation signal for moving instruction coordinates of the play space corresponding to an instruction position indicated by a pointing operation is transmitted to the prize acquisition device.SELECTED DRAWING: Figure 6

Description

  The present invention relates to a remote operation system for remotely operating a prize acquisition device capable of remote operation play that attempts to acquire a prize placed in a play space by moving a crane unit, using a user terminal.

  When playing with an arcade game device, it is necessary to visit a store or facility such as a game center. However, in recent years, with the development of network technology and the improvement of functions of user terminals typified by smartphones, a technology for playing a game device remotely by operating it via a network is being put into practical use.

  For example, Patent Literature 1 discloses a technology that allows a prize acquisition device that is a kind of arcade game device commonly called a “crane game machine” to be played by remote control.

JP 2001-259216 A

  Now, a business operator who operates a system for acquiring prizes by remotely operating such a prize acquisition apparatus with a user terminal always wants to attract users and improve profits. One of the attractions that attracts users is how easy and intuitive the operation input is.

  On the other hand, for example, a smartphone can be considered as one of devices used by a user for remote operation. A “touch panel” that is a means for detecting a touch position as well as an image display means is standardly mounted on a smartphone, and a pointing operation can be performed by a touch operation. If a personal computer is used as a remote control device, a pointing operation can be performed by a mouse operation.

  The present invention has been devised on the basis of such a background, and the object thereof is a remote operation based on a pointing operation and a high operability in a game in which a prize acquisition device is remotely operated to challenge acquisition of a prize. It is to provide the technology for realizing.

A first invention for solving the above-described problem is a remote control system for remotely operating a premium acquisition device capable of remote control play by attempting to acquire a premium placed in a play space by moving a crane unit at a user terminal. The premium acquisition device includes a camera that captures the play space, and a marker that serves as a mark for recognizing an image of the coordinate system of the play space is provided at a position where the camera can capture the image. And
Monitor image display control means (for example, the control board 1550 in FIG. 5, the live monitor image 38 in FIG. 6, the terminal processing unit 200 in FIG. 14, the game management unit 210) that displays the captured image of the camera on the user terminal as a monitor image. , Monitor image display control unit 212, step S16 in FIG. 18, step S22),
Correspondence setting means for setting the correspondence between the coordinate system of the play space and the display coordinate system of the monitor image based on the image of the marker in the captured image (for example, the control board 1550 in FIG. 14 terminal processing unit 200, game management unit 210, correspondence setting unit 214, step S18 in FIG.
Instruction coordinate calculation means (for example, control board 1550 in FIG. 5, control board 1550 in FIG. 14) that calculates the instruction coordinates in the play space corresponding to the instruction position instructed by the user's pointing operation on the monitor image. Terminal processing unit 200, game management unit 210, instruction coordinate calculation unit 216, step S94 to step S96 in FIG. 19, and
Operation signal transmission control means (for example, control board 1550 in FIG. 5, terminal processing unit 200 in FIG. 14, game management) for transmitting a remote operation signal for moving the crane unit to a position corresponding to the designated coordinates to the prize acquisition device. Unit 210, operation signal transmission control unit 218, and step S98) of FIG.

  The "crane part" here is a mechanism part that can move to acquire a prize in the prize acquisition device, and forms such as "gripping", "crawling", "hooking", and "sucking" are considered. It can be said that it is a mechanism that engages with the prize in the form.

  According to the first aspect, the position coordinates in the play space can be obtained based on the position coordinates pointed to the monitor image. The user can instruct where to move the crane unit by performing a pointing operation while viewing the state of the prize of the prize acquisition device on the monitor image. Therefore, high operability can be realized in the remote operation based on the pointing operation.

  2nd invention is an apparatus which positions the said prize part by moving the said crane part two-dimensionally according to a user's remote operation, and performs the action sequence of the said crane part from the positioned position, The said invention is the said instruction | indication The coordinate calculation means is the remote control system according to the first aspect of the invention that calculates the movement target coordinates of the two-dimensional movement as the designated coordinates.

  The “action sequence” referred to here is a series of steps and processes for engaging the crane section and the prize. The operation in the sequence, that is, the action operation can be appropriately set according to the mechanism of the crane unit and the like. For example, if the crane unit is configured to open and close a plurality of gripping claws (or may be called gripping arms) to grip a prize, the action sequence is lowered to open the gripping claws. A series of catch operations until the gripping claws are closed and raised later are included. In descending, the action sequence includes both a configuration for stopping the descent operation in response to a stop operation input and a configuration for automatically descending.

  According to the second aspect of the invention, the first aspect of the invention can be applied to remote operation of a crane unit that moves two-dimensionally.

  According to a third aspect of the present invention, virtual image display control means for determining a set display position in the monitor image corresponding to a given set position in the play space based on the correspondence and displaying a virtual image (for example, 5 is a remote operation system according to the second invention, further comprising a control board 1550 in FIG. 5, a terminal processing unit 200 in FIG. 14, a game management unit 210, a virtual image display control unit 220, and step S22 in FIG.

  According to the third invention, a virtual image can be displayed on the monitor image at a position in the monitor image corresponding to a given set position in the play space.

  According to a fourth aspect of the present invention, the set position is a position where the crane unit is movable by the two-dimensional movement, and the virtual image display control means uses the virtual line of the two-dimensional coordinates related to the two-dimensional movement as the virtual line. It is a remote control system of 3rd invention displayed as an image.

  The “grid line” referred to here may be, for example, an unbroken solid line display form, or a display form such as a broken line, a chain line, or a wavy line. Alternatively, it may be expressed by an array of small images.

  According to 4th invention, a grid line can be displayed on the position which can move a crane part in a monitor image. Thereby, the user can use it as a standard of how much the crane unit should be moved and where it should be moved. There is no such user support in the past, and the operability is far higher than the configuration in which grid lines are not displayed, and the appeal of the game is enhanced.

  A fifth aspect of the invention is the remote control system according to the fourth aspect of the invention, wherein the indicated coordinate calculation means calculates the indicated coordinates by using any of the intersections of the grid lines as the indicated position by the pointing operation.

  According to the fifth invention, the operability can be improved more than the configuration in which designation by the intersection is not possible by setting the designated position as the movement destination as the intersection of the grid lines.

  In a sixth aspect of the present invention, the prize acquisition device is a device capable of continuing play, and the virtual image display control means variably sets an interval of the grid lines in accordance with the number of times of the continuous play. 5 is a remote control system according to the invention of claim 5;

The size of the number of continue plays indirectly represents how many times the prize acquisition has failed.
According to the sixth aspect, the interval between the grid lines can be changed according to the number of times of continuation. For example, if the interval is set to be narrower as the number of continue plays is larger, it becomes easier to indicate the destination of the crane unit in more detail, so that the operability is improved.

  In a seventh aspect of the invention, the setting position is a position of the crane unit, the setting display position is a display position of the crane unit in the monitor image, and the virtual image display control means is configured to display the setting display. The remote control system according to any one of the third to sixth aspects, wherein the straight virtual image is displayed from a position in a direction in which the crane unit performs the action sequence.

  According to the seventh aspect, by displaying the linear virtual image, the user can easily recognize the direction of the action sequence by the crane unit. Therefore, the operability is much higher than the configuration in which a linear virtual image is not displayed.

  According to an eighth aspect of the present invention, a prize marker serving as a mark for recognizing the prize position of the prize is attached to the prize, and based on the prize marker, the prize is displayed at the current display position of the crane unit. A prize presence / absence determining means for determining whether or not the prize is positioned in the direction of the action sequence when the action sequence is performed (for example, the control board 1550 in FIG. 5, the terminal processing section 200 in FIG. 14, the game management section) 210, a prize existence determination unit 222, and step S44 in FIG. 18, and the virtual image display control means changes the display form of the virtual image based on the determination result of the prize existence determination means. A remote control system according to any one of the seventh to seventh aspects of the invention.

  According to the eighth aspect, it is possible to inform the user whether or not a prize exists in the direction of the action sequence in the display form of the virtual image.

  In a ninth aspect of the present invention, a prize marker serving as a mark for recognizing the prize position of the prize is attached to the prize, and the indicated coordinate calculation means is configured to display the prize in the monitor image by the pointing operation. The movement target coordinates of the crane unit when the action sequence is performed toward the coordinates of the play space that is image-recognized based on a prize marker attached to the prize when the display location of the prize is designated Is the remote control system according to any one of the second to eighth inventions.

  According to the ninth aspect, by instructing a prize displayed in the monitor image by a pointing operation, the crane section is moved to the position of the crane section when performing an action sequence toward the position of the prize. Will be able to.

  In a tenth aspect of the present invention, image information indicating the type of the prize is associated with the prize marker, and a background portion of the remote operation screen of the user terminal or the background of the play space included in the monitor image Premium type image display control means (for example, control board 1550 in FIG. 5, terminal processing unit 200 in FIG. 14, game management unit 210, premium type image display control unit 226) displays an image based on the type of the premium in the image portion. FIG. 18 is a remote operation system according to the ninth aspect of the present invention, further comprising step S42).

  According to the tenth invention, an image related to a prize can be displayed on the background portion of the remote operation screen or the background image portion in the monitor image, and the game play can be visually lively and enjoyed.

  In an eleventh aspect of the invention, the prize is an AR box in which an AR (Augmented Reality) marker is written on the outer surface as the prize marker, and an image based on the AR marker is displayed in the AR box in the monitor image. The remote operation system of the ninth or tenth invention further comprising an AR image display control means (for example, the control board 1550 in FIG. 5, the terminal processing unit 200, the game management unit 210, and the AR image display unit 224 in FIG. 14). It is.

  According to the eleventh aspect, the AR box can be regarded as a prize, and an image based on the AR marker can be displayed on the outer surface thereof. For example, if the image is a prize image, an AR box can be used as a substitute for the prize.

  In a twelfth aspect of the present invention, the prize is an AR box with an AR (Augmented Reality) marker on the outer surface, and an AR image display control for displaying an image based on the AR marker in the AR box in the monitor image. A remote control system according to any one of the first to tenth aspects of the invention.

  According to the twelfth aspect, an image based on the AR marker can be displayed on the surface of the prize.

  In a thirteenth aspect of the present invention, the prize acquisition device is configured such that a movable range of the crane unit can be set, and based on the correspondence relationship, the movable range or a range other than the movable range is A movable range identification display means for identifying and displaying in the monitor image (for example, touch panel 1506 in FIG. 5, control board 1550, terminal processing unit 200 in FIG. 14, game management unit 210, movable range identification display control unit 230, image display) The remote control system according to any one of the first to twelfth discoveries, further comprising a unit 392 and step S22 in FIG.

  According to the thirteenth aspect, the movable range of the crane section can be identified and displayed in the monitor image to support the user.

  In addition, the form of the hardware of a remote operation system can employ | adopt the structure suitable for the communication form and system design of a user terminal and a play apparatus.

  For example, if the user terminal and the play device are connected to each other and are remotely operated by the user terminal, as a fourteenth invention, the remote operation system is configured by the user terminal, the first to the thirteenth. The remote control system according to any one of the inventions can be configured.

  When the game is configured as a client-server type on-run game, for example, as a fifteenth aspect, the remote operation system is configured by a computer system that controls the user terminal. The remote control system according to any one of the inventions can be configured.

  According to a sixteenth aspect of the invention, there is provided a program for remotely operating a prize acquisition device capable of remote control play by attempting to acquire a prize arranged in a play space by moving a crane unit, the prize acquisition apparatus Is provided with a camera for photographing the play space, and a marker serving as a mark for recognizing an image of the coordinate system of the play space is provided at a position where the camera can photograph. Based on the monitor image display control means to be displayed on the user terminal as a monitor image and the image of the marker in the captured image, a correspondence relationship between the coordinate system of the play space and the display coordinate system of the monitor image is set. Correspondence setting means, a finger of the play space corresponding to the designated position designated by the user pointing operation on the monitor image The user as instruction coordinate calculation means for calculating coordinates based on the correspondence, and operation signal transmission control means for transmitting a remote operation signal for moving the crane unit to a position corresponding to the instruction coordinates to the prize acquisition device It is a program for causing a terminal to function.

  According to the sixteenth aspect, a program that exhibits the same effect as the first aspect can be realized on the user terminal.

The figure which shows the structural example of a prize acquisition system. The apparatus front view which shows the structural example of the prize acquisition apparatus. The right side view of the right side surface toward the apparatus front which shows the structural example of a prize acquisition apparatus. The figure which shows the example of the program data memorize | stored in IC memory of a prize acquisition apparatus. The figure which shows the structural example of a user terminal. The figure for demonstrating the outline | summary of the flow until game play start. The example of the picked-up image by the 1st video camera used as the origin of the live monitor image of FIG. The contrast diagram of the example of a substitute prize and the example of how to show in the live monitor image of the said substitute prize. The comparison figure which shows the example of a change of the display form of the virtual image based on a prize existence determination result. The figure which shows the example of the remote control screen on which the premium type image was displayed. The functional block diagram which shows the function structural example of a server system. The figure which shows the data structural example of premium acquisition apparatus management data. The figure which shows the data structural example of user management data. The functional block diagram which shows the function structural example of a user terminal. The figure which shows the data structural example of play data. The figure which shows the data structural example of space recognition data. The figure which shows the data structural example of movement destination instruction | indication management data. The flowchart for demonstrating the flow of the process in a user terminal. The flowchart following FIG. The flowchart following FIG. The figure which shows the function structural example of the server system in the modification of a prize acquisition system. The figure which shows the example of the program and data which the server memory | storage part in a modification stores. The functional block diagram which shows the function structural example of the user terminal in a modification. The figure which shows the modification of a virtual image (the 1). The figure which shows the modification of a virtual image (the 2).

  Examples of embodiments of the present invention will be described below, but it is needless to say that forms to which the present invention can be applied are not limited to the following embodiments.

[Description of hardware configuration]
FIG. 1 is a diagram illustrating a configuration example of a prize acquisition system according to the present embodiment.
The prize acquisition system 1000 is a game in which a user selects a desired prize (desired prize) from a plurality of types of prizes prepared in advance, and remotely operates a prize acquisition apparatus capable of acquiring the desired prize to aim for the prize acquisition. It is a game system for executing.

  The prize acquisition system 1000 includes a server system 1100, a plurality of prize acquisition apparatuses 1200 (1200a, 1200b,...), And user terminals 1500 (1500a, 1500b,...) Used separately for users 2 (2a, 2b,...). Are connected to each other via a communication line 9 so that data communication is possible.

  The communication line 9 means a so-called network capable of data communication. That is, the communication line 9 includes a communication network such as a telephone communication network, a cable network, and the Internet in addition to a dedicated line (dedicated cable) for direct connection and a LAN (Local Area Network) by Ethernet (registered trademark) or the like. This means that the communication method may be wired or wireless.

  The number of users 2 (2a, 2b,...) And their user terminals 1500 (1500a, 1500b,...) Vary depending on the usage status of the prize acquisition system 1000. Therefore, in actual operation, the prize acquisition system 1000 may be connected to only two user terminals 1500 as shown in the figure, or may be connected to one at the same time, or three or more. May be connected.

  The operator facility 3 includes a server system 1100 and premium acquisition devices 1200 (1200a, 1200b,...), And is prepared by an operator of the premium acquisition system 1000. The numbers of the server system 1100 and the prize acquisition device 1200 are not limited to the illustrated example, and can be set as appropriate. The installation locations of the server system 1100 and the prize acquisition device 1200 (1200a, 1200b,...) Are not limited to the same location.

  The server system 1100 is interposed between the user terminal 1500 and the prize acquisition device 1200, and information related to the prize acquisition device 1200 (1200a, 1200b,...) Is transmitted to the user terminal 1500 constituting the remote operation system in the present embodiment. A computer system provided includes a main body device 1101, a keyboard 1106, a touch panel 1108, and a storage 1140, and a main body device 1101 is equipped with a control board 1150.

  The control board 1150 includes various microprocessors such as a CPU (Central Processing Unit) 1151, GPU (Graphics Processing Unit), and DSP (Digital Signal Processor), various IC memories 1152 such as a VRAM, a RAM, and a ROM, and a communication device 1153. Has been. Part or all of the control board 1150 may be realized by an application specific integrated circuit (ASIC), a field programmable gate ARray (FPGA), or a system on a chip (SoC).

Then, the server system 1100 causes the control board 1150 to perform arithmetic processing based on a predetermined program and data.
1) a user management function related to user registration,
2) a game management function for providing data necessary for the user 2 to play a game on the user terminal 1500 and realizing a game play on the user terminal 1500;
3) an online shopping management function for selling online a consideration medium consumed as a consideration for the prize acquisition device 1200;
4) a function of managing information about the prize acquisition device 1200 such as which type of prize can be acquired by which prize acquisition device 1200 and providing it to the user terminal 1500;
5) a function of providing access information for remotely operating the prize acquisition device 1200 selected by the user terminal 1500 according to the user's selection operation;
To realize.

  Although the server system 1100 is described as a single unit, a configuration may be adopted in which a plurality of blade servers sharing each function are mounted and connected to each other via an internal bus so that data communication is possible. Alternatively, the server system 1100 may be configured to function as a whole by performing data communication with a plurality of independent servers installed at remote locations via the communication line 9.

  The prize acquisition device 1200 (1200a, 1200b,...) Is a game device that allows the user 2 to operate the acquisition mechanism unit by remote operation to move and give away the prizes stored in the housing. In the present embodiment, the prize acquisition device 1200 is provided with a plurality of types of prize acquisition devices that differ in at least one of an operation method, a configuration of an acquisition mechanism unit, and a prize arrangement method (arrangement pattern). Yes.

  2 and 3 are diagrams showing a configuration example of the prize acquisition device 1200 according to the present embodiment, in which FIG. 2 corresponds to a front view of the device, and FIG. 3 corresponds to a right side view of the right side surface as viewed from the front of the device. The prize acquisition device 1200 performs a game play that attempts to move a prize for acquiring a prize arranged in the game space, and if the prize cannot be obtained, the arrangement state of the prize as a result of the movement attempt. Is maintained and used for the next game play.

  The prize acquisition device 1200 according to the present embodiment operates the casing 1201, a plurality of video cameras 1220 (first video camera 1220f and second video camera 1220s) that capture the casing 1201 from the outside, and the prize acquisition device 1200. And a control board 1250 to be controlled.

  The casing 1201 defines a play space 1202 covered with a transparent partition so that the inside can be seen from the outside, and one or a plurality of prizes 4 and a crane unit 1210 as an acquisition mechanism unit in the play space. Is housed. The inside of the play space 1202 can be taken from two directions with two video cameras, the first video camera 1220f and the second video camera 1220s. Note that the number, installation position, shooting angle, and the like of the video cameras 1220 are not limited to the illustrated example, and can be set as appropriate. For example, a configuration in which the video camera 1220 is provided inside the play space 1202 is also possible. Also, a transparent partition that defines the play space 1202 may be unnecessary.

  The crane unit 1210 is a mechanism unit that can move the position of the prize 4 for the prize acquisition in the prize acquisition device 1200, and may be in the form of “gripping”, “crawling”, “hooking”, “sucking”, etc. It can be set as the mechanism part engaged with a prize in the form.

  The crane unit 1210 of this embodiment is a crane that is positioned by two-dimensionally moving the play space 1202 in a “first direction” that is the left-right direction of the device and a “second direction” that is the front-back direction of the device. Designed to function as. The crane unit 1210 hangs a plurality of movable arms that can be opened and closed (hereinafter also referred to as “claws 1212”), and functions as a crane that can lift and move the prize 4.

  The structure of the crane part 1210 can be set as appropriate with reference to that of a conventional crane game machine. Specifically, the crane portion 1210 is placed in a case 1211 provided at the lowermost part of the lifting shaft portion 1219 suspended by the two-dimensional linear motion mechanism portion 1218 from 1) the claw 1212 and 2) from the control board 1250. An electric motor 1213 that operates the claw 1212 to open and close according to the drive signal, 3) an opening sensor 1214, 4) a gripping force changing mechanism 1215 that changes the gripping force of the prize 4 by the claw 1212, and 5) A case rotation mechanism 1216 that rotates the case 1211 around the lifting shaft 1219 in accordance with a drive signal from the control board 1250 is mounted.

  The opening degree sensor 1214 is a sensor for determining an action situation in this embodiment (including a catch situation of whether or not the prize 4 is caught in this embodiment). The opening sensor 1214 detects the opening of the claw 1212 and outputs a signal corresponding to the detected opening to the control board 1250. The sensor for determining the action status is not limited to the opening degree sensor. For example, a load sensor that detects a load acting on the case 1211 and the claw 1212, a switch that is turned on when the load is applied, and the presence of an object other than the claw 1212 that exists directly under the case 1211 are detected. Distance sensors, proximity sensors, etc. can be added or replaced.

  The configuration of the gripping force changing mechanism 1215 can be set as appropriate with reference to that of a conventional crane game machine. For example, an electric actuator that changes one end to the claw 1212 and changes the other end locking position of the coil spring that biases the claw in the closing direction according to a control signal from the control board 1250 may be realized. it can.

  In the present embodiment, the first direction that is one movement direction of the two-dimensional linear motion mechanism portion 1218 faces the left-right direction of the apparatus, and the second direction that is the other movement direction faces the front-rear direction of the apparatus. Yes.

  The first video camera 1220f photographs the play space 1202 from the front side of the device. In the present embodiment, the shooting direction of the first video camera 1220f is attached so as to face the second direction of the two-dimensional linear motion mechanism unit 1218. It may be set so as to reproduce the field of view in a case where the play space 1202 is looked down slightly from the front. The shooting angle of view is fixed, and the full-width movable range of the crane unit 1210 in the first direction by the two-dimensional linear motion mechanism 1218 is included in the shooting range, and the entire angle of front view of the play space 1202 can be shot. The shooting direction and fixed position are determined.

  Similarly, the second video camera 1220s shoots the play space 1202 from the right side when facing the front of the apparatus. In the present embodiment, the shooting direction of the second video camera 1220s is attached so as to face the first direction of the two-dimensional linear motion mechanism 1218, but it may be set to slightly intersect the first direction. . The shooting angle of view is fixed, and the full-width movable range of the crane unit 1210 in the second direction by the two-dimensional linear motion mechanism unit 1218 is included in the shooting range, and the entire field of view side view of the play space 1202 can be shot. The shooting direction and fixed position are determined.

  An image (captured image) captured by the first video camera 1220f or the second video camera 1220s has no delay (including no delay at all and a slight delay that is considered to have little influence on play). By being provided as a live monitor image and displayed as a live monitor image, the user 2 (player) can observe the state of the play space 1202 necessary for the game play while being far away.

A plurality of AR boxes are arranged in a rectangular parallelepiped play space 1202.
The “AR box” here is a rectangular parallelepiped having AR (Augmented Reality) markers provided on six sides. The “AR marker” is a marker for recognizing an image of the coordinate system of the play space. In the image recognition type real extension system, a reference position, a reference orientation, and a virtual image for recognizing the space are determined. It is an image of a peculiar pattern for detecting a reference position and orientation when displaying.

  In the present embodiment, a first AR box 1271, a second AR box 1272, a third AR box 1273, a fourth AR box 1274, and a fifth AR box 1275 are attached. These AR boxes are provided with box-specific AR markers on all six sides.

The first AR box 1271 is fixed to the upper left corner on the front side of the play space 1202 as viewed from the front of the apparatus, with one of the six faces facing the front.
The second AR box 1272 is fixed to the upper right corner on the far side of the play space 1202 when viewed from the front of the apparatus, with one of the six faces facing the front.
The third AR box 1273 is fixed to the lower right corner on the far side of the play space 1202 as viewed from the front of the apparatus, with one of the six faces facing the front.
The fourth AR box 1274 is fixed to the lower left corner on the labor side of the play space 1202 as viewed from the front of the device, with one of the six surfaces facing the front.
The fifth AR box 1275 is fixed to the crane unit 1210 in a posture in which one of the six surfaces faces the front. Specifically, the fifth AR box 1275 is fixed so that the lifting shaft 1219 of the crane part 1210 penetrates the AR box. Note that the fifth AR box 1275 can be substituted by providing an AR marker on the case 1211 of the crane unit 1210.

  The control board 1250 is a communication for wirelessly communicating with various processors such as CPU 1251, GPU, DSP, various IC memories 1252, such as VRAM, RAM, ROM, and mobile phone base stations and wireless LAN base stations connected to the communication line 9. A module 1253, an interface circuit 1257, and the like are mounted. The interface circuit 1257 includes a driver circuit for the crane unit 1210, a circuit for inputting image data of an image captured by the video camera 1220, and the like. And the prize acquisition device 1200 can control the operation of the crane unit 1210 by the control board 1250 performing arithmetic processing based on a predetermined program and data.

  FIG. 4 is a diagram illustrating an example of programs and data stored in the IC memory 1252 of the prize acquisition device 1200. In this embodiment, in the IC memory 1252 of the control board 1250, the control program 1280, the crane part initial position coordinates 1282 that define the game start initial position of the crane part 1210, the control parameter setting value list 1283, the sequence progress 1290, , Action status information 1292 is stored. Of course, data other than these may be stored as appropriate. For example, a time counter for counting the play time limit, the position coordinates of the crane unit 1210, and the like may be stored as appropriate.

The control program 1280 is a program that realizes a function for controlling the operation of each unit of the apparatus in accordance with a remote operation input.
In this embodiment,
1) An image distribution function for creating image distribution data of a captured image of the video camera 1220 without delay and transmitting it externally and displaying it as a live monitor image on the user terminal 1500;
2) A control parameter value management function that resets the contents of the control parameter set value list 1283 to respective predetermined initial values or changes them to values received together with the corresponding signals in response to a predetermined change instruction signal received from the outside. When,
3) It is determined whether the current operation status corresponds to the movement sequence, action sequence, or end operation sequence, and the type of the current sequence and whether the sequence has been started or ended. A sequence progress management function for storing in the sequence progress 1290 information indicating whether
4) an action status information transmission function for sequentially updating the action status information 1292 in accordance with an output signal from the opening sensor 1214 and transmitting it externally;
Can be realized.

  The contents of the control parameter set value list 1283 can be set as appropriate according to the configuration of the prize acquisition device 1200. In the present embodiment, a crane part movement form setting 1284, a crane part movement speed value 1285 that defines the movement speed of the crane part, a gripping force setting value 1286, and an action control form setting value 1287 are included.

  The crane part movement form setting 1284 designates the type of form in which the crane part 1210 is moved. The contents of the type of movement form can be set as appropriate, but in this embodiment, the presence / absence of fluctuations in speed during movement, the magnitude of fluctuations, and the like can be set.

  The gripping force setting value 1286 is a value for setting the force for closing the claw 1212, in other words, the gripping force of the crane unit 1210.

  The action control form set value 1287 specifies the function of the action by the crane unit 1210. For example, when three claws 1212 are mounted on the crane part 1210, the set value of how many of them are operated, the operation order of the plurality of claws 1212, the opening restriction value of the claws 1212, and the lifting shaft part 1219. One or a plurality of functions such as releasing (enabling) or not releasing the function of rotating can be set.

  The action status information 1292 is information for determining the action status. The contents can be set as appropriate according to the type of sensor mounted on the crane unit 1210. In this embodiment, the opening / closing control value indicating whether the claw 1212 is controlled to be opened or closed, and the opening / closing of the claw 1212 determined from the output signal of the opening sensor 1214. And an open / closed state value that takes any value. If the open / close control value is “closed” and the open / closed state value is “open”, it is estimated that the prize 4 is sandwiched between the claws 1212. Therefore, it can be determined that “action is successful” or “catch success” in this embodiment. . If the open / close control value is “closed” and the open / closed state value is “closed”, it is presumed that the prize 4 is not gripped. Therefore, it is possible to determine “action failure” or “catch failure” in this embodiment. it can.

  In this embodiment, the prize acquisition device 1200 transmits the action status information 1292 externally. However, the control program 1280 implements a function for determining action success / action failure from the action status information 1292, and the action status information 1292 is stored in the action status information 1292. Instead, a signal indicating the result of determination may be transmitted externally.

  In the remote operation of the prize acquisition device 1200, the control board 1250 is connected to an external device via the communication line 9 via the communication module 1253 so as to be communicable with the video camera 1220 (first video camera 1220f, second video camera 1220s). This is realized by controlling the crane unit 1210 and the like in accordance with the operation signal from the external device while providing the live image photographed in the above.

  Specifically, in this embodiment, the prize acquisition device 1200 is communicably connected to the user terminal 1500 associated by the server system 1100, and corresponds to live image distribution data, action status information 1292, and the like. To the attached user terminal 1500. On the other hand, signals corresponding to various operation inputs transmitted from the user terminal 1500 are transmitted to the prize acquisition device 1200. Thereby, remote operation is realized.

  Then, when the user 2 who has become a player can move the targeted prize 4 to the prize acquisition area 1240 set in the play space 1202 by operating the crane unit 1210 well, the prize has been acquired. The acquired prize 4 or the same kind of prize 4 is delivered to a delivery destination that is authorized and set in advance by the player.

  In this embodiment, the prize acquisition area 1240 is a virtual area that is recognized only on the operation screen of the user terminal 1500, but may be a physical opening that communicates with the payout opening 1226 on the front surface of the housing 1201. .

FIG. 5 is a diagram illustrating a configuration example of the user terminal 1500 in the present embodiment.
The user terminal 1500 is a computer system that is used individually for game play by the user 2 as a player, and is an electronic device (electronic device) that can access the server system 1100 via the communication line 9 and execute an online game. It is. And it is the remote operation system which operates remotely the prize acquisition apparatus in this embodiment.

  The user terminal 1500 according to the present embodiment is a so-called smartphone, but may be a portable game device, a game controller, a personal computer, a tablet computer, a wearable computer, an arcade game device, or the like.

  The user terminal 1500 includes a direction input key 1502, a button switch 1504, a touch panel 1506 functioning as an image display device / contact position input device, a built-in battery 1509, a speaker 1510, a microphone 1512, an image sensor unit 1520, A control board 1550 and a memory card reader 1542 that can read and write data from a memory card 1540 that is a computer-readable storage medium are provided. In addition, a power button, a volume adjustment button, and the like not shown are provided.

  The control board 1550 is wireless for wireless communication with various processors such as a CPU 1551, a GPU, a DSP, various IC memories 1552 such as a VRAM, a RAM, and a ROM, and a mobile phone base station and a wireless LAN base station connected to the communication line 9. A communication module 1553, an interface circuit 1557, and the like are mounted.

  The interface circuit 1557 includes a driver circuit of the touch panel 1506, a circuit that receives signals from the direction input key 1502 and the button switch 1504, an output amplifier circuit that outputs an audio signal to the speaker 1510, and an audio signal collected by the microphone 1512. An input signal generation circuit to generate, a circuit to input image data of an image taken by the image sensor unit 1520, a signal input / output circuit to the memory card reader 1542, and the like are included.

  These elements mounted on the control board 1550 are electrically connected via a bus circuit or the like so that data can be read and written and signals can be transmitted and received. Note that a part or all of the control board 1550 may be configured by ASIC, FPGA, or SoC. Then, the control board 1550 stores programs and various data for realizing various functions enabling game play on the terminal in the IC memory 1552.

  In the present embodiment, the user terminal 1500 is configured to download programs and various setting data from the server system 1100 or the like, but may be configured to read from a storage medium such as a memory card 1540 obtained separately.

[Game description]
An outline of the game flow will be described.
FIG. 6 is a diagram for explaining an outline of the flow up to the start of the game play in the present embodiment. When the user 2 who is a player starts a predetermined program on the user terminal 1500, accesses the server system 1100, and goes through a login procedure, the user terminal 1500 receives a prize to be obtained (hereinafter, "desired prize"). The desired prize selection screen W2 for selecting "is displayed.

  When a prize selection operation for selecting a desired prize from the obtainable prizes is performed on the selection screen, a play apparatus selection screen W4 is displayed. On the selection screen, a prize acquisition device 1200 (hereinafter referred to as a “candidate device”) that can acquire a desired prize in the server system 1100 and is a candidate for a device used for play is searched, and the candidate device is searched. Displayed as selectable. Then, when the user 2 performs a selection operation of the prize acquisition device 1200 used for play among the candidate devices, the device is set as a “play device”.

  When the play device is determined, access information for direct communication connection with the play device is transmitted from the server system 1100 to the user terminal 1500. The user terminal 1500 is communicatively connected to the play device using the access information so as to be remotely operable.

  In addition, as a method of “communication connection so as to be remotely operable”, a configuration employing a relay connection method in which the user terminal 1500 and the play device are relay-connected by the server system 1100 is also possible.

  When the user terminal 1500 is connected for communication by remote control, the remote control screen W6 is displayed on the touch panel 1506 and the game can be played. The remote operation screen W6 is a screen corresponding to a game play screen, and is a screen for instructing the destination of the crane unit 1210 by a pointing operation by a touch operation on the touch panel 1506.

  On the remote operation screen W6, a prize name display 30, a play consideration display 31, a remaining credit display 32, a grid level-up operation icon 33, a remaining time display 35 indicating the remaining time limit that can be instructed to move, and an action sequence A start operation icon 36, a camera switching operation icon 37, a live monitor image 38, and a prize acquisition area display 39 are displayed. In the configuration in which the prize acquisition is realized by a physical opening or a pedestal, the prize acquisition area display 39 can be omitted.

  The remaining credit display 32 indicates the credit amount currently held by the player. Here, “credit” is an electronic settlement medium that is consumed as a payment for play consideration. It can be read as virtual currency, electronic money, prepaid points, etc. In this embodiment, it is set as a prepaid point. Credits can be purchased at a predetermined online shopping before the start of play, and can be purchased immediately by inputting a predetermined credit purchase operation even during play. .

  The grid level-up operation icon 33 is an icon for inputting an operation for making the grid width in the grid line virtual image 60, which will be described later, fine, or changing (leveling up) the display form of the grid lines so that it can be more visually recognized. is there. Specifically, when the operation icon is touch-operated, a menu in which the level-up content is associated with the level-up consideration is displayed. When the user selects any menu and inputs a payment approval operation for consideration, credits are consumed and the display of the grid lines is changed according to the selected menu.

  The action sequence start operation icon 36 is an operation icon for inputting an operation for immediately starting an action sequence regardless of whether or not the crane unit 1210 has moved.

  In the live monitor image 38, a photographed image of the first video camera 1220f or the second video camera 1220s that has been switched with the camera switching operation icon 37 is displayed (see FIGS. 2 and 3). The user performs a touch operation input while viewing the live monitor image 38 and remotely operates the crane unit 1210 to play with the aim of acquiring the prize 4. The captured images of the first video camera 1220f and the second video camera 1220s are so-called parsed images viewed from the viewpoint of the cameras, and are not images such as parallel projection views. This is one of the game characteristics and interests of performing game play by remote control while viewing images from a camera installed at a fixed position.

  Incidentally, the live monitor image 38 in the example of FIG. 6 is based on the captured image W7 of the first video camera 1220f shown in FIG.

  On the remote operation screen W6, as a visual support for improving the operability of the remote operation by the touch operation, the virtual image over the live monitor image 38 is over using the image recognition type AR system (virtual reality system). A lap is displayed. In the present embodiment, a grid line virtual image 60, a perpendicular virtual image 62, and a range identification virtual image 64 are displayed as virtual images that are displayed in an overlapping manner.

  In addition to the improvement in operability, the lively virtual image 66 is displayed in an overlapping manner in the portion where each AR box is shown so that the AR box is not fully visible in the live monitor image 38. The overlap display can also be called an overlay display.

  In this embodiment, the image recognition AR system includes an AR box (first AR box 1271 to fifth AR box 1275) that is reflected in a captured image of each video camera received by the user terminal 1500 from the prize acquisition device 1200 that is a playing device. The AR marker is image-recognized, and the position of each AR box shown in the live monitor image 38 is associated with the actual position of each AR box in the play space 1202. That is, it is realized by setting the correspondence between the coordinate system of the play space 1202 and the display coordinate system of the live monitor image 38 based on the marker image in the captured image.

  A virtual image is an image that is actually displayed in an overlapping manner, and based on the correspondence obtained by image recognition, the set display position in the live monitor image corresponding to a given set position in the play space is determined. This is the image that is displayed.

  The grid line virtual image 60 is an image showing a position where the crane unit 1210 of the prize acquisition device 1200 can move two-dimensionally, and is an image group of two-dimensional coordinates related to two-dimensional movement.

  The grid line virtual image 60 of the present embodiment is the moving direction of the crane unit 1210 that is visible in the live monitor image 38 (for example, in the live monitor image 38 based on the image captured by the first video camera 1220f, In the first direction, the live monitor image 38 based on the image taken by the second video camera 1220s, the line segment along the left-right direction of the remote operation screen, that is, the second direction), and the line segment in the up-and-down direction of the crane unit 1210 are in a grid pattern FIG. In the illustrated example, each line segment is represented as a broken line, but may be a solid line or a wavy line. Further, the line segment may be expressed by an array of small figures (for example, small stars).

  The grid line virtual image 60 of the present embodiment is a live monitor image 38 obtained from the position of the play space 1202 of the crane unit 1210 identified by the fifth AR box 1275 (hereinafter referred to as “actual crane position”). Displayed with reference to the position of the crane unit 1210 (hereinafter referred to as “crane position in the image”). The

  The interval between the lines of the grid line virtual image 60 is variable. Specifically, at the time of the continuation play, the number of continuations is changed so as to become finer as the number of continuations increases. Regardless of the distinction between non-continuous play / continuous play, when an operation on the grid level-up operation icon 33 is detected and a predetermined approval procedure is performed, the change is made more finely.

The user touches the touch panel 1506 with the grid line virtual image 60 as a guide, and performs a pointing operation on the destination of the crane unit 1210.
Then, based on the result of the image recognition realized previously, the user terminal 1500 determines the movement destination coordinates in the play space 1202 (specifically, the live monitor image 38 displayed at that time) from the touched position coordinates. (Position coordinates in the first direction or the second direction corresponding to the left and right) Then, the movement destination coordinates are transmitted to the prize acquisition device 1200 which is a play device as a remote operation signal for moving the crane unit 1210. Alternatively, the nearest intersection of the grid line virtual image 60 is searched from the touched position coordinates, and the destination coordinate in the play space 1202 corresponding to the position of the intersection is transmitted to the prize acquisition device 1200 as a remote operation signal.

  The perpendicular virtual image 62 is a linear virtual image directed in a direction in which the crane unit 1210 of the prize acquisition device 1200 that is a play device performs an action sequence. In the present embodiment, one line segment that hangs down from the crane position in the image and reaches the floor surface of the play space 1202 also serves as the line segment constituting the grid line virtual image 60, but it appears as if it is highlighted. Designed.

  The range identification virtual image 64 is a virtual image that identifies and displays the display range in the live monitor image 38 corresponding to the movable range of the crane unit that is set in advance in the prize acquisition device 1200 that is a play device. In the example shown in the drawing, the hatched portions of the left and right ends of the grid line virtual image 60 correspond to this, and this shaded hatched portion indicates that the crane unit cannot move, Conversely, the movable range of the crane part is shown. To do. Although shown as a planar design, it may be displayed as a translucent rectangular parallelepiped design so that a translucent box is in close contact with the inner wall at the left and right ends of the live monitor image 38.

  Although details will be described later, the design and display form of the grid line virtual image 60 and the perpendicular virtual image 62 are not limited to the illustrated example and can be set as appropriate.

  In the present embodiment, the prize 4 arranged in the play space 1202 of the prize acquisition device 1200 can be a substitute for a prize, a so-called substitute prize.

FIG. 8 is a comparison diagram of an example of a substitute prize in the present embodiment and an example of how to show the substitute prize in the live monitor image 38.
As shown in FIG. 8A, the appearance of the substitute prize 5 is as follows: a prize marker 70 (a front prize marker 70f, a left prize marker 70s, an upper prize marker 70t) that is an AR marker specific to each face on each of the six faces of the rectangular parallelepiped. , ...) are provided. That is, the substitute giveaway 5 is a so-called “AR box”. Each premium marker 70 is associated with image information so-called “AR image” of each of the six faces of the prize 4 that the substitute prize substitutes. In the live monitor image 38, as shown in FIG. The prize image 72 (front prize image 72f, left prize image 72s, upper prize image 72t,...) Of the associated prize 4 is displayed at the position where the prize marker 70 is recognized. In this embodiment, the prize markers 70 provided on each of the six faces of one substitute prize 5 are the same, but an image for each face may be displayed as a separate marker for each face.

When the substitute prize 5 is used, the position of the substitute prize 5 in the play space 1202 can be recognized by recognizing the prize marker 70 as an image.
Therefore, in this embodiment, based on the prize marker 70, it is determined whether or not the prize is located in the direction of the action sequence when the action sequence is performed at the current display position of the crane unit 1210. And the display form of a virtual image can be changed based on this prize existence determination result.

  Then, the change of the display form of the virtual image based on the prize existence determination result can be realized by changing the display form of at least one of the grid line virtual image 60, the perpendicular virtual image 62, and the range identification virtual image 64. .

For example, FIG. 9 is a comparison diagram showing an example of changing the display form of the virtual image based on the prize existence determination result. As shown in FIG. 9A, in this embodiment, when the substitute prize 5 does not exist immediately below the current position of the crane unit 1210 at that time, the perpendicular virtual image 62 in the first display form is displayed. On the other hand, when the substitute prize 5 exists, the perpendicular virtual image 62e in the second display form is displayed as shown in FIG. 9 (2).
It should be noted that the prize presence / absence determination result may be notified to the user by displaying / not displaying a separate dedicated virtual image (for example, replacement display with a premium image in which the outline of the substitute prize 5 is emphasized).

In the present embodiment, images based on various types of prizes can be displayed based on information on prizes associated with the prize marker 70.
For example, as shown in FIG. 10, the background portion of the remote operation screen W10 of the user terminal 1500 (in the illustrated example, the area other than the remaining time display 35 and the action sequence start operation icon 36 in addition to the outer peripheral portion of the live monitor image 38) ), The first prize type image 74a can be displayed, or the second prize type image 74b can be displayed in the background image portion of the play space 1202 included in the live monitor image 38.

  Further, in the present embodiment, the position of the substitute prize 5 can be recognized by the position of the prize marker 70. Therefore, the display position of the substitute prize 5 (substantially equivalent to the prize 4) in the live monitor image 38 is indicated by the pointing operation. The movement target coordinates of the crane unit 1210 when the action sequence is performed toward the coordinates of the play space 1202 that is image-recognized based on the prize marker 70 attached to the substitute prize is calculated as the instruction coordinates. Can be transmitted as a remote control signal to the prize acquisition device 1200 which is a play device.

  The operation of the prize acquisition device 1200 includes a positioning sequence, an action sequence, and an end operation sequence.

  The “positioning sequence” is a process for positioning the crane unit 1210 in the play space 1202 based on a remote operation signal received from the user terminal 1500. The prize acquisition device 1200 has a function of moving the crane unit 1210 to the designated coordinates when the designated coordinates are received as a remote operation signal. In the present embodiment, when the designated coordinates of the movement destinations in the first direction and the second direction are received, the positioning is completed. Also, a predetermined action sequence start signal indicating that an operation input to the action sequence start operation icon 36 (see FIG. 6) has been made on the user terminal 1500 when a predetermined movement destination designation time limit has elapsed has been received. In this case, positioning is completed.

  The “action sequence” is a process for causing the crane unit 1210 to perform an action operation after the completion of positioning. The content of the action action depends on the configuration of the prize acquisition mechanism. In this embodiment, there are four consecutive subsequences of “lowering”, “opening the nail 1212”, “closing the nail 1212”, and “raising”. When the sub-sequence of ascending is completed, if the prize 4 is caught and maintained, “action is successful”.

  In the present embodiment, when a predetermined action start operation input is performed on the user terminal 1500, the prize acquisition device 1200 automatically executes these four subsequences continuously. One or a plurality of the above may be configured to be remotely operated from the user terminal 1500.

  When the action sequence ends, the prize acquisition device 1200 automatically executes an end operation sequence. The “end operation sequence” is a process in which the crane unit 1210 is moved to a given end operation position to perform an end operation. In the present embodiment, the “end operation position” is a position immediately above the center position of the prize acquisition area 1240. Then, as the “end operation”, two sub-sequences of “an opening operation for opening the claw 1212” and “a closing operation for closing the claw 1212” are automatically executed continuously.

  In the present embodiment, the end operation sequence is automatically executed, but may be configured to be remotely operated from the user terminal 1500. For example, a configuration in which movement to the end operation position is a target for remote operation is also possible. If the crane unit 1210 is moved to a position directly above the center position of the prize acquisition area 1240 and then moved to the crane unit initial position such as the home position, the position of the home position can be set as the “end operation position”. Good.

  And if the action sequence is successful by the action sequence, the prize 4 can be caught well, and if the crane unit 1210 can hold it until it moves to the end operation position, it is caught by the end operation. The prizes fall toward the prize acquisition area 1240. If the dropped prize 4 stays in the prize acquisition area 1240 well, it is recognized that the prize has been acquired.

  The determination as to whether the prize 4 remains in the prize acquisition area 1240 can be appropriately set as to whether the prize 4 is entirely within the area, or whether the prize 4 is recognized as being acquired. . In the present embodiment, the prize 4 is image-recognized from the image taken by the video camera 1220 to determine whether it is included in the setting range of the prize acquisition area 1240. When the prize acquisition area 1240 is realized as a physical opening, it may be determined using a sensor that detects passage of an object to the opening. Alternatively, when the prize acquisition area 1240 is realized as a physical pedestal portion, an acquisition determination may be made by providing a load sensor in the pedestal portion and measuring the weight of what is placed on the pedestal portion. .

  In the present embodiment, when it is determined that the action has failed at the end of the action sequence, the continue play is possible in the present embodiment.

  Specifically, during the play, the user terminal 1500 acquires action statuses one by one from the prize acquisition device 1200 that is a play device. Specifically, in addition to the sequence progress 1290, action status information 1292 (see FIG. 4) is acquired as information for determining action success / action failure.

  If the current operation status is “action sequence / end” and the latest action status information 1292 is “open / close control value = closed and open / close state = open” in the latest sequence progress 1290, the user terminal 1500 It is determined that the action is successful, that is, the catch success in this embodiment. Similarly, if the latest sequence progress 1290 is “action sequence / end” and the latest action status information 1292 is “open / close control value = closed and open / closed state = closed”, the action has failed. It is determined that the catch has failed.

  If it is determined that the action has failed at the end of the action sequence, the user terminal 1500 temporarily stops the premium acquisition device 1200 without shifting to the end operation sequence. Specifically, a pause signal is transmitted to the prize acquisition device 1200, and the prize acquisition device 1200 receives the pause signal to pause the operation. Alternatively, it may be realized that the prize acquisition device 1200 suspends transmission of a signal for starting an end operation sequence.

  Then, the user terminal 1500 performs continue transition control. In the continuation transition control, preparation is made for transition to the continuation play, which is a free prize acquisition play in which at least the end operation sequence is omitted. Specifically, the user terminal 1500 performs a continuation selection standby process for accepting a selection operation as to whether or not to perform a continuation play.

  In the continuation selection standby process, for example, a continuation transition notification that informs the player that continuation is possible, an approval operation icon that approves the transition to continuation play, and an unapproved operation that rejects approval are displayed in the remote operation screen And icon. Then, when the selection operation for performing the continue play is performed, the state shifts to the continue play.

  In the continuation play in the present embodiment, the end operation sequence that has been waiting for execution due to the temporary stop, the selection of a prize that would have been required if replayed, and the selection of a prize acquisition device to be used, Is omitted. Then, the crane unit 1210 starts to play from a state in which the crane unit 1210 is at a position at the end of the action sequence (movement destination instructed in the immediately preceding play) due to a temporary stop.

[Description of functional configuration]
FIG. 11 is a functional block diagram illustrating a functional configuration example of the server system 1100 according to the present embodiment. The server system 1100 in the present embodiment includes an operation input unit 100s, a server processing unit 200s, a sound output unit 390s, an image display unit 392s, a communication unit 394s, and a server storage unit 500s.

  The operation input unit 100s is a means for inputting various operations for server management. The keyboard 1106 in FIG. 1 corresponds to this.

  The server processing unit 200s is realized by, for example, a microprocessor such as a CPU or a GPU, or an electronic component such as an ASIC or IC memory, and inputs / outputs data to / from each functional unit including the operation input unit 100s and the server storage unit 500s. Take control. The server system executes various arithmetic processes based on predetermined programs and data, operation input signals from the operation input unit 100s, data received from the user terminal 1500, data received from the prize acquisition device 1200, and the like. The operation of 1100 is controlled in an integrated manner.

  The server processing unit 200s according to the present embodiment includes a user management unit 202, an online shopping management unit 204, a free gift acquisition system management unit 206, a timing unit 280s, a sound generation unit 290s, an image generation unit 292s, Communication control unit 294s. Of course, functional units other than these can be included as appropriate.

  The user management unit 202 manages processing related to the user registration procedure and data of each user associated with the user account. In the present embodiment, the user management unit 202 includes 1) giving a unique user account to a registered user, 2) registering information management for registering and managing personal information for each user account, and 3) an accounting element (in this embodiment). Book management of electronic payment media consumed by payment of credits for playing premium acquisition device 1200 in online shopping) 4) Play history management for managing log-in and log-out history for game play, etc. And each function. Of course, other data management functions associated with other accounts can be included as appropriate.

  The online shopping management unit 204 is responsible for control related to online shopping, and can be realized by appropriately using known online shopping technology. In this embodiment, the player can purchase “credits” consumed as a play consideration for playing the prize acquisition device 1200 by online shopping. Of course, sales objects in online shopping can be appropriately set in addition to these.

  The premium acquisition system management unit 206 executes various processes related to management of the premium acquisition system. In the present embodiment, processing for setting and managing the prize acquisition device 1200 used by the player for game play, processing for storing and managing various types of information related to the prize acquisition system in the server storage unit 500s, and the information for the user terminal 1500 And processing to be provided. Of course, processes other than these can be included as appropriate.

  The time measurement unit 280s measures the current date and time, the time limit, and the like using the system clock.

  The sound generation unit 290s is realized by executing an IC or software that generates and decodes sound data, and generates or decodes sound data such as operation sounds and BGM related to system management of the server system 1100 and game play. And the audio | voice signal regarding system management is output to the sound output part 390s.

  The sound output unit 390s emits an audio signal. In the example of FIG. 1, a speaker (not shown) included in the main device 1101 corresponds to this.

  The image generation unit 292s can generate an image related to system management of the server system 1100. Then, an image relating to system management can be output to the image display unit 392s.

  The image display unit 392s displays various images for system management based on the image signal input from the image generation unit 292s. For example, it can be realized by an image display device such as a flat panel display or a projector. In the example of FIG. 1, the touch panel 1108 corresponds.

  The communication control unit 294s executes data processing related to data communication, and realizes data exchange with an external device via the communication unit 394s.

  The communication unit 394s is connected to the communication line 9 to realize communication. For example, it is realized by a wireless communication device, a modem, a TA (terminal adapter), a cable communication cable jack, a control circuit, or the like. In the example of FIG. 1, the communication device 1153 corresponds.

  The server storage unit 500s stores programs and various data for realizing various functions for causing the server processing unit 200s to control the server system 1100 in an integrated manner. Further, it is used as a work area for the server processing unit 200s, and temporarily stores calculation results and the like executed by the server processing unit 200s according to various programs. This function is realized by, for example, an IC memory such as a RAM or a ROM, a magnetic disk such as a hard disk, an optical disk such as a CD-ROM or DVD, an online storage, or the like. In the example of FIG. 1, a storage medium such as an IC memory 1152 and a hard disk mounted on the main device 1101 and a storage 1140 correspond to this.

  The server storage unit 500 s in this embodiment stores a server program 503, a distribution game program 505, sales management data 509, and prize acquisition device management data 510. In addition, the server storage unit 500s stores user management data 600, play device setting data 790, and current date and time 800 as data that are sequentially updated and managed. In addition, information such as a timer, a counter, and various flags can be stored as appropriate.

  The server program 503 is a program for realizing the functions as the user management unit 202, the online shopping management unit 204, and the prize acquisition system management unit 206 by being read and executed by the server processing unit 200s.

  The distribution game program 505 is an original of the game program 502 (see FIG. 14) provided to the user terminal 1500.

  The sales management data 509 stores data for defining and managing products sold through online shopping. In the present embodiment, the credits consumed as play consideration of the prize acquisition device 1200 are included in the sales items.

  The premium acquisition device management data 510 is prepared for each premium acquisition device 1200 (1200a, 1200b,...) Of the operator facility 3 (see FIG. 1), and stores various data associated with the premium acquisition device.

  For example, as shown in FIG. 12, one premium acquisition device management data 510 includes a unique premium acquisition device ID 511, access information 512, a premium name or identification information indicating the type of the prize received, or a substitute premium. A prize ID 513 for storing identification information, a prize acquisition play consideration 514, a continue play consideration 515, a grid upgrade consideration 516, movable range definition data 518, AR box recognition dictionary data 530, and an AR box in the play space Position coordinate list 532, AR box AR image data 534, first video camera coordinate transformation matrix 536, second video camera coordinate transformation matrix 538, grid line virtual image definition data 550, and range identification virtual image Including definition data 560 and premium type image definition data 562Of course, data other than these can be included as appropriate.

  The access information 512 is information necessary for communication connection to the apparatus via the communication line 9. For example, an IP address and a passcode are included.

  The movable range definition data 518 is one of data relating to the hardware specifications of the prize acquisition device, and includes first direction movable range data and second direction movable range data of the two-dimensional linear motion mechanism unit 1218.

  The AR box recognition dictionary data 530 is dictionary data for recognizing an image of the AR box used in the prize acquisition device. In the present embodiment, AR marker dictionary data for each of the first AR box 1271 to the fifth AR box 1275 and the AR box that is the substitute prize 5 is stored.

  The AR space position coordinate list 532 in the play space stores the initial position coordinates in the play space 1202 for each AR box used in the prize acquisition device. The fifth AR box 1275 has coordinates at the initial position of the crane unit 1210.

  The AR box AR image data 534 is stored in the AR box recognition dictionary data 530 as image information to be displayed in an overlapping manner (overlap display or overlay display) on the image portion of the AR box displayed in the live monitor image 38. Each AR marker is stored in association with each other. In the present embodiment, the lively virtual image 66 (see FIG. 6) and the prize image 72 of the prize 4 associated with the substitute prize 5 (front prize image 72f, left prize image 72s, upper prize image 72t,...; See FIG. ) And are stored.

The first video camera coordinate transformation matrix 536 and the second video camera coordinate transformation matrix 538 are information associating the coordinates in the play space with the coordinates in the monitor image.
The first video camera coordinate transformation matrix 536 is a transformation matrix from the captured image coordinate system of the first video camera 1220f to the play space coordinate system. In this embodiment, since the shooting angle of view, shooting direction, shooting distance, and play space 1202 of the first video camera 1220f are fixed values, the coordinate transformation matrix is geometrically obtained and stored in advance. Similarly, the second video camera coordinate transformation matrix 538 is a transformation matrix from the captured image coordinate system of the second video camera 1220s to the play space coordinate system.

  The grid line virtual image definition data 550 is data that defines the grid line virtual image 60 and is stored in one or more. One grid line virtual image definition data 550 includes, for example, an application condition 551, a grid shape 553, a grid line interval 555, and a grid intersection point coordinate list 557.

  The application condition 551 stores various data describing the condition to which the definition data is applied. The application condition 551 is described as, for example, AND or OR of the condition of the number of times of continuation and the condition of the parameter based on the play history of the user who is a player (for example, the condition of the cumulative number of play, the condition of the prize acquisition rate, etc.). Can do.

The grid shape 553 defines the display form of how to display grid lines or grid intersections.
The grid line interval 555 defines a grid line interval. In this embodiment, the larger the value of the continuation number condition included in the application condition 551, the smaller the interval is set.
The grid intersection coordinate list 557 stores the position coordinates of each intersection of grid lines in the play space 1202 in association with each other.
The grid shape 553 and the grid line interval 555 may be defined as one virtual image data.

  The grid intersection coordinate list 557 is a list of coordinates in the play space coordinate system for each grid line in the grid line virtual image 60 defined by the definition data.

  The range identification virtual image definition data 560 is definition data for displaying the range identification virtual image 64 (see FIG. 6).

  The prize type image definition data 562 is data stored when the substitute prize 5 is included as the prize 4 that can be acquired by the prize acquisition apparatus, and the prize type image 74 (74a, 74b for each substitute prize 5); 10) is stored.

  Returning to FIG. 11, the user management data 600 is prepared for each registered user, and stores various data associated with an account, which is unique identification information. In the present embodiment, for example, as shown in FIG. 13, one user management data 600 includes a unique user account 601, payment medium book data 603, personal information registration data 605, retained credit amount 607, play History data 610. Of course, data other than these can be included as appropriate.

  The settlement medium book data 603 includes information on the amount of supplement / consumption of the settlement medium for electronic settlement (for example, virtual currency and points) associated with the user, the reason for supplement / consumption, and the date and time of change. This is a so-called book that is stored in association with each other. It can be read as billing history data or billing history information.

  The personal information registration data 605 includes personal information of the user. For example, it may include an e-mail address, a telephone number, a giveaway address to which the acquired prize is sent, and the like.

  The retained credit amount 607 stores the remaining number of media consumed as a play consideration for the prize acquisition device 1200 purchased by the user by consuming the payment medium.

  The play history data 610 is created for each play. One play history data 610 is also created during the continuous play. One play history data 610 includes a play date and time (date and time when play is started), a desired prize type, a play apparatus ID that is a prize acquisition apparatus ID of the prize acquisition apparatus 1200 that is a play apparatus, and the number of times of continuation. , And the number of prizes acquired. Of course, data other than these can be included as appropriate.

  Returning to FIG. 11, the play device setting data 790 is data related to devices that are being used for game play among the prize acquisition devices 1200 (1200a, 1200b,. Created and discarded (deleted) at the end of game play. One piece of play device setting data 790 stores a play device ID, which is a freebie acquisition device ID of the freebie acquisition device 1200 as a play device, and a player account in association with each other. Other information, for example, use start date and time can also be included.

  FIG. 14 is a functional block diagram showing a functional configuration example of the user terminal 1500 in the present embodiment. The user terminal 1500 in this embodiment includes an operation input unit 100, a terminal processing unit 200, a sound output unit 390, an image display unit 392, a communication unit 394, and a terminal storage unit 500.

  The operation input unit 100 is a means for a user to input various operations. The direction input key 1502, the button switch 1504, the touch panel 1506, and the like shown in FIG. In the configuration in which the voice input is enabled, the microphone 1512 can be included in this. In the configuration in which the gesture input is enabled, the image sensor unit 1520 can be included in this.

  The terminal processing unit 200 is realized by, for example, a microprocessor such as a CPU or a GPU, or an electronic component such as an ASIC or IC memory, and inputs / outputs data to / from each function unit including the operation input unit 100 and the terminal storage unit 500. Take control. In the example of FIG. 5, the control board 1550 and the CPU 1551 correspond to this.

  The terminal processing unit 200 executes various arithmetic processes based on predetermined programs and data, operation input signals from the operation input unit 100, data received from the server system 1100, signals received from the prize acquisition device 1200, and the like. Thus, the operation of the user terminal 1500 is integratedly controlled.

  The terminal processing unit 200 according to the present embodiment includes a game management unit 210, a timing unit 280, a sound generation unit 290, an image generation unit 292, and a communication control unit 294. Of course, functional units other than these can be included as appropriate.

  The game management unit 210 performs various processes related to game execution management. The game management unit 210 according to the present embodiment includes a monitor image display control unit 212, a correspondence relationship setting unit 214, an instruction coordinate calculation unit 216, an operation signal transmission control unit 218, a virtual image display control unit 220, and a prize existence / non-existence. The determination unit 222 includes an AR image display unit 224, a prize type image display control unit 226, a movable range information acquisition control unit 228, and a movable range identification display control unit 230. Of course, functional units other than these may be included as appropriate.

  The monitor image display control unit 212 controls the touch panel 1506 to display a live monitor image 38 based on the captured image of the video camera 1220 (first video camera 1220f, second video camera 1220s) installed in the playing device. In addition, the monitor image display control unit 212 responds to the switching operation input to the camera switching operation icon 37 (see FIGS. 5 and 9), the first monitor image based on the captured image of the first video camera 1220f, and the first monitoring image. The second monitor image based on the image captured by the two video cameras 1220s can be switched and displayed.

  In the present embodiment, the two-dimensional movement of the crane unit 1210 of the prize acquisition apparatus 1200 is performed by switching between the movement in the first direction and the movement in the second direction. The first monitor image can be displayed when moving in one direction, and the second monitor image can be displayed when moving in the second direction.

  The correspondence setting unit 214 sets the correspondence between the coordinate system of the play space 1202 and the display coordinate system of the live monitor image 38 based on the image of the AR marker in the image captured by the video camera 1220. In the present embodiment, as the setting of the correspondence relationship, for example, the AR marker is recognized from a captured image obtained by shooting the play space, and the first video camera coordinate transformation matrix 536 preset for each premium acquisition device 1200 is used. Acquiring the second video camera coordinate conversion matrix 538 and converting the pointing position coordinates of the pointing operation to the position coordinates in the play space based on the acquired conversion matrices.

  Note that in the case where the first video camera coordinate transformation matrix 536 and the second video camera coordinate transformation matrix 538 are not prepared in advance and the user terminal 1500 sequentially calculates and calculates, the calculation processing also has a corresponding relationship. It will be included in the setting.

  The designated coordinate calculation unit 216 calculates the designated coordinates in the play space 1202 corresponding to the designated position designated by the user's pointing operation on the live monitor image 38 based on the correspondence set by the correspondence setting unit 214. Specifically, the movement target coordinates of the two-dimensional movement of the crane unit 1210 are calculated as designated coordinates. At this time, the pointing coordinates are calculated by using any of the intersections of the grid lines as the pointing position by a pointing operation.

  The designated coordinate calculation unit 216 also recognizes an image based on the prize marker 70 attached to the prize when the display location of the prize in the live monitor image 38 is designated by a pointing operation. The movement target coordinates of the crane unit 1210 when performing an action sequence toward the coordinates are calculated as instruction coordinates.

  The operation signal transmission control unit 218 performs control to transmit a remote operation signal for moving the crane unit 1210 to a position corresponding to the instruction coordinates calculated by the instruction coordinate calculation unit 216 to the prize acquisition device 1200.

The virtual image display control unit 220 determines a set display position in the live monitor image 38 corresponding to a given setting position in the play space 1202 based on the correspondence set by the correspondence setting unit 214 and determines the virtual image. Is displayed.
Specifically, the grid line virtual image 60 can be displayed as a virtual image forming a grid line of two-dimensional coordinates related to the two-dimensional movement of the crane unit 1210 (see FIG. 6). Then, the interval between the grid lines of the grid line virtual image 60 can be variably set according to the number of continue plays.

  In addition, the virtual image display control unit 220 displays a linear virtual image from the display position of the crane unit 1210 in the live monitor image 38 in the direction in which the crane unit 1210 performs the action sequence. In the present embodiment, the perpendicular virtual image 62 corresponds to this (see FIG. 6).

  Further, the virtual image display control unit 220 changes the display form of the virtual image based on the determination result of the prize existence determination unit 222. In the present embodiment, the change in the display form of the perpendicular virtual image 62 corresponds to this (see FIG. 9).

  The prize existence determination unit 222 determines, based on the prize marker 70, whether or not the prize is located in the direction of the action sequence when the action sequence is performed at the current display position of the crane unit 1210.

  The AR image display unit 224 displays the AR box display location in the live monitor image 38 when the prize 4 is the substitute prize 5 which is an AR box having an AR (Augmented Reality) marker on the outer surface as the prize marker. Then, an image based on the AR marker is displayed. The display control of the front prize image 72f, the left prize image 72s, and the upper prize image 72t in FIG. 8 corresponds to this.

  The prize type image display control unit 226 includes an image based on the type of prize substituted for the substitute prize 5 associated with the prize marker in the background portion of the remote operation screen of the user terminal 1500 or the live monitor image 38. Displayed on the background image portion of the play space 1202 to be displayed. In the present embodiment, the display of the first prize type image 74a and the second prize type image 74b corresponds to this (see FIG. 10).

  The movable range information acquisition control unit 228 performs control to acquire information indicating the movable range of the crane unit 1210 of the prize acquisition device 1200 that is a play device. This embodiment is realized by acquiring a copy of the premium acquisition device management data 510 (see FIG. 12) of the premium acquisition device 1200 selected as the play device from the server system 1100. If the data corresponding to the management data is stored in advance in the IC memory 1252 (see FIG. 4) of the prize acquisition device 1200, when the user terminal 1500 remotely operates the prize acquisition device 1200. It may be acquired.

  The movable range identification display control unit 230 displays on the live monitor image 38 corresponding to the movable range of the crane unit 1210 of the prize acquisition device 1200 that is a play device, based on the correspondence set by the correspondence setting unit 214. The range is calculated, and control for identifying and displaying the movable range or a range other than the movable range in the live monitor image 38 is performed. In the present embodiment, the display control of the range identification virtual image 64 (see FIG. 6) corresponds to this.

  The timer 280 measures the current date and time, the time limit, etc. using the system clock.

  The sound generation unit 290 is realized by executing an IC or software that generates and decodes sound data, and generates or decodes sound data such as operation sounds and BGM related to game play. Then, the audio signal is output to the sound output unit 390.

  The sound output unit 390 emits an audio signal. In the example of FIG. 5, the speaker 1510 corresponds to this.

  The image generation unit 292 can generate various images related to game play. Then, the image signal is output to the image display unit 392.

  The image display unit 392 displays various images based on the image signal input from the image generation unit 292. For example, it can be realized by an image display device such as a flat panel display, a cathode ray tube (CRT), a projector, or a head mounted display. In the example of FIG. 5, the touch panel 1506 corresponds.

  The communication control unit 294 executes data processing related to data communication, and realizes data exchange with an external device via the communication unit 394.

  The communication unit 394 is connected to the communication line 9 to realize communication. For example, it is realized by a wireless communication device, a modem, a TA (terminal adapter), a cable communication cable jack, a control circuit, or the like. In the example of FIG. 5, the wireless communication module 1553 corresponds.

  The terminal storage unit 500 stores programs and various data for realizing various functions in the terminal processing unit 200. Further, it is used as a work area of the terminal processing unit 200, and temporarily stores the calculation results executed by the terminal processing unit 200. This function is realized by, for example, an IC memory such as a RAM or a ROM, a magnetic disk such as a hard disk, an optical disk such as a CD-ROM or DVD, an online storage, or the like. In the example of FIG. 5, the IC memory 1552 and the memory card 1540 correspond to this. Online storage can also be included.

  The terminal storage unit 500 in the present embodiment stores a game program 502, a user account 504, a prize acquisition device management data 510c, own user management data 600c, play data 700, and a current date and time 800. In addition, information such as a timer, a counter, and various flags can be stored as appropriate.

  The game program 502 is software for realizing the function as the game management unit 210 by being read and executed by the terminal processing unit 200. In the present embodiment, the distribution game program 505 (see FIG. 11) of the server system 1100 is downloaded and stored.

  The user account 504 is stored as a result input by the user when starting the game program 502 to play the game of the present embodiment and performing a predetermined login procedure.

  The premium acquisition device management data 510c is a copy of the premium acquisition device management data 510 (see FIG. 11) of the premium acquisition device 1200 that is a play device, and access information to the play device according to selection / setting of the play device. Is acquired and stored from the server system 1100 as data including

  The own user management data 600c is a copy of the user management data 600 (see FIG. 11) of the user who uses the player's own device, and is acquired and stored from the server system 1100 in accordance with the login procedure.

The play data 700 is created before the play of the prize acquisition device 1200 and is deleted at the end of play. During continuous play, it is used continuously.
Specifically, as shown in FIG. 15, for example, the play data 700 includes a player account 701, a play device ID 703, received captured image data 705, received action determination information 707, a play mode 710, It includes space recognition data 720, virtual image setting data 730, prize position coordinates 740, destination instruction management data 750, and remote operation screen display control data 770. Of course, data other than these can be included as appropriate. For example, in a configuration in which the server system 1100 relays between the user terminal 1500 and a prize acquisition device 1200 that is a play device in remote operation, the play data 700 includes access information to the user terminal.

  The play apparatus ID 703 is a prize acquisition apparatus ID of the prize acquisition apparatus 1200 selected by the player as a machine body used for game play. Acquired from the server system 1100 and stored along with the selection / setting procedure of the play device.

  The received photographed image data 705 stores data of the photographed image of the first video camera 1220f and the photographed image of the second video camera 1220s that are transmitted one by one from the prize acquisition device 1200 that is a playing device.

  The received action determination information 707 stores sequence progress 1290 and action status information 1292 transmitted one by one from the prize acquisition device 1200 that is a playing device (see FIG. 4).

  The play mode 710 stores information indicating whether the current play is a non-continuous play (premium acquisition play) or a continuous play. At the start of the game, it is initialized to a value indicating non-continuous play.

  The space recognition data 720 is prepared for each video camera 1220 of the prize acquisition apparatus 1200 that is a play apparatus, and based on the captured image of the video camera, the AR box (first AR box 1271 to fifth AR box 1275, substitute prize 5). Various information for recognizing a space by recognizing the AR marker and various information on the result of space recognition are stored.

For example, as shown in FIG. 16, the space recognition data 720 includes:
A monitor image AR box position coordinate list 722, a monitor image AR box size list 724, a monitor image AR box position value list 726, and a monitor image in-place prize position coordinate 728 are included. Of course, data other than these can be included as appropriate.

  The monitor image AR box position coordinate list 722 stores the position coordinates of each AR box in the monitor image coordinate system. Each AR box is stored in association with the first direction coordinate and the second direction coordinate of the monitor image coordinate system. The first direction coordinate is a position where the AR box is recognized in the captured image of the first video camera 1220f. The second direction coordinate is a position where the AR box is recognized in the captured image of the second video camera 1220s.

  The monitor image AR box size list 724 stores information indicating the marker size in the monitor image coordinate system of each AR box. For each AR box, the first direction size and the second direction size of the monitor image coordinate system are stored in association with each other. The first direction size indicates the size in which the AR box is recognized in the captured image of the first video camera 1220f. The second direction size indicates the size in which the AR box is recognized in the captured image of the second video camera 1220s.

  The monitor image AR box orientation value list 726 stores values describing the orientation of each AR box in the monitor image coordinate system. For each AR box, the first direction posture value and the second direction posture value of the monitor image coordinate system are stored in association with each other. The first direction posture value indicates the posture in which the AR box is recognized in the captured image of the first video camera 1220f. The second direction posture value indicates the posture in which the AR box is recognized in the captured image of the second video camera 1220f.

  The monitor image in-place prize position coordinate 728 is prepared for each substitute prize 5 and stores a value describing the attitude of the substitute prize in the monitor image coordinate system. The identification information of the substitute prize 5 and the first direction position and the second direction position of the monitor image coordinate system are stored in association with each other in one monitor image prize position coordinate 728.

Returning to FIG. 15, the virtual image setting data 730 is prepared when various virtual images are not specific image data, but are drawn and formed each time. For example, when drawing a virtual image as a CG image obtained by photographing an object arranged in a virtual three-dimensional space with a virtual camera, the setting data is data defining the virtual three-dimensional space.
The virtual image setting data 730 includes
1) grid setting data 731 for the first direction, which is the setting of grid lines along the first direction,
2) grid setting data 732 for the second direction, which is the setting of grid lines along the second direction,
3) First-direction perpendicular setting data 733 that is a setting of the perpendicular virtual image 62 (see FIG. 6) when the captured image of the first video camera 1220f is displayed as the live monitor image 38;
4) Second-direction perpendicular setting data 734 that is a setting of the perpendicular virtual image 62 when the captured image of the second video camera 1220s is displayed as the live monitor image 38;
5) First direction range identification display setting data 735 that is a setting of the range identification virtual image 64 (see FIG. 6) when the captured image of the first video camera 1220f is displayed as the live monitor image 38;
6) Second direction range identification display setting data 736, which is a setting of the range identification virtual image 64 when the captured image of the second video camera 1220s is displayed as the live monitor image 38;
including. Of course, data other than these can be included as appropriate.

  The prize position coordinates 740 are prepared for each recognized substitute prize 5, and store the position coordinates of the substitute prize in the play space coordinate system. The position coordinates are obtained based on the first video camera coordinate transformation matrix 536 and the second video camera coordinate transformation matrix 538 of the premium image position coordinate 728 (see FIG. 16) in the monitor image. Can be calculated.

The destination instruction management data 750 stores various data describing the progress of remote operation.
In the present embodiment, as shown in FIG. 17, a first direction pointing operation position coordinate 751, a first direction movement destination instruction coordinate 752, a second direction pointing operation position coordinate 753, and a second direction movement destination instruction coordinate 754. And positioning completion determination data 760. Of course, data other than these can be included as appropriate.

The first direction pointing operation position coordinate 751 is a touch position coordinate in the monitor image coordinate system when the captured image of the first video camera 1220f is displayed as the live monitor image 38.
The first direction movement destination instruction coordinates 752 are calculated based on the first direction pointing operation position coordinates 751 and the first video camera coordinate transformation matrix 536 of the prize acquisition device 1200 which is a playing device.

Similarly, the second direction pointing operation position coordinate 753 is a touch position coordinate in the monitor image coordinate system when the captured image of the second video camera 1220s is displayed as the live monitor image 38.
The second direction movement destination instruction coordinates 754 are calculated based on the second direction pointing operation position coordinates 753 and the second video camera coordinate transformation matrix 538 of the prize acquisition device 1200 which is a playing device.

  The positioning completion determination data 760 stores data referred to for determining the positioning completion. In the present embodiment, a first direction instruction flag 761 that is set when the movement destination in the first direction has been instructed, and a second direction instruction that is set when the movement destination in the second direction has been instructed. A completed flag 763 and a positioning limit time timer 765.

  The initial value of the first direction instructed flag 761 and the second direction instructed flag 763 is “0 (not instructed)”. However, when a remote operation signal in the first direction and the second direction is transmitted, “1” is indicated. "Is set. Based on these two flags, it can be determined that the positioning is completed.

  The positioning time limit timer 765 is used to count the time limit during which a movement instruction operation can be input. When the timer finishes counting the predetermined time, it is determined that the positioning is completed regardless of the state of the first direction instructed flag 761 and the second direction instructed flag 763.

  Although different from these, if an operation to the action sequence start operation icon 36 is detected on a remote operation screen (for example, the remote operation screen W6 in FIG. 6), each data of the positioning completion determination data 760 is detected. Regardless of the state, it is determined that the positioning is completed.

  Returning to FIG. 15, the remote operation screen display control data 770 relates to the display of the desired prize selection screen W2, the play device selection screen W4, the remote operation screen W6 (see FIG. 6), and the remote operation screen W10 (see FIG. 10). Control data can be stored.

[Description of operation]
Next, the operation of the prize acquisition system 1000 will be described.
18 to 20 are flowcharts for explaining the flow of processing in the user terminal 1500 in the present embodiment. A series of processing flow described here is realized by executing the game program 502 on the user terminal 1500.

The user terminal 1500 first executes a login process (step S10).
Specifically, when the game program 502 is activated and a user account is input, the user terminal 1500 accesses the server system 1100 and transmits a login request. The server system 1100 executes the login acceptance process in response to this. When the predetermined login procedure is completed, the server system 1100 provides the user management data 600 of the logged-in user to the requesting user terminal 1500.

Next, the user terminal 1500 executes a play device selection process for selecting the prize acquisition device 1200 as a play device (step S12).
In this processing, the user terminal 1500 acquires information on the unused premium acquisition device 1200 based on the play device setting data 790 (see FIG. 11) and information on the types of premiums that can be acquired from the information from the server system 1100. To do. Upon receiving them, the user terminal 1500 displays a desired prize selection screen W2 and accepts a selection input for a prize desired to be acquired.

  Next, a prize acquisition device 1200 capable of acquiring the selected type of prize is searched, a play apparatus selection screen W4 is displayed, selection of the prize acquisition apparatus 1200 used in the prize acquisition play is accepted, and the selected prize is acquired. The premium acquisition device ID of the device 1200 is returned to the server system 1100. The server system 1100 sets the play device setting data 790 for registering the premium acquisition device 1200 of the received premium acquisition device ID as the play device of the player, and acquires the premium including access information to the premium acquisition device 1200 that is the play device. The device management data 510 is transmitted to the user terminal 1500. The user terminal 1500 receives and stores this.

  Next, the user terminal 1500 establishes a remote operation environment by communication connection with the play device using the access information to the premium acquisition device 1200 which is the play device acquired previously (step S14).

  Then, when the prize acquisition device 1200 that is the play device establishes communication between the two, each photographed image by the first video camera 1220f and the second video camera 1220s from the gift acquisition device 1200 that is the play device is sent to the user terminal 1500. Start the live distribution process to send. Also, the prize acquisition device 1200 that is a play device starts automatic update of the sequence progress 1290 and the action status information 1292, and starts distributing them to the user terminal 1500.

  When communication between the two is established, the user terminal 1500 starts sequential reception of the data, and stores them as received captured image data 705 and received action determination information 707 (step S16; see FIG. 15).

  Next, the user terminal 1500 starts calculation for setting a correspondence relationship between the coordinate system of the play space and the display coordinate system of the monitor image based on the received captured image of the video camera 1220 (step S18). Specifically, the type, size, and orientation of the AR marker in the AR box that is captured in the captured image are determined, and space recognition data 720 (see FIG. 16) is created.

Next, the user terminal 1500 sets a virtual image (step S20).
Specifically, from the grid line virtual image definition data 550 included in the prize acquisition device management data 510c acquired from the server system 1100, the definition data that matches the current condition is searched for the definition data 550, and the grid shape 553 and grid The first direction grid setting data 731 and the second direction grid setting data 732 are set using the line interval 555 (see FIG. 15).

  In addition, the monitor image AR box position coordinate list 722 of the space recognition data 720 (see FIG. 16) includes the crane position in the image indicated by the fifth AR box 1275. Based on this, the vertical setting data for the first direction is set. 733 and second direction perpendicular setting data 734 are set (see FIG. 15).

  Then, based on the movable range definition data 518 and the range identification virtual image definition data 560 included in the prize acquisition device management data 510c (see FIGS. 14 and 12) acquired from the server system 1100, the first direction vertical line setting data. 733 and second direction perpendicular setting data 734 are set (see FIG. 15).

Then, the user terminal 1500 starts displaying the remote operation screen (step S22).
Along with this, first, control for displaying the grid line virtual image 60, the perpendicular virtual image 62, and the range identification virtual image 64 on the live monitor image 38 is started (see FIG. 6). Secondly, the AR image display control is started, and control for displaying the lively virtual image 66 in an overlapping manner on the AR box shown in the live monitor image 38 is started.

  When the prize marker 70 of the substitute prize 5 is recognized in the live monitor image 38 (YES in step S40), the user terminal 1500 displays an AR display on the substitute prize 5 (see FIG. 8), and substitute prize 5 The display of the premium type image 74 (74a, 74b; see FIG. 10) corresponding to the type is started (step S42).

Also, the determination of whether or not any substitute prize 5 exists under the crane unit 1210 and the notification control of the determination result are started (step S44).
The determination of the existence of the prize is, for example, the position coordinates in the live monitor image 38 of the fifth AR box 1275 attached to the crane unit 1210, which are included in the AR box position coordinate list 722 in the monitor image (see FIG. 16). This can be realized by comparison with the position coordinates of the AR box that is designated as the prize 5.

  Next, the user terminal 1500 initializes the positioning completion determination data 760 (see FIG. 17), starts the positioning limit time timer 765 (step S46), and starts the game play (step S48).

  19, when a touch operation on the grid level-up operation icon 33 (see FIG. 6) is detected after the game play is started (YES in step S70), the user terminal 1500 executes a grid line upgrade process ( Step S72). Along with this, the payment processing of the consideration to be upgraded and the grid line interval are changed more finely, and the display of the grid line virtual image 60 is updated.

  When a touch operation on the camera switching operation icon 37 (see FIG. 6) is detected after the game play is started (YES in step S74), the user terminal 1500 changes the captured image to be the live monitor image 38 according to the camera switching operation. At the same time, the display of the virtual image such as the grid line virtual image 60 is switched (step S76).

  If the pointing operation on the touch panel 1506 is detected after the game play is started (YES in step S78), and the touched position coordinate indicating the pointing operation indicates the position of the substitute prize 5 (YES in step S80). The user terminal 1500 sets the movement destination instruction coordinates to the position coordinates in the play space corresponding to the position coordinates of the substitute prize 5 that has been pointed (step S82), and sends the remote operation signal to the prize acquisition apparatus 1200 that is the playing apparatus. Transmit (step S84).

At that time, the first direction movement destination instruction coordinates 752 or the second direction movement destination instruction coordinates 754 respectively correspond to the first direction coordinates and the second direction coordinates of the corresponding monitor image system of the substitute prize 5 and corresponding first video cameras. This is set by converting to the play space coordinate system using the coordinate conversion matrix for the video 536 or the coordinate conversion matrix for the second video camera 538. Then, the first direction movement destination instruction coordinates 752 or the second direction movement destination instruction coordinates 754 are transmitted as a remote operation signal.
In the prize acquisition device 1200 that has received this, the crane unit 1210 is moved to a position above the substitute prize 5 on which the pointing operation has been performed.

  Then, the user terminal 1500 sets all directions as instructed (step S86).

  If a pointing operation is detected but it is not pointing the substitute prize 5 (NO in step S80), the user terminal 1500 refers to the positioning completion determination data 760. If the direction that can be indicated by the live monitor image 38 at that time (the first direction if the captured image of the first video camera 1220f is the live monitor image 38, the 22nd direction if the captured image of the second video camera 1220s) is not specified. (YES in step S92), the user terminal 1500 executes a designated coordinate calculation process (steps S94 to S96).

  Specifically, as the designated coordinate calculation process, the nearest grid intersection is determined from the designated position coordinates of the pointing operation (step S94), and the destination designated coordinates in the direction that can be designated on the live monitor image 38 at that time, that is, the first coordinate. Either the one-direction movement destination designation coordinate 752 or the second direction movement destination designation coordinate 754 is set to the coordinate of the determined grid intersection (step S96).

  The grid intersection point is determined by converting the touch position coordinates subjected to the pointing operation into the play space coordinate system using the first video camera coordinate conversion matrix 536 or the second video camera coordinate conversion matrix 538. Then, the converted touch position coordinates are defined in the definition data of the application condition 551 that suits the current state in the grid line virtual image definition data 550 (see FIG. 12) of the prize acquisition device management data 510c (see FIGS. 14 and 12). This can be realized by comparing with the grid intersection coordinate list 557.

  The grid intersection coordinate list 557 is a list of coordinate values of the monitor image system when the captured image of the first video camera 1220f is the live monitor image 38, and the captured image of the second video camera 1220s is the live monitor image 38. In the configuration realized by the list of coordinate values of the monitor image system in the case where the coordinates are selected, the coordinates of the list corresponding to the live monitor image 38 at that time are compared with the touch position coordinates of the pointing operation which are the same monitor image system coordinates. The grid intersection may be determined.

Next, the user terminal 1500 transmits a remote operation signal corresponding to the pointing operation to the prize acquisition device 1200 that is the playing device (step S98), and the user terminal 1500 sets the corresponding direction as indicated (step S100). .
In the present embodiment, the first direction movement destination instruction coordinates 752 or the second direction movement destination instruction coordinates 754 set in the past steps are transmitted as a remote operation signal. In the configuration in which the coordinate conversion from the monitor image system coordinates to the play space coordinate system is performed on the prize acquisition device 1200 side, the touch position coordinates may be transmitted as they are. Or you may transmit the information which shows the drive time and drive pulse number for driving-controlling the motor of the crane part 1210 suitable for moving the crane part 1210 to a designated position coordinate.

  Moving to FIG. 20, the user terminal 1500 always monitors whether or not the positioning is completed. If it is determined that the positioning is complete (YES in step S130), the user terminal 1500 transmits a positioning completion signal to the prize acquisition device 1200 that is the playing device (step S132). The prize acquisition device 1200 that has received the positioning completion signal automatically starts executing the action sequence. Along with this, the sequence progress 1290 and the action status information 1292 are updated with the progress of the sequence and transmitted to the user terminal 1500 (see FIG. 4).

  Subsequently, based on the received action determination information 707 (see FIG. 15) received from the prize acquisition device 1200 that is a play device, the user terminal 1500 determines whether the action operation has been successful at the end of the action sequence. judge.

  If it is determined that the action has failed (NO in step S134), the user terminal 1500 transmits a predetermined hold signal to the prize acquisition device 1200 that is a play device (step S140). The prize acquisition device 1200 temporarily stops its operation when receiving the hold signal. Specifically, since the action success / action failure determination is performed at the end of the action sequence, the prize acquisition device 1200 that has received the hold signal stops the movement without starting the end operation sequence. The position of the crane unit 1210 in the play space 1202 is maintained as it is when the action sequence ends.

  While the operation of the prize acquisition device 1200 is suspended, the user terminal 1500 notifies the user that it is a continuation play, notifies the user that the continuation play requires compensation, and executes the continuation play. The selection input of approval / non-approval is accepted (step S142).

  If the acceptance result approves the execution of the continue play (YES in step S144), the user terminal 1500 executes a play history data update process (step S150). Specifically, the play history data 610 (see FIG. 13) of the own user management data 600c (see FIG. 14) is updated, and the server system 1100 is accessed to store and manage the own user stored and managed in the server system 1100. Request to update the original user management data 600 (see FIG. 11).

  Then, the user terminal 1500 changes the play mode 710 (see FIG. 15) from “non-continuous play” to “continue play” (step S152), and returns to step S20 (see FIG. 18).

  When returning to step S20, the virtual image is set again (step S20). At this time, if the number of continuations conforms to different application conditions 551 (see FIG. 12), the grid line interval of the grid line virtual image 60 is changed from the time of the first prize acquisition play (non-continuous play). It will be. Then, when display control of the remote operation screen as the continue play is started in step S22, the virtual image reset in step S20 is displayed in an overlapping manner.

  Returning to FIG. 20, when the selection input for approval / non-approval of execution of the continue play corresponds to non-approval (NO in step S144), the user terminal 1500 sends a hold release signal to the prize acquisition device 1200 which is a play device. (Step S160).

  Then, when the execution of the continue play is not approved and when it is determined that the action is successful in step S134 (YES in step S134), the user terminal 1500 next determines the success / failure of the prize acquisition. If it is determined that the prize has been acquired (YES in step S170), a predetermined prize dispatch procedure process is executed (step S172), and the user's play history data is updated (step S174). The process ends.

  As described above, according to the present embodiment, it is possible to perform a game for challenging the acquisition of a prize by remotely operating the prize acquisition apparatus by a pointing operation called a touch operation, and by displaying the virtual image on the live monitor image 38, The operability can be greatly improved as compared with the case where virtual images are not displayed in an overlapping manner.

  In addition, the live monitor image 38 is subject to slight perspective and aberration depending on the specifications of the optical system of the video camera 1220 and the like. Therefore, there is a slight difference between the position that the player is viewing in the live monitor image 38 or the position indicated by the grid line virtual image 60 and the actual position in the play space 1202. Even if the player performs a touch operation on the target position while looking at the live monitor image 38, the actual movement destination of the crane unit 1210 may slightly deviate when viewed geometrically depending on the touch-operated position. This deviation of the perspective and aberration is not known when playing for the first time, but will be swallowed after playing several times. Then, the player comes to think about where to perform the touch operation in anticipation of the deviation of the perspective and aberration, and that is one of the joys of capturing the game. Also in that case, the grid line virtual image 60 is a good guideline for grasping the trick.

  Thus, according to the present embodiment, an attractive prize acquisition system having high operability while being a remote operation based on a touch operation on the touch panel, which is one of pointing operations.

[Modification]
As mentioned above, although the example of embodiment which applied this invention was demonstrated, the form which can apply this invention is not limited to the said form, A component can be added, abbreviate | omitted, and changed suitably.

[Modification 1]
For example, in the above-described embodiment, the game play is configured to be realized by directly communicating the user terminal 1500 with the prize acquisition device 1200 that is the play device, but the user terminal 1500 and the prize acquisition device that is the play device. A configuration in which the server system 1100 is interposed between the server 1200 and the server 1200 is also possible. For example, in a configuration in which the server system 1100 is interposed, a configuration in which the server system 1100 functions as a simple signal relay device is also possible.

[Modification 2]
As another example, the prize acquisition system 1000 can be realized as a client-server online game. In other words, the server system 1100 functions as a computer system that controls the user terminal 1500, and the user terminal 1500 is a reception device for player operation input and a display device for a remote operation screen, so that the server system 1100 is a remote operation system. A configuration is also possible.

  Specifically, the functional configuration of the server system 1100 is as shown in FIG. 21, for example, and the programs and data stored in the server storage unit 500s are as shown in FIG. The server program 503B can realize the function as the game management unit 210 in the server processing unit 200s. The distribution game client program 507 is a program that, when executed by the user terminal 1500, realizes a function as a game client.

  FIG. 23 is a diagram illustrating a functional configuration example of the user terminal 1500 when the prize acquisition system 1000 is realized as a client-server online game. The user terminal 1500 in the configuration downloads the distribution game client program 507, stores it as the game client program 590 in the terminal storage unit 500, and executes it, thereby causing the terminal processing unit 200 to function as the user terminal calculation unit 260. Realize. User terminal calculation unit 260 includes an operation signal transmission control unit 261 and a game screen display control unit 262.

The operation signal transmission control unit 261 transmits various data and requests to the server system 1100 according to the operation performed on the operation input unit 100.
The game screen display control unit 262 performs control for displaying a game screen based on various data received from the server system 1100. In the present embodiment, display control of the desired prize selection screen W2, the play device selection screen W4, the remote operation screen W6 (see FIG. 6), and the remote operation screen W10 (see FIG. 10) corresponds to this.

  And what is necessary is just to read the execution subject of the step of the flowchart of FIGS. 18-20 as the server system 1100 in the said structure.

[Modification 3]
In the above-described embodiment, the prize acquisition mechanism unit that moves in the play space 1202 by remote operation is exemplified as the crane unit 1210. However, a configuration other than a crane is possible. For example, a scoop or excavator that scoops up a prize, a hook that hooks a prize, a pusher that pushes a prize, or the like may be employed.

Then, depending on the function of the employed prize acquisition mechanism unit, the two-dimensional movement direction that is the left-right direction and the front-rear direction of the apparatus in the above embodiment can be the left-right direction and the up-down direction of the apparatus.
Specifically, for example, various prizes are suspended at various locations on the back wall surface of the play space. And, by adopting a hook-like prize acquisition mechanism that hooks the prize, a positioning sequence that moves and positions in the left and right and up and down directions, and an action sequence that extends the hook in the direction of the device after positioning, Is provided. The player moves the prize acquisition mechanism unit remotely in the left-right direction (first direction) and the up-down direction (second direction) of the device, sets a target for one of the prizes in the prize group, and gives a prize. The present invention can also be applied to a premium acquisition system in which the acquisition mechanism unit hooks and acquires a hook.

[Modification 4]
Further, the way of designing and showing the grid line virtual image 60 and the perpendicular virtual image 62 is not limited to the example in the above embodiment, and can be designed as appropriate.

  For example, as shown in FIG. 24, the grid line virtual image 60B may be displayed along a plane parallel to or substantially parallel to the floor surface of the play space 1202 that can be set slightly below the position of the crane unit 1210. . Moreover, the perpendicular virtual image 62 may be displayed as a plurality of line segments suspended from the tip when the nail 1212 is spread or as a vertical plane 62B including the line segments as boundaries.

Further, for example, as shown in FIG. 25, the grid line virtual image 60 may be designed to display a position where two-dimensional movement is possible by polar coordinates. Specifically, the grid line virtual image 60 is displayed as a plurality of concentric circles with the intersection of the plane parallel to the floor surface of the play space 1202 where the grid line virtual image 60 is drawn and the perpendicular virtual image 62 as the center of the circle. Also good. Furthermore, the concentric circles may be displayed as a semitransparent cylinder in the vertical direction.
In addition, the grid line virtual image 60 may be displayed as a discrete array of predetermined images such as cross marks without displaying grid lines.

[Variation 5]
Moreover, the structure which abbreviate | omitted the 1st AR box 1271-4th AR box 1274 from the structure of the said embodiment is also possible. Specifically, the 6th surface of the fifth AR box 1275 is provided with an AR marker specific to each surface. Then, in the grid line virtual image definition data 550 (see FIG. 12), the grid shape 553 and the grid line interval 555 are replaced with one image data, and the relative display position coordinates, relative relative to the monitor image system coordinates of the fifth AR box 1275 are used as a reference. A configuration including data defining a display size and a relative display posture can be adopted.

[Modification 6]
As an example of the user's pointing operation, the touch operation on the touch panel 1506 of the user terminal 1500 has been described. However, when the user terminal 1500 is configured with a personal computer, the mouse operation can be a pointing operation.

2 ... User 4 ... Premium 5 ... Substitute premium 37 ... Camera switching operation icon 38 ... Live monitor image 60 ... Grid line virtual image 62 ... Vertical virtual image 64 ... Range identification virtual image 70 ... Premium marker 72 ... Premium image 74 ... Premium type Image 200 ... Terminal processing unit 210 ... Game management unit 212 ... Monitor image display control unit 214 ... Correspondence relationship setting unit 216 ... Instruction coordinate calculation unit 218 ... Operation signal transmission control unit 220 ... Virtual image display control unit 222 ... Premium existence determination unit 224 ... AR image display unit 226 ... Premium type image display control unit 230 ... Moveable range identification display control unit 500 ... Terminal storage unit 502 ... Game program 510 ... Premium acquisition device management data 512 ... Access information 518 ... Moveable range definition data 530 ... AR box recognition dictionary data 532 ... AR in play space Box position coordinate list 534 ... AR image data for AR box 536 ... First video camera coordinate transformation matrix 538 ... Second video camera coordinate transformation matrix 550 ... Grid line virtual image definition data 555 ... Grid line interval 557 ... Grid intersection coordinate List 560 ... range identification virtual image definition data 562 ... premium type image definition data 700 ... play data 703 ... play device ID
705 ... Received captured image data 720 ... Space recognition data 730 ... Virtual image setting data 740 ... Premium position coordinates 750 ... Destination instruction management data 751 ... First direction pointing operation position coordinates 752 ... First direction movement destination instruction coordinates 753 ... Second direction pointing operation position coordinates 754 ... Second direction movement destination instruction coordinates 760 ... Positioning completion determination data 770 ... Remote operation screen display control data 1000 ... Premium acquisition system 1100 ... Server system 1200 ... Premium acquisition apparatus 1210 ... Crane unit 1220f ... first video camera 1220s ... second video camera 1271 ... first AR box 1272 ... second AR box 1273 ... third AR box 1274 ... fourth AR box 1275 ... fifth AR box 1292 ... action status information 1500 ... Over The terminal 1506 ... touch panel 1550 ... the control board W6 ... remote control screen

Claims (16)

A remote operation system for remotely operating a prize acquisition device capable of remote operation play by attempting to acquire a prize arranged in a play space by moving a crane unit, on a user terminal,
The premium acquisition device is provided with a camera for photographing the play space, and a marker serving as a mark when recognizing an image of the coordinate system of the play space is provided at a position capable of photographing from the camera.
Monitor image display control means for displaying a photographed image of the camera on the user terminal as a monitor image;
Correspondence setting means for setting the correspondence between the coordinate system of the play space and the display coordinate system of the monitor image based on the image of the marker in the captured image;
Instruction coordinate calculation means for calculating the instruction coordinates of the play space corresponding to the instruction position instructed by the user's pointing operation on the monitor image, based on the correspondence relationship;
An operation signal transmission control means for transmitting a remote operation signal for moving the crane unit to a position corresponding to the indicated coordinates to the prize acquisition device;
Remote control system with The prize acquisition device is a device that performs positioning by moving the crane part two-dimensionally according to a remote operation by a user, and performs an action sequence of the crane part from the positioned position;
The indicated coordinate calculation means calculates the movement target coordinates of the two-dimensional movement as the indicated coordinates.
The remote control system according to claim 1. Virtual image display control means for determining a set display position in the monitor image corresponding to a given set position in the play space and displaying a virtual image based on the correspondence relationship;
The remote control system according to claim 2, further comprising: The set position is a position where the crane part can move in the two-dimensional movement,
The virtual image display control means displays a grid line of two-dimensional coordinates related to the two-dimensional movement as the virtual image.
The remote control system according to claim 3. The indicated coordinate calculation means calculates the indicated coordinates by using any of the intersections of the grid lines as the indicated position by the pointing operation.
The remote control system according to claim 4. The prize acquisition device is a device capable of continuing play,
The virtual image display control means variably sets the grid line interval according to the number of times of the continuous play.
The remote control system according to claim 5. The set position is a position of the crane part,
The setting display position is a display position of the crane unit in the monitor image,
The virtual image display control means displays the virtual image that is linear in the direction in which the crane unit performs the action sequence from the setting display position.
The remote control system according to any one of claims 3 to 6. The prize is provided with a prize marker that serves as a mark when the prize position of the prize is recognized as an image.
A prize presence / absence determining means for determining whether or not the prize is positioned in the direction of the action sequence when the action sequence is performed at the current display position of the crane unit based on the prize marker;
Further comprising
The virtual image display control means changes the display form of the virtual image based on the determination result of the prize existence determination means.
The remote control system according to any one of claims 3 to 7. The prize is provided with a prize marker that serves as a mark when the prize position of the prize is recognized as an image.
When the pointing operation is instructed to display the prize in the monitor image, the designated coordinate calculation means uses the coordinates of the play space recognized as an image based on a prize marker attached to the prize. Calculating the movement target coordinates of the crane unit when the action sequence is directed toward the designated coordinates;
The remote control system according to any one of claims 2 to 8. The prize marker is associated with the type of the prize,
A prize type image display control means for displaying an image based on the type of the prize on the background part of the remote operation screen of the user terminal or the background image part of the play space included in the monitor image;
The remote control system according to claim 9, further comprising: The prize is an AR box in which an AR (Augmented Reality) marker is written on the outer surface as the prize marker.
AR image display control means for displaying an image based on the AR marker in the AR box in the monitor image;
The remote control system according to claim 9 or 10, further comprising: The prize is an AR box with an AR (Augmented Reality) marker on the outer surface,
AR image display control means for displaying an image based on the AR marker in the AR box in the monitor image;
The remote control system according to any one of claims 1 to 10, further comprising: The prize acquisition device is configured such that a movable range of the crane part can be set,
Based on the correspondence, the movable range identification display means for identifying and displaying the movable range or a range other than the movable range in the monitor image;
The remote control system according to any one of claims 1 to 12, further comprising:   The remote operation system according to any one of claims 1 to 13, wherein the remote operation system includes the user terminal.   The remote operation system according to any one of claims 1 to 13, wherein the remote operation system is configured by a computer system that controls the user terminal. A program for remotely operating a prize acquisition device capable of remote operation play that attempts to acquire a prize arranged in a play space by moving a crane unit on a user terminal,
The premium acquisition device is provided with a camera for photographing the play space, and a marker serving as a mark when recognizing an image of the coordinate system of the play space is provided at a position capable of photographing from the camera.
Monitor image display control means for displaying a photographed image of the camera on the user terminal as a monitor image;
Correspondence setting means for setting the correspondence between the coordinate system of the play space and the display coordinate system of the monitor image based on the image of the marker in the captured image;
An instruction coordinate calculation means for calculating an instruction coordinate of the play space corresponding to an instruction position instructed by a user pointing operation on the monitor image based on the correspondence relation;
An operation signal transmission control means for transmitting a remote operation signal for moving the crane unit to a position corresponding to the indicated coordinates to the prize acquisition device;
A program for causing the user terminal to function as

Images