JP6704578B1 - Worship support method, program, and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an effective worship support method for achieving both convenience of electronic payment of donations and feeling of donation. SOLUTION: A worship support method is to acquire a real image of a shrine to be visited and to change a moving image of a virtual offering to a real image of the shrine according to an operation input to a worshiper terminal 100 by a worshiper. Displaying the synthesized donation video on the worshiper terminal 100 and performing a process for electronic settlement of the donation to the worship target according to the operation input. [Selection diagram] Figure 2

Description

The present disclosure relates to a worship support method, a program, and a storage medium.

Patent Document 1 discloses an outlet for ejecting gifts for donations, a reception unit for accepting donation information from a card or information terminal device in which donation information including donation amount and card information is registered, and based on the donation information. A transmitting unit that transmits a card payment instruction to the information processing device of the card company via the network, and a reception unit that receives a payment completion notification based on the payment instruction from the information processing device of the card company, There is disclosed a worship support device including an emission control unit that discharges a reward item from an outlet when a card payment completion notification is received.

JP, 2018-161278, A

The present disclosure aims to provide an effective worship support method for achieving both the convenience of electronic payment of donations and the actual feeling of donations.

A worship support method according to an aspect of the present disclosure is to obtain a real image of a shrine to be visited and to display a moving image of a virtual offering as a real image of a shrine in response to an operation input to a terminal device of a worshiper. And displaying the donation moving image synthesized on the terminal device on the terminal device, and performing a process for electronic payment of the donation to the worship target according to the operation input.

A program according to another aspect of the present disclosure causes a device to execute the above worship support method.

A storage medium according to still another aspect of the present disclosure stores a program that causes an apparatus to execute the above worship support method.

According to the present disclosure, it is possible to provide a worship support method that is effective in achieving both the convenience of electronic payment of donations and the realization of donations.

It is a schematic diagram showing a schematic configuration of a worship support system. It is a block diagram which illustrates the functional composition of a worshiper terminal and a worship support server. It is a schematic diagram which shows the state in which the camera of the worshiper terminal was turned to the shrine side. It is a schematic diagram which illustrates the relationship between the orientation of a worshiper terminal and a display target area. It is a schematic diagram which shows the example of calculation of a moving path. It is a schematic diagram which shows the relationship between the attitude|position change of a worshiper terminal and the display position of a moving route. It is a block diagram which illustrates the hardware constitutions of a worshiper terminal and a worship support server. It is a flowchart which illustrates the worship support procedure. It is a flowchart which illustrates the worship support procedure. It is a flowchart which illustrates the worship support procedure. It is a flowchart which illustrates the worship support procedure.

Hereinafter, embodiments will be described in detail with reference to the drawings. In the description, the same elements or elements having the same function will be denoted by the same reference symbols, without redundant description.

[Worship support system]
The worship support system shown in FIG. 1 is a system that supports electronic settlement of donations during worship. Worship here includes worship. There are no particular restrictions on what you can visit. Specific examples of worship targets include shrines and temples.

The worship support system 1 includes a plurality of worshipers terminals 100 (terminal devices), a plurality of worship target terminals 200, and at least one worship support server 300. The worshiper terminal 100 is a terminal used by the worshiper and may not necessarily be the property of the worshiper. The worship target terminal 200 is a terminal provided in the worship target 10. The worshiper terminal 100 and the worship target terminal 200 may be any terminals as long as they are terminals capable of wired or wireless network communication. Specific examples of the worshiper terminal 100 and the worship target terminal 200 include a notebook computer, a tablet computer, a stationary (for example, desktop) computer, a smartphone, and the like.

The worship support server 300 is connected to the plurality of worshipers terminals 100 and the plurality of worship target terminals 200 via a network line. The connection here means that information communication is possible and is not necessarily limited to wired connection. The worship support server 300 acquires the information of the worship target 10 from the worship target terminal 200, accumulates the information, and provides the worshiper terminal 100 with an electronic payment service for donations at the worship service based on the accumulated information. The worshiper terminal 100 includes an application for enabling the electronic payment service provided by the worship support server 300. The worship support server 300 may be configured to store a program for installing the application and provide the program in response to a request from the worshiper terminal 100.

The worshiper terminal 100 including the above application acquires a real image of the shrine of the worship target 10 and displays a moving image in which a moving virtual offering image is combined with the real image of the shrine in response to an operation input by the worshiper. And performing the process for electronic payment of the donation to the worship target 10 according to the operation input. The electronic payment process includes a process of requesting an electronic payment from a server of a business operator that executes payment, such as a financial institution, a payment agency, and a service provider specializing in electronic payment. The worshiper terminal 100 may request electronic settlement from a server of a financial institution or the like via the worship support server 300.

For example, as shown in FIG. 2, the worshiper terminal 100 has a functional configuration (hereinafter, referred to as “functional module”), an actual image acquisition unit 110, an operation input acquisition unit 101, and a donation moving image display unit 120. It has a donation amount setting unit 102 and a settlement requesting unit 103. The functional module of the worshiper terminal 100 is configured by the cooperation of the program module included in the application and the hardware of the worshiper terminal 100.

The actual image acquisition unit 110 acquires an actual image of the shrine of the worship target 10. The operation input acquisition unit 101 acquires an operation input by a worshiper. The operation input is an input to the input device 182 (see FIG. 4) included in the worshiper terminal 100, such as a mouse, a keyboard, or a touch panel. The donation moving image display unit 120 displays an image of a virtual offering moving (for example, flying or falling) in response to the above operation input (operation input acquired by the operation input acquisition unit 101) as a real image of the shrine (actual image acquisition unit 110 Display the donation video that is combined with the acquired actual image). The display of the moving image is a display on the display device 181 (see FIG. 4) of the worshiper terminal 100, such as a monitor or a touch panel.

The donation amount setting unit 102 sets the amount of donation to the worship target 10 based on the operation input. For example, the donation amount setting unit 102 sets the donation amount according to the numerical value designated by the operation input. The payment requesting unit 103 requests the worship support server 300 for electronic payment for donating the amount set by the donation amount setting unit 102 to the worship target 10.

The worshiper terminal 100 may be configured to further select the worship target 10 based on the current position of the worshiper terminal 100. The worshiper terminal 100 may be configured to further execute the selection of the worship target 10 based on the orientation of the worshiper terminal 100. For example, the worshiper terminal 100 further includes a position/orientation information acquisition unit 131 and a worship target selection unit 132 as functional modules.

The position/posture information acquisition unit 131 acquires position information of the worshiper terminal 100 (hereinafter referred to as “terminal position information”) and attitude information of the worshiper terminal 100 (hereinafter referred to as “terminal attitude information”). The terminal position information is information indicating the current position of the worship terminal 100 on the earth, for example, latitude and longitude information of the position of the worship terminal 100, and the GPS sensor 183 of the worship terminal 100 (see FIG. 7). Etc. are detected. The terminal attitude information is information indicating which direction the worshiper terminal 100 is currently facing, and is detected by the attitude sensor 184 (see FIG. 7) such as an electronic compass, an acceleration sensor, or a gyro sensor included in the worshiper terminal 100. It For example, the terminal attitude information indicates which direction the line of sight of the camera 185 (see FIG. 3) of the worshiper terminal 100 is currently facing.

The worship target selection unit 132 selects the worship target 10 based on at least one of the terminal position information and the terminal attitude information acquired by the position/orientation information acquisition unit 131. When selecting the worship target 10 based on the terminal position information, the worship target selection unit 132 worships based on, for example, the terminal position information and the position information of the shrine of the worship target (hereinafter referred to as “shrine position information”). Select the target 10. As an example, the worship target selecting unit 132 selects the worship target 10 in which the current position of the worshiper terminal 100 and the position of the shrine are the closest. For example, the worship target selection unit 132 requests the worship support server 300 to select the worship target 10 having the closest current position of the worshiper terminal 100 and the position of the shrine, and acquires information about the selection result from the worship support server 300. The information of the selection result includes the identification information of the selected worship target 10 and the shrine location information.

When selecting the worship object 10 based on the terminal attitude information, the worship object selecting unit 132 selects the worship object 10 based on, for example, the terminal position information, the terminal attitude information, and the company position information. As an example, the worship target selecting unit 132 selects the worship target 10 in which the azimuth of the position of the shrine relative to the current position of the worship terminal 100 and the azimuth of the worship terminal 100 are closest to each other. For example, the worship target selection unit 132 requests the worship support server 300 to select the worship target 10 in which the shrine is located in a direction close to the direction to which the worship terminal 100 is heading, based on the current position of the worship terminal 100, and Information is acquired from the worship support server 300. The information of the selection result in this case also includes the identification information of the selected worship target 10 and the company location information.

The worship target selection unit 132 may select the worship target 10 based on both the relationship between the current position of the worship terminal 100 and the position of the shrine, and the relationship between the orientation of the worship terminal 100 and the direction of the shrine. .. Selecting the worship object 10 includes selecting a plurality of worship objects 10. In addition, selecting the worship target 10 includes tentatively selecting a final selection candidate. Hereinafter, the worship target selected by the worship target selection unit 132 is referred to as a “selected worship target”. Although the present embodiment exemplifies a configuration in which the worship target 10 is automatically selected based on at least one of the terminal position information and the terminal attitude information, the worshiper terminal 100 uses the terminal position information and the terminal attitude information as information. It may be configured to select the worship target according to the selection of the worshiper.

The worshiper terminal 100 may be configured to acquire an actual image based on a previously acquired image of the shrine. For example, the worshiper terminal 100 may be configured to, when acquiring the actual image of the shrine, extract the actual image of the display target area according to the orientation of the own device from the previously acquired panoramic image of the shrine. Good. The panoramic image is an image of a wider area than the actual image displayed by the worshiper terminal 100. The worshiper terminal 100 may be configured to acquire the actual image of the shrine taken by the camera of the device when acquiring the actual image of the shrine. Further, the worshiper terminal 100 displays a real image of the shrine taken by the camera of the own device in the first mode, and displays a panoramic image of the shrine that is acquired in advance according to the direction of the own device. A second-mode real-image acquisition for extracting a real-image of the target area, and a switching between the first-mode real-image acquisition and the second-mode real-image acquisition according to the current position of the own device are executed. It may be configured. For example, the actual image acquisition unit 110 is a subdivided functional module, which is a worship mode switching unit 111, a worship target search unit 112, a worship target information reception unit 113, a worship target information storage unit 114, and a first worship target information storage unit 114. It has an acquisition unit 115 and a second acquisition unit 116.

The worship mode switching unit 111 switches between real image acquisition in the first mode and real image acquisition in the second mode according to the current position of the worshiper terminal 100. For example, the worship mode switching unit 111 switches between real image acquisition in the first mode and real image acquisition in the second mode based on the relationship between the current position of the worshiper terminal 100 and the position of the shrine of the selected worship target. .. As an example, the worship mode switching unit 111 sets the actual image acquisition mode to the first mode when the distance between the current position of the worshiper terminal 100 and the position of the shrine of the selected worship target is smaller than a predetermined switching threshold. Then, when the distance is larger than the threshold, the actual image acquisition mode is set to the second mode. The above-mentioned threshold value is set to a distance at which the shrine hall can be photographed by the camera of the worshiper terminal 100, for example.

When the actual image acquisition mode is the second mode, the actual image is extracted from the previously acquired panoramic image, so that the worship target 10 is selected without being restricted by the current position and the current direction of the worshiper terminal 100. It is possible to Therefore, the worship target searching unit 112 enables the worshiper to reselect the worship target 10 regardless of the selection result by the worship target selecting unit 132. When the worship mode switching unit 111 sets the actual image acquisition mode to the second mode, the worship target search unit 112 requests the worship support server 300 to search for worship targets by specifying search conditions, and displays the search result. Information is acquired from the worship support server 300. The information of the search result includes the identification information of the worship target 10 extracted according to the search conditions. The worship target search unit 112 may specify the search condition according to the specification input by the worshiper. For example, the worship target search unit 112 displays a screen for designating search conditions on the display device 181 of the worshiper terminal 100, and acquires a designation input based on the screen from the input device 182 of the worshiper terminal 100. The screen for specifying the search condition may include an input unit for a plurality of types of search conditions. Specific examples of the types of search conditions include the genealogy of the worship target 10, the profit, the location of the company hall, and the like.

The worship target information receiving unit 113 selects one worship target 10 from the search results acquired by the worship target search unit 112, and receives additional information of the worship target 10. For example, the worship target information receiving unit 113 specifies the identification information of the selected worship target 10 and receives additional information of the worship target 10 from the worship support server 300. The additional information includes position information of the shrine, panoramic image information of the shrine, information of a return symbol indicating a return for the donation, and the like. The information on the panoramic image of the shrine and the return symbol is, for example, acquired in advance from the worship target terminal 200 and stored in the worship support server 300.

The worship support server 300 may store a plurality of panoramic images taken at different times for each worship target. In this case, the worship target information receiving unit 113 may acquire the panoramic image corresponding to the current time from the worship support server 300. The current time here may be the current time indicated by the worshiper terminal 100 or the current time indicated by the worship support server 300. The current time indicated by the worshiper terminal 100 and the current time indicated by the worship support server 300 may differ depending on the location of the worshiper terminal 100 and the worship support server 300. The worship support server 300 may acquire a panoramic image from a camera installed in the shrine and transmit it to the worshiper terminal 100 each time the worship target information receiving unit 113 requests additional information.

The return symbol may be any as long as it can visually indicate the return. Specific examples of the reciprocal symbol include a character who is an anthropomorphic deity of the worship target 10 and an article that shows reciprocation. The worship support server 300 may store a plurality of types of return symbols for each worship target 10. The worship object information storage unit 114 stores the additional information of the worship object 10 received by the worship object information receiving unit 113 in association with the identification information of the worship object 10.

The 1st acquisition part 115 acquires the real image of the shrine image|photographed by the camera of the worshiper terminal 100, when the mode of real image acquisition is set to the 1st mode. When the mode of actual image acquisition is set to the second mode, the second acquisition unit 116 determines from the panoramic image stored in the worship target information storage unit 114 a real image of the display target area according to the orientation of the worshiper terminal 100. To extract. For example, the second acquisition unit 116 extracts a real image of the display target area corresponding to the line-of-sight direction of the camera of the worshiper terminal 100 from the panoramic image of the company hall. As an example, the second acquisition unit 116 has a predetermined correspondence relationship so that the shrine is displayed in the center when the line-of-sight direction of the camera of the worshiper terminal 100 is in the actual direction of the shrine (the direction in which the shrine actually exists). Based on this, the display target area is set according to the line-of-sight direction of the camera of the worshiper terminal 100.

FIG. 3 schematically shows a state in which the line-of-sight direction (the X-axis positive direction in the drawing) of the camera 185 of the worshiper terminal 100 faces the actual direction of the shrine 11. In this case, the second acquisition unit 116 acquires an actual image of the display area A1 in which the company hall 11 is at the center from the panoramic image P (see FIG. 4). The second acquisition unit 116 moves the display area to the right side of the shrine 11 as the line-of-sight direction of the camera 185 tilts to the right side of the shrine 11 (clockwise around the Z axis in the drawing) (see display area A2 in FIG. 4). .. In addition, the second acquisition unit 116 moves the display area to the left side of the shrine 11 as the line-of-sight direction of the camera 185 tilts to the left side of the shrine 11 (counterclockwise about the Z axis in the drawing) (the display area in FIG. 4). (See A3).

Even if the distance between the current position of the prayer terminal 100 and the position of the selected shrine 11 to be worshiped is smaller than the switching threshold, due to the congestion of the shrine 11 or the like, the camera 185 of the prayer terminal 100 causes It may be difficult to shoot. In preparation for this, the worship mode switching unit 111 sets the real image acquisition mode to the first mode even when the distance between the current position of the worshiper terminal 100 and the position of the selected shrine 11 to be worshiped is smaller than the switching threshold. It may be configured to have two modes.

Returning to FIG. 2, when the worshiper terminal 100 displays a donation video in which an image of a virtual offering is combined with an actual image, the worshiper terminal 100, based on the relationship between the direction of the operation input to the device itself and the direction of the device itself, It is configured to calculate a three-dimensional moving path of the virtual offering and generate synthetic moving image data so that the virtual offering moves within the actual image along the moving route corresponding to the three-dimensional moving route. It may have been done. For example, the donation moving image display unit 120 includes a movement route calculation unit 121, a combined data generation unit 122, and a combined image display unit 123 as more subdivided functional modules.

The movement route calculation unit 121 calculates the three-dimensional movement route of the virtual offering based on the direction of the operation input to the input device 182 of the worshiper terminal 100 and the direction of the worshiper terminal 100. The three-dimensional movement route is a three-dimensional movement route defined in the space around the worshiper terminal 100. For example, in FIG. 4, the movement route calculation unit 121 calculates a three-dimensional movement route of a virtual offering based on an operation input (hereinafter, referred to as “moving operation input”) for moving the offering mark C1 displayed on the display device 181. To do. Specific examples of the movement operation input include flick or swipe input on the touch panel. For example, when the movement operation input does not include a component in the left-right direction (Y axis positive/negative direction in the figure) of the worshiper terminal 100, the movement route calculation unit 121 moves the worshiper terminal 100 in the front direction (X axis positive direction in the figure). The along direction is set as the relative movement direction with respect to the worshiper terminal 100 (see the broken line arrow R1 in FIG. 5). When the movement operation input includes the right component of the worship terminal 100, the direction tilted to the right with respect to the front direction of the worship terminal 100 is set as the relative movement direction with respect to the worship terminal 100 (FIG. 5). (See dashed arrow R2 inside). When the movement operation input includes a component to the left of the worship terminal 100, the direction tilted to the left with respect to the front direction of the worship terminal 100 is set as the relative movement direction with respect to the worship terminal 100 (FIG. 5). (See dashed arrow R3 inside).

Next, the movement path calculation unit 121 calculates the movement distance based on the magnitude of the upward component of the movement operation input (Z-axis direction in the drawing), the speed of the movement operation input, and the like. Next, the movement route calculation unit 121 calculates the relative arrival position AP with respect to the worshiper terminal 100 based on the relative movement direction and the movement distance, and forms a parabola from the current position of the worshiper terminal 100 to the relative arrival position AP. Calculates the relative movement path of. Next, the moving route calculation unit 121 converts the relative moving route into a three-dimensional moving route based on the orientation of the worshiper terminal 100. For example, the movement route calculation unit 121 three-dimensionally moves the relative movement route by coordinate conversion from the coordinate system CS1 fixed to the worshiper terminal 100 to the coordinate system CS2 fixed in the space around the worshiper terminal 100. Convert to a route.

Returning to FIG. 2, the synthetic data generation unit 122 generates synthetic moving image data so that the virtual offer moves in the actual image along the movement route corresponding to the three-dimensional movement route. For example, the synthetic data generation unit 122 calculates a movement route corresponding to the three-dimensional movement route based on the current orientation of the worshiper terminal 100 and the three-dimensional movement route, and a virtual offer for moving along the movement route. By combining (for example, overlapping) with the actual image, the combined moving image data is generated.

The composite image display unit 123 displays the donation video according to the composite video data generated by the composite data generation unit 122. The composite image display unit 123 may be configured to generate a sound effect in accordance with the donation video. For example, the synthetic image display unit 123 may generate a sound effect in response to the virtual money offering reaching the relative arrival position AP, or may generate a sound effect of moving the virtual offering.

While the donation video is being displayed by the synthetic data generation unit 122 and the synthetic image display unit 123, the movement route corresponding to the three-dimensional movement route is updated according to the current orientation of the worshiper terminal 100. Therefore, when the worshiper terminal 100 is tilted, the display position of the movement path of the virtual offering also changes according to the tilt. For example, in the example of FIG. 6, the movement route MR corresponding to the three-dimensional movement route moves to the left side together with the image of the shrine 11 in response to the sight line direction of the camera 185 tilting to the right side of the shrine 11, and the sight line direction of the camera 185. Moves to the right along with the image of the shrine 11 in response to tilting to the left of the shrine 11.

Returning to FIG. 2, the worshiper terminal 100 further displays, in response to the display of the virtual offering video, a moving image of the redemption symbol showing the return offering for the virtual offering, which is combined with the actual image of the shrine 11 to display the return image. It may be configured to perform. The worshiper terminal 100 may be configured to change the moving image of the return symbol according to the arrival position of the virtual offering. For example, the worshiper terminal 100 further includes a return video display unit 140. The redemption video display unit 140 displays the redemption video in response to the arrival of the virtual offering. The return video display unit 140 includes a return video data generation unit 141, a combined data generation unit 142, and a combined image display unit 143 as functional modules that are subdivided.

The redemption moving image data generation unit 141 generates moving image data of the redemption symbol in response to the arrival of the virtual offering. For example, the moving image data of the return symbol is data indicating the operation of the return symbol in the coordinate system CS2 (the coordinate system fixed in the space around the worshiper terminal 100). For example, the return video data generation unit 141 generates return symbol video data based on the return symbol information stored in the worship target information receiving unit 113. The return video data generation unit 141 may change the video data of the return symbol based on the arrival position of the virtual offering. For example, the redemption moving image data generation unit 141 changes the moving image data of the redemption symbol depending on whether the arrival position of the virtual offering is off the shrine 11 or when the arrival position of the virtual offering is off the shrine 11. As an example, when the arrival position of the virtual offering is not deviated from the shrine 11, the redemption moving image data generation unit 141 is moving image data (hereinafter, referred to as a moving image data in which a redemption symbol operates so as to show a return in response to the virtual offering of the offering to the shrine 11). This is referred to as "first moving image data"). On the other hand, when the arrival position of the virtual offering is deviated from the shrine 11, the redemption moving image data generation unit 141 carries moving image data with the redemption symbol to the shrine 11 (hereinafter referred to as “second moving image data”). ) Is generated. The return video data generation unit 141 may generate video data including the second video data and the first video data in order when the arrival position of the virtual offering is out of the hall 11.

The combined data generation unit 142 generates combined moving image data in which the image of the return symbol that operates according to the moving image data generated by the returned moving image data generation unit 141 is combined with the actual image of the shrine 11. For example, the composite data generation unit 142 calculates the display position of the return symbol in the actual image based on the current orientation of the worshiper terminal 100 and the moving image data of the return symbol, and displays the return symbol at the display position. The composite moving image data is generated by repeating the composition of the image with the actual image.

The composite image display unit 143 displays a return video according to the composite video data generated by the composite data generation unit 142. The composite image display unit 143 may be configured to generate a sound effect in accordance with the return video.

While the return data is being displayed by the combined data generation unit 142 and the combined image display unit 143, the display position of the return symbol corresponding to the return symbol moving image data is updated according to the current orientation of the worshiper terminal 100. Therefore, if the worshiper terminal 100 is tilted, the display position of the return symbol is also changed according to the tilt.

The worship support server 300 has a worship target database 311, a worship target information transmission unit 312, and a payment processing unit 313 as functional modules. The worship target database 311 stores, for each worship target 10, a data set in which the position information of the shrine 11, the panoramic image P of the shrine 11, the return symbol information, and the like are associated with the identification information of the worship target. The worship target information transmission unit 312 extracts information on the worship target 10 from the worship target database 311 in response to a request from the worship terminal 100 and transmits the information to the worship terminal 100.

The payment processing unit 313 executes processing for electronic payment in response to the request from the payment requesting unit 103. For example, the payment processing unit 313 requests an electronic payment corresponding to the request from the payment requesting unit 103 to a server of a financial institution or the like. The electronic payment may be any electronic payment as long as the payment is made by moving the worshipers' funds to the worship target. Examples of electronic payment include account transfer, credit card payment, and electronic money payment.

FIG. 7 is a block diagram illustrating the hardware configuration of the worshiper terminal 100 and the worship support server 300. As shown in FIG. 7, the worshiper terminal 100 includes a circuit 180, a display device 181, an input device 182, a GPS sensor 183, an attitude sensor 184, and a camera 185. The circuit 180 includes one or more processors 191, a memory 192, a storage 193, an input/output port 194, and a communication port 195. The storage 193 has a computer-readable storage medium such as a hard disk. The storage medium may be a removable medium such as a non-volatile semiconductor memory, a magnetic disk or an optical disk. The storage 193 acquires an actual image of the shrine 11 of the worship target 10 and displays a moving image in which an image of a moving virtual offering is composited with the actual image of the shrine 11 in response to an operation input by the worshiper. It stores a program (for example, the above-mentioned application) for causing the worshiper terminal 100 to perform a process for electronic payment of a donation to the worship target 10 according to the operation input. For example, the storage 193 stores a program for configuring the functional module of the worshiper terminal 100 described above. The memory 192 temporarily stores the program loaded from the storage medium of the storage 193 and the calculation result of the processor 191. The processor 191 cooperates with the memory 192 to execute the above program, thereby configuring each functional module described above. The input/output port 194 inputs/outputs electric signals from/to the display device 181, the input device 182, the GPS sensor 183, the attitude sensor 184, and the camera 185 in accordance with instructions from the processor 191. The communication port 195 performs network communication with the worship support server 300 in response to a command from the processor 191.

The worship support server 300 includes a circuit 390. The circuit 390 includes one or more processors 391, a memory 392, a storage 393, and a communication port 394. The storage 393 has a computer-readable storage medium such as a hard disk. The storage medium may be a removable medium such as a non-volatile semiconductor memory, a magnetic disk or an optical disk. The storage 393 stores a program for configuring the functional modules of the worship support server 300 described above. The memory 392 temporarily stores the program loaded from the storage medium of the storage 393 and the calculation result by the processor 391. The processor 391 cooperates with the memory 392 to execute the above program, thereby configuring each functional module described above. The communication port 394 performs network communication with the worshiper terminal 100 in response to a command from the processor 391.

The configuration of the worship support system 1 illustrated above is merely an example. The worship support system 1 obtains a real image of the shrine 11 of the worship target 10 and synthesizes an image of a moving virtual offering to the real image of the shrine 11 according to an operation input to the worshiper terminal 100 by the worshiper. It is possible to change the displayed moving image on the worshiper terminal 100 and the electronic payment process for the donation to the worship target 10 in accordance with the operation input as long as it can be executed.

A database in which the contents of the worship target database 311 are copied (hereinafter referred to as “local database”) may be provided in the worshiper terminal 100, and the local database may be periodically updated according to the updated contents of the worship target database 311. In this case, the process of selecting the worship target 10 in the worshiper terminal 100 can be executed more quickly.

Further, at least part of the functions of the worshiper terminal 100 described above may be transferred to the worship support server 300 side. For example, all the functional modules of the worshiper terminal 100 described above can be moved to the worship support server 300 side. In this case, the worshiper terminal 100 is operated by the worship support server 300 as an input device, a sensing device, and a display device.

[Worship support procedure]
Hereinafter, as an example of a worship support method, a worship support procedure executed by the worship support system 1 will be illustrated. In this procedure, a real image of the shrine 11 of the worship target 10 is acquired, and a moving image of a virtual offering is moved to the real image of the shrine 11 in accordance with an operation input to the worshiper terminal 100 by the worshiper. It includes displaying the donation video on the worshiper terminal 100 and performing a process for electronic settlement of the donation to the worship target 10 according to the operation input.

For example, as shown in FIG. 8, the worshiper terminal 100 executes steps S01, S02, and S03. In step S01, the position/orientation information acquisition unit 131 waits for an input of a worship support start command while the application for worship support is activated. In step S02, the position/orientation information acquisition unit 131 acquires the terminal position information. The position/orientation information acquisition unit 131 may acquire the terminal orientation information. In step S03, the worship target selection unit 132 requests the worship support server 300 to select the worship target 10 whose current position of the worshiper terminal 100 is closest to the position of the shrine 11. The worship target selection unit 132 requests the worship support server 300 to select a worship target whose azimuth of the position of the shrine 11 based on the current position of the worship terminal 100 and the azimuth of the worship terminal 100 are closest to each other. Good.

In response to this, the worship support server 300 executes steps S21 and S22. In step S21, the worship target information transmission unit 312 selects from the worship target database 311 a worship target whose current position of the worshiper terminal 100 is closest to the position of the shrine 11. The worship target information transmission unit 312 may select the worship target 10 in which the azimuth of the position of the shrine 11 based on the current position of the worship terminal 100 and the azimuth of the worship terminal 100 are closest to each other. In step S22, the worship target information transmission unit 312 transmits the information on the selection result of the worship target 10 in step S21 to the worshiper terminal 100. The information of the selection result includes the identification information of the selected worship target and the position information of the shrine 11.

In response to this, the worshiper terminal 100 executes steps S04 and S05. In step S04, the worship target selecting unit 132 acquires information on the selection result transmitted by the worship target information transmitting unit 312. In step S05, the worship mode switching unit 111 confirms whether or not the distance between the current position of the worshiper terminal 100 and the position of the selected shrine 11 to be visited is smaller than the switching threshold value.

When it is determined in step S05 that the distance between the current position of the worship terminal 100 and the position of the selected shrine to visit is smaller than the switching threshold, the worship terminal 100 executes steps S06 and S07. In step S06, the worship mode switching unit 111 sets the actual image acquisition mode to the first mode. When it is difficult to photograph the shrine 11 by the camera 185 of the worshiper terminal 100 due to congestion of the shrine 11, the worship mode switching unit 111 may set the actual image acquisition mode to the second mode. In step S07, the first acquisition unit 115 activates the camera 185 of the worshiper terminal 100 in order to acquire the actual image of the shrine 11. After that, the actual image acquisition of the company 11 in the actual image acquisition unit 110 is executed by the first acquisition unit 115.

When it is determined in step S05 that the distance between the current position of the worship terminal 100 and the position of the shrine of the selected worship target is equal to or greater than the switching threshold, the worship terminal 100 executes steps S08, S09, and S11. In step S08, the worship mode switching unit 111 sets the actual image acquisition mode to the second mode. In step S09, the worship target search unit 112 displays a screen for specifying search conditions on the display device 181 of the worshiper terminal 100. In step S11, the worship target search unit 112 and the designation input based on the screen for designating the search condition are acquired from the input device 182 of the worshiper terminal 100. The worship target search unit 112 specifies search conditions according to the designated input, and requests the worship support server 300 to search for the worship target 10.

In response to this, the worship support server 300 executes steps S23 and S24. In step S23, the worship target information transmission unit 312 extracts from the worship target database 311 the worship target 10 that matches the search condition designated by the worship target search unit 112. In step S24, the worship target information transmission unit 312 transmits the search result information to the worshiper terminal 100. The information of the search result includes the identification information of the worship target 10 extracted according to the search conditions.

In response to this, the worshiper terminal 100 executes steps S12 and S13. In step S12, the worship target search unit 112 displays the search result of the worship target 10 on the display device of the worshiper terminal 100. For example, the worship target search unit 112 displays a list of worship targets 10 extracted according to the search conditions. In step S13, the worship target information receiving unit 113 selects one worship target 10 from the search results acquired by the worship target search unit 112, and specifies the identification information of the selected worship target 10 to add the worship target 10. It requests the worship support server 300 to transmit information.

In response to this, the worship support server 300 executes steps S25 and S26. In step S25, the worship target information transmission unit 312 extracts additional information of the worship target 10 designated by the worship target information reception unit 113 from the worship support server 300. In step S26, the worship target information transmission unit 312 transmits the extracted additional information of the worship target 10 to the worshiper terminal 100.

In response to this, the worshiper terminal 100 executes step S14. In step S14, the worship target information receiving unit 113 receives the additional information of the worship target 10 and writes it in the worship target information storage unit 114. After that, the actual image acquisition of the company 11 in the actual image acquisition unit 110 is executed by the second acquisition unit 116. The panoramic image P of the shrine 11 stored in the worship target information storage unit 114 is used for the actual image acquisition by the second acquisition unit 116.

After steps S07 and S14, the worshiper terminal 100 executes steps S31, S32, and S33 as shown in FIG. In step S31, the actual image acquisition unit 110 acquires an actual image of the shrine 11 of the worship target 10. When the actual image acquisition mode is the first mode, the first acquisition unit 115 acquires the actual image of the shrine 11 taken by the camera 185 of the worshiper terminal 100. When the actual image acquisition mode is the second mode, the second acquisition unit 116 determines the actual display target area corresponding to the orientation of the worshiper terminal 100 from the panoramic image P stored in the worship target information storage unit 114. Extract images. The second acquisition unit 116 derives the direction of the worshiper terminal 100 (for example, the line-of-sight direction of the camera 185 of the worshiper terminal 100) based on the terminal attitude information acquired by the position/orientation information acquisition unit 131.

In step S32, the composite image display unit 123 displays a standby image including an object for operation input (for example, the above-mentioned offering mark C1) and the actual image acquired by the actual image acquisition unit 110 on the display device 181 of the attendant terminal 100. indicate. In step S33, the operation input acquisition unit 101 confirms whether there is an operation input to the input device 182 of the worshiper terminal 100.

When determining in step S33 that there is no operation input to the input device 182, the worshiper terminal 100 returns the process to step S31. After that, the standby image is repeatedly updated until there is an operation input.

When it is determined in step S33 that there is an operation input to the input device 182, the worshiper terminal 100 executes steps S34, S35, and S36. In step S34, the operation input acquisition unit 101 acquires an operation input to the input device 182 of the worshiper terminal 100. The operation input includes an input for designating the amount of donation and an input for throwing a virtual donation (for example, an input for moving the donation mark C1). In step S35, the donation amount setting unit 102 sets the amount of donation to the worship target 10 based on the operation input. The donation amount setting unit 102 sets the amount of donation according to the numerical value designated by the above operation input. In step S36, the movement route calculation unit 121 is based on the direction of the movement operation input to the input device 182 of the worshiper terminal 100 (for example, the moving direction of the offering mark C1 by the operation input) and the direction of the worshiper terminal 100. Then, the three-dimensional movement path of the virtual offering is calculated.

Next, the worshiper terminal 100 executes steps S41 and S42 as shown in FIG. In step S41, the synthetic data generation unit 122 sets the position of the virtual offering (hereinafter, referred to as “three-dimensional position”) in the coordinate system CS2 (coordinate system fixed in the space around the worshiper terminal 100) as a tertiary. Set to the initial position of movement along the original movement route. In step S42, the real image acquisition unit 110 acquires a real image of the shrine 11 of the worship target 10. When the actual image acquisition mode is the first mode, the first acquisition unit 115 acquires the actual image of the shrine 11 taken by the camera of the worshiper terminal 100. When the actual image acquisition mode is the second mode, the second acquisition unit 116 determines the actual display target area corresponding to the orientation of the worshiper terminal 100 from the panoramic image P stored in the worship target information storage unit 114. Extract images. The second acquisition unit 116 derives the direction of the worshiper terminal 100 (for example, the line-of-sight direction of the camera 185 of the worshiper terminal 100) based on the terminal attitude information acquired by the position/orientation information acquisition unit 131.

Next, the worshiper terminal 100 executes steps S43, S44, S45, and S46. In step S43, the composite data generation unit 122 calculates the display position of the virtual offering in the actual image based on the current orientation of the worshiper terminal 100 and the three-dimensional position. In step S44, the composite data generation unit 122 generates composite image data (composite moving image data for one frame) in which the image of the virtual offering is combined at the display position in the actual image. In step S45, the composite image display unit 123 displays one frame of the donation moving image on the display device 181 of the worshiper terminal 100 based on the composite image data generated by the composite data generation unit 122. In step S46, the synthetic data generation unit 122 confirms whether or not the virtual offering has reached the relative arrival position AP.

When it is determined in step S46 that the virtual offering has not reached the relative reaching position AP, the worshiper terminal 100 executes step S47. In step S47, the synthetic data generation unit 122 moves the three-dimensional position of the virtual offerings along the three-dimensional movement route. For example, the synthetic data generation unit 122 moves the three-dimensional position of the virtual offering at the movement pitch of one frame of the donation video. After that, the worshiper terminal 100 returns the process to step S42. After that, the movement of the three-dimensional position of the virtual offering and the display of the donation moving image are continued until the virtual offering reaches the relative reaching position AP.

When it is determined in step S46 that the virtual offering has reached the relative arrival position AP, the worshiper terminal 100 executes steps S51 and S52 as shown in FIG. In step S51, the return video data generation unit 141 generates the video data of the return symbol. The return video data generation unit 141 may change the video data of the return symbol based on the relative reaching position AP of the virtual offering. In step S52, the synthetic data generation unit 142 moves the position of the return symbol (hereinafter, referred to as “three-dimensional position”) in the coordinate system CS2 (coordinate system fixed in the space around the worshiper terminal 100) as a moving image. Set to the initial position of data.

Next, the worshiper terminal 100 executes step S53. In step S53, the actual image acquisition unit 110 acquires an actual image of the shrine 11 of the worship target 10. When the actual image acquisition mode is the first mode, the first acquisition unit 115 acquires the actual image of the shrine 11 taken by the camera 185 of the worshiper terminal 100. When the actual image acquisition mode is the second mode, the second acquisition unit 116 determines the actual display target area corresponding to the orientation of the worshiper terminal 100 from the panoramic image P stored in the worship target information storage unit 114. Extract images. The second acquisition unit 116 derives the direction of the worshiper terminal 100 (for example, the line-of-sight direction of the camera 185 of the worshiper terminal 100) based on the terminal attitude information acquired by the position/orientation information acquisition unit 131.

Next, the worshiper terminal 100 executes steps S54, S55, S56, and S57. In step S54, the composite data generation unit 142 calculates the display position of the return symbol in the actual image based on the current orientation of the worshiper terminal 100 and the three-dimensional position. In step S55, the combined data generation unit 142 generates combined image data (one frame of combined moving image data) in which the image of the return symbol is combined at the display position in the actual image. In step S56, the composite image display unit 143 displays one frame of the return video on the display device 181 of the worshiper terminal 100 based on the composite image data generated by the composite data generation unit 142. In step S57, the synthetic data generation unit 142 confirms whether or not the operation of the return symbol according to the moving image data is completed.

When it is determined in step S57 that the return symbol operation has not been completed, the worshiper terminal 100 executes step S58. In step S58, the synthetic data generation unit 142 moves the three-dimensional position of the return symbol according to the moving image data. For example, the synthetic data generation unit 122 moves the three-dimensional position of the return symbol at the movement pitch of one frame of the return movie. After that, the worshiper terminal 100 returns the process to step S53. After that, until the operation of the return symbol is completed, the three-dimensional movement of the return symbol and the display of the return movie are continued. If it is determined in step S57 that the return symbol operation has been completed, the worshiper terminal 100 executes step S59. In step S59, the payment requesting unit 103 requests the worship support server 300 for an electronic payment to donate to the worship target of the amount set by the donation amount setting unit 102.

In response to this, the worship support server 300 executes step S61. In step S61, the payment processing unit 313 executes a process for electronic payment in response to the request from the payment requesting unit 103. For example, the payment processing unit 313 requests an electronic payment corresponding to the request from the payment requesting unit 103 to a server of a financial institution or the like. This completes the worship support procedure.

[Effects of this embodiment]
As described above, the worship support method according to the present embodiment acquires a real image of the shrine 11 of the worship target 10 and moves in accordance with the operation input to the worshiper terminal 100 by the worshiper. This includes displaying on the worshiper terminal 100 a donation video in which a moving image of the offering is combined with the actual image of the shrine 11, and performing a process for electronic payment of the donation to the worship target 10 according to an operation input. ..

According to this worship support method, a moving image of a moving virtual offering is composited with a real image of the shrine 11 in response to an operation input to the worshiper terminal 100 by the worshiper, and a donation to the shrine 11 is made. Electronic payment is executed. Therefore, this worship support method is effective in achieving both the convenience of worship and the actual feeling of worship.

The worship support method may further include displaying, on the terminal device, a return video in which a moving image of a return symbol indicating a return for the donation is combined with the actual image of the shrine in response to the display of the donation video. In this case, the feeling of donation at worship can be further improved.

The worship support method may further include changing the moving image of the return symbol according to the arrival position of the virtual offering. In this case, the feeling of donation at worship can be further improved. The moving image may be changed according to the amount of the virtual offering and the purpose of the worshiper's worship. The purpose of worship can be grasped based on, for example, an input to the worshiper terminal 100.

Obtaining the real image of the shrine 11 may include extracting a real image of the display target area according to the orientation of the worshiper terminal 100 from the panoramic image P of the shrine 11 obtained in advance. In this case, regardless of the distance between the worshiper terminal 100 and the shrine 11, a real image of the shrine 11 whose display area changes depending on the orientation of the worshiper terminal 100 and a virtual offer are reproduced. be able to. Therefore, it is possible to improve convenience of worship while maintaining the feeling of worship.

Obtaining the real image of the shrine 11 may include extracting, from the panoramic image P of the shrine 11, a real image of the display target area according to the line-of-sight direction of the camera 185 of the worshiper terminal 100. In this case, since the line-of-sight direction of the camera and the display target area are linked, the feeling of worship can be further improved.

Extracting the actual image of the display target area corresponding to the line-of-sight direction of the camera 185 means that the predetermined relationship is established so that the shrine 11 is displayed in the center when the line-of-sight direction of the camera 185 is in the actual direction of the shrine 11. It may include setting the display target area according to the line-of-sight direction of the camera 185 based on the. In this case, since the line-of-sight direction of the camera 185 and the display target area are linked in the same manner as the image picked up by the camera 185, the feeling of worship can be further improved.

Obtaining the actual image of the shrine 11 may include obtaining the actual image of the shrine 11 taken by the camera 185 of the worshiper terminal 100. In this case, since the moving image of the virtual offering is combined with the real-time image acquired by the worshiper terminal 100, the feeling of donation at the worship service can be further improved.

Acquiring the actual image of the shrine 11 is performed by acquiring the actual image of the shrine 11 taken by the camera 185 of the worshiper terminal 100 in the first mode and the previously acquired panoramic image P of the shrine 11. , Real image acquisition in the second mode for extracting a real image of the display target area according to the orientation of the worship terminal 100, and real image acquisition in the first mode and second mode according to the current position of the worship terminal 100 Switching between real image acquisition and acquisition may be included. In this case, the convenience of worship and the feeling of worship can both be achieved more reliably.

Displaying, on the worshiper terminal 100, a video in which an image of a virtual offering is combined with a real image is based on the direction of the operation input to the worshiper terminal 100 and the orientation of the worshiper terminal 100, and the three-dimensional image of the virtual offering is provided. It may include calculating the moving route and generating the synthetic moving image data so that the virtual offering moves in the actual image along the moving route MR corresponding to the three-dimensional moving route. In this case, the position of the virtual offering is maintained on the three-dimensional movement path, so that the movement of the virtual offering in the image becomes closer to that of the actual moving object. Therefore, the feeling of donation for worship can be further improved.

The worship support method may further include selecting the worship target 10 based on the current position of the worshiper terminal 100. In this case, the convenience of visiting can be further improved.

The worship support method may further include selecting the worship target 10 based on the orientation of the worshiper terminal 100. In this case, the convenience of visiting can be further improved.

Acquiring the real image of the shrine 11 includes selecting a panoramic image corresponding to the current time from the panoramic images of the shrine that are captured at different times, and acquiring the real image from the selected panoramic image. May be included. In this case, since the actual image corresponding to the current time is acquired, it is possible to further improve the feeling of worship.

Although the embodiments have been described above, the present disclosure is not necessarily limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention.

The present disclosure includes the configurations described below.
(Appendix 1)
Extracting a real image of the display target area according to the orientation of the worshiper's terminal device from the panoramic image of the shrine that is acquired in advance,
Displaying an image for performing an operation input for donating a virtual offering on the terminal device together with an actual image of the company hall;
According to the operation input, processing for electronic payment of the donation to the worship target is performed, and the worship support method.
(Appendix 2)
Extracting the actual image of the display target area according to the orientation of the worshiper's terminal device means extracting the actual image of the display target area according to the line-of-sight direction of the camera of the terminal device from the panoramic image of the shrine. The worship support method described in Appendix 1, including the following.
(Appendix 3)
Extracting the real image of the display target area according to the line-of-sight direction of the camera means that the predetermined relationship is displayed so that the company hall is displayed in the center when the line-of-sight direction of the camera faces the actual direction of the company hall. 3. The worship support method according to appendix 2, comprising setting a display target area according to the line-of-sight direction of the camera based on.
(Appendix 4)
The worship according to any one of appendices 1 to 3, further comprising displaying a donation video in which a moving image of a moving virtual offering is composited with a real image of the shrine on the terminal device according to the operation input. How to help.
(Appendix 5)
5. The worship support method according to appendix 4, further comprising displaying a return image on which the moving image of a return symbol showing a return for donation is combined with the actual image of the company on the terminal device in response to the display of the donation video.
(Appendix 6)
6. The worship support method according to appendix 5, further comprising changing the moving image of the return symbol according to the arrival position of the virtual offering.
(Appendix 7)
To display a moving image in which the image of the virtual offering is combined with the actual image of the company on the terminal device,
Calculating a three-dimensional movement path of the virtual offering based on the direction of the operation input to the terminal device and the direction of the terminal device;
Generating synthetic moving image data so that the virtual money offer moves in the actual image of the company along a movement route corresponding to the three-dimensional movement route. Worship support method.
(Appendix 8)
The worship support method according to any one of appendices 1 to 7, further comprising selecting a worship target based on the orientation of the terminal device.
(Appendix 9)
A program that causes a device to execute the worship support method according to claim 1.
(Appendix 10)
A computer-readable storage medium that stores a program that causes an apparatus to execute the worship support method according to claim 1.

The configuration described above is also effective in achieving both the convenience of electronic payment of donations and the realization of donations.

10... worship target, 11... shrine, 100... worshiper terminal (terminal device), 185... camera, MR... travel route, P... panoramic image.

Claims (10)

A worship support method executed by a worshiper terminal,
The actual image acquisition unit acquires the actual image of the shrine that is to be visited,
The donation video display unit displays, on the worshiper's terminal, a donation video in which a moving image of a moving virtual offering is composited with a real image of the shrine in response to an operation input.
The payment requesting unit performs a process for electronic payment of the donation to the worship target according to the operation input,
Ginseng worship which in return video display unit, according to the display of the donation video includes displaying a moving image in return symbols indicating the in return for donation in return videos synthesized real image of the shrine in the worshipers terminal, the How to help. Further comprising, visit support method according to claim 1, wherein said in return video display unit changes the moving image of the in return symbol in accordance with the arrival position of the virtual offertory. A worship support method executed by a worshiper terminal,
The actual image acquisition unit acquires the actual image of the shrine that is to be visited,
The donation video display unit displays, on the worshiper's terminal, a donation video in which a moving image of a moving virtual offering is composited with a real image of the shrine in response to an operation input.
A payment requesting unit performs a process for electronic payment of a donation to the worship target according to the operation input;
Acquiring the actual image of the shrine, from the panoramic image of the shrine acquired in advance, to extract the actual image of the display target area according to the orientation of the worshiper terminal, from the panoramic image of the shrine, Extracting an actual image of the display target area according to the line-of-sight direction of the camera of the worshiper terminal,
Extracting the real image of the display target area according to the line-of-sight direction of the camera means that the predetermined relationship is displayed so that the company hall is displayed in the center when the line-of-sight direction of the camera faces the actual direction of the company hall. based on, including ginseng worship support method to set the display target area in accordance with the viewing direction of the camera. A worship support method executed by a worshiper terminal,
The actual image acquisition unit acquires the actual image of the shrine that is to be visited,
The donation video display unit displays, on the worshiper's terminal, a donation video in which a moving image of a moving virtual offering is composited with a real image of the shrine in response to an operation input.
A payment requesting unit performs a process for electronic payment of a donation to the worship target according to the operation input;
It is, including ginseng worship support method to get the real image of the shrine taken by the pilgrim terminal of the camera for acquiring an actual image of the shrine. A worship support method executed by a worshiper terminal,
The actual image acquisition unit acquires the actual image of the shrine that is to be visited,
The donation video display unit displays , on the worshiper's terminal, a donation video in which a moving image of a moving virtual offering is composited with a real image of the shrine in response to an operation input.
A payment requesting unit performs a process for electronic payment of a donation to the worship target according to the operation input;
Acquiring the actual image of the shrine is
Real image acquisition in a first mode for acquiring a real image of the shrine taken by the camera of the worshiper terminal;
Acquiring a real image of a second mode for extracting a real image of a display target area according to the orientation of the worshiper terminal from a panoramic image of the shrine acquired in advance;
Current first mode actual image acquisition and the real image acquisition and that the the including ginseng bows support method for switching a second mode according to the position of the worshipers terminal. Displaying a moving image in which the image of the virtual offering is combined with the actual image of the shrine on the worshiper's terminal,
Calculating a three-dimensional movement path of the virtual offering based on the direction of the operation input to the worshiper terminal and the orientation of the worshiper terminal;
And a said virtual offertory along a movement path corresponding to the three-dimensional movement path to generate combined moving image data so as to move in the real image of the shrine, any according one of claims 3-5 Worship support method. Visit object selecting unit, based on the current position of the worshipers terminal, further comprising selecting the visit subject, visit support method of any one of claims 1-6. The pilgrims based on the orientation of the terminal, further comprising selecting the visit subject, visit support method of any one of claims 1-7. Programs to be executed by the device visit support method of any one of claims 1-8. The visit support method of any of claims 1-8 for storing a program to be executed by device, a computer readable storage medium.

Images