JP2020058658A - Application program - Google Patents

Abstract

To provide an application program which displays the content related to a temple or a shrine on a display device as the augmented reality.SOLUTION: A control circuit of an information processing device is made to operate as: an object image acquisition unit which acquires an object image OI obtained by imaging an object O including a marker M related to a temple or a shrine by an imaging device over time; a marker image extraction unit which extracts a marker image MI being the image of the marker M from the object image OI; a content acquisition unit which acquires a content image CI associated with the extracted marker image MI from a database storing the marker image MI of the marker M included in the one or more objects O related to a temple or a shrine and the content image CI being the image of the content related to a temple or a shrine related to the objects O in association with each other; a superimposition image generation unit which generates a superimposition image AR by superimposing the read content image CI on the object image OI including the image of the marker M; and an output control unit which displays the superimposition image AR on the display device 17 over time.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an application program for displaying contents related to temples and shrines on a display device as augmented reality.

  There is known a technique of displaying contents unique to a temple and shrine on a display device as augmented reality (Patent Document 1).

JP, 2005-0198892, A

  It is desirable that the technology for displaying contents related to temples and shrines on a display device as augmented reality is increasingly user-friendly.

  An application program according to an aspect of the present invention uses a control circuit of an information processing device, an image pickup device for an object including a fortune teller, amulet or votive tablet, a building, or a building, which is associated with a shrine, and includes a marker. An object image acquisition unit that acquires an object image generated by capturing images over time, a marker image extraction unit that extracts a marker image that is an image of the marker from the object image, and an object related to one or more temples and shrines The content image associated with the extracted marker image is acquired from the database that stores the marker image of the marker included in the item and the content image that is the image of the content related to the shrine related to the object in association with each other. The content acquisition unit and the object image including the image of the marker are overlapped with the read content image. A superimposed image generating unit that generates a superimposed image and, operating the superimposed image as an output control unit with time displayed on the display device.

  According to the present invention, the technology for displaying contents related to temples and shrines on the display device as augmented reality can be made even more user-friendly.

  Note that the effects described here are not necessarily limited and may be any effects described in the present invention.

1 shows a hardware configuration of an information processing system according to an embodiment of the present invention. The functional structure of an information processing apparatus is shown. 3 shows an operation flow of the information processing device. 1 schematically shows an operation example of the first embodiment (an operation example when an object is a votive panel and a building). An operation example of the second embodiment (operation example 1 when the object is an omikuji) is schematically shown. An operation example of the third embodiment (operation example 2 in the case where the object is an omikuji) is schematically shown.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  1. Hardware configuration of information processing system

  FIG. 1 shows a hardware configuration of an information processing system according to an embodiment of the present invention.

  The information processing system 1 includes a mobile device 10 (information processing device) and a server device 20, which are connected via a network N including the Internet.

  The mobile device 10 is, for example, an information processing device such as a smartphone, a tablet computer, a personal computer, a wearable computer (smart watch, head mounted display, etc.). In the present embodiment, the mobile device 10 has a built-in imaging device (camera), audio output device (speaker), and display device (display). In another embodiment (not shown), the mobile device 10 includes an imaging device (camera), an audio output device (earphones, headphones), and a display device (display) that are connected by wire or wirelessly (Bluetooth (registered trademark) or the like). ) And information can be transmitted and received.

  The server device 20 functions as a so-called cloud computing server.

  The mobile device 10 includes a CPU 11, a ROM 12, a RAM 13, a large-capacity nonvolatile storage device 14 such as an SSD, a network communication interface 15, an operating device 16, a display device 17, a voice output device 18, and an imaging device 19, and these are mutually connected. It has a bus B1 to be connected. The CPU 11, ROM 12, and RAM 13 form a control circuit 100. The CPU 11 loads the application program stored in the ROM 12 into the RAM 13 and executes it.

  The server device 20 includes a CPU 21, a ROM 22, a RAM 23, a large-capacity nonvolatile storage device 24 such as an SSD or an HDD, a network communication interface 25, an operating device 26, and a display device 27, and a bus B2 interconnecting these. . The CPU 21, the ROM 22 and the RAM 23 form a control circuit 200. The CPU 21 loads the application program stored in the ROM 22 into the RAM 23 and executes it.

  2. Functional configuration of information processing device

  FIG. 2 shows a functional configuration of the information processing device.

  In the control circuit 100 of the mobile device 10, the CPU 11 loads the application program stored in the ROM 12 into the RAM 13 and executes the application program, so that the application launching unit 101, the object image acquiring unit 102, the marker image extracting unit 103, and the content acquiring unit 104. , And operates as the superimposed image generation unit 105 and the output control unit 106. The mobile device 10 typically downloads this application program from a cloud application store (not shown) via the network N.

  3. Operation flow of information processing device

  FIG. 3 shows an operation flow of the information processing device.

  (1) Example 1 (when the object is other than an omikuji)

  As a premise, when the CPU 11 activates (starts up) an application program, the application activation unit 101 updates the database 110 online. Specifically, the application launching unit 101 downloads the latest database 110 from the server device 20 via the network N and updates the database 110 stored in the storage device 14. Then, the application activation unit 101 activates (starts up) the imaging device 19. The image (moving image) captured by the imaging device 19 over time is displayed on the display device 17 over time in real time.

  A1, A2, and A3 in FIG. 4 schematically show an operation example (the object is a votive panel) of the first embodiment. B1, B2, and B3 in FIG. 4 schematically show an operation example (the object is a building) of the first embodiment.

  The object image acquisition unit 102 acquires an object image OI that is generated by imaging the object O (A1, B1 in FIG. 4) that is related to the temple and shrine and includes the marker M with the imaging device 19 over time. Yes (step S1). The object image OI includes a marker image MI which is an image of the marker M (A2 and B2 in FIG. 4). The “object image” is an image (moving image) captured by the imaging device 19 over time and displayed on the display device 17 in real time over time.

  "Objects related to temples and shrines" include, for example, omikuji, amulets or votive tablets provided by temples and shrines, or buildings or structures existing within the precincts of temples and shrines (only if "object" is omikuji Example 2 and Example 3). A "marker" is an object unique to a shrine. For example, when the "object" is a charm or votive tablet, the "marker" is drawn on these (typically not printed by handwriting; the same applies below), the name of the shrine, the imprint of the shrine, or the peculiarity of the shrine. It may be a mark or the like. For example, when the "object" is a building or a building, the "marker" may be a letter of the temple name written on them or a mark unique to the temple or a building or a building having a characteristic shape. It may be the object itself (whole) or a part thereof. Moreover, one object may include a plurality of markers. For example, when the “object” is a charm or votive tablet, the characters of the temple name, the imprint of the temple and the mark unique to the temple may be used as the “plurality of markers”. For example, when the "object" is a building or a building, the characters of the name of the temple and the marks unique to the temple and the building or the building itself (whole) or a part of which has a characteristic shape are " It may be a plurality of markers ”.

  The marker image extraction unit 103 extracts the marker image MI (one or more) that is the image of the marker M from the object image OI (step S2).

  The storage device 14 stores the database 110. The database 110 stores a marker image 111 of a marker included in an object related to one or more temples and shrines, and a content image 112 in association with each other. A "content image" is an image of content related to a shrine related to an object. In the first embodiment, “content related to temples and shrines” is typically content unique to temples and shrines. The "content peculiar to the shrine" is, for example, an image of a character peculiar to the shrine (two-dimensional or three-dimensional still image or moving image), an image of the collection peculiar to the shrine, text content showing explanations about the shrine, etc. Or, a combination of at least two of these.

  The database 110 may further store the audio content in association with the marker image 111 and the content image 112. The “voice content” is, for example, voice information or a sound effect indicating a commentary on a temple or shrine, or a combination of at least two of these. In the database 110, the content image and / or the audio content associated with the marker images of the plurality of different markers included in the object related to the same shrine may be the same or different. In the first embodiment, in the database 110, one marker image may be associated with a plurality of different content images and / or audio contents (in this case, one content image and one content image are sequentially or randomly generated each time the flow is executed. / Or obtain the audio content (step S3 described below).

  The content acquisition unit 104 acquires (reads out) the content image CI associated with the marker image MI extracted by the marker image extraction unit 103 from the database 110 (step S3). The content acquisition unit 104 further acquires (reads out) the audio content (when the database 110 stores the audio content) associated with the marker image MI extracted by the marker image extraction unit 103 from the database 110.

  The superimposed image generation unit 105 superimposes the content image CI read from the database 110 by the content acquisition unit 104 on the object image OI to generate a superimposed image AR (step S4).

  The position of the content image CI may depend on the position of the marker image MI (for example, the content image CI is superimposed on the marker image MI so that the marker image MI is hidden). Alternatively, the position of the content image CI may be independent of the position of the marker image MI (for example, the content image CI is always arranged in the center of the superimposed image AR regardless of the position of the marker image MI).

  The output control unit 106 displays the superimposed image AR generated by the superimposed image generation unit 105 on the display device 17 (so-called augmented reality) (step S5) (A3 and B3 in FIG. 4). When there is audio content read from the database 110 by the content acquisition unit 104, the output control unit 106 outputs the audio content from the audio output device 18.

  (2) Example 2 (Operation example 1 when the object is an omikuji)

  FIG. 5 schematically shows an operation example of the second embodiment (operation example 1 when the object is a fortuneteller).

  The description of the same contents as those of the first embodiment will be omitted, and different points will be mainly described.

  The object image acquisition unit 102 uses the imaging device 19 to capture an object O (C1 in FIG. 5) that is an object O related to a shrine (fortune sold at the shrine) and that includes a plurality of markers M1, M2, M3, and M4. An object image OI generated by capturing images over time is acquired (step S1). The object image OI includes marker images MI1, MI2, MI3, MI4 that are images of the markers M1, M2, M3, M4 (C2 in FIG. 5). When the “object” is an omikuji, a plurality of markers are drawn on the paper piece (typically printing), and the text content (fortune, etc.) of the omikuji is not drawn.

  If the "object" is an omikuji sold at a shrine, multiple omikuji are typically sold to multiple worshipers. When the omikuji (object O) includes a plurality of markers M1, M2, M3, and M4, the combinations of the plurality of markers drawn on the plurality of omikuji are different. For example, by drawing (printing) markers selected from five types at the positions of the markers M1, M2, M3, and M4, a plurality of objects including 625 combinations (= 5 × 5 × 5 × 5) O can be produced.

  The marker image extraction unit 103 extracts marker images MI1, MI2, MI3, MI4 which are images of the markers M1, M2, M3, M4 from the object image OI (step S2).

  The storage device 14 stores the database 110. The database 110 associates a plurality of marker images 111 of a plurality of markers included in one object with a plurality of content images 112 having different attributes, which are images of content related to a shrine related to the object. To remember. When the “object” is an omikuji, the “content image” includes at least an image of the text content of the omikuji (text content indicating fortune etc.). When the “object” is an omikuji, the database 110 stores a plurality of marker images 111 of a plurality of markers included in one object (omikuji) and a plurality of content images 112 each having a different attribute in association with each other. When the "object" is an omikuji, the "attribute" is, for example, total luck, money luck, love luck, academic luck, or the like. In the present embodiment, the database 110 has a plurality of marker images MI1, MI2, MI3, MI4, which are images of the plurality of markers M1, M2, M3, M4 included in one object O (fortune), and attributes (total). A plurality of content images of different luck, money luck, love luck, and academic luck are stored in association with each other. In other words, the database 110 associates the marker image MI1 of the marker M1 included in one object O (Omikuji) with the content image having the attribute of total luck, and the marker image MI2 of the marker M2 and the attribute of luck. The content image is associated with each other, the marker image MI3 of the marker M3 is associated with the content image whose attribute is love luck, and the marker image MI4 of the marker M4 and the content image whose attribute is academic luck are associated with each other and stored.

  The database 110 may further store the audio content in association with the marker image 111 and the content image 112. The "voice content" is, for example, voice information or sound effects indicating fortune or the like, or a combination thereof.

  The content acquisition unit 104 is associated with all the marker images MI1, MI2, MI3, MI4 from the database 110, triggered by the marker image extraction unit 103 extracting all the marker images MI1, MI2, MI3, MI4. The content images CI1, CI2, CI3, CI4 are acquired (read out) (step S3). The content acquisition unit 104 further acquires (reads out) the audio content (when the database 110 stores the audio content) associated with the marker images MI1, MI2, MI3, and MI4 extracted by the marker image extraction unit 103 from the database 110. ).

  The superposed image generation unit 105 superimposes the read plurality of content images CI1, CI2, CI3, CI4 on the object image OI including the plurality of marker images MI1, MI2, MI3, MI4 in order (in a predetermined order) to superimpose the plurality of content images CI1, CI2, CI3, CI4. The superimposed images AR1, AR2, AR3, and AR4 are generated (step S4). The output control unit 106 sequentially displays the plurality of superimposed images AR1, AR2, AR3, and AR4 on the display device 17 (in a predetermined order) (step S5). Specifically, it is as follows.

  The superimposed image generation unit 105 superimposes the content image CI1 read from the database 110 by the content acquisition unit 104 on the object image OI to generate a superimposed image AR1 (step S4). The output control unit 106 displays the superimposed image AR1 generated by the superimposed image generation unit 105 on the display device 17 (so-called augmented reality) (step S5) (C3 in FIG. 5).

  After a lapse of a predetermined time (for example, several seconds to several tens of seconds) or triggered by a user operation, the superimposed image generation unit 105 superimposes the content image CI2 read from the database 110 by the content acquisition unit 104 on the object image OI and the superimposed image. AR2 is generated (step S4). The output control unit 106 displays the superimposed image AR2 generated by the superimposed image generation unit 105 on the display device 17 (so-called augmented reality) (step S5) (C4 in FIG. 5).

  After a lapse of a predetermined time (for example, several seconds to several tens of seconds) or triggered by a user operation, the superimposed image generation unit 105 superimposes the content image CI3 read from the database 110 by the content acquisition unit 104 on the object image OI and the superimposed image. AR3 is generated (step S4). The output control unit 106 displays the superimposed image AR3 generated by the superimposed image generation unit 105 on the display device 17 (so-called augmented reality) (step S5) (C5 in FIG. 5).

  After a lapse of a predetermined time (for example, several seconds to several tens of seconds) or triggered by a user operation, the superimposed image generation unit 105 superimposes the content image CI4 read from the database 110 by the content acquisition unit 104 on the object image OI and the superimposed image. AR4 is generated (step S4). The output control unit 106 displays the superimposed image AR4 generated by the superimposed image generation unit 105 on the display device 17 (so-called augmented reality) (step S5) (C6 in FIG. 5).

  As shown in FIG. 5, the positions of the content images CI1, CI2, CI3, CI4 may be independent of the position of the marker image MI (for example, the content images CI1, CI2, CI3, CI4 are arranged in the center of the superimposed image AR). To). Alternatively, the positions of the content images CI1, CI2, CI3, CI4 may depend on the positions of the marker images MI1, MI2, MI3, MI4 (for example, the marker images MI1, MI2, MI3, MI4 are hidden such that the marker images MI1, MI2, MI3, MI4 are hidden). Content images CI1, CI2, CI3, CI4 are superimposed on MI2, MI3, MI4).

  The output control unit 106 in FIG. 5 outputs the audio content from the audio output device 18 when the content acquisition unit 104 has the audio content read from the database 110.

  (3) Example 3 (Operation example 2 when the object is an omikuji)

  FIG. 6 schematically illustrates an operation example of the third embodiment (operation example 2 when the object is a fortuneteller).

  The description of the same contents as in the second embodiment will be omitted, and the different points will be mainly described. In the second embodiment, the object includes a plurality of markers, whereas in the third embodiment, the object includes one marker.

  The object image acquisition unit 102 causes the imaging device 19 to sequentially capture an image of an object O (Omikuji sold at the temple) that includes a marker M (D1 in FIG. 6) that is related to the temple. The object image OI generated by is acquired (step S1). The object image OI includes a marker image MI which is an image of the marker M (D2 in FIG. 6).

  When the omikuji (object O) includes one marker M, the markers drawn on the plurality of omikuji are different from each other. As an object, for example, a oracle for which tens to hundreds of kinds of markers are drawn (printed) may be manufactured.

  The marker image extraction unit 103 extracts the marker image MI which is the image of the marker M from the object image OI (step S2).

  The storage device 14 stores the database 110. The database 110 associates one marker image 111 of one marker included in one object with a plurality of content images 112, which are images of contents related to a shrine related to the object and have different attributes. To remember. When the “object” is an omikuji, the database 110 stores one marker image 111 of one marker included in one object (omikuji) and a plurality of content images 112 having different attributes, in association with each other. In the present embodiment, the database 110 has one marker image MI, which is an image of one marker M included in one object O (fortune), and attributes (general luck, money luck, love luck, academic luck), respectively. A plurality of different content images are stored in association with each other. In other words, the database 110 includes a marker image MI of one marker M included in one object O (Omikuji) and a plurality of content images having different attributes (a content image having an attribute of total luck and an attribute of good luck). A certain content image, a content image whose attribute is love luck, and a content image whose attribute is academic luck are stored in association with each other.

  The content acquisition unit 104 acquires (reads out) the content images CI1, CI2, CI3, CI4 associated with the marker image MI from the database 110, triggered by the marker image extraction unit 103 extracting the marker image MI. Step S3).

  The superimposed image generation unit 105 sequentially superimposes the read plurality of content images CI1, CI2, CI3, CI4 on the object image OI including one marker image MI (in a predetermined order) to generate a plurality of superimposed images AR1, AR2. , AR3, AR4 are generated (step S4). The output control unit 106 sequentially displays the plurality of superimposed images AR1, AR2, AR3, and AR4 on the display device 17 sequentially (in a predetermined order) (so-called augmented reality) (step S5) (D3 in FIG. 6, D4, D5 and D6).

  4. Modification

  (1) Modification 1

  In the above embodiment, the storage device 14 of the mobile device 10 stores the database 110 downloaded from the server device 20, and the content acquisition unit 104 acquires (read out) the content image and the audio content from the database 110. Alternatively, the mobile device 10 may not store the database 110, and the server device 20 may store the database 110 instead. In that case, the content acquisition unit 104 notifies the server device 20 of the extracted marker image via the network N, and acquires (downloads) only the content image and audio content associated with the notified marker image from the server device 20. ) May be.

  However, when the user of the application program is a worshiper who is in the precincts, the mobile device 10 carried by the worshiper may be offline. In the method of the first modification, the mobile device 10 notifies the server device 20 of the extracted marker image via the network N if not online, and only the content image and the audio content associated with the notified marker image are displayed. , Cannot be acquired (downloaded) from the server device 20. On the other hand, in the above embodiment, the storage device 14 of the mobile device 10 stores the database 110 downloaded from the server device 20, so that the process can be executed even when the mobile device 10 is offline. Is advantageous in.

  (2) Modification 2

  In the first embodiment, the “object related to the shrine” includes, for example, an amulet or votive tablet provided by the shrine (sale, etc.) or a building or structure existing in the precincts of the shrine. Alternatively, the "object related to the shrine" may be a red stamp. In this modified example, "red stamp" is a page of paper included in a red stamp book owned by a worshiper, and a page of paper with a stamp imprint unique to the temple and handwritten with a character string unique to the temple. means. When the “object” is a red stamp, the “marker” may be a stamp imprinted on the red stamp book and / or a handwritten character string (such as the name of a temple or shrine).

  5. Conclusion

  First, according to the present embodiment, as shown in A1, A2, and A3 of FIG. 4, the “object” including the marker includes an amulet or a votive tablet provided (sales etc.) by the shrine. As a result, the worshiper can view the superimposed image in which the image of the guardian or votive tablet unique to the temple and the content image unique to the temple are superimposed as augmented reality.

  By the way, when the “marker” is the imprint imprinted on the red stamp book as in the second modification, the imprint is often imprinted on the handwritten character string or the like. When the seal imprint is superimposed on the character string or the like, the marker image extraction unit 103 may fail to extract the marker image (image of the seal imprint) from the object image (step S2). In addition, when the “marker” is a character string handwritten on a red stamp book (text of the temple name, etc.), the typeface etc. may differ depending on the temple staff who is handwriting (or even if there is only one staff member). If the typeface of the character string is different, the marker image extraction unit 103 may fail to extract the marker image (image of the imprint) from the object image (step S2).

  On the other hand, according to the present embodiment, as shown in A1, A2, and A3 of FIG. 4, the “object” including the marker includes an amulet or a votive tablet provided (sales etc.) by the shrine. In order for the marker image extraction unit 103 to reliably extract the marker image from the object image (step S2), the marker included in the "object" cannot be superimposed on another object, and the individual difference can occur in the marker. A clear object is desirable so that it is not (or at least hard to occur). Amulets or votive tablets are mechanically mass-produced. Therefore, it is possible to easily mass-produce an amulet or votive panel that includes a marker that is a clear object that cannot be superimposed on other objects and that does not allow individual differences in markers (at least unlikely to occur). it can.

  Secondly, according to the present embodiment, as shown by B1, B2, and B3 in FIG. 4, the “object” including the marker includes a building or a building existing in the temple grounds. In this case, the “marker” may be the name of the temple or shrine written on the building or the building, or a mark unique to the temple or the building, or the building itself (whole) or its one that has a characteristic shape. It may be part. As a result, the worshipers in the precinct can view the superimposed image in which the content image peculiar to the shrine is superimposed on the image (moving image) of the precinct displayed in real time over time as augmented reality.

  According to the present embodiment, as shown in B1, B2, and B3 of FIG. 4, the marker and the database that stores the marker image and the content image in association with each other are used to acquire the appropriate content image. Instead, it is conceivable to use GPS to acquire the content image. For example, the server device 20 has a database that stores the GPS position information of the location where the shrine exists and the content image unique to the shrine in association with each other. The mobile device 10 carried by a worshiper in the precinct can receive GPS signals. The mobile device 10 transmits the GPS position information of the location of the mobile device 10 (existing in the precinct) to the server device 20. The server device 20 reads the content image associated with the received GPS position information from the database. The server device 20 transmits the read content image to the mobile device 10. The mobile device 10 receives the content image and displays the superimposed image generated based on the content image (augmented reality).

  However, the method using the GPS position information may cause the following problems. For example, the GPS position information of the mobile device 10 may be incorrect (slightly shifted, etc.). In that case, in an area where the temples and shrines are densely located (Kyoto, etc.), the GPS location information of the location of the mobile device 10 does not indicate the location of the temple or shrine where the mobile device 10 actually exists, but exists near the temple or shrine, for example. May indicate the location of another shrine. Then, the server device 20 reads from the database the content image (content image unique to another shrine) associated with the GPS position information (indicating the location of another shrine) received from the mobile device 10. As a result, the mobile device 10 receives the content image unique to another temple and shrine from the server device 20, and displays the superimposed image generated based on the content image unique to another temple and shrine.

  On the other hand, according to the present embodiment, as shown by B1, B2, and B3 in FIG. 4, the temple-specific marker and the database 110 that stores the marker image 111 and the content image 112 in association with each other are used. , A content image at a proper location (content image unique to a temple or shrine) can be reliably acquired.

  In addition, since temples and shrines may be designated as cultural assets, and to keep the majestic atmosphere from being destroyed, for example, the dolls of characters unique to the temple are physically It may not be placed in the precincts, or an object just for marker use should not be physically placed in the precincts. On the other hand, according to the present embodiment, as shown in B1, B2, and B3 of FIG. 4, the “marker” is a character of the temple or shrine name written on the building or the building or a mark unique to the temple or shrine. Alternatively, it may be a building or a building itself (whole) or a part thereof having a characteristic shape. For this reason, worshipers do not have to physically place dolls or the like of the characters peculiar to the temples or shrines in the precincts, or physically place objects only for the purpose of the marker in the precincts, as an augmented reality. The content displayed on the mobile device 10 can be viewed while in the precinct.

  Thirdly, according to the present embodiment, as shown in FIGS. 5 and 6, the “object” including the marker is a fortune. When the fortune (object) includes a plurality of markers, the combinations of the plurality of markers drawn on the plurality of fortunes are different from each other. Similarly, when an omikuji (object) includes one marker, the markers drawn on a plurality of omikuji are different. The database 110 stores a plurality of marker images of different markers and a plurality of content images in association with each other. As a result, the content image displayed as the superimposed image (the image of the text content indicating the fortune, etc.) is different for each of the plurality of lottery tickets. Thereby, the worshiper can appreciate the superimposed image in which the content image of the content similar to that of a typical fortune is superimposed as augmented reality.

  By the way, the following method can be considered as a method for displaying a different content image for each of a plurality of lottery tickets. For example, by drawing (printing) the same markers on a plurality of pieces of paper, a plurality of all the same lotteries are manufactured as objects. The mobile device 10 notifies the server device 20 via the network N of one marker image extracted from the object image or a combination of a plurality of marker images (all the same for a plurality of fortune-telling). The server device 20 holds a plurality of (for example, tens to hundreds) types of content images (text content images indicating fortune). Upon receiving the notification of the marker image, the server device 20 selects the content image in a predetermined order or randomly. The mobile device 10 acquires (downloads) the content image selected by the server device 20 from the server device 20.

  However, with this method, different content images are displayed for one omikuji, so if the user is not satisfied with a certain content (fortune, etc.) Content (fortune, etc.) will be displayed. In this way, if the user is not satisfied with a certain content (fortune, etc.), he / she will not have to purchase the omikuji again.

  On the other hand, according to the present embodiment, as shown in FIGS. 5 and 6, when the omikuji (object) includes a plurality of markers, the combinations of the plurality of markers drawn on the plurality of omikuji are different. Similarly, when an omikuji (object) includes one marker, the markers drawn on a plurality of omikuji are different. According to the second and third embodiments, a specific content image is displayed for one omikuji. Therefore, when the user is not satisfied with a certain content (fortune, etc.), the same content (fortune, etc.) will be displayed even if the application is executed again. Therefore, when the user is not satisfied with a certain content (fortune, etc.), it is possible to encourage the user to purchase the omikuji again. Omikuji are mechanically mass-produced. For this reason, dozens to hundreds of types of fortune are included that include a combination of different markers (when the fortune includes multiple markers) or each include different markers (when the fortune includes one marker). It can be easily mass-produced.

  Although each embodiment and each modified example of the present technology have been described above, the present technology is not limited to the above-described embodiments, and various modifications may be made without departing from the scope of the present technology. Of course.

  Mobile device 10, application activation unit 101, object image acquisition unit 102, marker image extraction unit 103, content acquisition unit 104, superimposed image generation unit 105, output control unit 106.

Claims (2)

The control circuit of the information processing device,
An object image acquisition unit that acquires an object image generated by temporally capturing the object including a marker, which is an object including a sacred lot, amulet or votive tablet related to a temple or shrine, or a building or a building, with a marker. When,
A marker image extraction unit that extracts a marker image that is an image of the marker from the object image,
A marker image extracted from a database that stores marker images of markers included in one or more objects related to shrines and content images that are images of content related to temples related to the objects in association with each other. A content acquisition unit for acquiring the associated content image,
A superimposed image generation unit that generates a superimposed image by superimposing the read content image on the object image including the image of the marker,
An application program that operates as an output control unit that displays the superimposed image on the display device over time. The application program according to claim 1, wherein
The object includes one or more markers,
The marker image extraction unit extracts one or more marker images, which are images of the one or more markers,
The database stores one or more marker images of one or more markers included in one object and a plurality of content images each having a different attribute in association with each other,
The content acquisition unit, from the database,
Acquiring one or a plurality of content images each having a different attribute, which is associated with the extracted one or a plurality of marker images,
The superimposed image generation unit generates a plurality of superimposed images by sequentially superimposing the read plurality of content images on the object image including the image of the one or more markers,
The output control unit is an application program that sequentially displays the plurality of superimposed images on the display device over time.

Images