JP2014170260A - Portable terminal device, program, stamp, and capsule commodity including stamp - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve design by visualizing contents carved on stamp even in an environment without a reading device and by achieving the presentation relevant to a pattern of the stamp, and to improve amusement property of the stamp.SOLUTION: A control part 27 performs image recognition of at least a part of a seal 30 of a stamp 10 which is acquired by an imaging part 21 by image-capturing and in which a specific marker whose content is visually recognizable by a user is carved. The control part 27 generates a presentation image, such as 3D and AR (Augment Reality), corresponding to the image-recognized seal 30 and displays it on a display section 22.

Description

  The present invention relates to a portable terminal device that recognizes an image of a seal stamp and generates an effect image, a program, a seal, and a capsule product including the seal.

  2. Description of the Related Art Conventionally, a technique for guiding to a homepage of a site from a two-dimensional QR code (registered trademark) readable by a mobile phone is known. Further, for example, Patent Document 1 introduces a stamp stamp that can print a URL (Uniform Resource Locator) of a retail store home page and a mail address of a contact address on a product catalog.

  On the other hand, AR (Augment Reality) technology is known in which the real environment perceived by humans is expanded by a computer. For example, Patent Document 2 introduces a technique for appropriately changing an object image combined with an image representing the state of the real world in an augmented reality image (hereinafter simply referred to as an AR image).

Utility Model Registration No. 3149333 JP 2011-204047 A

  According to the technology disclosed in Patent Document 1, in order to print a stamp on a blank space of a store in a product catalog, a large-scale device such as a reading device such as a personal computer or an output device such as a printer for printing is required. It is. Also, with the imprint of only a one-dimensional barcode or two-dimensional barcode, it is difficult for the user to grasp the contents visually in an environment where there is no reading device.

  On the other hand, mobile terminals have become more multifunctional, and recently, smartphones with enhanced network communication environment for Internet connection as well as imaging functions have become widespread. It would be beneficial if the smartphone and the stamp stamp can be linked to achieve illustrations, animation CG, 3D or AR images, and even sound effects related to the stamp stamps purchased by consumers. . In this case, it is possible to give added value as a toy to the stamp stamp purchased by the consumer, and it should be possible to increase the taste and promote the sales promotion of the stamp stamp itself.

  The present invention has been made to solve the above-described problems, and an object thereof is to provide a portable terminal device, a program, a seal, and a capsule product including the seal that can enhance the interest of the seal.

  The mobile terminal device of the present invention is a mobile terminal device having at least an imaging unit and a display unit, wherein the imaging unit recognizes an image of at least a part of a seal imprinted with a specific marker, and A control unit that generates an effect image corresponding to the imprinted image and displays it on the display unit, and the specific marker is a pattern related to the effect image.

  In this invention, it is preferable that the said control part superimposes the image of the to-be-photographed object acquired by the said imaging part, and the effect image corresponding to the said imprinted image on the said display part.

  In the present invention, the control unit may display the effect image corresponding to the part or a combination thereof on the display unit when the image-recognized imprint forms a part divided in advance. preferable.

  In the present invention, it further includes an audio output unit, and the control unit generates audio corresponding to the image-recognized imprint when the image-recognized imprint has instructed a sound effect. It is preferable to output from the section.

  The present invention is a program of the mobile terminal device that is executed by the computer of the mobile terminal device and includes at least an imaging unit and a display unit, and a marker of a pattern related to the effect image is imprinted on the computer The present invention relates to a program for executing processing for recognizing at least a part of an imprint of a stamp by the imaging unit, and processing for generating the effect image corresponding to the imprinted image and displaying it on the display unit.

  The present invention relates to the effect image used in a portable terminal device that recognizes an image of at least a part of an imprint of a seal, generates an effect image corresponding to the image-recognized image, and displays it on a display unit. It relates to a stamp with a picture marker.

  In the present invention, it is preferable that the stamp is provided on the handle portion itself of an earphone jack accessory having a tip portion and a handle portion that can be attached to an earphone jack terminal of the portable terminal device. Further, in the present invention, the stamp is provided via an attachment member in an opening provided in the handle portion of an earphone jack accessory having a tip portion and a handle portion that can be attached to the earphone jack terminal of the portable terminal device. It is preferable that it can be mounted.

  In the present invention, the stamp is a first hemispherical member, a plate surface of the stamp is formed on a circular surface of the first hemispherical member, the first hemispherical member, It is preferable that a spherical container is formed by combining the second semispherical member. Further, in the present invention, the stamp is formed in a substantially columnar shape, and the plate surface of the stamp is formed in at least one cross section. The first substantially semispherical member and the second substantially semispherical member It is preferable that a spherical container is formed by combining the substantially cylindrical stamp.

  According to the present invention, it is possible to provide a portable terminal device, a program, a stamp, and a capsule product including the stamp that can enhance the interest of the stamp.

It is an image figure of the production system implement | achieved by the capsule goods and portable terminal device which concern on embodiment of this invention. It is a block diagram which shows the internal structure of the portable terminal device which concerns on embodiment of this invention. It is a flowchart which shows operation | movement of the portable terminal device which concerns on embodiment of this invention. It is an image figure which shows the modification 1 of the production system implement | achieved by the capsule goods and portable terminal device which concern on embodiment of this invention. It is an image figure which shows the modification 2 of the production system implement | achieved by the capsule goods and portable terminal device which concern on embodiment of this invention. It is a figure which shows the modification 1 of the capsule goods which concern on embodiment of this invention. It is a figure which shows the modification 2 of the capsule goods which concern on embodiment of this invention.

(Configuration of the embodiment)
Hereinafter, an embodiment for carrying out the present invention (hereinafter simply referred to as the present embodiment) will be described with reference to the accompanying drawings.

  The image figure of the production system 100 implement | achieved by FIG. 1 by the capsule goods 1 and the portable terminal device 20 which concern on this embodiment is shown.

  As shown in FIG. 1A, a capsule product 1 covered with a translucent plastic cover includes a stamp stamp 10 of a type in which vermilion is used or ink is infiltrated. As shown in FIG. 1B, an impressive icon whose contents can be visually recognized by the user, such as a character or a logo, or a combination thereof (hereinafter collectively referred to as the stamp stamp 10). (This is called a specific marker).

  Then, as shown in FIG. 1C, the mobile terminal device 20 such as a smartphone, a game machine, or a PC reads the imprint 30 printed on the paper surface when the stamp stamp 10 is stamped by the user (for example, ), Recognizing a specific marker from the shape, position information, etc. of the imprint 30 and performing an effect by the appearance of a character, character, image, video, sound, 3D, AR image, a sound effect, or a site link Realize guidance.

  Note that the mobile terminal device 20 in the present embodiment includes an imaging unit 21, a display unit 22, an operation unit 23, an audio output unit 24, a communication unit 25, a storage unit 26, and a control unit 27. In the storage unit 26, an application program for reproducing a production image obtained by downloading from a site such as a seller of a capsule product 1 in which the stamp seal 10 is included in advance (the program 260 according to the present embodiment). Are installed and stored in the storage unit 26. According to the production example shown in FIG. 1C, the user first activates the application program acquired by downloading. Then, since the video acquired by the imaging unit 21 of the mobile terminal device 20 is displayed on the display unit 22, the user performs an operation of focusing on the imprint 30 of the hero pattern while watching the video on the display unit 22 ( The hero 20a taking a battle pose appears on the display unit 22 of the mobile terminal device 20 as an effect image. At this time, the mobile terminal device 20 recognizes an image of at least a part of the specific marker indicated by the seal 30 obtained through the reading operation, and generates an effect image such as 3D or AR corresponding to the specific marker that has been image-recognized. Display on the screen.

  In the present embodiment, the effect image displayed on the display unit by recognizing the seal imprint by the mobile terminal device is content related to the pattern of the seal imprint, so only the impression is seen without a reading device or the like. The user can predict the contents of the effect image, and can easily select a stamp for outputting the desired effect image. In addition, since the imprint pattern itself is interesting, it can be enjoyed with the imprint itself even in an environment without a reading device.

  Regarding the output of the effect image, only the effect image related to the specific marker included in the imprint 30 prepared corresponding to the specific marker included in the imprint 30 acquired by the reading operation is displayed on the display unit 22. As shown in the present embodiment, the subject image acquired by the imaging unit 21 simultaneously with the image of the imprint 30 by the reading operation, and the effect image related to a specific marker included in the imprint 30 And may be displayed on the display unit 22 in a superimposed manner. Interestingness can be further enhanced by displaying the subject image and the effect image in a superimposed manner.

As an aspect in which the subject image and the effect image are displayed in a superimposed manner, for example, a stamp stamp 10 in which a specific marker indicating the effect image related to the human hairstyle is imprinted on a part of the head of the person image printed on the paper is stamped When the reading operation is performed, the effect image corresponding to the specific marker included in the seal impression 30 indicated by the stamp stamp 10 and the subject image may be displayed in a composite manner. That is, on the display unit 22 of the mobile terminal device 20, a subject image (AR image) produced by straight hair, perm, brown hair, etc. is superimposed on the image of the human image that is the subject, and the hairstyle / Hair color etc. can be changed. In this case, it is possible to display an image in which the entire hairstyle changes by reading an imprint printed on a part of the head of the person image. By using the portable terminal device shown in this embodiment, it is possible to change and display a part beyond the range of the seal imprinted on paper or the like. Can be provided.

  Also, depending on the specific marker engraved on the stamp stamp 10, for example, Mt. Fuji, Tokyo Tower, Sky Tree, Pyramid, Building, Train, Front Circle, Moai Image, etc. appear on the subject building street. An effect in which an AR image appears is also possible. Furthermore, by photographing a plurality of imprints 30 and playing the melody by changing the pitch according to the positional information of each imprint 30 in that case, or by reading the imprint 30 while sliding the mobile terminal device 20, It is also possible to produce a sound by playing a melody with the sound of an instrument such as a guitar, piano, or drum indicated by each imprint 30.

  FIG. 2 shows an internal configuration of the mobile terminal device 20 according to the present embodiment. As shown in FIG. 2, the mobile terminal device 20 according to the present embodiment includes an imaging unit 21, a display unit 22, an operation unit 23, an audio output unit 24, a communication unit 25, a storage unit 26, and a control. Part 27. The earphone jack accessory 28 is an accessory that is attached to a 3.5 mm earphone jack terminal (not shown) that the mobile terminal device 20 normally has. The earphone jack accessory 28 can be used for storage when the stamp stamp 10 according to the present embodiment is carried with the mobile terminal device 20.

  The imaging unit 21 is a camera configured by a photoelectric conversion element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, a control circuit thereof, and the like. The display unit 22 is configured using, for example, an LCD (Liquid Crystal Display Device) or an organic EL (Electro-Luminescence), which is configured by arranging a large number of pixels (a combination of light emitting elements of a plurality of colors) vertically and horizontally. Display information including effect images such as AR and 3D generated by the control unit 27 and written in a predetermined area (VRAM area) of the storage unit 26 is displayed.

  The operation unit 23 includes a key switch to which various functions are assigned, such as a power key, a call key, a numeric key, a character key, a direction key (left / right / up / down), a determination key, a call key, and an imaging key. When these keys are operated by the operator, a signal corresponding to the operation content is generated and output to the control unit 27 as an instruction from the operator. The operation unit 23 may be realized by a touch panel for inputting position information. In this case, the effect images such as the above-described key switches and 3D or AR are displayed on the touch panel.

  The sound output unit 24 is a speaker that outputs sound including sound effects generated by the control unit 27. The communication unit 25 captures a wireless communication system, performs wireless communication with a base station (not shown) connected to the communication network, and transmits and receives various data. Here, the various data includes voice data at the time of voice call, mail data at the time of mail transmission / reception, Web page data at the time of browsing the Web (World Wide Web), and the like. Particularly relevant to the present invention, the communication unit 25 obtains data necessary for 3D and AR image generation corresponding to the seal impression 30 of the stamp stamp 10 by downloading from a company site (server). At this time, the communication unit 25 connects to a server (not shown) according to a protocol compliant with TCP / IP (Transmission Control Protocol / Internet Protocol), for example.

  A work area and a VRAM (Video RAM) area are allocated to the storage unit 26 in addition to a program area in which the program 260 according to the present embodiment is stored. A 3D or AR image generated by the control unit 27 or an image acquired via the Internet is stored in the work area each time, and display information including the 3D or AR image is drawn in the VRAM area. As the storage unit 26, for example, a semiconductor storage element, magnetism, or an optical storage element is mounted.

  The control unit 27 recognizes an image of at least a part of the stamp 30 of the stamp stamp 10 obtained by reading through the imaging unit 21 and engraved with a specific marker whose contents can be visually recognized by the user, and the image-recognized imprint 30. Has a function of generating an effect image corresponding to, and displaying it on the display unit 22. Examples of effect images include characters, characters, still images, moving images, sounds, 3D images, AR images, and the like.

  The control unit 27 superimposes and displays the subject image acquired simultaneously with the image of the imprint 30 acquired by the reading operation and the effect image corresponding to the specific marker included in the image-recognized imprint 30 (superimpose). May be. In addition, when the imprint 30 that has been image-recognized forms a part that is divided in advance, the control unit 27 may display an effect image corresponding to the part or a combination thereof on the display unit 22.

  Note that the control unit 27 may generate a sound effect at the timing at which the effect image is displayed on the display unit 22, and output the generated sound effect to the sound output unit 24. In addition, when the design of the imprint 30 that has been image-recognized indicates a sound effect, the control unit 27 may generate and output the sound corresponding to the imprint 39 that has been image-recognized to the audio output unit 24.

  For this reason, if the structure of the program 260 executed by the control unit 27 is functionally disassembled and illustrated, as shown in FIG. 2, the main control unit 270, the image acquisition unit 271, the image recognition unit 272, and the effect A control unit 273 and a display control unit 274 are included.

  The image acquisition unit 271 takes in an image including the seal 30 acquired through the imaging unit 21 by a reading operation and outputs the image to the image recognition unit 272. The image recognition unit 272 recognizes an image of a specific marker included in the seal 30 included in the image output from the image acquisition unit 271 and outputs the specific marker to the effect control unit 273.

  The effect control unit 273 generates an effect image such as 3D or AR prepared in association with the specific marker recognized by the image recognition unit 272 and displays the generated effect image on the display unit 22. In addition, the effect control unit 273 superimposes the subject image acquired through the imaging unit 21 simultaneously with the image of the imprint 30 by the reading operation and the effect image corresponding to the specific marker included in the image-recognized imprint 30 ( (Superimpose) is displayed. In addition, when the specific marker of the image-recognized imprint 30 forms a part that is divided in advance, the effect control unit 273 displays an effect image corresponding to the part or a combination thereof on the display unit 22.

  In addition, when the specific marker of the imprint 30 that has been image-recognized instructs the production by voice, the effect control unit 273 generates sound corresponding to the specific marker of the imprint 30 that has been image-recognized in the audio output unit 24. Output.

  The display control unit 274 draws the effect image generated by the effect control unit 273 in the VRAM area of the storage unit 26, reads the displayed display information in synchronization with the display timing, and displays it on the display unit 22. The voice synthesizing unit 275 generates a production voice or sound effect under the control of the production control unit 273 and outputs it to the audio output unit 24.

(Operation of the embodiment)
Hereinafter, the operation of the mobile terminal device 20 of the present embodiment will be described based on the flowchart of FIG.

  First, when the power is turned on, the control unit 27 (main control unit 270) of the mobile terminal device 20 determines whether or not the program 260 (dedicated application program) according to the present embodiment has been installed in the mobile terminal device 20. Determination is made (step S101). The main control unit 270 can determine the presence or absence of installation by referring to a list of installed applications (not shown) allocated and stored in a predetermined area of the storage unit 26. Here, if it is determined that it has not been installed yet (step S101 “NO”), the main control unit 270 generates a message to that effect and displays it on the display unit 22, and provides the program 260 to the consumer. Encourage the acquisition of In accordance with this message, the consumer obtains a dedicated application program by downloading, and further stores it in the program area of the storage unit 26 by installing it (step S102).

  On the other hand, if it is determined in step S101 that the program 260 is already installed in the mobile terminal device 20 (step S101 “YES”), the consumer performs an operation for starting the program 260. When the program 260 is activated (step S103), the mobile terminal device 20 recognizes an image of a specific marker stamped on the stamp stamp 10, and generates and outputs an effect image by AR based on the image recognition result of the specific marker. Is possible.

  When the program 260 is activated, the video acquired by the imaging unit 21 is displayed on the display unit 22, so that the user looks at the display unit 22, for example, as shown in FIG. A reading operation is performed on the stamp 30 printed on the paper surface by stamping the stamp stamp 10 captured by the imaging unit of the device. In other words, focusing is performed on the seal 30 and the image acquisition key 271 is turned on when the image capture key of the operation unit 23 or the image capture button assigned to a partial area of the display unit 22 is turned on (step S104 “YES”). Is activated. In the present embodiment, not only focusing but also an imaging key of the operation unit 23 or an imaging button assigned to a partial area of the display unit 22 is turned on as a reading operation. The image acquisition unit 271 may be activated simply by focusing on and performing focusing. The image acquisition unit 271 delivers an image including the impression 30 acquired through the photographing unit 21 by the reading operation to the image recognition unit 272, and the image recognition unit 272 recognizes an image of a specific marker included in the impression 30 in the image. Is performed (step S105).

  The image recognition result of the specific marker by the image recognition unit 272 is output to the effect control unit 273. When the effect control unit 273 determines from the image recognition result output from the image recognition unit 272 that the imprint is not a combination imprint (step S106 “No”), the effect image prepared in association with the specific marker that has been image-recognized. From the storage unit 26, for example, as shown in FIG. 1C, an AR image is generated as an effect image and output to the display unit 22 for reproduction (step S108).

  On the other hand, as shown in FIG. 4A, for example, the imprint 30 is divided into three parts by the upper, middle, and lower partial impressions 30a, 30b, and 30c, and the combination of the partial impressions 30a, 30b, and 30c completes the process. If the final imprint 30 is to be formed (step S106 “Yes”), the effect control unit 273 determines the combination (step S107), and any one of the upper, middle, and lower partial imprints (type). 1) (step S107 “1”), for example, an AR image with action # 1 is reproduced as an effect image (step S109), up / down, up / center, or center / bottom If it is a combination of partial impressions (step S107 "2"), for example, an AR image with action # 2 corresponding to the combination is reproduced as an effect image (Step S110).

  If the type 3 is a combination of all of the three partial impressions (step S107 “3”), for example, the action of the hero's male figure standing on the photographed impression 30 shown in FIG. It is reproduced for presentation as an AR image with # 3 and displayed on the display unit 22 (step S111). That is, it is possible to customize the effect image corresponding to the specific marker indicated by the seal impression 30 by the difference in the combination of the partial seal impressions. In this way, depending on the way of combination, it is possible to change the production media such as characters, images, video, audio, etc. Furthermore, it is possible to change the 3D effect and AR effect of these media.

  Subsequently, when the specific marker of the seal 30 obtained by the image recognition indicates a voice effect (S112 “Yes”), the effect control unit 273 controls the voice synthesis unit 275 to recognize the image in the voice output unit 24. A sound corresponding to a specific marker of the seal impression 30 is generated and output (step S113). At this time, not only the voice is output, but the musical instrument played or the pitch changes depending on the position where the seal 30 is printed, and for example, the portable terminal device 20 is continuously printed (stamped). It is possible to produce a melody by sliding it on the seal.

  When the effect image is displayed on the display unit 22 in steps S108, S109, S110, and S11, the effect control unit 273 generates a sound effect by controlling the voice synthesis unit 275, and outputs the generated sound effect as a sound. You may output to the part 24. In this case, when the sound output unit 24 outputs the sound effect to the outside world, it is possible to produce the appearance of the hero by the effect image, and as a result, the effect is enhanced. Finally, when the effect control unit 273 detects the end of the program (step S114 “Yes”), the process returns to the reading operation detection process in step S104.

  By the way, the stamp stamp 10 according to the present embodiment is a roller type as shown in FIG. 5A, for example, in addition to the plate 10a having a flat surface as shown in FIG. 1B. It may be. By making the plate surface 10a a roller type, it becomes easy to create a large number of imprints, and by marking a plurality of different types of markers on the plate surface 10a, for example, as shown in FIGS. It is possible to produce video, audio or decoration effects according to each marker.

  Here, the sales form of the stamp stamp 10 will be described. The stamp stamp 10 can be sold as a capsule product (capsule container 1) as shown in FIG. 1A or FIG. 6A, for example. A capsule toy 1 represented by Gashapon (registered trademark) is a toy in which a television popular program, a character product of a game, and the like are stored in a spherical case made of translucent plastic. For example, in a vending machine or the like, when a consumer puts a coin into an insertion slot and turns the handle, the capsule container 1 selected at random is discharged from the extraction slot.

  For example, as shown in FIG. 6A, the capsule container 1 is divided into three in a certain direction (for example, the vertical direction), and the substantially half-spherical member 1a having a hollow inside and constituting the upper half, and the lower half Is formed between a substantially semispherical member 1b having a hollow inside and a substantially semispherical member 1a, 1b having a hollow inside, and is made of the same material as that of the substantially semispherical members 1a, 1b except for the plate surface 10a. And a main body portion of the stamp stamp 10 formed in the above.

  As shown in exploded views in FIGS. 6B and 6C, the capsule container 1 has an imprint 30 in addition to the main body of the cylindrical stamp stamp 10 having a plate surface 10a and a seal tension surface 10b. A mini-book 2 and a ball chain 3 in which a guide indicating that an effect image such as AR can be displayed by performing a reading operation on the mobile terminal device 20 are included. The ball chain 3 can be used as a handle at the time of carrying by releasing the set latch and setting it again through two small holes provided at the top of the semicircular capsule 1a constituting the upper half. By constructing and selling the capsule container 1 in this way, it is possible to save the capsule cost as well as carrying.

In this embodiment, the plate surface is provided on only one circular surface of the cylindrical stamp stamp. However, the present invention is not limited to this, and the plate surface is provided on both circular surfaces of the cylindrical stamp stamp. May be. Thereby, two types of printing plates can be provided in one container, and a more interesting stamp can be provided.

  In the present embodiment, the spherical capsule container can be divided into three parts. However, the present invention is not limited to this. For example, a spherical capsule container can be divided into two parts, a plate surface is formed on the circular surface of the first substantially semispherical member, and the inside of the first substantially semispherical member facing the first substantially semispherical member is hollow. A spherical capsule container may be configured by combining with a semi-spherical member. In the present embodiment, the hemispherical member facing the marking surface has been described as having a hollow inside, but is not limited thereto. However, if the inside is hollow, accessories and the like can be stored in the hollow portion, and convenience can be improved.

  FIG. 7 shows a configuration when the stamp stamp 10 according to this embodiment is used as the earphone jack accessory 28. As shown in FIG. 7A, the stamp stamp 10 is a handle portion of an earphone jack accessory 28 comprising a tip portion 28a and a handle portion 28b that can be attached to a 3.5 mm earphone jack terminal of the portable terminal device 20. It is hung in a hole 28c provided in 28b via a string or chain 28d (FIG. 7 (b-1)) or directly attached to the handle portion 28b (FIG. 7 (b-2)). In addition, as shown in FIG.7 (c), it is good also as a structure which can be mounted | worn in the hole 28c provided in the handle part 28b via mounting members, such as a string or the chain | strand 28d.

  According to the stamp stamp 10 according to the present embodiment, for example, a stamp is stamped on a part of a New Year's card and sent to the recipient. It is possible to realize an application in which an effect image is displayed or a new year greeting video on the sender side is played. However, in the latter case, it is necessary to register the video in advance on a server operated by the operator. In this case, it is possible to realize a service based on a New Year's card that has never existed, and to expect an effect of increasing communication by exchanging New Year's cards. At the same time, the sales promotion effect of the stamp stamp 10 as a toy can be obtained.

  According to the mobile terminal device 20 according to the present embodiment, the control unit 27 includes the imprint 30 of the stamp stamp 10 on which a specific marker whose content can be visually recognized by the user is acquired by the imaging unit 21 through a reading operation. At least a part of the image is recognized, and an effect image corresponding to the image-recognized imprint 30 is generated and displayed on the display unit 22, so that the user can view the contents imprinted on the imprint 30 even in an environment without a reading device. By making this seal 30 and the portable terminal device 20 such as a smartphone cooperate with each other, the characters, images, videos, 3D effects, and AR effects associated with the stamp image of the stamp stamp 10 are linked. The production can be realized and the taste can be enhanced.

  In addition, according to the mobile terminal device 20 according to the present embodiment, the control unit 27 displays the subject acquired by the imaging unit 21 through the reading operation and the effect image related to the specific marker included in the imprint 30 that has been image-recognized. By overlaying and displaying, it is possible to easily reproduce the AR image without requiring a perspective transformation technique. For this reason, for example, by reproducing the AR image related to the capsule product 1 including the stamp stamp 10 purchased by the consumer, it is possible to increase the taste and obtain the sales promotion effect of the toy.

  In addition, when the image-recognized seal 30 forms a part which is divided in advance, the effect content corresponding to the part or a combination thereof is displayed on the display unit 22 so that the effect content is flexible and expandable. In addition to the same imprint set, it can be combined with the divided impressions of other imprint sets to further change the production. In addition to the image, the effect of the effect can be further increased by combining the effect with the sound.

  In addition, by using the stamp stamp 10 according to the present embodiment as an item for generating an effect image such as 3D or AR, the user can quickly place the marker even in an environment without a writing device such as a PC or a printer. By creating impressive icons such as popular characters in this marker, the user can easily recognize the contents even in an environment without a reading device.

  In addition, according to the mobile terminal device 20 according to the present embodiment, only 3D and AR images are illustrated as presentation images generated by the mobile terminal device 20, but illustrations, still images, or two-dimensional or three-dimensional animation CG, etc. May be a video. Furthermore, although only a smart phone is illustrated as the mobile terminal device 20, a mobile phone, a game machine, a PDA (Personal Digital Assistance), or a PC (Personal Computer) having a shooting function and an Internet connection environment may be used.

  Note that the program 260 according to the present embodiment is executed by the computer (27) of the mobile terminal device 20, for example, as illustrated in FIG. 2, and includes at least the imaging unit 21 and the display unit 22. 20 programs 260. For example, as shown in FIG. 3, the program 260 is a computer that captures at least an imprint of the stamp stamp 10 that is acquired by the imaging unit 21 through a reading operation and has a specific marker whose contents can be visually recognized by the user. A process of recognizing a part of the image (S104, S105) and a process of generating an effect image corresponding to the imprinted image 30 recognized and displaying it on the display unit 22 (S106 to S113) are executed.

  According to the program 260 according to the present embodiment, the control unit 27 sequentially reads and executes the program 260 stored in the storage unit 26, so that the contents stamped on the stamp stamp 10 can be visually confirmed even in an environment where there is no reading device. The stamp stamp 10 as a toy can be enhanced by realizing an effect related to the stamp stamp 10 purchased by the user by linking the seal stamp 30 and the mobile terminal device 20 such as a smartphone. The sales promotion effect can be obtained.

  As mentioned above, although preferred embodiment of this invention was explained in full detail, it cannot be overemphasized that the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiments. Further, it is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  DESCRIPTION OF SYMBOLS 1 ... Capsule goods, 10 ... Stamp stamp, 20 ... Portable terminal device, 21 ... Imaging part, 22 ... Display part, 23 ... Operation part, 24 ... Audio | voice output part, 25 ... Communication part, 26 ... Memory | storage part, 27 ... Control 28 ... Earphone jack accessory, 30 ... Imprint, 100 ... Production system, 260 ... Program, 271 ... Image acquisition unit, 272 ... Image recognition unit, 273 ... Production control unit, 274 ... Display control unit.

The mobile terminal device of the present invention is a mobile terminal device having at least an imaging unit and a display unit, wherein the imaging unit recognizes an image of at least a part of a seal imprinted with a specific marker, and A control unit that generates an effect image corresponding to the image-recognized imprint and displays the generated image on the display unit, and the specific marker is a pattern related to the effect image and the content of the effect image can be predicted. is there.

The present invention is a program for a mobile terminal device that is executed by a computer of a mobile terminal device and includes at least an imaging unit and a display unit, wherein the computer relates to the effect image, and the content of the effect image is A process for recognizing at least a part of a seal imprinted with a predictable pattern marker by the imaging unit, and generating the effect image corresponding to the image-recognized seal and displaying it on the display unit And a program for executing the process.

The present invention, image recognition of at least a portion of the seal image of the stamp, a stamp used by the mobile terminal device to be displayed on the display unit to generate an effect image corresponding to the imprint that the image recognition, the presentation The present invention relates to a stamp in which a marker of a picture that can predict the contents of the effect image is engraved.

The mobile terminal device of the present invention is a mobile terminal device having at least an imaging unit and a display unit, wherein the imaging unit recognizes an image of at least a part of a seal imprinted with a specific marker, and A control unit that generates an effect image corresponding to the image-recognized imprint and displays the generated image on the display unit, and the specific marker is a pattern related to the effect image and the content of the effect image can be predicted. is there. Alternatively, the mobile terminal device of the present invention is a mobile terminal device having at least an imaging unit and a display unit, and at least a part of a seal imprinted with a specific marker is image-recognized by the imaging unit. A control unit that generates an effect image corresponding to the imprint that has been recognized and displays it on the display unit, and the specific marker is an icon whose contents can be visually recognized by a user such as a character or a logo, or It is a combination of them, and is related to the effect image, and the content of the effect image is predictable, and the effect image is related to the seal, characters, characters, still images, moving images, Sound, 3D image, AR image, or a combination thereof.

The present invention is a program for a mobile terminal device that is executed by a computer of a mobile terminal device and includes at least an imaging unit and a display unit, wherein the computer relates to the effect image, and the content of the effect image is A process for recognizing at least a part of a seal imprinted with a predictable pattern marker by the imaging unit, and generating the effect image corresponding to the image-recognized seal and displaying it on the display unit And a program for executing the process. Alternatively, the present invention is a program of the mobile terminal device that is executed by a computer of the mobile terminal device and includes at least an imaging unit and a display unit, and the computer has contents by a user such as a character or a logo At least a part of an imprint of a stamp that is a visually recognizable icon or a combination of them, and is related to the effect image and is engraved with a pattern marker that can predict the content of the effect image. A program for executing an image recognition process and a process for generating the effect image corresponding to the image-recognized imprint and displaying it on the display unit, wherein the effect image is associated with the imprint, The program is a character, character, still image, moving image, sound, 3D image, AR image, or a combination thereof. That.

The present invention is a seal used in a mobile terminal device that recognizes an image of at least a part of a seal of a seal, generates an effect image corresponding to the image-recognized image, and displays it on a display unit. The present invention relates to a stamp in which a marker of a picture that can predict the contents of the effect image is engraved. Alternatively, the present invention is a seal used in a portable terminal device that recognizes an image of at least a part of a seal of a seal, generates an effect image corresponding to the image-recognized seal and displays it on a display unit, The effect image is a character, character, still image, moving image, sound, 3D image, AR image, or a combination thereof associated with the imprint, and the imprint is a user of a character or a logo This is related to an icon whose contents are visually recognizable, or a combination thereof, and in which a marker of a picture related to the effect image and capable of predicting the content of the effect image is engraved.

Claims (10)

A portable terminal device having at least an imaging unit and a display unit,
A control unit that recognizes an image of at least a part of a seal imprinted with a specific marker by the imaging unit, generates an effect image corresponding to the imprint that has been image-recognized, and displays it on the display unit;
The mobile terminal device in which the specific marker is a pattern related to the effect image. In claim 1,
The controller is
A portable terminal device that superimposes an image of a subject acquired by the imaging unit and an effect image corresponding to the image-recognized imprint on the display unit. In claim 1 or claim 2,
An audio output unit;
The controller is
A portable terminal device that generates a sound corresponding to the image-recognized imprint and outputs the sound from the sound output unit when the image-recognized imprint indicates a sound effect. A program of the mobile terminal device, which is executed by a computer of the mobile terminal device and has at least an imaging unit and a display unit,
In the computer,
Processing for recognizing at least a part of a seal imprinted with a marker of a pattern related to the effect image by the imaging unit;
The program which performs the process which produces | generates the said production | presentation image corresponding to the said imprinted image and displays it on the said display part.   An image marker related to the effect image is used in a mobile terminal device that recognizes an image of at least a part of an imprint of a seal, generates an effect image corresponding to the image-recognized imprint, and displays it on a display unit. Engraved stamp. In claim 5,
The stamp is a stamp provided on the handle portion itself of an earphone jack accessory having a tip portion and a handle portion that can be attached to an earphone jack terminal of the portable terminal device. In claim 5,
The stamp is a stamp that can be attached to an opening provided in the handle portion of an earphone jack accessory having a tip portion and a handle portion that can be attached to an earphone jack terminal of the portable terminal device via a mounting member.   A capsule product in which the stamp according to any one of claims 5 to 7 is contained in a spherical capsule container. In claim 5,
The stamp is a first semispherical member, and a plate surface of the stamp is formed on a circular surface of the first semispherical member;
A seal in which a spherical container is formed by combining the first hemispherical member and the second hemispherical member. In claim 5,
The stamp is formed in a substantially cylindrical shape, and a plate surface of the stamp is formed in at least one cross section, and includes a first substantially semispherical member, a second substantially semispherical member, and the substantially cylindrical shape. A seal in which a spherical container is formed by combining with a stamp.

Images