JP6473014B2 - Information providing system and information providing apparatus - Google Patents

Description

  The present invention relates to an information providing system and an information providing apparatus that provide information using a print medium.

  In general, in a printed matter sent for the purpose of advertising or the like, such as direct mail, information that the sender wants to notify the recipient is printed on a predetermined sheet as text or a picture. Then, the printed matter is received and opened by the recipient, so that the recipient is notified of the printed characters and pictures.

  However, such printed matter is often discarded without being opened at the destination. For this reason, various ideas for raising the willingness to open are considered.

  By the way, Patent Document 1 discloses a technique in which when a character displayed on a printed material is photographed, a three-dimensional model of the character is generated and displayed. By applying this technology to printed materials such as those described above, it is possible to make the recipient interested in printed materials sent for the purpose of advertising, such as direct mail, and to motivate opening. become able to.

JP 2014-29566 A

  In the technique disclosed in Patent Document 1, only the three-dimensional model of the character displayed on the printed material is displayed. For example, the same character is sent to the direct mail destination where the same character is displayed. The three-dimensional model is simply displayed, and unique information cannot be provided for each direct mail destination. For this reason, it is difficult for the recipient of the printed matter to be aware that the printed matter is for him / herself, and it is difficult to say that the printed matter is sufficiently interested in the recipient.

  The present invention has been made in view of the problems of the conventional techniques as described above, and provides an information providing system and an information providing apparatus capable of providing attractive and unique information using a print medium. For the purpose.

In order to achieve the above object, the present invention provides:
A print medium having a picture display area in which a picture is displayed and an identification information display area in which unique identification information is displayed;
Image recognition means for recognizing the picture displayed in the picture display area and the unique identification information displayed in the identification information display area as image data;
Separating means for separating the image data recognized by the image recognition means into the picture and the unique identification information;
Three-dimensional model generating means for generating a three-dimensional model of the picture cut by the cutting means;
Voice data generating means for recognizing the unique identification information carved by the carving means and generating voice data corresponding to the unique identification information;
An output unit that displays and outputs the three-dimensional model of the picture generated by the three-dimensional model generation unit, and outputs the audio data generated by the audio data generation unit.

  In the present invention configured as described above, when the picture and unique identification information displayed on the print medium are recognized as image data by the image recognition unit, first, the image recognition unit recognizes the image by the segmentation unit. The image data is divided into a picture and unique identification information. For the picture, a three-dimensional model is generated by the three-dimensional model generation means, and for the unique identification information, sound corresponding to the unique identification information is obtained by the voice data generation means. Data is generated. Thereafter, in the output means, the three-dimensional model of the picture generated by the three-dimensional model generation means is displayed and output, and the sound data generated by the sound data generation means is output. Therefore, for example, by using information that can identify the print medium supply destination, such as the name and name of the print medium supply destination, as the unique identification information, the name and name of the supply destination can be output in voice or the supply destination The information corresponding to the voice is output as a voice. Thus, unique information can be provided by voice while providing a three-dimensional model of a picture displayed on the print medium to a print medium provider.

  In addition, if the sketch of the drawing is displayed on the print medium, and the image recognition means recognizes the picture colored in the sketch as image data, the print medium is provided with a favorite color in the drawing below. A three-dimensional model of the picture is displayed and output, and unique information can be provided for each destination of the print medium.

  According to the present invention, for example, as the unique identification information, the name and name of the printing medium providing destination, such as the name and name of the printing medium providing destination, can be used to output the name and name of the providing medium by voice. In other words, information corresponding to the provision destination is output as voice, and thus unique information can be provided by voice while providing a three-dimensional model of a picture displayed on a print medium.

  In addition, when a sketch is displayed on the print medium and the image recognition means recognizes the sketch colored in the sketch as image data, the print medium is provided with a favorite color on the bottom. The displayed three-dimensional model of the picture is displayed and output, and unique information can be provided for each destination of the print medium.

It is a block diagram which shows 1st Embodiment of the information provision system of this invention. It is a figure which shows the structure of the printed matter shown in FIG. It is a flowchart for demonstrating the information provision method in the information provision system shown in FIG.1 and FIG.2. It is a figure which shows the state in which the name information which is a user's name was entered in the name entry area of the printed matter shown in FIG. It is a figure which shows the state in which the audio | voice data of name information are output while the 3D model of a character picture is displayed and output with a smart phone. It is a block diagram which shows 2nd Embodiment of the information provision system of this invention. It is a figure which shows the structure of the printed matter shown in FIG. It is a flowchart for demonstrating the information provision method in the information provision system shown in FIG.6 and FIG.7. It is a figure which shows the state by which coloring was given to the character sketch of the printed matter shown in FIG. It is a figure which shows the state by which the audio | voice data according to a two-dimensional code are output while the 3D model of a character picture is displayed and output with a smart phone.

  Embodiments of the present invention will be described below with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing a first embodiment of the information providing system of the present invention. FIG. 2 is a diagram illustrating a configuration of the printed material 10 illustrated in FIG. 1.

  As shown in FIG. 1, the information providing system according to this embodiment includes a printed material 10 serving as a print medium and a smartphone 20 serving as an information providing device.

  As shown in FIG. 2, the printed matter 10 has a picture display area 11 and a name entry area 12 that becomes an identification information display area.

  In the picture display area 11, a character picture 11a serving as a picture is displayed. This character picture 11a is displayed in a state where a picture of an arbitrary character is colored and completed.

  The name entry area 12 is an area for entering the name of the user to whom the printed material 10 is provided.

  As shown in FIG. 1, the smartphone 20 includes an imaging unit 21, an image recognition unit 22, a segmentation unit 23, a three-dimensional model generation unit 24, an audio data generation unit 25, a synthesis unit 26, and a display unit 27. The voice output unit 28 and the synthesis unit 26, the display unit 27, and the voice output unit 28 constitute the output means of the present invention. In addition, although the input means and communication means other than this are provided in the smart phone 20, the component which is not directly related to this invention is abbreviate | omitted.

  The photographing unit 21 is for photographing the printed material 10.

  The image recognizing unit 22 uses character image 11a displayed in the picture display area 11 of the printed material 10 and the name as unique identification information written in the name input region 12 from the photographed data of the printed material photographed by the photographing unit 21. Information is recognized as image data.

  The segmenting unit 23 segments the image data recognized by the image recognizing unit 22 into a character picture 11 a displayed in the picture display area 11 and name information entered in the name entry area 12.

  The three-dimensional model generation unit 24 generates a three-dimensional model of the character picture 11 a carved by the carving unit 23. The three-dimensional model is generated, for example, by converting the character picture 11a carved by the carving unit 23 into a three-dimensional texture format, as disclosed in Patent Document 1, and converting the data in the three-dimensional texture format to the third order. A well-known technique such as mapping by original shape data can be used.

  The voice data generation unit 25 recognizes the name information carved by the carving unit 23 and generates voice data corresponding to the name information. Note that voice data can also be generated by a general method for generating voice data from text data.

  The synthesizer 26 synthesizes the three-dimensional model of the character picture 11 a generated by the three-dimensional model generator 24 and the voice data of the name information generated by the voice data generator 25.

  The display unit 27 is composed of a liquid crystal display or the like, and displays and outputs a three-dimensional model of the character picture 11a among the data synthesized by the synthesis unit 26.

  The voice output unit 28 includes a speaker or the like, and outputs voice data of name information entered in the name entry area 12 among the data synthesized by the synthesis unit 26.

  Below, the information provision method in the information provision system comprised as mentioned above is demonstrated.

  FIG. 3 is a flowchart for explaining an information providing method in the information providing system shown in FIGS. 1 and 2.

  In the information providing system shown in FIG. 1 and FIG. 2, information is displayed to the user by displaying information on the smartphone 20 using the information displayed on the printed matter 10.

  When the user who provides the printed material 10 receives information using this information providing system, he / she enters his / her name in the name entry area 12 of the printed material 10 (step 1) and uses the smartphone 20. The printed matter 10 is photographed (step 2).

  FIG. 4 is a diagram showing a state in which name information 12a, which is the name of the user, is entered in the name entry area 12 of the printed material 10 shown in FIG.

  As shown in FIG. 4, when the printed product 10 in which the name information 12 a is entered in the name entry area 12 is photographed by the photographing unit 21, the image recognition unit 22 captures the printed matter 10 photographed by the photographing unit 21. From the photographic data, the character picture 11a displayed in the picture display area 11 of the printed matter 10 and the name information 12a entered in the name entry area 12 are recognized as image data (step 3).

  Next, in the segmenting unit 23, the image data recognized by the image recognition unit 22 is segmented into the character picture 11a displayed in the picture display area 11 and name information 12a entered in the name entry area 12 ( Step 4). In this case, ranges of the picture display area 11 and the name entry area 12 are designated in advance, and the range may be divided according to the designated range, or the name information 12a is recognized using a general character recognition technique. However, other portions may be cut out as the character picture 11a.

  Of the character picture 11 a and the name information 12 a carved by the carving unit 23, the character picture 11 a is input to the three-dimensional model generation unit 24. In the three-dimensional model generation unit 24, as described above, for example, the character picture 11a cut by the cutting unit 23 is converted into a three-dimensional texture format, and the data in the three-dimensional texture format is mapped to the three-dimensional shape data. As a result, a three-dimensional model of the character picture 11a is generated (step 5).

  Of the character picture 11 a and name information 12 a carved by the carving unit 23, the name information 12 a is input to the voice data generating unit 25. In the voice data generation unit 25, first, the name information 12a carved by the carving unit 23 is recognized by OCR (Optical Character Recognition / Reader) or the like and converted into text data (step 6). .

  Next, the voice data generation unit 25 converts the text data of the name information 12a into voice data, thereby generating voice data corresponding to the name information 12a (step 7).

  When the three-dimensional model of the character picture 11a is generated by the three-dimensional model generation unit 24 and the voice data of the name information 12a is generated by the voice data generation unit 25, the third order of the character picture 11a is generated by the synthesis unit 26. The original model and the voice data of the name information 12a are synthesized (step 8), the three-dimensional model of the character picture 11a is displayed and output on the display unit 27, and the voice data of the name information 12a is output from the voice output unit 28. (Step 9).

  FIG. 5 is a diagram showing a state in which the smartphone 20 displays and outputs the three-dimensional model of the character picture 11a and the voice data of the name information 12a.

  As shown in FIG. 5, the character by the character picture 11 a is displayed in three dimensions by the character 3D model 13 on the printed material 10 on the display unit 27 of the smartphone 20 by the series of processes described above. At the same time, the name information 12a “Tokki Ichiro” entered in the name entry area 12 is outputted as a voice with a title.

  Thereby, while providing the three-dimensional model of the character picture 11a displayed on the printed matter 10, the name of the user of the printed matter 10 can be provided by voice, and the attractiveness of the printed matter 10 is improved for the user.

(Second Embodiment)
FIG. 6 is a block diagram showing a second embodiment of the information providing system of the present invention. FIG. 7 is a diagram illustrating a configuration of the printed material 110 illustrated in FIG. 6.

  As shown in FIGS. 6 and 7, the information providing system according to the present embodiment is different from the one shown in the first embodiment in that the smartphone 120 has a communication unit 129 and a database server via the communication line 140. 130, and the printed material 110 is provided with an identification code display area 112 in which a two-dimensional code 112a serving as unique identification information is displayed as an identification information display area. The difference is that an unfinished character sketch 111a is displayed in the area 111 as a character picture without being colored. The two-dimensional code 112a is unique for each printed matter 110, and includes access information for designating an access destination by the communication unit 129.

  The photographing unit 121 is for photographing the printed material 110 in the same manner as that shown in the first embodiment.

  The image recognizing unit 122 displays the character picture in which the character sketch 111a displayed in the picture display area 111 of the printed material 110 is colored and the identification code display area 112 from the photographed data of the printed matter photographed by the photographing unit 121. The displayed two-dimensional code 112a is recognized as image data.

  The segmentation unit 123 converts the image data recognized by the image recognition unit 122 into a character picture in which the character sketch 111a displayed in the picture display area 111 is colored and a two-dimensional image displayed in the identification code display area 112. Cut into code 112a.

  The three-dimensional model generation unit 124 generates a three-dimensional model of the character picture that has been carved by the carving unit 123 in the same manner as that shown in the first embodiment.

  The voice data generation unit 125 analyzes the two-dimensional code 112a carved by the carving unit 123, notifies the communication unit 129 of the analysis result, and receives the text data acquired from the database server 130 via the communication unit 129. Convert to audio data. Thereby, the sound data generation unit 125 generates sound data corresponding to the two-dimensional code 112a.

  The synthesizing unit 126 is similar to the one shown in the first embodiment, and the three-dimensional model of the character picture generated by the three-dimensional model generating unit 124 and the voice generated by the voice data generating unit 125. Combining with data.

  The display unit 127 is composed of a liquid crystal display or the like, similar to that shown in the first embodiment, and displays and outputs a three-dimensional model of a character picture among the data synthesized by the synthesis unit 126.

  The audio output unit 128 includes a speaker or the like, and outputs audio data generated by the audio data generation unit 125 among the data synthesized by the synthesis unit 126. Thereby, the audio output unit 128 outputs audio data corresponding to the two-dimensional code 112a displayed in the identification code display area 112.

  Below, the information provision method in the information provision system comprised as mentioned above is demonstrated.

  FIG. 8 is a flowchart for explaining an information providing method in the information providing system shown in FIGS. 6 and 7.

  In the information providing system shown in FIGS. 6 and 7, by displaying information on the smartphone 120 using the information displayed on the printed material 110, as shown in the first embodiment, Information will be provided to users.

  When the user who provides the printed material 110 receives information using this information providing system, the user can color the character sketch 111a displayed in the picture display area 111 of the printed material 110 with a desired color (step). 101), the printed matter 110 is photographed using the smartphone 120 (step 102).

  FIG. 9 is a diagram illustrating a state in which the character sketch 111a of the printed material 110 illustrated in FIG. 7 is colored.

  As shown in FIG. 9, when the printed material 110 in which the character picture 111 b is displayed by coloring the character sketch 111 a is photographed by the photographing unit 121, the image recognizing unit 122 performs the photographing unit 121. The character picture 111b displayed in the picture display area 111 of the printed matter 110 and the two-dimensional code 112a displayed in the identification code display area 112 are recognized as image data from the photographed data of the printed matter photographed in (1). Step 103).

  Next, in the segmenting unit 123, the image data recognized by the image recognition unit 22 is segmented into a character picture 111b displayed in the picture display area 111 and a two-dimensional code 112a displayed in the identification code display area 112. (Step 104). In the same manner as that shown in the first embodiment, the ranges of the picture display area 111 and the identification code display area 112 may be specified in advance, and may be divided according to the specified range. Then, the two-dimensional code 112a may be recognized from the image data recognized by the image recognition unit 122, and the other part may be cut out as the character picture 111b.

  Of the character picture 111b and the two-dimensional code 112a carved by the carving unit 123, the character picture 111b is input to the three-dimensional model generation unit 124, and in the same manner as shown in the first embodiment, the three-dimensional The model generation unit 124 generates a three-dimensional model of the character picture 111b (step 105).

  Of the character picture 111b and the two-dimensional code 112a carved by the carving unit 123, the two-dimensional code 112a is input to the audio data generating unit 125. In the audio data generation unit 125, first, the two-dimensional code 112a carved by the carving unit 123 is analyzed, and the analysis result is notified to the communication unit 129 (step 106).

  As described above, since the two-dimensional code 112a includes access information for designating an access destination by the communication unit 129, the communication unit 129 uses the analysis result notified from the voice data generation unit 125 to create a database. The voice information database 131 of the server 130 is accessed.

  In the voice information database 131, for example, information to be provided as voice information is registered as text data in association with user attribute information such as the user's age, sex, residence, and hobby preferences. On the other hand, the two-dimensional code 112 a displayed in the identification code display area 112 b of the printed material 110 includes access information indicating the registration location of information corresponding to the attribute information of the user in the audio information database 131. Therefore, the information to be provided to the user is searched using the access information included in the two-dimensional code 112a, and is acquired from the voice information database 131 via the communication line 140 by the communication unit 129 (step 107).

  Information acquired by the communication unit 129 is input to the voice data generation unit 25. In the voice data generation unit 25, information based on text data input from the communication unit 129 is converted into voice data. Audio data corresponding to 112a is generated (step 108).

  When the three-dimensional model of the character picture 111b is generated by the three-dimensional model generation unit 124 and the voice data corresponding to the two-dimensional code 112a is generated by the voice data generation unit 125, these character pictures are generated by the synthesis unit 126. The three-dimensional model 111b and the voice data corresponding to the two-dimensional code 112a are synthesized (step 109), and the three-dimensional model of the character picture 111b is displayed and output on the display unit 127, and also according to the two-dimensional code 112a. Audio data is output from the audio output unit 128 (step 110).

  FIG. 10 is a diagram illustrating a state in which a three-dimensional model of the character picture 111b is displayed and output on the smartphone 120 and audio data corresponding to the two-dimensional code 112a is output.

  As shown in FIG. 10, through the series of processes described above, the display unit 127 of the smartphone 120 displays the character by the character picture 111 b as a three-dimensional character 3D model 113 and riding on the printed material 110. In addition, audio information corresponding to the two-dimensional code 112a is output from the audio output unit 128.

  Thereby, while providing a three-dimensional model of the character picture 111b displayed on the printed material 110, unique information can be provided by voice for each user of the printed material 110, and the attractiveness of the printed material 110 is improved for the user. To do. In addition, by displaying and outputting a three-dimensional model of the character picture 111b in which the user has colored the character sketch 111a displayed on the printed material 110, unique information is also provided for each user of the printed material 110. Can be provided.

  In this embodiment, information to be provided as audio information is registered as audio data in the audio information database 131, and the audio data generation unit 125 converts the text data into audio data. The audio data itself may be registered in the information database 131, and the audio data generation unit 125 may acquire the audio data from the audio information database 131.

  In addition, the smartphone 120 does not access the database server 130 to acquire information to be provided as audio data, but registers information corresponding to the two-dimensional code 112a in an application installed in the smartphone 120. The voice data generation unit 125 may search for voice data using the two-dimensional code 112a.

  In addition, information itself provided as sound data may be included in the two-dimensional code 112a, and the sound data generation unit 125 may convert the information included in the two-dimensional code 112a into sound data.

  Also in this embodiment, the user's name may be output as voice data. In that case, the user's name may be included in the two-dimensional code 112a, or the user's name may be displayed in the identification code display area 112.

  In the two embodiments described above, in the synthesis units 26 and 126, the three-dimensional model generated by the three-dimensional model generation units 24 and 124 and the voice generated by the voice data generation units 25 and 125. The three-dimensional model is displayed and output on the display units 27 and 127 and the voice data is output from the voice output units 28 and 128. The three-dimensional model and the voice data are synthesized. It may be configured to output simultaneously without any problem.

10, 110 Printed material 11, 111 Picture display area 11a, 111b Character picture 12 Name entry area 12a Name information 13, 113 Character three-dimensional model 20, 120 Smartphone 21, 121 Shooting part 22, 122 Image recognition part 23, 123 Separation part 24 , 124 Three-dimensional model generation unit 25, 125 Audio data generation unit 26, 126 Synthesis unit 27, 127 Display unit 28, 128 Audio output unit 111a Character sketch 112 Identification code display area 112a Two-dimensional code 129 Communication unit 130 Database server 131 Audio Information database 140 Communication line

Claims (3)

A print medium having a picture display area in which a picture is displayed and an identification information display area in which unique identification information is displayed;
Image recognition means for recognizing the picture displayed in the picture display area and the unique identification information displayed in the identification information display area as image data;
Separating means for separating the image data recognized by the image recognition means into the picture and the unique identification information;
Three-dimensional model generating means for generating a three-dimensional model of the picture cut by the cutting means;
Voice data generating means for recognizing the unique identification information carved by the carving means and generating voice data corresponding to the unique identification information;
An information providing system comprising: an output unit that displays and outputs a three-dimensional model of a picture generated by the three-dimensional model generation unit, and outputs audio data generated by the audio data generation unit. In the information provision system of Claim 1,
The print medium displays a sketch of the picture in the picture display area,
The information recognizing system, wherein the image recognizing means recognizes a picture colored in the background as image data. Image recognition means for recognizing the picture and unique identification information displayed on the print medium as image data;
Separating means for separating the image data recognized by the image recognition means into the picture and the unique identification information;
Three-dimensional model generating means for generating a three-dimensional model of the picture cut by the cutting means;
Voice data generating means for recognizing the unique identification information carved by the carving means and generating voice data corresponding to the unique identification information;
An information providing apparatus comprising: an output unit that displays and outputs a three-dimensional model of a picture generated by the three-dimensional model generation unit, and outputs audio data generated by the audio data generation unit.

Images