JP5798225B1 - Information transmission system and information transmission method using code image - Google Patents

Abstract

Convenience that it is possible to acquire further information that cannot be obtained only by viewing the content image without changing the position of viewing the content image while viewing the content image displayed on the screen of the display device. Bring to users. A content image 21 is displayed at the center of the screen of a display device 2 and a code image 22 is displayed at a peripheral portion. In the code image 22, binary data is recorded as a binary data pattern. The code image 22 is photographed by the portable terminal, the binary data is recognized, the binary data is transmitted to the server device, and specific information can be acquired from the server device. Since the code image 22 is a frame type, it does not hinder the display of the content image. Further, since the outer shape of the code image 22 is the same as the outer shape of the screen 11, even if the code image 22 is photographed from a position away from the display device 2 with a portable terminal, the binary data can be correctly recognized. [Selection] Figure 4

Description

  The present invention relates to an information transmission system and an information transmission method for transmitting information using a code image displayed together with a content image on a display device.

  A two-dimensional code such as a QR code (registered trademark) is usually printed on a paper surface. However, the two-dimensional code can be displayed and used in an image (including a still image, a moving image, and a video) displayed on the screen of the display device (see Patent Document 1 below). For example, in a television shopping program, a merchandise seller displays a QR code in an image displayed on the screen of the television device. In the QR code, the URL (Uniform Resource Locator) of the website of the merchandise seller is encoded and recorded. A viewer who is watching the program can access the website of the merchandise seller almost automatically by reading the QR code displayed in the image with a mobile terminal with a camera such as a smartphone. The viewer can acquire detailed information on the product from the website via the mobile terminal, and can purchase a product via the website.

  On the other hand, in recent years, digital signage (electronic signage) has become widespread. Digital signage is a display device that displays an image on a screen and functions as an advertising signboard, a guidance display board, a poster, or the like (see Patent Document 2 below). By displaying a QR code on an image displayed on the screen of such a display device, it is possible to provide detailed information to consumers and users via a portable terminal, as in the above-described TV shopping program. it can.

International Publication No. 2006/104198 JP 2012-14351 A

  By the way, normally, the QR code has a square outer shape, and the size of one side is several centimeters. Therefore, the QR code is displayed in a very small area of the image displayed on the screen of the television device. For this reason, in order to read this QR code with a portable terminal, the portable terminal must be brought close to the screen of the television apparatus so that the distance between the camera of the portable terminal and the screen of the television apparatus is several centimeters. Since viewers usually watch programs broadcast on the television device at a distance of about 2 to 3 meters from the screen of the television device, they carry the QR code in the image displayed on the screen of the television device. In order to be read by the terminal, the viewer must move close to the television device. This is cumbersome and difficult for those who are not free.

  However, if a very large QR code is displayed on the screen of the television device, the viewer can move the QR code to the portable terminal without moving from a position about 2 to 3 meters away from the screen of the television device. It is thought that it can be read. In this case, however, the random dot pattern of the QR code is displayed on the entire screen of the television device, which may give an unpleasant impression to the viewer. Further, since the product image is not displayed while such a large QR code is displayed, the viewer cannot confirm the product being sold, which is inconvenient.

  Such a problem may occur not only in a television apparatus but also in digital signage.

  The present invention has been made in view of the above-described problems, for example, and an object of the present invention is to determine the position of viewing a content image while viewing the content image (for example, an image of a product) displayed on the screen of the display device. Providing an information transmission system and information transmission method that can provide users (viewers, consumers, etc.) with the convenience of being able to acquire additional information that cannot be obtained simply by looking at the content image without change. There is to do.

In order to solve the above problems, an information transmission system according to the present invention has a rectangular screen in which the lengths of the upper side and the lower side are longer than the lengths of the left side and the right side, and includes a code image and a content image. a display device for displaying an image over the entire area in the screen, a photographing device for photographing the entire of the screen the composite image is displayed, the composite image in said screen captured by the imaging device An information processing device that performs information processing, and an output device that performs an output process for outputting a result of the information processing performed by the information processing device, wherein the code image is arranged at a peripheral portion of the screen , the content image is arranged at the center of the screen, the code image surrounds over the content image on the entire periphery thereof, the content image is moving or Is video, the code image is along the contour of the screen, adjacent to the periphery of the screen, extending over the entire circumference of the screen, the size of the outer shape of the code image of the outline of the screen It is formed in a frame shape that matches the size, and has four linear image pieces each extending over the entire length of the four sides of the screen , and the upper and lower sides of the screen are among the four image pieces. The length of each of the two image pieces extending along the vertical direction is greater than 0% and not more than 20% of the vertical length of the screen , and of the four image pieces, the left side of the screen And the length in the left-right direction of each of the two image pieces extending along the right side is greater than 0% and not more than 20% of the length in the left-right direction of the screen . A plurality of figures having a predetermined shape having a color or a second color Includes binary data pattern is a geometric pattern formed by arranging said binary data pattern representing the recorded information, at least three portions corresponding to the corner of the screen in the code image, the code A position mark which is a geometric mark indicating the position of the image is arranged, and the information processing specifies the entire code image in the composite image photographed by the photographing device based on the position mark, and Including a process of recognizing the recording information represented by the binary data pattern included in each image piece of the identified code image, and the output process includes the recording information recognized in the information processing or the recording information It includes a process of displaying corresponding information, outputting a voice, or transmitting.

The ratio of the length of the outer shape of the code image in the horizontal direction to the length of the code image in the vertical direction is equal to the ratio of the length of the screen in the horizontal direction and the length of the screen in the vertical direction. Is desirable.

Of the four image pieces, the vertical length of the image piece extending along the upper side of the screen, the vertical length of the image piece extending along the lower side of the screen, and the left side of the screen It is desirable that the length in the left-right direction of the image piece extending along the right side and the length in the left-right direction of the image piece extending along the right side of the screen coincide with each other .

The recording information includes identification information for designating information to be transmitted from a server device to the output device, and the output processing includes the identification information included in the recording information recognized in the information processing. It is desirable to include processing for transmitting to the server device, receiving information transmitted from the server device in response to the information, and outputting the received information .

In order to solve the above-described problem, the information transmission method of the present invention provides a composite image including a code image and a content image on a rectangular screen in which the length of each of the upper side and the lower side is longer than the length of each of the left side and the right side. An image display step for displaying the entire area of the display device in the screen, a photographing step for photographing the entire screen on which the composite image is displayed in the image display step, and a photographing step in the photographing step. An information processing step in which an information processing device performs information processing on the composite image in the captured screen, and an output processing in which an output device outputs the result of the information processing performed in the information processing step and a step, wherein the code image is disposed on the periphery of the screen, the content images are arranged at the center of the screen, Serial code image surrounds over the content image on the entire periphery thereof, the content image is moving or video, the code image is along the contour of the screen, adjacent to the periphery of the screen, the screen Four linear shapes that extend over the entire circumference, are formed in a frame shape in which the size of the outer shape of the code image matches the size of the outer shape of the screen, and extend over the entire length of the four sides of the screen. and an image piece of the of the four image pieces, the length of each of the vertical direction of the two images pieces extending along the upper and lower sides of the screen 0% vertical length of the screen And the length in the left-right direction of the two image pieces extending along the left and right sides of the screen among the four image pieces is the length in the left-right direction of the screen. Greater than 0% of 20% or less, and each image piece includes a binary data pattern that is a geometric pattern formed by arranging a plurality of figures having a predetermined shape having a first color or a second color, A binary data pattern represents recorded information, and a position mark, which is a geometric mark indicating the position of the code image, is arranged in a portion corresponding to at least three corners of the screen in the code image. The entire code image in the composite image photographed by the photographing device is specified based on the position mark, and the binary data pattern included in each image piece of the specified code image is expressed. Including the process of recognizing the record information, wherein the output process displays the record information recognized in the information process or information corresponding to the record information. Including a process of outputting or transmitting voice.

  According to the present invention, while viewing the content image displayed on the screen of the display device, it is possible to acquire further information that cannot be obtained by merely viewing the content image without changing the position where the content image is viewed. Convenience can be provided to the user.

1 is a block diagram illustrating an information transmission system according to an embodiment of the present invention. It is explanatory drawing which shows the display apparatus in the information transmission system by embodiment of this invention. In the information transmission system by embodiment of this invention, it is explanatory drawing which shows the image displayed on the image display area of a display apparatus. In the information transmission system by embodiment of this invention, it is explanatory drawing which shows the display apparatus with which the image was displayed on the image display area. In the information transmission system by embodiment of this invention, it is explanatory drawing which shows the display apparatus with which the divided content image was displayed. In the information transmission system by embodiment of this invention, it is explanatory drawing which shows the display apparatus by which the code image and the content image were displayed on some screens. It is explanatory drawing which shows the code image in the information transmission system by embodiment of this invention. It is explanatory drawing which shows the code image in the information transmission system by embodiment of this invention. It is explanatory drawing which shows the binary data pattern in the information transmission system by embodiment of this invention. It is a flowchart which shows operation | movement of the information transmission system by embodiment of this invention. It is explanatory drawing which shows the modification of the code image in the information transmission system by embodiment of this invention. It is explanatory drawing which shows the modification of the code image in the information transmission system by embodiment of this invention. It is explanatory drawing which shows the modification of the code image in the information transmission system by embodiment of this invention. It is explanatory drawing which shows the modification of the code image in the information transmission system by embodiment of this invention.

  Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 shows an information transmission system according to an embodiment of the present invention. In FIG. 1, an information transmission system 1 according to an embodiment of the present invention includes a display device 2, a photographing device 3, an information processing device 4, and an output device 5.

  The display device 2 is a device having a screen for displaying an image, such as a liquid crystal display screen, for example, a television device, a digital signage, a monitor device for a personal computer, or the like. The display device 2 is desirably provided with a large screen of, for example, 40 type to 70 type or more. When the display device 2 is a television device, the display device 2 includes a receiver for receiving a television broadcast. When the display device 2 is digital signage, the display device 2 includes a communication device that communicates with a server for image distribution, a storage device that stores an image to be displayed, and the like.

  The display device 2 is connected to an external image providing device 6. The image providing device 6 is a device that provides an image to be displayed on the screen of the display device 2 to the display device 2. For example, when the display device 2 is a television device, the image providing device 6 is a television broadcast transmitter. When the display device 2 is digital signage, it is a server computer for image distribution.

  The photographing device 3 includes a camera and photographs an image displayed on the screen of the display device 2 with the camera. The information processing device 4 includes an arithmetic processing device, a storage device, and the like, and performs information processing on an image photographed by the photographing device 3. Specifically, the information processing device 4 reads a binary data pattern displayed in an image photographed by the photographing device 3, and recognizes binary data represented by the read binary data pattern. The output device 5 includes a communication device and transmits a result of information processing by the information processing device 4. Specifically, the output device 5 transmits binary data recognized by the information processing device 4 or information corresponding to the binary data to the external server device 7. The server device 7 is a server computer, for example, and is connected to the output device 5 via a computer network such as the Internet.

  The imaging device 3, the information processing device 4, and the output device 5 are realized as functions of the camera-equipped mobile terminal 8, such as a smartphone, a mobile phone, and a tablet. More specifically, the imaging device 3, the information processing device 4, and the output device 5 are realized by installing application software (computer program) that causes the camera-equipped mobile terminal 8 to function as these devices. Is done.

  FIG. 2 shows the display device 2. As shown in FIG. 2, the display device 2 includes a screen 11 on which an image is displayed. Here, an area where an image is displayed in the screen 11 is referred to as an image display area 12. Usually, the image is displayed on the entire screen 11. In this case, the image display area 12 is the entire screen 11. In addition, the display device 2 can have a function of limiting the range in which an image is displayed to a part of the screen 11. When this function is executed, the image display area 12 is a part of the screen 11. In the present embodiment, the image display area 12 is a quadrangle and has an upper side 12A, a lower side 12B, a left side 12C, and a right side 12D.

  FIG. 3 shows an image displayed in the image display area 12 of the display device 2. FIG. 4 shows the display device 2 in which an image is displayed in the image display area 12. As shown in FIG. 3, the image displayed in the image display area 12 of the display device 2 is a composite image 23 including a content image 21 and a code image 22. The content image 21 is a still image, a picture, a photograph, a document, a moving image, a video, an animation, a slide show, or the like that expresses information to be transmitted visually to a user (viewer, consumer, etc.). The content of the content image 21 is, for example, a television program, an advertisement, a guidance display, or the like. On the other hand, the code image 22 is an image in which recording information is recorded as a binary data pattern. Details of the code image 22 will be described later. As shown in FIG. 4, the code image 22 is arranged at the peripheral edge in the image display area 12, and the content image 21 is arranged at the center in the image display area 12.

  FIG. 4 shows an example in which one content image 21 is arranged in the code image 22, but as shown in FIG. 5, a plurality of content images 31 </ b> A, 31B and 31C (or one content image divided into a plurality of partial images) can also be arranged. 4 shows an example in which the image display area 12 is set on the entire screen 11 of the display device 2, but the image display area 12 is displayed on the screen of the display device 2 as shown in FIG. 11 is set, a composite image 23 is displayed in the image display area 12 set in a part of the screen 11. In the screen 11 shown in FIG. 6, in an area 24 other than the image display area 12, for example, information such as a program introduction sentence and a weather forecast provided by data broadcasting, and operation buttons for selecting the information are displayed. Images etc. are displayed.

  7 and 8 show the structure of the code image 22. FIG. 9 shows a binary data pattern included in the code image 22. As shown in FIG. 7, in this embodiment, the code image 22 has four image pieces 22A, 22B, 22C, and 22D. For convenience of understanding, in FIG. 7, four image pieces 22A, 22B, 22C, and 22D in the code image 22 are shown separately. Each of the image pieces 22A, 22B, 22C, and 22D is formed in an elongated linear shape. 2, 4, and 7, the image piece 22 </ b> A extends along the upper side 12 </ b> A of the image display region 12 and extends over the entire length of the upper side 12 </ b> A. Further, the image piece 22B extends along the lower side 12B of the image display area 12 and extends over the entire length of the lower side 12B. Further, the image piece 22C extends along the left side 12C of the image display region 12 over almost the entire length of the left side 12C. In addition, the image piece 22D extends along the right side 12D of the image display region 12 over almost the entire length of the right side 12D. The code image 22 surrounds the content image. Further, the code image 22 extends along the outer shape of the image display area 12 over the entire circumference of the image display area 12. Further, the length in the left-right direction of each image piece 22A, 22B is almost 100% of the length in the left-right direction of the image display area 12, and the length in the vertical direction of each image piece 22A, 22B is the length of the image display area 12. It is about 5% of the length in the vertical direction. The vertical length of each image piece 22C, 22D is approximately 90% of the vertical length of the image display area 12, and the horizontal length of each image piece 22C, 22D is the length of the image display area 12. It is approximately 3% of the length in the left-right direction.

  Thus, the code image 22 has a frame shape as a whole. Since the code image 22 is a frame type, the code image 22 only occupies a small and narrow area along each side of the image display area 12 at the peripheral edge of the image display area 12. Thereby, even if the code image 22 is displayed in the image display area 12, a large area at the center in the image display area 12 can be secured as an area for displaying the content image 21. That is, even if the code image 22 is displayed in the image display area 12, the content image 21 can be displayed in a large size at a position that is easy for the user to view, and the content image 21 can be prevented from being obstructed by the code image 22. it can. Therefore, the user can photograph the code image 22 with the photographing device 3 (mobile terminal 8) while viewing the content image 21.

  On the other hand, since the code image 22 is formed in a frame shape, the size of the outer shape of the code image 22 can be made substantially equal to the size of the outer shape of the image display region 12. As a result, the user can take the imaging device 3 (mobile terminal 8) from the normal position where the image displayed in the image display area 12 of the display device 2 is viewed, that is, from a position 2 to 3 meters away from the display device 2. The code image 22 displayed in the image display area 12 can be appropriately photographed (in an optimum state for application software that reads the code image 22 to read the code image 22) by pointing the camera at the display device 2. it can. That is, the user does not need to approach the screen 11 of the display device 2 in order to capture the code image 22.

  Further, as shown in FIG. 8, the code image 22 includes a binary data pattern 25 and a position mark 26. As shown in FIG. 9, the binary data pattern 25 is a geometric pattern formed by arranging a plurality of figures 25A and 25B having a predetermined shape having the first color or the second color. Binary data is represented by an array of a figure 25A having a color of 25 and a figure 25B having a second color. The first color and the second color are different from each other. For example, the first color is white and the second color is black. Moreover, the shape of each figure 25A, 25B is a square, for example. A binary data pattern 25 is included in each image piece 22A, 22B, 22C, 22D. When the information processing apparatus 4 recognizes binary data corresponding to the binary data pattern 25, for example, the graphic 25A having the first color is recognized as “0”, and the graphic 25B having the second color is recognized. It is recognized as “1”.

  The position mark 26 is a geometric mark indicating the position of the code image 22. The code image 22 in the present embodiment has four position marks 26, and two of these position marks 26 are included in the image piece 22A, and the remaining two position marks 26 are included in the image piece 22B. In the image piece 22A, the position marks 26 are arranged at both ends of the image piece 22A. Further, in the image piece 22B, the position marks 26 are arranged at both ends of the image piece 22B. That is, the four position marks 26 are arranged at the four corners of the code image 22. The information processing apparatus 4 can specify the code image based on the position mark 26. The position mark 26 desirably has a shape (for example, a circle shape) different from the figures 25A and 25B forming the binary data pattern 25. As a result, the position mark 26 can be easily specified by the information processing apparatus 4, and as a result, the code image 22 can be easily specified by the information processing apparatus 4.

  The code image 22 is recorded as a binary data pattern 25 obtained by converting the recording information into binary data. By recording the record information as the binary data pattern 25, the information processing apparatus 4 can easily recognize the record information. The contents of the recorded information can be arbitrarily determined. For example, an ID for designating information to be downloaded from the server device 7 to the portable terminal 8 is recorded in the code image 22 as recording information. When the user captures the code image 22 with the portable terminal 8, the portable terminal 8 recognizes the ID recorded in the code image 22 and transmits the recognized ID to the server device 7 from the portable terminal 8. . Further, when the server device 7 receives the ID transmitted from the mobile terminal 8, the server device 7 downloads the information specified by the received ID to the mobile terminal 8. By constructing such a mechanism with software, the user can only view the content image 21 by photographing the screen of the display device 2 while viewing the content image 21 displayed on the screen of the display device 2. Further information that cannot be obtained can be easily obtained on the spot via the portable terminal 8.

  FIG. 10 shows the operation of the information transmission system 1. Hereinafter, an example in which the display device 2 is a television device, the image providing device 6 is a television broadcast transmitter, and a television shopping program is broadcast using the information transmission system 1 will be described as an example. 1 will be described.

  The merchandise seller or the program broadcaster displays a composite image 23 as shown in FIG. 3 in the image display area 12 of the display device 2 at the timing of prompting the viewer to purchase the merchandise in the TV shopping program (step S2). S1). The content image 21 arranged at the center of the composite image 23 is an image of a product (handbag). In this image, basic information about the product, such as the price and color of the product, is displayed together with a picture of the product. Further, in the code image 22 arranged at the peripheral portion of the composite image 23, a web page in which detailed information (for example, product dimensions, product reviews, etc.) on the seller's website is described. Are recorded as record information (binary data pattern 25).

  The viewer is watching the program from a position about 2 to 3 meters away from the display device 2, and at the timing when the purchase of the product is prompted, the camera of the photographing device 3 (mobile terminal 8) is Is directed toward the display device 2 and the screen 11 of the display device 2 is photographed. Thereby, the image in the screen 11 is image | photographed (step S2).

  The information processing device 4 (mobile terminal 8) determines whether or not the code image 22 is present in the captured image (step S3). For example, the information processing apparatus 4 determines whether or not the position mark 26 is present in the captured image. If the position mark 26 is present, the information processing apparatus 4 determines that the code image 22 is present in the captured image (step S3). : YES)

  If there is a code image 22 in the photographed image, the information processing apparatus 4 (mobile terminal 8) reads the code image 22 (step S4). Specifically, the information processing apparatus 4 recognizes binary data represented by the binary data pattern 25 included in each of the image pieces 22A, 22B, 22C, and 22D of the code image 22 in the composite image 23, that is, recording information. To do. The recognized record information is the URL of a web page describing detailed information about the merchandise on the seller's website.

  Subsequently, the output device 5 (mobile terminal 8) activates, for example, a web browser installed in the mobile terminal 8, and transmits the recognized URL to the server device 7 from the web browser (step S5). Thereby, the data of the web page describing the detailed information regarding the product is downloaded from the server device 7 to the mobile terminal 8, and the web page is displayed on the screen of the mobile terminal 8 (step S6). As a result, the user can acquire detailed information regarding the product that cannot be obtained from the screen 11 of the display device 2 through the screen of the mobile terminal 8.

  As described above, according to the information transmission system 1 according to the embodiment of the present invention, the user changes the position of viewing the content image 21 while viewing the content image 21 displayed on the screen 11 of the display device 2. In addition, it is possible to acquire further information that cannot be obtained simply by looking at the content image 21.

  In the above-described embodiment, as shown in FIG. 4, the code image 22 is divided into four image pieces 22A, 22B, 22C, and 22D on the upper side 12A, the lower side 12B, the left side 12C, and the right side 12D, respectively. Although the content image 21 is completely surrounded by the arrangement, the present invention is not limited to this. Like the code image 32 shown in FIG. 11, the two image pieces 32 </ b> A and 32 </ b> B may be arranged only on the upper side and the lower side of the image display area 12, respectively. Further, as in the code image 42 shown in FIG. 12, the two image pieces 42 </ b> A and 42 </ b> B may be arranged only on the left side and the right side of the image display region 12, respectively. Further, like the code image 52 shown in FIG. 13, the two image pieces 52 </ b> A and 52 </ b> B may be arranged only on the lower side and the left side of the image display region 12, respectively. Further, like the code image 62 shown in FIG. 14, the three image pieces 62 </ b> A, 62 </ b> B, and 62 </ b> C may be arranged only on the lower side, the left side, and the right side of the image display area 12.

  In the code image 22, the length in the left-right direction of the image piece 22A or 22B extending along the upper side 12A or the lower side 12B of the image display region 12 is 100% of the length in the left-right direction of the image display region 12 (see FIG. 7). However, in order to enable reading of the code image by photographing from a position away from the display device 2, it is desirable to make the outer shape of the code image 22 close to the outer shape of the image display area 12, and for this purpose, the image piece 22A Alternatively, the length in the left-right direction of 22B is desirably 80% or more and 100% or less of the length in the left-right direction of the image display region 12. Further, the vertical length of the image piece 22A or 22B is not limited to 5% of the vertical length of the image display region 12 (see FIG. 7). However, in order to secure a wide area for displaying the content image 21 in the screen 11 of the display device 2, the vertical length of the image piece 22A or 22B is the vertical length of the image display area 12. It is desirable that it is larger than 0% and 20% or less.

  In the code image 22, the vertical length of the image piece 22C or 22D extending along the left side 12C or the right side 12D of the image display region 12 is 90% of the vertical length of the image display region 12 (see FIG. 7). However, in order to enable reading of the code image by photographing from a position away from the display device 2, it is desirable to make the outer shape of the code image 22 close to the outer shape of the image display area 12, and for that purpose, the image piece 22C. Alternatively, the vertical length of 22D is desirably 80% or more and 100% or less of the vertical length of the image display region 12. Further, the length of the image piece 22C or 22D in the left-right direction is not limited to 3% of the length of the image display region 12 in the left-right direction (see FIG. 7). However, in order to secure a wide area for displaying the content image 21 in the screen 11 of the display device 2, the horizontal length of the image piece 22C or 22D is the horizontal length of the image display area 12. It is desirable that it is larger than 0% and 20% or less.

  Each figure 25A, 25B forming the binary data pattern 25 of the code image 22 is not limited to a quadrangle, and may be, for example, a triangle, a hexagon, or a circle. Further, the two types of colors attached to the respective figures 25A and 25B are not limited to white and black. In the above-described embodiment, the case where the four position marks 26 are arranged at the four corners of the code image 22 is described as an example, but the present invention is not limited to this. For example, three position marks 26 may be arranged at the three corners of the code image 22. Further, the number of position marks may be increased, and for example, position marks may be arranged in the middle part of the image piece. Further, the shape of the position mark is not limited to a circle as shown in FIG.

  In the above-described embodiment, when the portable terminal 8 captures the code image 22 by the photographing device 3 and recognizes binary data included in the code image 22 by the information processing device 4, the binary data is output. Although the case where it transmits to the server apparatus 7 by the apparatus 5 was mentioned as an example, this invention is not limited to this. As modes for outputting the recognized binary data by the output device 5, various modes can be adopted as described below.

  For example, a character string converted into binary data is recorded in the code image 22 as a binary data pattern 25, the code image 22 is photographed by the photographing device 3, and the binary data included in the code image 22 is recorded as information. When recognized by the processing device 4, a character string corresponding to the recognized binary data may be displayed on the screen of the mobile terminal 8.

  Also, some audio data is stored in the portable terminal 8, and the audio data selection identification information converted into binary data is recorded in the code image 22 as a binary data pattern 25. When the image 22 is photographed by the photographing device 3 and the binary data included in the code image 22 is recognized by the information processing device 4, it is stored in the portable terminal 8 according to the identification information corresponding to the recognized binary data. One of the audio data may be selected, and the selected audio data may be output as audio from the speaker of the mobile terminal 8. In a similar manner, specific moving image data may be reproduced on the portable terminal 8 in accordance with the identification information read from the code image 22. Also, audio data or moving image data is stored in the server device 7, identification information read from the code image 22 is transmitted from the portable terminal 8 to the server device 7, and specific audio data or moving image data is transmitted to the server according to the identification information. You may make it download from the apparatus 7 to the portable terminal 8. FIG.

  Moreover, although the case where the display apparatus 2 is mainly a television apparatus has been described in the above embodiment, when the display apparatus 2 is a digital signage, the information transmission system 1 according to the embodiment of the present invention operates as follows. There is an effect. In other words, when the display device 2 is digital signage, the display device 2 may be installed at a position higher than the height of the person or across the obstacle. For example, when the display device 2 is installed on the upper side of the pass gate and provides information to passers-by passing through the pass gate, the display device 2 is installed on the other side across the track from the subway station platform. This is the case. In such a case, a user (passerby, subway user, etc.) cannot access the screen of the display device 2. Even in such a case, according to the information transmission system 1, the size of the outer shape of the code image is almost equal to the size of the outer shape of the screen (image display area) of the display device 2 (that is, the screen of the display device 2 is large). If so, the user can take a code image displayed on the screen by photographing the screen of the display device 2 with the mobile terminal 8 from a position away from the display device 2. Can be read. Even in this case, since the code image is a frame shape, the content image displayed on the display device 2 is not hidden by the code image.

  In addition, the present invention can be appropriately changed without departing from the gist or concept of the invention that can be read from the claims and the entire specification, and an information transmission system and an information transmission method involving such a change are also described in the present invention. It is included in the technical idea of the invention.

DESCRIPTION OF SYMBOLS 1 Information transmission system 2 Display apparatus 3 Imaging apparatus 4 Information processing apparatus 5 Output apparatus 6 Image providing apparatus 7 Server apparatus 8 Portable terminal 11 Screen 12 Image display area 12A Upper side 12B Lower side 12C Left side 12D Right side 21, 31A, 31B, 31C Content image 22, 32, 42, 52, 62 Code image 22A, 22B, 22C, 22D, 32A, 32B, 42A, 42B, 52A, 52B, 62A, 62B, 62C Image fragment 23 Composite image 25 Binary data pattern 25A, 25B Graphic 26 Position mark

Claims (8)

A display device that has a rectangular screen in which the length of each of the upper side and the lower side is longer than the length of each of the left side and the right side, and displays a composite image including a code image and a content image over the entire area in the screen ; ,
A photographing device for photographing the entire screen on which the composite image is displayed ;
An information processing device that performs information processing on the composite image in the screen imaged by the imaging device;
An output device for performing an output process for outputting a result of the information processing performed by the information processing device;
The code image is arranged at a peripheral portion of the screen, the content image is arranged at a central portion of the screen , the code image surrounds the content image over the entire circumference,
The content image is a video or video,
The code image extends along the outer shape of the screen, is adjacent to the periphery of the screen, extends over the entire periphery of the screen, and the size of the outer shape of the code image matches the size of the outer shape of the screen. Four linear image pieces formed in a mold and extending over the entire length of the four sides of the screen,
Of the four image pieces, the length of each of the two image pieces extending along the upper and lower sides of the screen is greater than 0% and not more than 20% of the vertical length of the screen. And
Wherein among the four image pieces, the length of each of the right and left directions of the two images pieces extending along the left and right sides of the screen less large and 20% than 0% in the lateral direction of the length of the screen And
Each image piece includes a binary data pattern which is a geometric pattern formed by arranging a plurality of figures having a predetermined shape having a first color or a second color,
The binary data pattern represents recorded information;
A position mark that is a geometric mark indicating the position of the code image is arranged in a portion corresponding to at least three corners of the screen in the code image,
The information processing identifies the entire code image in the composite image photographed by the photographing device based on the position mark, and the binary data included in each image piece of the identified code image Including a process of recognizing the recorded information represented by a pattern,
The output process includes a process of displaying, outputting, or transmitting the recording information recognized in the information processing or information corresponding to the recording information. The ratio of the length of the outer shape of the code image in the horizontal direction and the length of the code image in the vertical direction is equal to the ratio of the length of the screen in the horizontal direction and the length of the screen in the vertical direction. The information transmission system according to claim 1 . Of the four image pieces, the vertical length of the image piece extending along the upper side of the screen, the vertical length of the image piece extending along the lower side of the screen, and the left side of the screen 3. The information transmission system according to claim 1, wherein a length in the left-right direction of the image piece that expands and a length in the left-right direction of the image piece that extends along the right side of the screen coincide with each other . The recorded information includes identification information for designating information to be transmitted from the server device to the output device,
The output process transmits the identification information included in the recording information recognized in the information processing to the server device, receives information transmitted from the server device in response thereto, and receives the received information. 4. The information transmission system according to claim 1, further comprising an output process. An image for displaying a composite image including a code image and a content image over the entire area of the screen of a display device having a rectangular screen in which the length of each of the upper side and the lower side is longer than the length of each of the left side and the right side Display process;
A photographing step of photographing the entire screen on which the composite image is displayed in the image display step with a photographing device;
An information processing step of performing information processing by an information processing device on the composite image in the screen shot in the shooting step;
An output step of performing an output process of outputting the result of the information processing performed in the information processing step by an output device;
The code image is arranged at a peripheral portion of the screen, the content image is arranged at a central portion of the screen , the code image surrounds the content image over the entire circumference,
The content image is a video or video,
The code image extends along the outer shape of the screen, is adjacent to the periphery of the screen, extends over the entire periphery of the screen, and the size of the outer shape of the code image matches the size of the outer shape of the screen. Four linear image pieces formed in a mold and extending over the entire length of the four sides of the screen,
Of the four image pieces, the length of each of the two image pieces extending along the upper and lower sides of the screen is greater than 0% and not more than 20% of the vertical length of the screen. And
Wherein among the four image pieces, the length of each of the right and left directions of the two images pieces extending along the left and right sides of the screen less large and 20% than 0% in the lateral direction of the length of the screen And
Each image piece includes a binary data pattern which is a geometric pattern formed by arranging a plurality of figures having a predetermined shape having a first color or a second color,
The binary data pattern represents recorded information;
A position mark that is a geometric mark indicating the position of the code image is arranged in a portion corresponding to at least three corners of the screen in the code image,
The information processing identifies the entire code image in the composite image photographed by the photographing device based on the position mark, and the binary data included in each image piece of the identified code image Including a process of recognizing the recorded information represented by a pattern,
The output process includes a process of displaying, recording, outputting, or transmitting the recording information recognized in the information processing or information corresponding to the recording information. The ratio of the length of the outer shape of the code image in the horizontal direction and the length of the code image in the vertical direction is equal to the ratio of the length of the screen in the horizontal direction and the length of the screen in the vertical direction. The information transmission method according to claim 5 . Of the four image pieces, the vertical length of the image piece extending along the upper side of the screen, the vertical length of the image piece extending along the lower side of the screen, and the left side of the screen The information transmission method according to claim 5 or 6, wherein the length of the image piece extending in the left-right direction and the length of the image piece extending along the right side of the screen coincide with each other . The recorded information includes identification information for designating information to be transmitted from the server device to the output device,
The output process transmits the identification information included in the recording information recognized in the information processing to the server device, receives information transmitted from the server device in response thereto, and receives the received information. 8. The information transmission method according to claim 5, further comprising an output process.

Images