JP2023154568A - Data transmission system, transmission apparatus, reception apparatus, control method thereof, and program - Google Patents

Abstract

To provide a technique to transmit data from a transmission apparatus to a reception apparatus at a high transmission rate without via network connection.SOLUTION: A transmission terminal 100 (transmission apparatus) converts data to be transmitted to a reception terminal 200 (reception apparatus) to an image in which a plurality of rows are arranged in a first direction and a plurality of pixels constituting each row are arranged along a second direction orthogonal to the first direction, and scrolls and displays the image in the first direction in a display region of a predetermined size in a display unit. The reception terminal 200 consecutively photographs the display region using a camera while the image is scrolled and displayed in the display region in the display unit of the transmission terminal 100 in the first direction. The reception terminal 200 further analyzes the obtained photographed image to restore data before conversion of the image in the transmission terminal 100.SELECTED DRAWING: Figure 1

Description

The present invention relates to data transmission technology for transmitting data between devices that are not connected to a network.

2. Description of the Related Art When transmitting data from one device (transmitting device) to another device (receiving device), it may be required to perform the data transmission without going through a network. For example, when transmitting data between a local government or a school and a bank, due to security issues, the device on the data sending side may not be able to connect to the Internet, and data transmission via the network may not be possible.

As a method for transmitting data between a transmitting device and a receiving device without connecting them via a network, there is a method using a two-dimensional code such as a QR code (registered trademark). In this method, for example, the receiving device uses a camera to read a two-dimensional code displayed by the transmitting device, obtains a link to a Web server, and obtains data to be transmitted from the Web server. Furthermore, in Patent Document 1, a display device on the sending side continuously displays a plurality of two-dimensional codes that encode data to be transferred at a predetermined interval, and a mobile phone on the receiving side sequentially displays a plurality of two-dimensional codes that are displayed in sequence. It is stated that the original information can be obtained by photographing the dimensional code with a camera and analyzing it.

Japanese Patent Application Publication No. 2007-156969

However, in the method using a Web server as described above, it is necessary to transmit data from the transmitting device to the Web server, and data cannot be transmitted to the receiving device without connecting the transmitting device to a network. Furthermore, construction of a Web server and security measures are costly. Furthermore, in the method in which the receiving device continuously photographs multiple two-dimensional codes that are displayed in sequence as still images, the receiving device must perform analysis processing on the photographed images for each still image, which reduces the data transmission speed. There may be a limit to how high the speed can be increased.

Therefore, one aspect of the present invention provides a technique for transmitting data from a transmitting device to a receiving device at a higher transmission rate without going through a network connection.

A data transmission system according to one aspect of the present invention is a data transmission system including a transmitting device and a receiving device not connected to the transmitting device via a network, wherein the transmitting device transmits information to be transmitted to the receiving device. converting means for converting data into an image in which a plurality of rows are arranged in a first direction, and a plurality of pixels forming each row are arranged along a second direction orthogonal to the first direction; display control means for scrolling and displaying the image obtained by the means in the first direction within a display area of a predetermined size on the display section of the transmitting device; a photographing means for continuously photographing the display area while the image is scrolled and displayed in the display area of the unit in the first direction; and analyzing photographed images obtained by photographing by the photographing means. Accordingly, the present invention is characterized by comprising an analysis means for restoring the data before conversion into the image.

A transmitting device according to one aspect of the present invention is a transmitting device for transmitting data from a transmitting device to a receiving device that is not connected to the transmitting device via a network, and the transmitting device transmits data to be transmitted to the receiving device. converting means for converting into an image in which a plurality of rows are arranged in a first direction and a plurality of pixels constituting each row are arranged along a second direction perpendicular to the first direction; display control means for scrolling and displaying the image in the first direction within a display area of a predetermined size on the display section of the transmitting device, while the image is being scroll-displayed in the first direction; The display area is continuously photographed by the receiving device, and the obtained photographed images are analyzed so that the data before being converted into the image is restored in the receiving device.

A receiving device according to one aspect of the present invention is a receiving device for transmitting data from a transmitting device to a receiving device that is not connected to the transmitting device via a network, and the receiving device displays a predetermined size on a display unit of the transmitting device. An image converted from data to be transmitted within an area, in which a plurality of rows are arranged in a first direction, and a plurality of pixels constituting each row are arranged along a second direction orthogonal to the first direction. a photographing means for continuously photographing the display area while the images arranged in the above-mentioned manner are being scrolled and displayed in the first direction; and analyzing photographed images obtained by photographing by the photographing means. , and an analysis means for restoring the data before conversion into the image.

According to the present invention, data can be transmitted from a transmitting device to a receiving device at a higher transmission rate without going through a network connection.

Schematic diagram to explain the overview of the data transmission system Block diagram showing an example of the hardware configuration of a transmitting device Block diagram showing an example of the hardware configuration of a receiving device Flowchart showing the steps of processing performed by the transmitting device Flowchart showing the steps of processing performed by the receiving device Diagram showing an example of the structure of an image generated by the conversion process of transmission data

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the claimed invention. Although a plurality of features are described in the embodiments, not all of these features are essential to the invention, and the plurality of features may be arbitrarily combined. Furthermore, in the accompanying drawings, the same or similar components are designated by the same reference numerals, and redundant description will be omitted.

<Overview of data transmission system>
FIG. 1 is a schematic diagram for explaining an overview of a data transmission system according to an embodiment. As shown in FIG. 1, the data transmission system according to the present embodiment includes a transmitting terminal 100 (transmitting device) and a receiving terminal 200 (receiving device). Data is transmitted to the terminal 200. Data transmission is performed asynchronously using image recognition, without a network connection (wired or wireless). In this embodiment, an example will be described in which the transmitting terminal 100 is configured with a personal computer (PC), and the receiving terminal 200 is configured with a smartphone having a photographing function (camera function).

The transmitting terminal 100 acquires data to be transmitted to the receiving terminal 200 (transmission data), and performs a conversion process to convert the acquired transmission data into an image. In this conversion process, as shown in FIG. A display image is generated by converting into an image arranged along the direction (horizontal direction). In this example, the first direction (vertical direction) corresponds to the scrolling direction when scrolling the image. The horizontal size (number of pixels) of the display image may be a predetermined size (for example, 200 pixels). Further, the vertical size (number of lines) of the display image can change depending on the amount of transmission data.

When the data to be transmitted is in binary format, the above conversion process can be performed as follows. For example, the transmitting terminal 100 allocates one bit from the transmission data to each pixel constituting the display image, and assigns each pixel to a first color (for example, black) or a second color corresponding to the assigned bit. (For example, blue) pixels are generated to convert the transmission data into a display image. Furthermore, the transmitting terminal 100 generates an image (a plurality of pixels) of each row based on the transmission data in units of rows that constitute the display image.

The sending terminal 100 scrolls and displays the display image obtained by the conversion process in the display area of the display unit (the display unit 106 in FIG. 2) of the sending terminal 100 in the vertical direction. Specifically, as shown in FIG. 1, the transmitting terminal 100 moves the display range to be displayed in the display area vertically one line (one pixel) at a time on the display image. Scroll the display image vertically. In this way, the entire display image (the image from the first row to the last row) corresponding to the transmission data is displayed as a moving image within the display area.

As shown in FIG. 1, the receiving terminal 200 uses a photographing section (camera 207 in FIG. The display area is then continuously photographed. The receiving terminal 200 acquires a plurality of photographed images by repeatedly photographing the display area at predetermined time intervals using, for example, a continuous photographing function provided as a photographing function. Alternatively, the receiving terminal 200 may acquire a plurality of captured images by capturing a display area using a video capturing function and extracting still images at predetermined time intervals from the obtained moving images.

When the display image has been captured, the receiving terminal 200 analyzes the captured image to restore the data before conversion to the display image. In this embodiment, the receiving terminal 200 restores a plurality of data series corresponding to a plurality of rows in a display image by performing an analysis process on each of a plurality of photographed images on a line-by-row basis. Furthermore, the receiving terminal 200 restores the data before conversion into a display image by concatenating these restored data series.

In this manner, the data transmission system of this embodiment uses image recognition to realize asynchronous data transmission from the sending terminal 100 to the receiving terminal 200 without using a network connection. In addition, the sending terminal 100 scrolls and displays the image obtained by the conversion process, and the receiving terminal 200 takes the image and analyzes it line by line. Achieve high-speed transmission. Note that, in order to improve the recognition rate of the image displayed on the display unit 106 of the sending terminal 100, the receiving terminal 200 is fixed at a position facing the display unit 106 using a fixture (stand). It is desirable that the camera 207 take a picture.

<Sending terminal configuration>
The transmitting terminal 100 has a hardware configuration as shown in FIG. 2, for example. Specifically, the sending terminal 100 includes a CPU 101, a RAM 102, an operation unit 103, a communication I/F (interface) 104, a storage (storage device) 105 such as an HDD (hard disk drive), and a display unit 106.

The CPU 101 controls the operation of each device in the sending terminal 100 and realizes each function of the sending terminal 100 by reading a program stored in the storage 105 into the RAM 102 and executing it. The storage 105 stores various programs such as a control program for the sending terminal 100, an OS (operating system), and application programs.

The operation unit 103 includes input devices such as a mouse, a keyboard, and a touch panel for a user to input information. The display unit 106 is composed of a display device such as a liquid crystal display. The communication I/F 104 is configured with a network I/F that communicates with an external device via a network. However, in this embodiment, the sending terminal 100 is not connected to the receiving terminal 200 via a network, and the communication I/F 104 is connected only to a dedicated network within a local government or school, for example.

<Configuration of receiving terminal>
The receiving terminal 200 has a hardware configuration as shown in FIG. 3, as an example. As described above, the receiving terminal 200 is composed of a smartphone, but may be composed of other types of terminal devices such as a tablet terminal. The receiving terminal 200 includes a CPU 201, a RAM 202, an operation unit 203, a communication I/F 204, a storage 205, a display unit 206, and a camera 207.

The CPU 201 controls the operation of each device in the receiving terminal 200 and realizes each function of the receiving terminal 200 by reading a program stored in the storage 205 into the RAM 202 and executing it. The storage 205 stores various programs such as a control program, an OS, and an application program for the receiving terminal 200.

The operation unit 203 and the display unit 206 are configured with, for example, a liquid crystal display having a touch panel function. The communication I/F 204 includes a network I/F for mobile communication such as LTE or 5G, a network I/F for wireless LAN communication, and the like. The camera 207 is a photographing device that outputs a photographed image obtained by photographing a subject.

<Processing at the sending terminal>
FIG. 4 is a flowchart showing the procedure of processing executed by the sending terminal 100. The processing of each step in FIG. 4 is realized, for example, by the CPU 101 reading out an application program installed in the sending terminal 100 from the storage 105 into the RAM 102 and executing it.

In S401, the CPU 101 obtains data to be transmitted to the receiving terminal 200. For example, among the data stored in the storage 105, data specified by the user via the operation screen of the application program displayed on the display unit 106 is acquired as the data to be transmitted.

Next, in S402, the CPU 101 performs conversion processing to convert the data to be transmitted into an image. As described above, the data to be transmitted is arranged in a plurality of rows in the first direction (vertical direction) corresponding to the scrolling direction when scrolling an image, and a plurality of pixels constituting each row are The image is converted into an image arranged along a second direction (horizontal direction) orthogonal to the first direction.

FIG. 6 shows a configuration example of an image (display image) generated by the conversion process of data to be transmitted. As shown in FIG. 6, the display image is generated such that each of a plurality of rows is composed of the following three parts.
●Data part (first part) indicating the data to be transmitted.
- A CD section (second part) indicating a check digit (CD) corresponding to the data indicated by the data section.
- A line number section (third section) that indicates the line number based on the first line of the display image in the vertical direction (scroll direction).

The check digit obtained from the CD section is used to check for errors in the data series obtained from the data section of the same row. The line number obtained from the line number section is used in the receiving terminal 200 to connect the line-by-line data series restored from the photographed image and to restore the data before conversion by the conversion process. Note that the positions of the data section, CD section, and line number section are not limited to the positions shown in FIG. For example, the line number section may be placed before the data section in the horizontal direction instead of after the CD section.

In this embodiment, in the conversion process, the CPU 101 allocates one bit from the transmission data to each pixel constituting the display image, and assigns each pixel to a first color (for example, black) corresponding to the allocated bit. ) or as a second color (for example, blue) pixel. In this case, one display pixel represents one bit. Note that, for example, more bits may be represented by one pixel by increasing the number of colors used for one pixel. For example, if four colors (eg, black, red, green, and blue) are available, one pixel can represent two bits. In this way, the CPU 101 allocates one or more bits from the transmission data to each pixel constituting the display image, and assigns each pixel as a pixel of the color corresponding to the allocated bit among two or more colors. All you have to do is generate .

When the conversion process is completed, in step S403, the CPU 101 scrolls and displays the display image in the vertical direction (in the direction in which the plurality of rows of the display image are arranged) within the display area of a predetermined size of the display unit 106. do. The display area is a part of the entire screen area of the display unit 106 with a predetermined size (for example, a size of 100 pixels horizontally and 200 pixels vertically), and each row of the display image is entirely within the display area. configured to be displayed. By this scroll display, the entire display image (the image from the first line (first line) to the last line) corresponding to the data to be transmitted is displayed as a moving image within the display area.

In S403, the CPU 101 displays the next line after the last line of the display image in the vertical direction and periodically scrolls the image so that all the lines of the display image are repeatedly displayed within the display area. It may be displayed (that is, looped display). This allows the receiving terminal 200 to photograph all rows of the display image multiple times.

Thereafter, in S404, the CPU 101 determines whether to end the scroll display of the display image. For example, the CPU 101 may end the scroll display at a timing when the scroll display continues for a predetermined period of time at a predetermined scroll speed, or may terminate the scroll display in response to completion of a predetermined number of loop displays for the entire display image. , the scrolling display may be ended. If the CPU 101 ends the scroll display, it ends the process according to the procedure of FIG. 4, and if the scroll display does not end, the CPU 101 returns the process to S403 and continues the scroll display.

<Processing at the receiving terminal>
FIG. 5 is a flowchart showing the procedure of processing executed by the receiving terminal 200. The processing of each step in FIG. 5 is realized, for example, by the CPU 201 reading out an application program installed in the receiving terminal 200 from the storage 205 into the RAM 202 and executing it.

In step S<b>501 , while the display image is vertically scrolled and displayed within the display area of the display unit 106 of the sending terminal 100 , the CPU 201 uses the camera 207 to continuously photograph the display area. As an example, the CPU 101 acquires a plurality of captured images by repeatedly capturing images of the display area (for example, at predetermined time intervals) while the display images are vertically scrolled and displayed within the display area.

Thereafter, in S502, the CPU 201 determines whether or not to end photographing by the camera 207. For example, the CPU 201 may end the shooting when a predetermined time has elapsed since the start of the shooting. If the CPU 201 has finished shooting, the process advances to S503, and if it has not finished shooting, the CPU 201 returns the process to S501 and continues shooting with the camera 207.

In S503, the CPU 201 restores the data before conversion into a display image by analyzing the photographed image obtained by photographing. As an example, analysis processing is performed line by line for each of a plurality of display images obtained by photographing a display image having the configuration shown in FIG. Specifically, in this analysis process, the CPU 201 identifies the row number for each row in the photographed image to be processed from the pixels in the row number part (third part), and identifies the row number obtained from the pixels in the data part (first part). The presence or absence of errors in the obtained data series is checked using check digits obtained from the pixels of the CD section (second section). The CPU 201 further stores data sequences in which no errors were detected in the inspection in the RAM 202 or the storage 205 in association with the specified line numbers. The CPU 201 uses one or more data series corresponding to each row of the display image saved in this way to restore the data before conversion to the display image.

Here, for example, assume that the display image has a size of 100 pixels horizontally and 6000 pixels vertically, and the display area of the sending terminal 100 has a size of 100 pixels horizontally and 200 pixels vertically. In this case, the transmitting terminal 100 periodically scrolls and displays display images within the display area at a cycle of 12 seconds (loop display), and the receiving terminal 200 uses the camera 207 to capture 25 images per second. Then, the number of captured images that include the first row of display images in one cycle of scroll display is 10 (=200 [pixels] / (6000 [pixels] / 12 [seconds]) x 25 [images / seconds]).

In the above example, since the first line of the display image is included in the 10 captured images, the above process allows the row corresponding to the first line of the display image to be Ten data sequences are obtained from the pixels in the data portion. If no error is detected in seven data sequences as a result of checking these ten data sequences using check digits, the seven data sequences are saved.

In the analysis process of S503, when a plurality of data series are stored in association with one row number based on a plurality of photographed images, the CPU 201 selects a data series with the highest frequency of appearance among the plurality of data series. It is saved as a valid data series corresponding to that one row number. In the above example, seven data series are compared with each other, and the data series with the highest frequency of appearance is saved as the valid data series corresponding to the first row. For example, if four of the seven data series are "172" (hexadecimal) and three data series are "18B" (hexadecimal), "172" is the row number 1. It is saved as a valid data series corresponding to .

The CPU 201 carries out such processing by concatenating multiple data series stored in association with the line numbers of the multiple lines constituting the display image, according to the line numbers. Restore data. When the analysis process in S503 is completed, the CPU 201 ends the process according to the procedure of FIG.

Note that if the captured image obtained by the camera 207 is distorted, the CPU 201 may perform distortion correction processing on the captured image and analyze the distorted captured image. This makes it possible to improve the image recognition rate through analysis processing. Furthermore, when the receiving terminal 200 transmits the data restored by the analysis process to an external device via the network, the transmitting terminal 100 acquires the encrypted data as the data to be transmitted and converts it into an image. may be converted and the image may be scrolled and displayed. In this case, the receiving terminal 200 transmits the data restored by the analysis process (S503) to the external device without decoding it, and the external device decodes the received data. This makes it possible to maintain security when transferring data from receiving terminal 200 to an external device.

As explained above, the data transmission system of this embodiment performs data transmission between the transmitting terminal 100 and the receiving terminal 200 that is not connected to the transmitting terminal via a network. The transmitting terminal 100 sends data to be transmitted to the receiving terminal 200 such that a plurality of rows are arranged in a first direction, and a plurality of pixels constituting each row are arranged along a second direction orthogonal to the first direction. Performs conversion processing to convert the image into a 3D image. The transmitting terminal 100 further scrolls and displays the image (display image) obtained by the conversion process in the first direction within a display area of a predetermined size on the display unit 106. The receiving terminal 200 uses the camera 207 to continuously photograph the display area of the display unit 106 of the sending terminal 100 while the image is being scrolled and displayed in the first direction. The receiving terminal 200 further analyzes the obtained captured image to restore the data before conversion into a display image.

In this way, according to the present embodiment, data can be transmitted asynchronously from the sending terminal 100 to the receiving terminal 200 using image recognition without using a network connection. Furthermore, the sending terminal 100 scrolls and displays an image converted from the data to be sent, and the receiving terminal 200 repeatedly captures the image and analyzes the captured image, thereby making it possible to transmit a large amount of data at once. It becomes possible.

Further, in this embodiment, the transmitting terminal 100 scrolls and displays an image obtained by the conversion process, and the receiving terminal 200 photographs the scrolled image and performs an analysis process on a line-by-line basis constituting the image. Is possible. As a result, for example, the sending terminal 100 sequentially displays a plurality of two-dimensional codes as still images, and the receiving terminal 200 sequentially photographs a plurality of two-dimensional codes, and images the photographed images in units of still images (two-dimensional codes). When analyzing images, it is highly likely that it will be difficult to recognize which images are the same, but according to this embodiment, it is possible to accurately identify the line numbers in some lines. Even if the line numbers cannot be recognized, there is a high probability that the line numbers can be accurately identified from the context of the line numbers, making it extremely easy to compare and analyze the same lines. Therefore, according to the present embodiment, data can be transmitted from the transmitting device (transmitting terminal 100) to the receiving device (receiving terminal 200) at a higher transmission speed without going through a network connection.

Further, in this embodiment, the same line of the image obtained by the conversion process is displayed and recognized at a plurality of different locations within the display area of the sending terminal 100 by scrolling the image. As a result, compared to the case where the image obtained by the conversion process is displayed as a still image, it is possible to avoid poor recognition by the receiving terminal 200 due to reflection on the screen of the display unit 106 of the sending terminal 100. It becomes possible to increase the Therefore, according to the present embodiment, it is possible to significantly improve the data transmission speed from the sending terminal 100 to the receiving terminal 200 and the image recognition rate by the analysis processing in the receiving terminal 200.

Note that the above-described embodiments can also be applied to, for example, content distribution. For example, an image obtained by converting content data may be scroll-displayed in a partial area of a television image or a moving image, and the image may be photographed using a camera on the receiving side. This makes it possible to quickly and inexpensively distribute content without preparing a web server. Furthermore, when performing such content distribution, data transmission can be asynchronous, so it is possible to avoid the risk of inadvertently establishing a network connection with an unspecified terminal, and to safely distribute the content.

The disclosure of this specification includes the following data transmission system, transmitter, receiver, control method thereof, and program.
(Item 1)
A data transmission system comprising a transmitting device and a receiving device not connected to the transmitting device via a network,
The transmitting device includes:
The data to be transmitted to the receiving device is converted into an image in which a plurality of rows are arranged in a first direction, and a plurality of pixels constituting each row are arranged along a second direction orthogonal to the first direction. a conversion means for converting;
Display control means for scrolling and displaying the image obtained by the converting means in the first direction within a display area of a predetermined size on the display section of the transmitting device,
The receiving device includes:
Photographing means for continuously photographing the display area while the image is being scrolled and displayed in the display area of the display unit of the transmitting device in the first direction;
A data transmission system comprising: an analysis means for restoring data before conversion into the image by analyzing a photographed image obtained by photographing by the photographing means.
(Item 2)
The display control means cycles the image by displaying a first line next to the last line of the image in the first direction so that all the lines of the image are repeatedly displayed in the display area. The data transmission system according to item 1, characterized in that the data transmission system displays scrolling information.
(Item 3)
The converting means is configured such that each of the plurality of rows includes a first part indicating data to be transmitted, a second part indicating a check digit corresponding to the data indicated by the first part, and the image in the first direction. 3. The data transmission system according to item 1 or 2, wherein the image is generated so as to be composed of a third part indicating a line number based on the first line of the image.
(Item 4)
The data to be transmitted is data in binary format,
The conversion means allocates one or more bits from the data to be transmitted to each pixel constituting the image, and assigns each pixel as a pixel of a color corresponding to the allocated bit among two or more colors. The data transmission system according to any one of items 1 to 3, characterized in that the data to be transmitted is converted into the image by generating the image.
(Item 5)
Items 1 to 1, characterized in that the photographing means acquires a plurality of photographed images by repeatedly photographing the display area while the images are being scrolled and displayed in the first direction within the display area. 4. The data transmission system according to any one of 4.
(Item 6)
Each of the plurality of lines included in the image includes a first part indicating data to be transmitted, a second part indicating a check digit corresponding to the data indicated by the first part, and the image in the first direction. It consists of a third part that indicates the line number based on the first line of
The analysis means performs an analysis process on each of the plurality of captured images on a line-by-line basis,
The analysis process specifies the line number from the pixels of the third part for each row in the photographed image to be processed, and checks whether there is an error in the data series obtained from the pixels of the first part by checking the row number of the second part. According to item 5, the method includes inspecting using a check digit obtained from a pixel, and storing a data series in which no error is detected in the inspection in association with the specified line number. data transmission system.
(Item 7)
In the analysis process, when a plurality of data series are stored in association with one row number based on the plurality of photographed images, a data series with the highest frequency of appearance among the plurality of data series is selected as the one. 7. The data transmission system according to item 6, further comprising: storing the data as a valid data series corresponding to one line number.
(Item 8)
Item 6, characterized in that the analysis process further includes restoring the data before conversion by concatenating a plurality of data series stored in association with a plurality of row numbers according to the row numbers. Or the data transmission system according to 7.
(Item 9)
The analysis means performs distortion correction processing on the photographed image obtained by photographing by the photographing means, and restores the data before conversion by analyzing the photographed image in which the distortion has been corrected. The data transmission system according to any one of items 1 to 8.
(Item 10)
The transmitting device obtains the encrypted data as the data to be transmitted,
Any one of items 1 to 9, wherein the receiving device transmits the data restored by the analysis means to an external device via a network without decoding, and the data is decoded in the external device. The data transmission system according to item 1.
(Item 11)
A transmitting device for transmitting data from a transmitting device to a receiving device that is not connected to the transmitting device via a network,
The data to be transmitted to the receiving device is converted into an image in which a plurality of rows are arranged in a first direction, and a plurality of pixels constituting each row are arranged along a second direction orthogonal to the first direction. a conversion means for converting;
display control means for scrolling and displaying the image obtained by the converting means in the first direction within a display area of a predetermined size on the display section of the transmitting device; While the display area is being displayed, the receiving device continuously photographs the inside of the display area, and the obtained captured images are analyzed so that the data before conversion to the image is restored in the receiving device. Characteristic transmitting device.
(Item 12)
The display control means cycles the image by displaying a first line next to the last line of the image in the first direction so that all the lines of the image are repeatedly displayed in the display area. 12. The transmitting device according to item 11, wherein the transmitting device displays scrolling information.
(Item 13)
The converting means is configured such that each of the plurality of rows includes a first part indicating data to be transmitted, a second part indicating a check digit corresponding to the data indicated by the first part, and the image in the first direction. 13. The transmitting device according to item 11 or 12, wherein the image is generated so as to include a third part indicating a line number based on the first line of the image.
(Item 14)
The data to be transmitted is data in binary format,
The conversion means allocates one or more bits from the data to be transmitted to each pixel constituting the image, and assigns each pixel as a pixel of a color corresponding to the allocated bit among two or more colors. The transmitting device according to any one of items 11 to 13, wherein the transmitting device converts the data to be transmitted into the image by generating the image.
(Item 15)
A receiving device for transmitting data from a transmitting device to a receiving device that is not connected to the transmitting device via a network,
An image converted from data to be transmitted is arranged in a display area of a predetermined size on a display section of the transmitting device, and a plurality of rows are arranged in a first direction, and a plurality of pixels constituting each row are arranged in the first direction. Photographing means for continuously photographing the display area while the images arranged along a second direction orthogonal to the first direction are scrolled in the first direction;
an analysis means for restoring data before conversion into the image by analyzing a photographed image obtained by photographing by the photographing means;
A receiving device comprising:
(Item 16)
Item 15, characterized in that the photographing means obtains a plurality of photographed images by repeatedly photographing the display area while the images are being scrolled and displayed in the first direction within the display area. Receiving device as described.
(Item 17)
Each of the plurality of lines included in the image includes a first part indicating data to be transmitted, a second part indicating a check digit corresponding to the data indicated by the first part, and the image in the first direction. It consists of a third part that indicates the line number based on the first line of
The analysis means performs an analysis process on each of the plurality of captured images on a line-by-line basis,
The analysis process specifies the line number from the pixels of the third part for each row in the photographed image to be processed, and checks whether there is an error in the data series obtained from the pixels of the first part by checking the row number of the second part. Item 16, characterized in that the data sequence is inspected using a check digit obtained from a pixel, and the data series in which no error is detected in the inspection is stored in association with the specified line number. receiving device.
(Item 18)
In the analysis process, when a plurality of data series are stored in association with one row number based on the plurality of photographed images, a data series with the highest frequency of appearance among the plurality of data series is selected as the one. 18. The receiving device according to item 17, further comprising: storing the data as a valid data series corresponding to one row number.
(Item 19)
Item 17 characterized in that the analysis process further includes restoring the data before conversion by concatenating a plurality of data series stored in association with a plurality of row numbers according to the row numbers. Or the receiving device according to 18.
(Item 20)
The analysis means performs distortion correction processing on the photographed image obtained by photographing by the photographing means, and restores the data before conversion by analyzing the photographed image in which the distortion has been corrected. The receiving device according to any one of items 16 to 19.
(Item 21)
A method for controlling a transmitting device for transmitting data from a transmitting device to a receiving device that is not connected to the transmitting device via a network, the method comprising:
The data to be transmitted to the receiving device is converted into an image in which a plurality of rows are arranged in a first direction, and a plurality of pixels constituting each row are arranged along a second direction orthogonal to the first direction. a conversion step to convert;
a display control step of scrolling and displaying the image obtained in the converting step in the first direction within a display area of a predetermined size on a display section of the transmitting device, the image scrolling in the first direction; While the display area is being displayed, the receiving device continuously photographs the inside of the display area, and the obtained captured images are analyzed so that the data before conversion to the image is restored in the receiving device. Characteristic method of controlling a transmitting device.
(Item 22)
A method for controlling a receiving device for transmitting data from a transmitting device to a receiving device that is not connected to the transmitting device via a network, the method comprising:
An image converted from data to be transmitted is arranged in a display area of a predetermined size on a display section of the transmitting device, and a plurality of rows are arranged in a first direction, and a plurality of pixels constituting each row are arranged in the first direction. a photographing step of continuously photographing the display area while the image arranged along the second direction orthogonal to the first direction is being scrolled and displayed in the first direction;
an analysis step of restoring the data before conversion to the image by analyzing the photographed image obtained by photographing in the photographing step;
A method for controlling a receiving device, comprising:
(Item 23)
A program for causing a computer to execute each step of the control method described in item 21 or 22.

The invention is not limited to the embodiments described above, and various changes and modifications can be made without departing from the spirit and scope of the invention. Therefore, the following claims are hereby appended to disclose the scope of the invention.

100: Sending terminal, 200: Receiving terminal, 101: CPU, 106: Display section, 201: CPU, 207: Camera

Claims (23)

A data transmission system comprising a transmitting device and a receiving device not connected to the transmitting device via a network,
The transmitting device includes:
The data to be transmitted to the receiving device is converted into an image in which a plurality of rows are arranged in a first direction, and a plurality of pixels constituting each row are arranged along a second direction orthogonal to the first direction. a conversion means for converting;
Display control means for scrolling and displaying the image obtained by the converting means in the first direction within a display area of a predetermined size on the display section of the transmitting device,
The receiving device includes:
Photographing means for continuously photographing the display area while the image is being scrolled and displayed in the display area of the display unit of the transmitting device in the first direction;
A data transmission system comprising: an analysis means for restoring data before conversion into the image by analyzing a photographed image obtained by photographing by the photographing means. The display control means cycles the image by displaying a first line next to the last line of the image in the first direction so that all the lines of the image are repeatedly displayed in the display area. 2. The data transmission system according to claim 1, wherein the data transmission system is scroll-displayed. The converting means is configured such that each of the plurality of rows includes a first part indicating data to be transmitted, a second part indicating a check digit corresponding to the data indicated by the first part, and the image in the first direction. 3. The data transmission system according to claim 1, wherein the image is generated so as to be composed of a third part indicating a line number based on the first line of the image. The data to be transmitted is data in binary format,
The conversion means allocates one or more bits from the data to be transmitted to each pixel constituting the image, and assigns each pixel as a pixel of a color corresponding to the allocated bit among two or more colors. The data transmission system according to claim 1 or 2, wherein the data to be transmitted is converted into the image by generating the image. Claim 1, wherein the photographing means acquires a plurality of photographed images by repeatedly photographing the display area while the images are being scrolled and displayed in the first direction within the display area. Or the data transmission system according to 2. Each of the plurality of lines included in the image includes a first part indicating data to be transmitted, a second part indicating a check digit corresponding to the data indicated by the first part, and the image in the first direction. It consists of a third part that indicates the line number based on the first line of
The analysis means performs an analysis process on each of the plurality of captured images on a line-by-line basis,
The analysis process specifies the line number from the pixels of the third part for each row in the photographed image to be processed, and checks whether there is an error in the data series obtained from the pixels of the first part by checking the row number of the second part. 6. The method according to claim 5, further comprising performing an inspection using a check digit obtained from a pixel, and storing a data series in which no error is detected in the inspection in association with the specified row number. Data transmission system as described. In the analysis process, when a plurality of data series are stored in association with one row number based on the plurality of photographed images, a data series with the highest frequency of appearance among the plurality of data series is selected as the one. 7. The data transmission system according to claim 6, further comprising: storing the data as a valid data sequence corresponding to one row number. Claim characterized in that the analysis process further includes restoring the data before conversion by concatenating a plurality of data series stored in association with a plurality of row numbers according to the row numbers. 6. The data transmission system according to 6. The analysis means performs distortion correction processing on the photographed image obtained by photographing by the photographing means, and restores the data before conversion by analyzing the photographed image in which the distortion has been corrected. The data transmission system according to claim 1 or 2. The transmitting device obtains the encrypted data as the data to be transmitted,
3. The receiving device transmits the data restored by the analysis means to an external device via a network without decoding it, and the data is decoded in the external device. data transmission system. A transmitting device for transmitting data from a transmitting device to a receiving device that is not connected to the transmitting device via a network,
The data to be transmitted to the receiving device is converted into an image in which a plurality of rows are arranged in a first direction, and a plurality of pixels constituting each row are arranged along a second direction orthogonal to the first direction. a conversion means for converting;
display control means for scrolling and displaying the image obtained by the converting means in the first direction within a display area of a predetermined size on the display section of the transmitting device; While the display area is being displayed, the receiving device continuously photographs the inside of the display area, and the obtained captured images are analyzed so that the data before conversion to the image is restored in the receiving device. Characteristic transmitting device. The display control means cycles the image by displaying a first line next to the last line of the image in the first direction so that all the lines of the image are repeatedly displayed in the display area. 12. The transmitting device according to claim 11, wherein the transmitting device displays scrolling information. The converting means is configured such that each of the plurality of rows includes a first part indicating data to be transmitted, a second part indicating a check digit corresponding to the data indicated by the first part, and the image in the first direction. The transmitting device according to claim 11 or 12, wherein the image is generated so as to be composed of a third part indicating a line number based on the first line of the image. The data to be transmitted is data in binary format,
The conversion means allocates one or more bits from the data to be transmitted to each pixel constituting the image, and assigns each pixel as a pixel of a color corresponding to the allocated bit among two or more colors. The transmitting device according to claim 11 or 12, wherein the data to be transmitted is converted into the image by generating the image. A receiving device for transmitting data from a transmitting device to a receiving device that is not connected to the transmitting device via a network,
An image converted from data to be transmitted is arranged in a display area of a predetermined size on a display section of the transmitting device, and a plurality of rows are arranged in a first direction, and a plurality of pixels constituting each row are arranged in the first direction. Photographing means for continuously photographing the display area while the images arranged along a second direction orthogonal to the first direction are scrolled in the first direction;
an analysis means for restoring data before conversion into the image by analyzing a photographed image obtained by photographing by the photographing means;
A receiving device comprising: 15. The photographing means acquires a plurality of photographed images by repeatedly photographing the display area while the images are being scrolled and displayed in the first direction within the display area. The receiving device described in . Each of the plurality of lines included in the image includes a first part indicating data to be transmitted, a second part indicating a check digit corresponding to the data indicated by the first part, and the image in the first direction. It consists of a third part that indicates the line number based on the first line of
The analysis means performs an analysis process on each of the plurality of captured images on a line-by-line basis,
The analysis process specifies the line number from the pixels of the third part for each row in the photographed image to be processed, and checks whether there is an error in the data series obtained from the pixels of the first part by checking the row number of the second part. 17. The method according to claim 16, further comprising performing an inspection using a check digit obtained from a pixel, and storing a data series in which no error is detected in the inspection in association with the specified row number. Receiving device as described. In the analysis process, when a plurality of data series are stored in association with one row number based on the plurality of photographed images, a data series with the highest frequency of appearance among the plurality of data series is selected as the one. The receiving device according to claim 17, further comprising: storing the data as a valid data sequence corresponding to one row number. Claim characterized in that the analysis process further includes restoring the data before conversion by concatenating a plurality of data series stored in association with a plurality of row numbers according to the row numbers. 19. The receiving device according to 17 or 18. The analysis means performs distortion correction processing on the photographed image obtained by photographing by the photographing means, and restores the data before conversion by analyzing the photographed image in which the distortion has been corrected. The receiving device according to any one of claims 16 to 18. A method for controlling a transmitting device for transmitting data from a transmitting device to a receiving device that is not connected to the transmitting device via a network, the method comprising:
The data to be transmitted to the receiving device is converted into an image in which a plurality of rows are arranged in a first direction, and a plurality of pixels constituting each row are arranged along a second direction orthogonal to the first direction. a conversion step to convert;
a display control step of scrolling and displaying the image obtained in the converting step in the first direction within a display area of a predetermined size on a display section of the transmitting device, the image scrolling in the first direction; While the display area is being displayed, the receiving device continuously photographs the inside of the display area, and the obtained captured images are analyzed so that the data before conversion to the image is restored in the receiving device. Features: A method of controlling a transmitting device. A method for controlling a receiving device for transmitting data from a transmitting device to a receiving device that is not connected to the transmitting device via a network, the method comprising:
An image converted from data to be transmitted is arranged in a display area of a predetermined size on a display section of the transmitting device, and a plurality of rows are arranged in a first direction, and a plurality of pixels constituting each row are arranged in the first direction. a photographing step of continuously photographing the display area while the image arranged along the second direction orthogonal to the first direction is being scrolled and displayed in the first direction;
an analysis step of restoring the data before conversion to the image by analyzing the photographed image obtained by photographing in the photographing step;
A method for controlling a receiving device, comprising: A program for causing a computer to execute each step of the control method according to claim 21 or 22.

Images